[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:09:13.154577 20199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.185.254:36219
I20260709 13:09:13.156193 20199 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:09:13.157269 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:13.175379 20206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:13.175390 20208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:13.175379 20205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:13.177309 20199 server_base.cc:1061] running on GCE node
I20260709 13:09:14.374187 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:14.374459 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:14.374732 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602554374700 us; error 0 us; skew 500 ppm
I20260709 13:09:14.375631 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:14.382800 20199 webserver.cc:533] Webserver started at http://127.19.185.254:43049/ using document root <none> and password file <none>
I20260709 13:09:14.383765 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:14.384064 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:14.384572 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:14.390897 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/master-0-root/instance:
uuid: "271b47335bec4874926c9d7225094ddb"
format_stamp: "Formatted at 2026-07-09 13:09:14 on dist-test-slave-rrf3"
I20260709 13:09:14.399693 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:09:14.405622 20214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:14.406929 20199 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:14.407392 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/master-0-root
uuid: "271b47335bec4874926c9d7225094ddb"
format_stamp: "Formatted at 2026-07-09 13:09:14 on dist-test-slave-rrf3"
I20260709 13:09:14.407775 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:14.463740 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:14.465493 20199 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:09:14.466209 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:14.539489 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.254:36219
I20260709 13:09:14.539588 20265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.254:36219 every 8 connection(s)
I20260709 13:09:14.547534 20266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:14.571128 20266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb: Bootstrap starting.
I20260709 13:09:14.577471 20266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.579427 20266 log.cc:826] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb: Log is configured to *not* fsync() on all Append() calls
I20260709 13:09:14.584544 20266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb: No bootstrap required, opened a new log
I20260709 13:09:14.609586 20266 raft_consensus.cc:359] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "271b47335bec4874926c9d7225094ddb" member_type: VOTER }
I20260709 13:09:14.610204 20266 raft_consensus.cc:385] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.610422 20266 raft_consensus.cc:740] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271b47335bec4874926c9d7225094ddb, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.611428 20266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "271b47335bec4874926c9d7225094ddb" member_type: VOTER }
I20260709 13:09:14.611949 20266 raft_consensus.cc:399] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:14.612303 20266 raft_consensus.cc:493] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:14.612627 20266 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.617748 20266 raft_consensus.cc:515] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "271b47335bec4874926c9d7225094ddb" member_type: VOTER }
I20260709 13:09:14.618683 20266 leader_election.cc:304] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 271b47335bec4874926c9d7225094ddb; no voters: 
I20260709 13:09:14.620644 20266 leader_election.cc:290] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:14.620952 20269 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.623978 20269 raft_consensus.cc:697] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 1 LEADER]: Becoming Leader. State: Replica: 271b47335bec4874926c9d7225094ddb, State: Running, Role: LEADER
I20260709 13:09:14.625003 20269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "271b47335bec4874926c9d7225094ddb" member_type: VOTER }
I20260709 13:09:14.626116 20266 sys_catalog.cc:565] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:14.638880 20271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 271b47335bec4874926c9d7225094ddb. Latest consensus state: current_term: 1 leader_uuid: "271b47335bec4874926c9d7225094ddb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "271b47335bec4874926c9d7225094ddb" member_type: VOTER } }
I20260709 13:09:14.638981 20270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "271b47335bec4874926c9d7225094ddb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "271b47335bec4874926c9d7225094ddb" member_type: VOTER } }
I20260709 13:09:14.639843 20271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:14.639983 20270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:14.642907 20279 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:14.657050 20279 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:14.659775 20199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:14.674711 20279 catalog_manager.cc:1383] Generated new cluster ID: f5cb663aaa9b4de0b51a3a9ced121385
I20260709 13:09:14.675041 20279 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:14.690560 20279 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:14.693641 20279 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:14.710263 20279 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb: Generated new TSK 0
I20260709 13:09:14.711289 20279 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:14.727227 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:14.735566 20288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:14.737335 20289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:14.741060 20291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:14.741210 20199 server_base.cc:1061] running on GCE node
I20260709 13:09:14.742151 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:14.742345 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:14.742600 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602554742559 us; error 0 us; skew 500 ppm
I20260709 13:09:14.743290 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:14.748165 20199 webserver.cc:533] Webserver started at http://127.19.185.193:35867/ using document root <none> and password file <none>
I20260709 13:09:14.748766 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:14.748971 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:14.749291 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:14.750414 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-0-root/instance:
uuid: "86c10dcab93143cd9717e9e1d3d7e027"
format_stamp: "Formatted at 2026-07-09 13:09:14 on dist-test-slave-rrf3"
I20260709 13:09:14.756379 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:09:14.760599 20296 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:14.761515 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:09:14.761835 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "86c10dcab93143cd9717e9e1d3d7e027"
format_stamp: "Formatted at 2026-07-09 13:09:14 on dist-test-slave-rrf3"
I20260709 13:09:14.762202 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:14.793794 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:14.795164 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:14.798256 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:14.802628 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:14.802899 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:14.803186 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:14.803378 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:14.914080 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:39721
I20260709 13:09:14.914165 20358 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:39721 every 8 connection(s)
I20260709 13:09:14.922102 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:14.938679 20363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:14.942126 20364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:14.950793 20199 server_base.cc:1061] running on GCE node
W20260709 13:09:14.950883 20366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:14.952250 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:14.952539 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:14.952762 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602554952743 us; error 0 us; skew 500 ppm
I20260709 13:09:14.953593 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:14.958462 20199 webserver.cc:533] Webserver started at http://127.19.185.194:42553/ using document root <none> and password file <none>
I20260709 13:09:14.959120 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:14.959106 20359 heartbeater.cc:344] Connected to a master server at 127.19.185.254:36219
I20260709 13:09:14.959508 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:14.959722 20359 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:14.959875 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:14.960976 20359 heartbeater.cc:507] Master 127.19.185.254:36219 requested a full tablet report, sending...
I20260709 13:09:14.961427 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-1-root/instance:
uuid: "c39a0b8166c94ec18a862a996ca7cabc"
format_stamp: "Formatted at 2026-07-09 13:09:14 on dist-test-slave-rrf3"
I20260709 13:09:14.964802 20231 ts_manager.cc:194] Registered new tserver with Master: 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721)
I20260709 13:09:14.968101 20231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46814
I20260709 13:09:14.969050 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:09:14.974612 20371 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:14.975512 20199 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:09:14.975806 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-1-root
uuid: "c39a0b8166c94ec18a862a996ca7cabc"
format_stamp: "Formatted at 2026-07-09 13:09:14 on dist-test-slave-rrf3"
I20260709 13:09:14.976116 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:14.998803 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:15.000329 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:15.002593 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:15.006435 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:15.006688 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.006949 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:15.007153 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.114493 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.194:46189
I20260709 13:09:15.114665 20433 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.194:46189 every 8 connection(s)
I20260709 13:09:15.129745 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:09:15.139981 20434 heartbeater.cc:344] Connected to a master server at 127.19.185.254:36219
I20260709 13:09:15.140501 20434 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:15.141708 20434 heartbeater.cc:507] Master 127.19.185.254:36219 requested a full tablet report, sending...
W20260709 13:09:15.142058 20438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:15.143855 20437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:15.144129 20231 ts_manager.cc:194] Registered new tserver with Master: c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:15.145665 20231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46818
I20260709 13:09:15.154572 20199 server_base.cc:1061] running on GCE node
W20260709 13:09:15.154836 20440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:15.155985 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:15.156287 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:15.156468 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602555156452 us; error 0 us; skew 500 ppm
I20260709 13:09:15.157017 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:15.159765 20199 webserver.cc:533] Webserver started at http://127.19.185.195:39593/ using document root <none> and password file <none>
I20260709 13:09:15.160424 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:15.160601 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:15.160837 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:15.161811 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-2-root/instance:
uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
format_stamp: "Formatted at 2026-07-09 13:09:15 on dist-test-slave-rrf3"
I20260709 13:09:15.166781 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:15.170537 20445 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.171494 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:09:15.171839 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-2-root
uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
format_stamp: "Formatted at 2026-07-09 13:09:15 on dist-test-slave-rrf3"
I20260709 13:09:15.172309 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602552983791-20199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:15.198176 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:15.199451 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:15.202310 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:15.205400 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:15.205680 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.205935 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:15.206116 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:15.307833 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.195:44555
I20260709 13:09:15.307924 20507 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.195:44555 every 8 connection(s)
I20260709 13:09:15.325130 20508 heartbeater.cc:344] Connected to a master server at 127.19.185.254:36219
I20260709 13:09:15.325588 20508 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:15.326545 20508 heartbeater.cc:507] Master 127.19.185.254:36219 requested a full tablet report, sending...
I20260709 13:09:15.329072 20231 ts_manager.cc:194] Registered new tserver with Master: 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:15.329926 20199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016451769s
I20260709 13:09:15.330847 20231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46830
I20260709 13:09:15.388624 20231 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46842:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:15.394016 20231 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:15.509756 20399 tablet_service.cc:1511] Processing CreateTablet for tablet 61286bda6a3a4fb59941bc9661d599b4 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:15.511441 20399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61286bda6a3a4fb59941bc9661d599b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.513338 20398 tablet_service.cc:1511] Processing CreateTablet for tablet 1a23b6bf55644e07bfe843c7542681b0 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:15.514786 20398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a23b6bf55644e07bfe843c7542681b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.517329 20397 tablet_service.cc:1511] Processing CreateTablet for tablet 48a4b56af3de4f298525e04fedae5bb5 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:15.518778 20397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a4b56af3de4f298525e04fedae5bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.521366 20396 tablet_service.cc:1511] Processing CreateTablet for tablet 6ee6e2517301414cb216d1dffbae7f77 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:15.534272 20396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ee6e2517301414cb216d1dffbae7f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.528577 20393 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa97bf3df114fc982944c3bd3c8f379 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:15.538514 20323 tablet_service.cc:1511] Processing CreateTablet for tablet 1a23b6bf55644e07bfe843c7542681b0 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:15.529953 20324 tablet_service.cc:1511] Processing CreateTablet for tablet 61286bda6a3a4fb59941bc9661d599b4 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:15.536410 20392 tablet_service.cc:1511] Processing CreateTablet for tablet 35348fc7cc9243b7b6b4b5e08a32f36d (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:15.543114 20393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa97bf3df114fc982944c3bd3c8f379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.550316 20321 tablet_service.cc:1511] Processing CreateTablet for tablet 6ee6e2517301414cb216d1dffbae7f77 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:15.538525 20395 tablet_service.cc:1511] Processing CreateTablet for tablet 62150089d1b746c49d450831b974c766 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:15.556154 20319 tablet_service.cc:1511] Processing CreateTablet for tablet a1063d92f77243c5a8d67a57251aaa78 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:15.561522 20394 tablet_service.cc:1511] Processing CreateTablet for tablet a1063d92f77243c5a8d67a57251aaa78 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:15.566448 20323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a23b6bf55644e07bfe843c7542681b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.570540 20392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35348fc7cc9243b7b6b4b5e08a32f36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.570586 20324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61286bda6a3a4fb59941bc9661d599b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.570062 20320 tablet_service.cc:1511] Processing CreateTablet for tablet 62150089d1b746c49d450831b974c766 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:15.563216 20391 tablet_service.cc:1511] Processing CreateTablet for tablet e69471876aad4f46b1651f45a14b9bdd (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:15.572099 20319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1063d92f77243c5a8d67a57251aaa78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.572113 20322 tablet_service.cc:1511] Processing CreateTablet for tablet 48a4b56af3de4f298525e04fedae5bb5 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:15.578493 20321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ee6e2517301414cb216d1dffbae7f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.584169 20395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62150089d1b746c49d450831b974c766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.586876 20316 tablet_service.cc:1511] Processing CreateTablet for tablet e69471876aad4f46b1651f45a14b9bdd (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:15.584438 20317 tablet_service.cc:1511] Processing CreateTablet for tablet 35348fc7cc9243b7b6b4b5e08a32f36d (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:15.581820 20318 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa97bf3df114fc982944c3bd3c8f379 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:15.597198 20320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62150089d1b746c49d450831b974c766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.603257 20317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35348fc7cc9243b7b6b4b5e08a32f36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.606571 20318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa97bf3df114fc982944c3bd3c8f379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.611044 20316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69471876aad4f46b1651f45a14b9bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.611960 20322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a4b56af3de4f298525e04fedae5bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.617733 20391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69471876aad4f46b1651f45a14b9bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.632450 20394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1063d92f77243c5a8d67a57251aaa78. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:15.660848 20278 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:15.686669 20526 tablet_bootstrap.cc:492] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:15.694435 20527 tablet_bootstrap.cc:492] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:15.695915 20526 tablet_bootstrap.cc:654] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.730664 20527 tablet_bootstrap.cc:654] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.774479 20472 tablet_service.cc:1511] Processing CreateTablet for tablet 1a23b6bf55644e07bfe843c7542681b0 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:15.774533 20473 tablet_service.cc:1511] Processing CreateTablet for tablet 61286bda6a3a4fb59941bc9661d599b4 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:15.780921 20472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a23b6bf55644e07bfe843c7542681b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.790398 20473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61286bda6a3a4fb59941bc9661d599b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.792441 20468 tablet_service.cc:1511] Processing CreateTablet for tablet a1063d92f77243c5a8d67a57251aaa78 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:15.788206 20469 tablet_service.cc:1511] Processing CreateTablet for tablet 62150089d1b746c49d450831b974c766 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:15.798664 20469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62150089d1b746c49d450831b974c766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.782121 20471 tablet_service.cc:1511] Processing CreateTablet for tablet 48a4b56af3de4f298525e04fedae5bb5 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:15.799330 20526 tablet_bootstrap.cc:492] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:15.799845 20526 ts_tablet_manager.cc:1403] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.114s	user 0.023s	sys 0.030s
I20260709 13:09:15.799558 20466 tablet_service.cc:1511] Processing CreateTablet for tablet 35348fc7cc9243b7b6b4b5e08a32f36d (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:15.801595 20467 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa97bf3df114fc982944c3bd3c8f379 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:15.800488 20470 tablet_service.cc:1511] Processing CreateTablet for tablet 6ee6e2517301414cb216d1dffbae7f77 (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:15.809528 20468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1063d92f77243c5a8d67a57251aaa78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.808605 20465 tablet_service.cc:1511] Processing CreateTablet for tablet e69471876aad4f46b1651f45a14b9bdd (DEFAULT_TABLE table=test-workload [id=b5df8f7ebdd04e1b84948dea93ad7d42]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:15.811779 20466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35348fc7cc9243b7b6b4b5e08a32f36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.817960 20470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ee6e2517301414cb216d1dffbae7f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.835765 20465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69471876aad4f46b1651f45a14b9bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.843636 20526 raft_consensus.cc:359] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:15.845402 20526 raft_consensus.cc:385] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.845935 20526 raft_consensus.cc:740] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.854908 20471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a4b56af3de4f298525e04fedae5bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.866367 20467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa97bf3df114fc982944c3bd3c8f379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:15.862510 20526 consensus_queue.cc:260] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:15.876485 20527 tablet_bootstrap.cc:492] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:15.931160 20359 heartbeater.cc:499] Master 127.19.185.254:36219 was elected leader, sending a full tablet report...
I20260709 13:09:15.931975 20526 ts_tablet_manager.cc:1434] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.131s	user 0.016s	sys 0.039s
I20260709 13:09:15.934175 20526 tablet_bootstrap.cc:492] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:15.947752 20527 ts_tablet_manager.cc:1403] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.249s	user 0.016s	sys 0.007s
I20260709 13:09:15.988462 20526 tablet_bootstrap.cc:654] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.992507 20527 raft_consensus.cc:359] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:15.994056 20527 raft_consensus.cc:385] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.994400 20527 raft_consensus.cc:740] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.995199 20527 consensus_queue.cc:260] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:15.997859 20527 ts_tablet_manager.cc:1434] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:09:15.998540 20527 tablet_bootstrap.cc:492] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:16.002067 20434 heartbeater.cc:499] Master 127.19.185.254:36219 was elected leader, sending a full tablet report...
I20260709 13:09:16.003360 20526 tablet_bootstrap.cc:492] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:16.003819 20526 ts_tablet_manager.cc:1403] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.007s
I20260709 13:09:16.005318 20527 tablet_bootstrap.cc:654] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.006855 20526 raft_consensus.cc:359] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.011696 20526 raft_consensus.cc:385] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.012179 20526 raft_consensus.cc:740] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.013126 20526 consensus_queue.cc:260] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.015940 20526 ts_tablet_manager.cc:1434] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:16.016927 20526 tablet_bootstrap.cc:492] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:16.025507 20526 tablet_bootstrap.cc:654] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.027135 20527 tablet_bootstrap.cc:492] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:16.027694 20527 ts_tablet_manager.cc:1403] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.020s
I20260709 13:09:16.031203 20527 raft_consensus.cc:359] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.032048 20527 raft_consensus.cc:385] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.032374 20527 raft_consensus.cc:740] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.033176 20527 consensus_queue.cc:260] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.035398 20527 ts_tablet_manager.cc:1434] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:16.035918 20526 tablet_bootstrap.cc:492] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:16.036465 20526 ts_tablet_manager.cc:1403] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.005s
I20260709 13:09:16.036485 20527 tablet_bootstrap.cc:492] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:16.040295 20526 raft_consensus.cc:359] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.041326 20526 raft_consensus.cc:385] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.041643 20526 raft_consensus.cc:740] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.042936 20527 tablet_bootstrap.cc:654] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.042409 20526 consensus_queue.cc:260] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.045766 20526 ts_tablet_manager.cc:1434] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 13:09:16.046692 20526 tablet_bootstrap.cc:492] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:16.048278 20527 tablet_bootstrap.cc:492] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:16.048797 20527 ts_tablet_manager.cc:1403] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:09:16.049942 20536 tablet_bootstrap.cc:492] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:16.059067 20527 raft_consensus.cc:359] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.059988 20527 raft_consensus.cc:385] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.060439 20527 raft_consensus.cc:740] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.061491 20526 tablet_bootstrap.cc:654] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.061364 20527 consensus_queue.cc:260] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.063875 20527 ts_tablet_manager.cc:1434] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:09:16.065142 20527 tablet_bootstrap.cc:492] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:16.067266 20536 tablet_bootstrap.cc:654] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.073397 20527 tablet_bootstrap.cc:654] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.075282 20526 tablet_bootstrap.cc:492] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:16.076316 20526 ts_tablet_manager.cc:1403] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.011s
I20260709 13:09:16.079559 20536 tablet_bootstrap.cc:492] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:16.080078 20536 ts_tablet_manager.cc:1403] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.004s
I20260709 13:09:16.081023 20526 raft_consensus.cc:359] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.082056 20526 raft_consensus.cc:385] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.083050 20536 raft_consensus.cc:359] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.083608 20526 raft_consensus.cc:740] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.086426 20526 consensus_queue.cc:260] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.089831 20526 ts_tablet_manager.cc:1434] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:16.091141 20526 tablet_bootstrap.cc:492] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:16.092674 20536 raft_consensus.cc:385] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.092581 20532 raft_consensus.cc:493] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.093281 20532 raft_consensus.cc:515] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.096410 20532 leader_election.cc:290] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.096959 20536 raft_consensus.cc:740] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.097752 20536 consensus_queue.cc:260] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.100741 20526 tablet_bootstrap.cc:654] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.102694 20527 tablet_bootstrap.cc:492] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:16.103205 20527 ts_tablet_manager.cc:1403] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.018s
I20260709 13:09:16.105808 20527 raft_consensus.cc:359] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.106356 20527 raft_consensus.cc:385] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.106604 20527 raft_consensus.cc:740] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.111331 20526 tablet_bootstrap.cc:492] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:16.111786 20526 ts_tablet_manager.cc:1403] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:09:16.111956 20536 ts_tablet_manager.cc:1434] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.005s
I20260709 13:09:16.112887 20536 tablet_bootstrap.cc:492] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:16.114439 20526 raft_consensus.cc:359] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.114981 20526 raft_consensus.cc:385] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.115240 20526 raft_consensus.cc:740] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.115967 20526 consensus_queue.cc:260] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.117769 20526 ts_tablet_manager.cc:1434] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:16.118505 20526 tablet_bootstrap.cc:492] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:16.119252 20536 tablet_bootstrap.cc:654] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.107275 20527 consensus_queue.cc:260] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.120435 20508 heartbeater.cc:499] Master 127.19.185.254:36219 was elected leader, sending a full tablet report...
I20260709 13:09:16.122412 20527 ts_tablet_manager.cc:1434] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:09:16.123404 20527 tablet_bootstrap.cc:492] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:16.127941 20526 tablet_bootstrap.cc:654] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:16.129572 20435 tablet.cc:2406] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:16.130767 20527 tablet_bootstrap.cc:654] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.143960 20526 tablet_bootstrap.cc:492] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:16.144600 20526 ts_tablet_manager.cc:1403] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.006s
I20260709 13:09:16.144011 20536 tablet_bootstrap.cc:492] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:16.148155 20536 ts_tablet_manager.cc:1403] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.004s
I20260709 13:09:16.151527 20536 raft_consensus.cc:359] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.152418 20536 raft_consensus.cc:385] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.152776 20536 raft_consensus.cc:740] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.153585 20536 consensus_queue.cc:260] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.157439 20536 ts_tablet_manager.cc:1434] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:16.158519 20536 tablet_bootstrap.cc:492] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:16.159524 20527 tablet_bootstrap.cc:492] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:16.160239 20527 ts_tablet_manager.cc:1403] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.001s
I20260709 13:09:16.163650 20527 raft_consensus.cc:359] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.164780 20527 raft_consensus.cc:385] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.165143 20527 raft_consensus.cc:740] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.165995 20527 consensus_queue.cc:260] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.165235 20536 tablet_bootstrap.cc:654] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.168463 20526 raft_consensus.cc:359] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.169240 20526 raft_consensus.cc:385] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.169545 20526 raft_consensus.cc:740] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.171823 20527 ts_tablet_manager.cc:1434] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:16.171900 20526 consensus_queue.cc:260] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.172679 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027" is_pre_election: true
I20260709 13:09:16.173331 20527 tablet_bootstrap.cc:492] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:16.173475 20334 raft_consensus.cc:2468] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 0.
I20260709 13:09:16.176578 20375 leader_election.cc:304] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:16.180227 20532 raft_consensus.cc:2804] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.180694 20532 raft_consensus.cc:493] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.181130 20532 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.188692 20527 tablet_bootstrap.cc:654] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.191351 20532 raft_consensus.cc:515] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.195511 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:16.196305 20334 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.212852 20532 leader_election.cc:290] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.213042 20530 raft_consensus.cc:493] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.213537 20530 raft_consensus.cc:515] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.214442 20334 raft_consensus.cc:2468] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 1.
I20260709 13:09:16.215714 20375 leader_election.cc:304] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:16.217923 20530 leader_election.cc:290] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.219281 20532 raft_consensus.cc:2804] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.232915 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:16.236604 20540 raft_consensus.cc:493] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.243881 20530 raft_consensus.cc:493] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.244876 20482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
W20260709 13:09:16.245786 20373 leader_election.cc:343] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.237360 20540 raft_consensus.cc:515] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.248301 20532 raft_consensus.cc:697] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:16.246570 20530 raft_consensus.cc:515] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.260825 20536 tablet_bootstrap.cc:492] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:16.261368 20536 ts_tablet_manager.cc:1403] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.018s
I20260709 13:09:16.264431 20536 raft_consensus.cc:359] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.265316 20536 raft_consensus.cc:385] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.265676 20536 raft_consensus.cc:740] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
W20260709 13:09:16.266780 20373 leader_election.cc:343] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.268927 20530 leader_election.cc:290] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.275377 20526 ts_tablet_manager.cc:1434] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.130s	user 0.011s	sys 0.001s
I20260709 13:09:16.276559 20526 tablet_bootstrap.cc:492] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:16.282182 20536 consensus_queue.cc:260] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.292300 20540 leader_election.cc:290] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:16.301379 20540 raft_consensus.cc:493] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.302038 20540 raft_consensus.cc:515] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.293708 20532 consensus_queue.cc:237] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.308240 20540 leader_election.cc:290] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:16.328186 20530 raft_consensus.cc:493] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.348272 20527 tablet_bootstrap.cc:492] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:16.348775 20527 ts_tablet_manager.cc:1403] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.176s	user 0.045s	sys 0.073s
I20260709 13:09:16.340451 20530 raft_consensus.cc:515] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.351920 20530 leader_election.cc:290] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.352394 20527 raft_consensus.cc:359] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.354200 20526 tablet_bootstrap.cc:654] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.354750 20527 raft_consensus.cc:385] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.356621 20527 raft_consensus.cc:740] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.362224 20532 raft_consensus.cc:493] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.363222 20527 consensus_queue.cc:260] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.365267 20532 raft_consensus.cc:515] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.367336 20527 ts_tablet_manager.cc:1434] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:09:16.370918 20532 leader_election.cc:290] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.369479 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027" is_pre_election: true
I20260709 13:09:16.371706 20527 tablet_bootstrap.cc:492] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:16.372330 20482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:16.373570 20530 raft_consensus.cc:493] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.374775 20373 leader_election.cc:343] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.375234 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027" is_pre_election: true
I20260709 13:09:16.375460 20530 raft_consensus.cc:515] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.375865 20334 raft_consensus.cc:2468] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 0.
I20260709 13:09:16.377255 20375 leader_election.cc:304] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:16.377602 20530 leader_election.cc:290] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.378101 20532 raft_consensus.cc:2804] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.378495 20532 raft_consensus.cc:493] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.378829 20532 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.388893 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027" is_pre_election: true
I20260709 13:09:16.391256 20334 raft_consensus.cc:2468] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 0.
I20260709 13:09:16.392474 20530 raft_consensus.cc:493] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.393004 20530 raft_consensus.cc:515] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.396991 20530 leader_election.cc:290] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.416980 20532 raft_consensus.cc:515] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
W20260709 13:09:16.413129 20449 leader_election.cc:343] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.423367 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:16.424382 20334 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.429131 20532 leader_election.cc:290] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.427012 20449 leader_election.cc:304] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027; no voters: 
I20260709 13:09:16.433080 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.431232 20409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.434998 20407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69471876aad4f46b1651f45a14b9bdd" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.435176 20409 raft_consensus.cc:2468] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 0.
I20260709 13:09:16.436831 20526 tablet_bootstrap.cc:492] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:16.437307 20526 ts_tablet_manager.cc:1403] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.161s	user 0.023s	sys 0.028s
I20260709 13:09:16.437124 20482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:16.441886 20408 raft_consensus.cc:2393] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86c10dcab93143cd9717e9e1d3d7e027 in current term 1: Already voted for candidate c39a0b8166c94ec18a862a996ca7cabc in this term.
I20260709 13:09:16.436568 20407 raft_consensus.cc:2468] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 0.
I20260709 13:09:16.444480 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:16.442101 20409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.442945 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
W20260709 13:09:16.449517 20373 leader_election.cc:343] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.449401 20478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa97bf3df114fc982944c3bd3c8f379" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:16.451263 20558 raft_consensus.cc:2804] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.451254 20300 leader_election.cc:304] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:16.452188 20530 raft_consensus.cc:2804] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.452399 20300 leader_election.cc:304] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:16.452567 20530 raft_consensus.cc:493] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.452960 20530 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.451802 20558 raft_consensus.cc:493] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.441988 20480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69471876aad4f46b1651f45a14b9bdd" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:16.443607 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.450660 20483 raft_consensus.cc:2468] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 0.
I20260709 13:09:16.454883 20479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:16.460583 20407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa97bf3df114fc982944c3bd3c8f379" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.461355 20407 raft_consensus.cc:2468] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 0.
I20260709 13:09:16.455858 20558 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.456439 20536 ts_tablet_manager.cc:1434] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.195s	user 0.020s	sys 0.005s
W20260709 13:09:16.467468 20298 leader_election.cc:343] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:16.469554 20298 leader_election.cc:343] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:16.470150 20298 leader_election.cc:343] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.471166 20527 tablet_bootstrap.cc:654] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.473582 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.473920 20536 tablet_bootstrap.cc:492] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:16.475190 20300 leader_election.cc:304] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc
W20260709 13:09:16.462365 20449 leader_election.cc:343] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.471637 20526 raft_consensus.cc:359] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.479620 20526 raft_consensus.cc:385] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.480137 20526 raft_consensus.cc:740] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.481225 20526 consensus_queue.cc:260] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.479020 20334 raft_consensus.cc:2468] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 1.
I20260709 13:09:16.481950 20530 raft_consensus.cc:515] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.477818 20449 leader_election.cc:304] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf; no voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:16.487108 20554 raft_consensus.cc:2749] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:16.487394 20449 leader_election.cc:343] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.491029 20560 raft_consensus.cc:2804] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.491688 20560 raft_consensus.cc:493] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.494042 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:16.492142 20560 raft_consensus.cc:3060] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.495007 20481 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:16.495265 20300 leader_election.cc:343] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.494768 20530 leader_election.cc:290] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.496740 20300 leader_election.cc:304] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:16.502009 20375 leader_election.cc:304] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:16.502877 20532 raft_consensus.cc:2804] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.504055 20530 raft_consensus.cc:2804] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.504429 20530 raft_consensus.cc:493] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.503823 20532 raft_consensus.cc:697] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:16.504776 20530 raft_consensus.cc:3060] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.502506 20231 catalog_manager.cc:5697] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 0 to 1, leader changed from <none> to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 1 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.505475 20532 consensus_queue.cc:237] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.508482 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:16.509094 20408 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.513609 20561 raft_consensus.cc:2749] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.516867 20558 raft_consensus.cc:515] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.516867 20530 raft_consensus.cc:515] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.521178 20530 leader_election.cc:290] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.519243 20479 raft_consensus.cc:2393] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86c10dcab93143cd9717e9e1d3d7e027 in current term 1: Already voted for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in this term.
I20260709 13:09:16.522301 20407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa97bf3df114fc982944c3bd3c8f379" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:16.522882 20407 raft_consensus.cc:3060] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.535106 20407 raft_consensus.cc:2468] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 1.
I20260709 13:09:16.541163 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa97bf3df114fc982944c3bd3c8f379" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:16.541663 20481 raft_consensus.cc:2468] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 1.
I20260709 13:09:16.543365 20408 raft_consensus.cc:2468] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 1.
I20260709 13:09:16.544220 20536 tablet_bootstrap.cc:654] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.545200 20298 leader_election.cc:304] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:16.559024 20561 raft_consensus.cc:493] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.554086 20530 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.560750 20300 leader_election.cc:304] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:16.566401 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
W20260709 13:09:16.566656 20298 leader_election.cc:343] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.573076 20558 leader_election.cc:290] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:16.559785 20561 raft_consensus.cc:515] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.582280 20300 leader_election.cc:304] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:16.581127 20526 ts_tablet_manager.cc:1434] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.144s	user 0.015s	sys 0.008s
I20260709 13:09:16.585481 20526 tablet_bootstrap.cc:492] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:16.581823 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
W20260709 13:09:16.591387 20449 leader_election.cc:343] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.592180 20561 leader_election.cc:290] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.592769 20561 raft_consensus.cc:2804] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.593216 20561 raft_consensus.cc:697] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:16.594087 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:16.594024 20561 consensus_queue.cc:237] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.594870 20483 raft_consensus.cc:2468] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 0.
I20260709 13:09:16.589890 20560 raft_consensus.cc:515] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.597061 20298 leader_election.cc:304] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027; no voters: 
I20260709 13:09:16.597960 20562 raft_consensus.cc:2804] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.631170 20568 raft_consensus.cc:2804] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.631747 20568 raft_consensus.cc:493] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.633415 20568 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.628762 20407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69471876aad4f46b1651f45a14b9bdd" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:16.632659 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.634122 20530 raft_consensus.cc:2749] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.639389 20407 raft_consensus.cc:3060] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.638979 20562 raft_consensus.cc:697] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
W20260709 13:09:16.644192 20300 leader_election.cc:343] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.647558 20527 tablet_bootstrap.cc:492] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:16.648072 20527 ts_tablet_manager.cc:1403] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.277s	user 0.026s	sys 0.026s
I20260709 13:09:16.645128 20560 leader_election.cc:290] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.651269 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69471876aad4f46b1651f45a14b9bdd" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
W20260709 13:09:16.655226 20298 leader_election.cc:343] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.655428 20536 tablet_bootstrap.cc:492] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:16.655856 20536 ts_tablet_manager.cc:1403] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.006s
I20260709 13:09:16.660483 20527 raft_consensus.cc:359] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
W20260709 13:09:16.663015 20278 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:16.661484 20527 raft_consensus.cc:385] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.662792 20536 raft_consensus.cc:359] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.664364 20527 raft_consensus.cc:740] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.664709 20536 raft_consensus.cc:385] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.665059 20536 raft_consensus.cc:740] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.665707 20527 consensus_queue.cc:260] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.665969 20536 consensus_queue.cc:260] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.668491 20527 ts_tablet_manager.cc:1434] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:09:16.662322 20334 raft_consensus.cc:2468] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 1.
I20260709 13:09:16.673854 20449 leader_election.cc:304] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027; no voters: c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:16.675513 20526 tablet_bootstrap.cc:654] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.675575 20558 raft_consensus.cc:2804] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.676378 20558 raft_consensus.cc:697] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 LEADER]: Becoming Leader. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:16.677584 20558 consensus_queue.cc:237] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.686259 20407 raft_consensus.cc:2468] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 1.
I20260709 13:09:16.660127 20562 consensus_queue.cc:237] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.687923 20300 leader_election.cc:304] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:16.680552 20527 tablet_bootstrap.cc:492] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:16.689441 20560 raft_consensus.cc:2804] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.689920 20560 raft_consensus.cc:697] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:16.690694 20560 consensus_queue.cc:237] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.696857 20536 ts_tablet_manager.cc:1434] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.007s
I20260709 13:09:16.698256 20536 tablet_bootstrap.cc:492] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:16.715975 20568 raft_consensus.cc:515] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.721598 20407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:16.722293 20407 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.724222 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:16.724988 20483 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.728879 20527 tablet_bootstrap.cc:654] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.733376 20526 tablet_bootstrap.cc:492] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:16.729918 20568 leader_election.cc:290] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.734149 20526 ts_tablet_manager.cc:1403] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.149s	user 0.023s	sys 0.009s
I20260709 13:09:16.729415 20407 raft_consensus.cc:2468] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 1.
I20260709 13:09:16.738095 20300 leader_election.cc:304] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:16.738312 20483 raft_consensus.cc:2468] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 1.
I20260709 13:09:16.738904 20568 raft_consensus.cc:2804] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.740581 20568 raft_consensus.cc:697] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:16.741422 20568 consensus_queue.cc:237] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.741714 20526 raft_consensus.cc:359] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.742322 20526 raft_consensus.cc:385] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.742626 20526 raft_consensus.cc:740] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.743279 20526 consensus_queue.cc:260] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.745227 20526 ts_tablet_manager.cc:1434] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:16.739630 20536 tablet_bootstrap.cc:654] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.746582 20526 tablet_bootstrap.cc:492] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027: Bootstrap starting.
I20260709 13:09:16.752220 20527 tablet_bootstrap.cc:492] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:16.752723 20527 ts_tablet_manager.cc:1403] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.007s
I20260709 13:09:16.754978 20558 raft_consensus.cc:493] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.755391 20558 raft_consensus.cc:515] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.755507 20527 raft_consensus.cc:359] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.756196 20527 raft_consensus.cc:385] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.756479 20527 raft_consensus.cc:740] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.757115 20527 consensus_queue.cc:260] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.757596 20558 leader_election.cc:290] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:16.759303 20527 ts_tablet_manager.cc:1434] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:16.759971 20526 tablet_bootstrap.cc:654] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.760179 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027" is_pre_election: true
I20260709 13:09:16.761240 20334 raft_consensus.cc:2393] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54eb901d3e9e4b6889bea6c4d962d6cf in current term 1: Already voted for candidate c39a0b8166c94ec18a862a996ca7cabc in this term.
I20260709 13:09:16.762339 20407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:16.760208 20527 tablet_bootstrap.cc:492] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc: Bootstrap starting.
I20260709 13:09:16.764838 20449 leader_election.cc:304] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf; no voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:16.766268 20558 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.770114 20536 tablet_bootstrap.cc:492] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:16.770804 20536 ts_tablet_manager.cc:1403] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.002s
I20260709 13:09:16.775276 20558 raft_consensus.cc:2749] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.777590 20230 catalog_manager.cc:5697] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.780303 20526 tablet_bootstrap.cc:492] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027: No bootstrap required, opened a new log
I20260709 13:09:16.780789 20526 ts_tablet_manager.cc:1403] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.004s
I20260709 13:09:16.781637 20536 raft_consensus.cc:359] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.782512 20536 raft_consensus.cc:385] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.782868 20536 raft_consensus.cc:740] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.783526 20526 raft_consensus.cc:359] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.782527 20231 catalog_manager.cc:5697] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 0 to 1, leader changed from <none> to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 1 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.784207 20526 raft_consensus.cc:385] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.783836 20536 consensus_queue.cc:260] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.784521 20526 raft_consensus.cc:740] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.785347 20526 consensus_queue.cc:260] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.787487 20536 ts_tablet_manager.cc:1434] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:09:16.788877 20536 tablet_bootstrap.cc:492] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:16.789012 20527 tablet_bootstrap.cc:654] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.787539 20526 ts_tablet_manager.cc:1434] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:16.796495 20536 tablet_bootstrap.cc:654] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.801857 20532 consensus_queue.cc:1048] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:16.811640 20527 tablet_bootstrap.cc:492] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc: No bootstrap required, opened a new log
I20260709 13:09:16.812127 20527 ts_tablet_manager.cc:1403] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.011s
I20260709 13:09:16.815270 20527 raft_consensus.cc:359] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.815975 20527 raft_consensus.cc:385] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.821743 20527 raft_consensus.cc:740] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.822747 20228 catalog_manager.cc:5697] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.823535 20527 consensus_queue.cc:260] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.825022 20228 catalog_manager.cc:5697] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.826943 20228 catalog_manager.cc:5697] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.830356 20532 consensus_queue.cc:1048] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.851603 20550 raft_consensus.cc:493] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.852167 20550 raft_consensus.cc:515] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.854390 20550 leader_election.cc:290] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.856086 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:16.857008 20481 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 0.
I20260709 13:09:16.859905 20333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027" is_pre_election: true
I20260709 13:09:16.860836 20333 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 0.
I20260709 13:09:16.862329 20373 leader_election.cc:304] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:16.864225 20550 raft_consensus.cc:2804] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.864593 20550 raft_consensus.cc:493] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.864939 20550 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.867678 20230 catalog_manager.cc:5697] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195). New cstate: current_term: 1 leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.878392 20550 raft_consensus.cc:515] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.884482 20527 ts_tablet_manager.cc:1434] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:09:16.895054 20333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:16.899240 20333 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:16.903378 20373 consensus_peers.cc:597] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc -> Peer 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555): Couldn't send request to peer 54eb901d3e9e4b6889bea6c4d962d6cf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.911716 20536 tablet_bootstrap.cc:492] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:16.912396 20536 ts_tablet_manager.cc:1403] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.124s	user 0.052s	sys 0.045s
I20260709 13:09:16.950968 20550 leader_election.cc:290] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:16.955264 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:16.956137 20481 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.958830 20333 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 1.
I20260709 13:09:16.960547 20375 leader_election.cc:304] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:16.961930 20586 raft_consensus.cc:2804] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.962409 20586 raft_consensus.cc:697] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:16.963177 20586 consensus_queue.cc:237] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.960767 20536 raft_consensus.cc:359] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.964772 20536 raft_consensus.cc:385] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.965121 20536 raft_consensus.cc:740] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.968575 20536 consensus_queue.cc:260] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.971365 20536 ts_tablet_manager.cc:1434] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260709 13:09:16.972481 20536 tablet_bootstrap.cc:492] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:16.977697 20481 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 1.
I20260709 13:09:16.990567 20536 tablet_bootstrap.cc:654] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.992238 20230 catalog_manager.cc:5697] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 0 to 1, leader changed from <none> to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 1 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.994978 20536 tablet_bootstrap.cc:492] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:16.995390 20536 ts_tablet_manager.cc:1403] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.004s
I20260709 13:09:16.997349 20536 raft_consensus.cc:359] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:16.997881 20536 raft_consensus.cc:385] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.998129 20536 raft_consensus.cc:740] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.998739 20536 consensus_queue.cc:260] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.000842 20536 ts_tablet_manager.cc:1434] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:17.001778 20536 tablet_bootstrap.cc:492] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:17.006386 20536 tablet_bootstrap.cc:654] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.017644 20536 tablet_bootstrap.cc:492] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:17.018100 20536 ts_tablet_manager.cc:1403] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:09:17.018668 20586 consensus_queue.cc:1048] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.020138 20536 raft_consensus.cc:359] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.020790 20536 raft_consensus.cc:385] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.021037 20536 raft_consensus.cc:740] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.021642 20536 consensus_queue.cc:260] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.023723 20536 ts_tablet_manager.cc:1434] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:17.024575 20536 tablet_bootstrap.cc:492] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf: Bootstrap starting.
I20260709 13:09:17.030562 20536 tablet_bootstrap.cc:654] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.035130 20536 tablet_bootstrap.cc:492] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf: No bootstrap required, opened a new log
I20260709 13:09:17.035517 20536 ts_tablet_manager.cc:1403] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:17.038185 20536 raft_consensus.cc:359] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.038879 20536 raft_consensus.cc:385] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.039211 20536 raft_consensus.cc:740] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.039944 20536 consensus_queue.cc:260] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.042050 20586 raft_consensus.cc:493] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.042174 20536 ts_tablet_manager.cc:1434] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:09:17.042614 20586 raft_consensus.cc:515] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.045892 20586 leader_election.cc:290] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:17.045903 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:17.046695 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027" is_pre_election: true
I20260709 13:09:17.047432 20334 raft_consensus.cc:2393] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c39a0b8166c94ec18a862a996ca7cabc in current term 1: Already voted for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in this term.
I20260709 13:09:17.048626 20375 leader_election.cc:304] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c39a0b8166c94ec18a862a996ca7cabc; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027
I20260709 13:09:17.049467 20586 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.057327 20568 raft_consensus.cc:493] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.057807 20568 raft_consensus.cc:515] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.059814 20568 leader_election.cc:290] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:17.056969 20586 raft_consensus.cc:2749] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.060418 20407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62150089d1b746c49d450831b974c766" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc" is_pre_election: true
I20260709 13:09:17.061053 20407 raft_consensus.cc:2468] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 0.
I20260709 13:09:17.061275 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62150089d1b746c49d450831b974c766" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" is_pre_election: true
I20260709 13:09:17.061901 20481 raft_consensus.cc:2468] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 0.
I20260709 13:09:17.062109 20300 leader_election.cc:304] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:17.062898 20568 raft_consensus.cc:2804] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.063217 20568 raft_consensus.cc:493] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.063489 20568 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.067672 20568 raft_consensus.cc:515] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.069435 20568 leader_election.cc:290] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:17.070106 20407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62150089d1b746c49d450831b974c766" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:17.070679 20407 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.070704 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62150089d1b746c49d450831b974c766" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:17.071324 20481 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.076272 20481 raft_consensus.cc:2468] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 1.
I20260709 13:09:17.077612 20407 raft_consensus.cc:2468] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 1.
I20260709 13:09:17.077783 20298 leader_election.cc:304] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027; no voters: 
I20260709 13:09:17.078933 20562 raft_consensus.cc:2804] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.079047 20568 consensus_queue.cc:1048] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.079427 20562 raft_consensus.cc:697] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:17.080288 20562 consensus_queue.cc:237] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.092159 20560 consensus_queue.cc:1048] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.100133 20229 catalog_manager.cc:5697] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.124840 20558 consensus_queue.cc:1048] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.138432 20558 consensus_queue.cc:1048] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.159804 20568 consensus_queue.cc:1048] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.178957 20481 raft_consensus.cc:3060] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:17.179181 20504 debug-util.cc:398] Leaking SignalData structure 0x7b080016d060 after lost signal to thread 20202
W20260709 13:09:17.180238 20504 debug-util.cc:398] Leaking SignalData structure 0x7b080016d740 after lost signal to thread 20265
I20260709 13:09:17.187516 20483 raft_consensus.cc:3060] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.193609 20562 consensus_queue.cc:1048] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.197168 20562 consensus_queue.cc:1048] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.201300 20407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
mode: GRACEFUL
new_leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:41426
I20260709 13:09:17.202140 20407 raft_consensus.cc:606] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Received request to transfer leadership to TS 86c10dcab93143cd9717e9e1d3d7e027
I20260709 13:09:17.207597 20568 consensus_queue.cc:1048] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.213953 20406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
mode: GRACEFUL
new_leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:41426
I20260709 13:09:17.214728 20406 raft_consensus.cc:606] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Received request to transfer leadership to TS 86c10dcab93143cd9717e9e1d3d7e027
I20260709 13:09:17.263492 20334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62150089d1b746c49d450831b974c766"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
mode: GRACEFUL
new_leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:45528
I20260709 13:09:17.264400 20334 raft_consensus.cc:606] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Received request to transfer leadership to TS c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:17.283279 20568 consensus_queue.cc:1048] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.323576 20568 consensus_queue.cc:1048] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.344183 20483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78"
dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
mode: GRACEFUL
new_leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:54766
I20260709 13:09:17.344828 20483 raft_consensus.cc:606] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 LEADER]: Received request to transfer leadership to TS c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:17.351408 20334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fa97bf3df114fc982944c3bd3c8f379"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
mode: GRACEFUL
new_leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:45528
I20260709 13:09:17.352052 20334 raft_consensus.cc:606] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Received request to transfer leadership to TS c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:17.362500 20334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e69471876aad4f46b1651f45a14b9bdd"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
mode: GRACEFUL
new_leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:45528
I20260709 13:09:17.363160 20334 raft_consensus.cc:606] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Received request to transfer leadership to TS 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:17.430747 20481 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.456961 20586 consensus_queue.cc:1048] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.470980 20532 consensus_queue.cc:1048] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.497484 20550 raft_consensus.cc:993] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc: : Instructing follower 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:17.497982 20588 raft_consensus.cc:1081] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Signalling peer 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:17.506333 20334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:45514
I20260709 13:09:17.508142 20588 raft_consensus.cc:993] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc: : Instructing follower 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:17.508563 20588 raft_consensus.cc:1081] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Signalling peer 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:17.507385 20334 raft_consensus.cc:493] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.509869 20334 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.511997 20333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:45514
I20260709 13:09:17.512593 20333 raft_consensus.cc:493] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.512944 20333 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.517374 20334 raft_consensus.cc:515] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.519869 20333 raft_consensus.cc:515] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.520609 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:17.521198 20406 raft_consensus.cc:3055] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.521492 20406 raft_consensus.cc:740] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:17.522323 20406 consensus_queue.cc:260] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.523185 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:17.523537 20406 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.523736 20481 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.525449 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:17.526031 20408 raft_consensus.cc:3055] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.526342 20408 raft_consensus.cc:740] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:17.527132 20408 consensus_queue.cc:260] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.528312 20408 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.531018 20481 raft_consensus.cc:2468] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 2.
I20260709 13:09:17.532349 20298 leader_election.cc:304] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027; no voters: 
I20260709 13:09:17.533214 20561 raft_consensus.cc:2804] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.533674 20561 raft_consensus.cc:697] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:17.534531 20561 consensus_queue.cc:237] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.539759 20408 raft_consensus.cc:2468] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 2.
I20260709 13:09:17.542063 20406 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 2.
I20260709 13:09:17.544941 20229 catalog_manager.cc:5697] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 1 to 2, leader changed from c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194) to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.548254 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:17.548846 20483 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.556332 20300 leader_election.cc:304] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:17.558393 20558 raft_consensus.cc:993] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf: : Instructing follower c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:17.558844 20558 raft_consensus.cc:1081] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 LEADER]: Signalling peer c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:17.560364 20333 leader_election.cc:290] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 2 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:17.560801 20407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:41414
I20260709 13:09:17.561345 20407 raft_consensus.cc:493] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.561726 20407 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.568929 20483 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 2.
I20260709 13:09:17.570464 20561 raft_consensus.cc:2804] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.571655 20561 raft_consensus.cc:697] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:17.572520 20561 consensus_queue.cc:237] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.574605 20407 raft_consensus.cc:515] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.577524 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:17.542936 20334 leader_election.cc:290] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 2 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:17.578115 20332 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.582325 20229 catalog_manager.cc:5697] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 1 to 2, leader changed from c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194) to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.585681 20332 raft_consensus.cc:2468] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 2.
I20260709 13:09:17.586417 20407 leader_election.cc:290] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 2 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:17.588083 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:17.588650 20483 raft_consensus.cc:3055] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.588953 20483 raft_consensus.cc:740] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:17.591018 20333 raft_consensus.cc:1240] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Rejecting Update request from peer 54eb901d3e9e4b6889bea6c4d962d6cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:17.594236 20375 leader_election.cc:304] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:17.595132 20532 raft_consensus.cc:2804] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.595623 20532 raft_consensus.cc:697] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:17.596740 20532 consensus_queue.cc:237] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.593715 20483 consensus_queue.cc:260] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.599308 20483 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.606972 20483 raft_consensus.cc:2468] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 2.
I20260709 13:09:17.608196 20229 catalog_manager.cc:5697] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 1 to 2, leader changed from 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195) to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 2 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.648653 20561 consensus_queue.cc:1048] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.656111 20561 raft_consensus.cc:993] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027: : Instructing follower 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:17.656713 20568 raft_consensus.cc:1081] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Signalling peer 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:17.659047 20483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e69471876aad4f46b1651f45a14b9bdd"
dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:54764
I20260709 13:09:17.659793 20483 raft_consensus.cc:493] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.660305 20483 raft_consensus.cc:3060] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.678848 20568 raft_consensus.cc:993] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027: : Instructing follower c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:17.679363 20568 raft_consensus.cc:1081] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Signalling peer c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:17.684182 20408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62150089d1b746c49d450831b974c766"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:41410
I20260709 13:09:17.684882 20408 raft_consensus.cc:493] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.685284 20408 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.691203 20568 consensus_queue.cc:1048] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.696798 20561 raft_consensus.cc:993] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027: : Instructing follower c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:17.697234 20561 raft_consensus.cc:1081] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Signalling peer c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:17.699390 20408 raft_consensus.cc:515] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.701076 20406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fa97bf3df114fc982944c3bd3c8f379"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:41410
I20260709 13:09:17.705153 20406 raft_consensus.cc:493] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.705566 20406 raft_consensus.cc:3060] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.707934 20333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62150089d1b746c49d450831b974c766" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:17.708242 20479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62150089d1b746c49d450831b974c766" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:17.708612 20333 raft_consensus.cc:3055] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.708927 20333 raft_consensus.cc:740] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:17.709777 20333 consensus_queue.cc:260] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.710695 20333 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.713735 20408 leader_election.cc:290] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 2 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:17.718425 20406 raft_consensus.cc:515] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.723268 20483 raft_consensus.cc:515] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.729362 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69471876aad4f46b1651f45a14b9bdd" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:17.729981 20332 raft_consensus.cc:3055] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.730306 20332 raft_consensus.cc:740] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:17.732466 20332 consensus_queue.cc:260] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.733623 20332 raft_consensus.cc:3060] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.737907 20333 raft_consensus.cc:2468] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 2.
I20260709 13:09:17.739269 20375 leader_election.cc:304] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:17.740479 20532 raft_consensus.cc:2804] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.741016 20532 raft_consensus.cc:697] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:17.741853 20532 consensus_queue.cc:237] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.747591 20333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa97bf3df114fc982944c3bd3c8f379" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:17.748296 20333 raft_consensus.cc:3055] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:17.748623 20333 raft_consensus.cc:740] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:17.750025 20483 leader_election.cc:290] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 2 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:17.750358 20333 consensus_queue.cc:260] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.750082 20406 leader_election.cc:290] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 2 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:17.750236 20231 catalog_manager.cc:5697] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 1 to 2, leader changed from 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193) to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 2 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.751554 20333 raft_consensus.cc:3060] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.757031 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa97bf3df114fc982944c3bd3c8f379" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:17.757740 20481 raft_consensus.cc:3060] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.757052 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69471876aad4f46b1651f45a14b9bdd" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:17.766563 20408 raft_consensus.cc:3060] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.777048 20481 raft_consensus.cc:2468] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 2.
I20260709 13:09:17.778434 20333 raft_consensus.cc:2468] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 2.
I20260709 13:09:17.778928 20373 leader_election.cc:304] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:17.779817 20532 raft_consensus.cc:2804] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.780316 20532 raft_consensus.cc:697] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:17.781136 20532 consensus_queue.cc:237] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.786311 20408 raft_consensus.cc:2468] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 2.
I20260709 13:09:17.787573 20449 leader_election.cc:304] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:17.788314 20332 raft_consensus.cc:2468] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 2.
I20260709 13:09:17.788478 20554 raft_consensus.cc:2804] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.789052 20554 raft_consensus.cc:697] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Becoming Leader. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:17.789867 20554 consensus_queue.cc:237] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:17.795761 20229 catalog_manager.cc:5697] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 1 to 2, leader changed from 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193) to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 2 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.799539 20231 catalog_manager.cc:5697] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf reported cstate change: term changed from 1 to 2, leader changed from 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193) to 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195). New cstate: current_term: 2 leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.961901 20408 raft_consensus.cc:1275] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:17.963338 20561 consensus_queue.cc:1048] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:17.977134 20481 raft_consensus.cc:1275] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:17.979674 20568 consensus_queue.cc:1048] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.991410 20332 raft_consensus.cc:1275] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:17.995468 20550 consensus_queue.cc:1048] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.999193 20481 raft_consensus.cc:1275] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.001049 20562 consensus_queue.cc:1048] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.008114 20483 raft_consensus.cc:1275] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.014832 20550 consensus_queue.cc:1048] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.052251 20408 raft_consensus.cc:1275] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.054388 20568 consensus_queue.cc:1048] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:18.215824 20332 raft_consensus.cc:1275] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.217311 20550 consensus_queue.cc:1048] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.224915 20481 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:18.232111 20481 raft_consensus.cc:1275] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.235800 20532 consensus_queue.cc:1048] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.239409 20483 raft_consensus.cc:1275] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.240922 20532 consensus_queue.cc:1048] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.241708 20408 raft_consensus.cc:1275] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.243125 20554 consensus_queue.cc:1048] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.252014 20333 raft_consensus.cc:1275] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.253890 20550 consensus_queue.cc:1048] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.263202 20332 raft_consensus.cc:1275] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:18.265671 20554 consensus_queue.cc:1048] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:20.395426 20199 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:09:20.396356 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:20.422731 20408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
mode: GRACEFUL
new_leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:49484
I20260709 13:09:20.423430 20408 raft_consensus.cc:606] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Received request to transfer leadership to TS 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:20.437484 20332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
mode: GRACEFUL
new_leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:42002
I20260709 13:09:20.438182 20332 raft_consensus.cc:606] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Received request to transfer leadership to TS 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:20.439599 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:20.440267 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:20.493450 20628 raft_consensus.cc:993] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc: : Instructing follower 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:20.494053 20550 raft_consensus.cc:1081] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Signalling peer 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:20.495630 20481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d"
dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:54758
I20260709 13:09:20.496264 20481 raft_consensus.cc:493] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:20.496652 20481 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.504247 20481 raft_consensus.cc:515] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:20.506855 20481 leader_election.cc:290] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 2 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:20.507846 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:20.508119 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:20.508595 20332 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.508770 20408 raft_consensus.cc:3055] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:20.509193 20408 raft_consensus.cc:740] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:20.509966 20408 consensus_queue.cc:260] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:20.511027 20408 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.515960 20408 raft_consensus.cc:2468] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 2.
I20260709 13:09:20.516315 20332 raft_consensus.cc:2468] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 2.
I20260709 13:09:20.517295 20449 leader_election.cc:304] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:20.518065 20554 raft_consensus.cc:2804] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.519446 20554 raft_consensus.cc:697] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Becoming Leader. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:20.520306 20554 consensus_queue.cc:237] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:20.530776 20231 catalog_manager.cc:5697] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf reported cstate change: term changed from 1 to 2, leader changed from c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194) to 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195). New cstate: current_term: 2 leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.811282 20635 raft_consensus.cc:993] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027: : Instructing follower 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:20.811815 20562 raft_consensus.cc:1081] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Signalling peer 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:20.813493 20483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4"
dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:54764
I20260709 13:09:20.814096 20483 raft_consensus.cc:493] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:20.814474 20483 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.821902 20483 raft_consensus.cc:515] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:20.824141 20483 leader_election.cc:290] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 2 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721)
I20260709 13:09:20.824934 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:20.825517 20408 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.825493 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:20.826273 20332 raft_consensus.cc:3055] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:20.826610 20332 raft_consensus.cc:740] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:20.827431 20332 consensus_queue.cc:260] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:20.828823 20332 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.830720 20408 raft_consensus.cc:2468] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 2.
I20260709 13:09:20.831780 20449 leader_election.cc:304] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:20.832487 20554 raft_consensus.cc:2804] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.832909 20554 raft_consensus.cc:697] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Becoming Leader. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:20.833725 20554 consensus_queue.cc:237] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:20.836920 20332 raft_consensus.cc:2468] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 2.
I20260709 13:09:20.841171 20230 catalog_manager.cc:5697] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf reported cstate change: term changed from 1 to 2, leader changed from 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193) to 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195). New cstate: current_term: 2 leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.948944 20332 raft_consensus.cc:1275] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:20.950431 20554 consensus_queue.cc:1048] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:20.957885 20408 raft_consensus.cc:1275] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:20.959522 20554 consensus_queue.cc:1048] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.260298 20408 raft_consensus.cc:1275] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.261536 20629 consensus_queue.cc:1048] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.271551 20332 raft_consensus.cc:1275] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.275483 20554 consensus_queue.cc:1048] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.441277 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:21.455533 20483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4"
dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
mode: GRACEFUL
new_leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:54766
I20260709 13:09:21.456176 20483 raft_consensus.cc:606] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Received request to transfer leadership to TS c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:21.461519 20332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
mode: GRACEFUL
new_leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:45528
I20260709 13:09:21.462054 20332 raft_consensus.cc:606] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Received request to transfer leadership to TS c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:21.466755 20332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
mode: GRACEFUL
new_leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:45528
I20260709 13:09:21.467290 20332 raft_consensus.cc:606] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Received request to transfer leadership to TS c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:21.472455 20332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
mode: GRACEFUL
new_leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:45528
I20260709 13:09:21.472939 20332 raft_consensus.cc:606] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Received request to transfer leadership to TS c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:21.485402 20483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d"
dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
mode: GRACEFUL
new_leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:54766
I20260709 13:09:21.485932 20483 raft_consensus.cc:606] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Received request to transfer leadership to TS c39a0b8166c94ec18a862a996ca7cabc
I20260709 13:09:21.594537 20635 raft_consensus.cc:993] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027: : Instructing follower c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.594975 20562 raft_consensus.cc:1081] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Signalling peer c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.596453 20408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:41410
I20260709 13:09:21.596933 20408 raft_consensus.cc:493] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.597272 20408 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.603551 20408 raft_consensus.cc:515] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.605155 20408 leader_election.cc:290] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 2 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:21.606235 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:21.606714 20332 raft_consensus.cc:3055] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:21.606943 20332 raft_consensus.cc:740] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:21.607609 20332 consensus_queue.cc:260] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.608585 20332 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.612959 20332 raft_consensus.cc:2468] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 2.
I20260709 13:09:21.613605 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:21.614184 20483 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.614079 20375 leader_election.cc:304] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:21.614928 20550 raft_consensus.cc:2804] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.616006 20550 raft_consensus.cc:697] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:21.616907 20550 consensus_queue.cc:237] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.619804 20483 raft_consensus.cc:2468] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 2.
I20260709 13:09:21.624854 20231 catalog_manager.cc:5697] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 1 to 2, leader changed from 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193) to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 2 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.729929 20635 raft_consensus.cc:993] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027: : Instructing follower c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.730404 20562 raft_consensus.cc:1081] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Signalling peer c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.732013 20408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:41410
I20260709 13:09:21.732559 20408 raft_consensus.cc:493] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.732857 20408 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.737111 20408 raft_consensus.cc:515] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.739200 20408 leader_election.cc:290] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 3 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:21.739585 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:21.739775 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a23b6bf55644e07bfe843c7542681b0" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:21.740260 20483 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.740211 20332 raft_consensus.cc:3055] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:21.740707 20332 raft_consensus.cc:740] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:21.741534 20332 consensus_queue.cc:260] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.742817 20332 raft_consensus.cc:3060] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.745065 20483 raft_consensus.cc:2468] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 3.
I20260709 13:09:21.746423 20373 leader_election.cc:304] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:21.747242 20550 raft_consensus.cc:2804] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:21.747699 20550 raft_consensus.cc:697] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:21.748440 20550 consensus_queue.cc:237] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.750793 20332 raft_consensus.cc:2468] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 3.
I20260709 13:09:21.756001 20231 catalog_manager.cc:5697] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 2 to 3, leader changed from 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193) to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 3 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.850852 20640 raft_consensus.cc:993] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf: : Instructing follower c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.851293 20554 raft_consensus.cc:1081] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Signalling peer c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.853011 20408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:41414
I20260709 13:09:21.853536 20408 raft_consensus.cc:493] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.853890 20408 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.858157 20408 raft_consensus.cc:515] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.859570 20408 leader_election.cc:290] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 3 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:21.860689 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:21.860746 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61286bda6a3a4fb59941bc9661d599b4" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:21.861336 20483 raft_consensus.cc:3055] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:21.861449 20332 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.861660 20483 raft_consensus.cc:740] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:21.862433 20483 consensus_queue.cc:260] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.863328 20483 raft_consensus.cc:3060] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.867729 20483 raft_consensus.cc:2468] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 3.
I20260709 13:09:21.868770 20373 leader_election.cc:304] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:21.869053 20332 raft_consensus.cc:2468] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 3.
I20260709 13:09:21.869472 20550 raft_consensus.cc:2804] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:21.869941 20550 raft_consensus.cc:697] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:21.870749 20550 consensus_queue.cc:237] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.877036 20231 catalog_manager.cc:5697] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 2 to 3, leader changed from 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195) to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 3 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.913704 20635 raft_consensus.cc:993] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027: : Instructing follower c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.914145 20562 raft_consensus.cc:1081] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Signalling peer c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.915460 20408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:41410
I20260709 13:09:21.915907 20408 raft_consensus.cc:493] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.916247 20408 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.920269 20408 raft_consensus.cc:515] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.921819 20408 leader_election.cc:290] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 3 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:21.922701 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:21.922821 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:21.923353 20483 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.923345 20332 raft_consensus.cc:3055] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:21.923928 20332 raft_consensus.cc:740] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:21.924754 20332 consensus_queue.cc:260] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.925951 20332 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.930521 20483 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 3.
I20260709 13:09:21.931846 20373 leader_election.cc:304] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:21.932493 20332 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 3.
I20260709 13:09:21.932662 20550 raft_consensus.cc:2804] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:21.933295 20550 raft_consensus.cc:697] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:21.934177 20550 consensus_queue.cc:237] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.941102 20231 catalog_manager.cc:5697] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 2 to 3, leader changed from 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193) to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 3 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.959546 20640 raft_consensus.cc:993] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf: : Instructing follower c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.960085 20554 raft_consensus.cc:1081] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Signalling peer c39a0b8166c94ec18a862a996ca7cabc to start an election
I20260709 13:09:21.961720 20408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
 from {username='slave'} at 127.0.0.1:41414
I20260709 13:09:21.962143 20408 raft_consensus.cc:493] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:21.962368 20408 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.966603 20408 raft_consensus.cc:515] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.968386 20408 leader_election.cc:290] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 3 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:21.969174 20332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:21.969537 20483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "c39a0b8166c94ec18a862a996ca7cabc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:21.969674 20332 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.970079 20483 raft_consensus.cc:3055] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:21.970352 20483 raft_consensus.cc:740] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:21.971007 20483 consensus_queue.cc:260] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.971869 20483 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.974455 20332 raft_consensus.cc:2468] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 3.
I20260709 13:09:21.975411 20375 leader_election.cc:304] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:21.976148 20550 raft_consensus.cc:2804] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:21.976552 20550 raft_consensus.cc:697] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Becoming Leader. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:21.977396 20550 consensus_queue.cc:237] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:21.977533 20483 raft_consensus.cc:2468] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39a0b8166c94ec18a862a996ca7cabc in term 3.
I20260709 13:09:21.983444 20231 catalog_manager.cc:5697] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc reported cstate change: term changed from 2 to 3, leader changed from 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195) to c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194). New cstate: current_term: 3 leader_uuid: "c39a0b8166c94ec18a862a996ca7cabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.066895 20483 raft_consensus.cc:1275] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.068091 20550 consensus_queue.cc:1048] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.077363 20332 raft_consensus.cc:1275] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.079312 20654 consensus_queue.cc:1048] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.130124 20483 raft_consensus.cc:1275] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:22.131268 20654 consensus_queue.cc:1048] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:22.139189 20332 raft_consensus.cc:1275] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:22.140828 20645 consensus_queue.cc:1048] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:22.270869 20483 raft_consensus.cc:1275] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:22.272054 20645 consensus_queue.cc:1048] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:22.280133 20332 raft_consensus.cc:1275] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:22.281507 20550 consensus_queue.cc:1048] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:22.502070 20483 raft_consensus.cc:1275] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:22.503417 20662 consensus_queue.cc:1048] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:22.508529 20332 raft_consensus.cc:1275] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:22.509915 20662 consensus_queue.cc:1048] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:22.521591 20334 raft_consensus.cc:1275] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:22.524314 20645 consensus_queue.cc:1048] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:22.529260 20483 raft_consensus.cc:1275] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Refusing update from remote peer c39a0b8166c94ec18a862a996ca7cabc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:22.531035 20654 consensus_queue.cc:1048] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.490671 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:24.498605 20408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
mode: GRACEFUL
new_leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:49484
I20260709 13:09:24.499486 20408 raft_consensus.cc:606] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Received request to transfer leadership to TS 86c10dcab93143cd9717e9e1d3d7e027
I20260709 13:09:24.502362 20408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
mode: GRACEFUL
new_leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:49484
I20260709 13:09:24.502868 20408 raft_consensus.cc:606] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Received request to transfer leadership to TS 86c10dcab93143cd9717e9e1d3d7e027
I20260709 13:09:24.505298 20408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62150089d1b746c49d450831b974c766"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
mode: GRACEFUL
new_leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:49484
I20260709 13:09:24.505738 20408 raft_consensus.cc:606] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Received request to transfer leadership to TS 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:24.507993 20408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
mode: GRACEFUL
new_leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:49484
I20260709 13:09:24.508430 20408 raft_consensus.cc:606] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Received request to transfer leadership to TS 86c10dcab93143cd9717e9e1d3d7e027
I20260709 13:09:24.510818 20408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78"
dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
mode: GRACEFUL
new_leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:49484
I20260709 13:09:24.511204 20408 raft_consensus.cc:606] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Received request to transfer leadership to TS 54eb901d3e9e4b6889bea6c4d962d6cf
I20260709 13:09:24.512283 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:24.512696 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:24.563045 20645 raft_consensus.cc:993] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc: : Instructing follower 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:24.563678 20654 raft_consensus.cc:1081] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Signalling peer 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:24.565397 20483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62150089d1b746c49d450831b974c766"
dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:54758
I20260709 13:09:24.565876 20483 raft_consensus.cc:493] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.566195 20483 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.571036 20483 raft_consensus.cc:515] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.572618 20483 leader_election.cc:290] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 3 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:24.573722 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62150089d1b746c49d450831b974c766" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:24.573834 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62150089d1b746c49d450831b974c766" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:24.574572 20334 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.574653 20408 raft_consensus.cc:3055] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:24.575050 20408 raft_consensus.cc:740] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:24.575690 20408 consensus_queue.cc:260] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.576746 20408 raft_consensus.cc:3060] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.579577 20334 raft_consensus.cc:2468] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 3.
I20260709 13:09:24.580811 20449 leader_election.cc:304] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027; no voters: 
I20260709 13:09:24.581224 20408 raft_consensus.cc:2468] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 3.
I20260709 13:09:24.581662 20669 raft_consensus.cc:2804] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:24.582755 20669 raft_consensus.cc:697] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 LEADER]: Becoming Leader. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:24.583699 20669 consensus_queue.cc:237] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.591140 20230 catalog_manager.cc:5697] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf reported cstate change: term changed from 2 to 3, leader changed from c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194) to 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195). New cstate: current_term: 3 leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.670732 20654 raft_consensus.cc:993] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc: : Instructing follower 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:24.671180 20645 raft_consensus.cc:1081] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Signalling peer 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:24.672664 20334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:45514
I20260709 13:09:24.673346 20334 raft_consensus.cc:493] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.673789 20334 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.679050 20654 raft_consensus.cc:993] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc: : Instructing follower 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:24.679607 20645 raft_consensus.cc:1081] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Signalling peer 54eb901d3e9e4b6889bea6c4d962d6cf to start an election
I20260709 13:09:24.679067 20334 raft_consensus.cc:515] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.681272 20483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78"
dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
 from {username='slave'} at 127.0.0.1:54758
I20260709 13:09:24.681597 20334 leader_election.cc:290] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 4 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:24.681770 20483 raft_consensus.cc:493] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.682137 20483 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.682735 20408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:24.683292 20408 raft_consensus.cc:3055] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:24.683598 20408 raft_consensus.cc:740] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:24.683825 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee6e2517301414cb216d1dffbae7f77" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:24.684425 20481 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.684455 20408 consensus_queue.cc:260] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.685750 20408 raft_consensus.cc:3060] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.689473 20654 raft_consensus.cc:993] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc: : Instructing follower 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:24.689911 20654 raft_consensus.cc:1081] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Signalling peer 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:24.689734 20483 raft_consensus.cc:515] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.691594 20483 leader_election.cc:290] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 3 election: Requested vote from peers 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721), c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189)
I20260709 13:09:24.691659 20332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:45514
I20260709 13:09:24.692289 20332 raft_consensus.cc:493] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.692646 20332 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.692982 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:24.693550 20406 raft_consensus.cc:3055] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:24.693843 20406 raft_consensus.cc:740] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:24.694657 20408 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 4.
I20260709 13:09:24.694630 20406 consensus_queue.cc:260] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.696178 20406 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.696360 20334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1063d92f77243c5a8d67a57251aaa78" candidate_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
I20260709 13:09:24.697029 20334 raft_consensus.cc:3060] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.691116 20481 raft_consensus.cc:2468] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 4.
I20260709 13:09:24.700489 20645 raft_consensus.cc:993] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc: : Instructing follower 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:24.700606 20300 leader_election.cc:304] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:24.701009 20645 raft_consensus.cc:1081] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Signalling peer 86c10dcab93143cd9717e9e1d3d7e027 to start an election
I20260709 13:09:24.700282 20332 raft_consensus.cc:515] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.703140 20332 leader_election.cc:290] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 3 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:24.703861 20334 raft_consensus.cc:2468] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 3.
I20260709 13:09:24.704147 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:24.704698 20481 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.705080 20449 leader_election.cc:304] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027; no voters: 
I20260709 13:09:24.705588 20406 raft_consensus.cc:2468] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54eb901d3e9e4b6889bea6c4d962d6cf in term 3.
I20260709 13:09:24.705787 20669 raft_consensus.cc:2804] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:24.706362 20669 raft_consensus.cc:697] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 LEADER]: Becoming Leader. State: Replica: 54eb901d3e9e4b6889bea6c4d962d6cf, State: Running, Role: LEADER
I20260709 13:09:24.707381 20669 consensus_queue.cc:237] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.708141 20677 raft_consensus.cc:2804] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:24.709497 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a4b56af3de4f298525e04fedae5bb5" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:24.710037 20406 raft_consensus.cc:3055] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:24.710362 20406 raft_consensus.cc:740] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:24.710654 20334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d"
dest_uuid: "86c10dcab93143cd9717e9e1d3d7e027"
 from {username='slave'} at 127.0.0.1:45514
I20260709 13:09:24.711361 20334 raft_consensus.cc:493] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:24.711263 20406 consensus_queue.cc:260] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.712884 20406 raft_consensus.cc:3060] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.711899 20334 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.722159 20406 raft_consensus.cc:2468] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 3.
I20260709 13:09:24.723500 20300 leader_election.cc:304] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c10dcab93143cd9717e9e1d3d7e027, c39a0b8166c94ec18a862a996ca7cabc; no voters: 
I20260709 13:09:24.727530 20230 catalog_manager.cc:5697] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf reported cstate change: term changed from 2 to 3, leader changed from c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194) to 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195). New cstate: current_term: 3 leader_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.719957 20481 raft_consensus.cc:2468] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 3.
I20260709 13:09:24.741463 20680 raft_consensus.cc:2804] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:24.741957 20680 raft_consensus.cc:697] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:24.742446 20677 raft_consensus.cc:697] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:24.742911 20680 consensus_queue.cc:237] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.743319 20334 raft_consensus.cc:515] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.743413 20677 consensus_queue.cc:237] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.746193 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c39a0b8166c94ec18a862a996ca7cabc"
I20260709 13:09:24.746853 20406 raft_consensus.cc:3055] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:24.747252 20406 raft_consensus.cc:740] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c39a0b8166c94ec18a862a996ca7cabc, State: Running, Role: LEADER
I20260709 13:09:24.747305 20481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35348fc7cc9243b7b6b4b5e08a32f36d" candidate_uuid: "86c10dcab93143cd9717e9e1d3d7e027" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf"
I20260709 13:09:24.748103 20481 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.748490 20406 consensus_queue.cc:260] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.749981 20406 raft_consensus.cc:3060] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.756136 20334 leader_election.cc:290] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 4 election: Requested vote from peers c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189), 54eb901d3e9e4b6889bea6c4d962d6cf (127.19.185.195:44555)
I20260709 13:09:24.758363 20481 raft_consensus.cc:2468] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 4.
I20260709 13:09:24.758800 20406 raft_consensus.cc:2468] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c10dcab93143cd9717e9e1d3d7e027 in term 4.
I20260709 13:09:24.760005 20298 leader_election.cc:304] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54eb901d3e9e4b6889bea6c4d962d6cf, 86c10dcab93143cd9717e9e1d3d7e027; no voters: 
I20260709 13:09:24.760121 20230 catalog_manager.cc:5697] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 3 to 4, leader changed from c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194) to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 4 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.761245 20680 raft_consensus.cc:2804] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:24.761879 20680 raft_consensus.cc:697] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 LEADER]: Becoming Leader. State: Replica: 86c10dcab93143cd9717e9e1d3d7e027, State: Running, Role: LEADER
I20260709 13:09:24.762862 20680 consensus_queue.cc:237] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } }
I20260709 13:09:24.773492 20230 catalog_manager.cc:5697] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 3 to 4, leader changed from c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194) to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 4 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.774873 20230 catalog_manager.cc:5697] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 reported cstate change: term changed from 2 to 3, leader changed from c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194) to 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193). New cstate: current_term: 3 leader_uuid: "86c10dcab93143cd9717e9e1d3d7e027" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.057087 20406 raft_consensus.cc:1275] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.058485 20669 consensus_queue.cc:1048] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.068279 20334 raft_consensus.cc:1275] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.069758 20670 consensus_queue.cc:1048] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:25.104640 20334 raft_consensus.cc:1275] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.105803 20670 consensus_queue.cc:1048] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c10dcab93143cd9717e9e1d3d7e027" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.114516 20406 raft_consensus.cc:1275] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Refusing update from remote peer 54eb901d3e9e4b6889bea6c4d962d6cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.116286 20669 consensus_queue.cc:1048] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.143826 20481 raft_consensus.cc:1275] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 4 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:25.145424 20680 consensus_queue.cc:1048] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:25.156162 20406 raft_consensus.cc:1275] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 4 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:25.157579 20678 consensus_queue.cc:1048] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:25.207864 20481 raft_consensus.cc:1275] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.209404 20677 consensus_queue.cc:1048] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:25.218266 20406 raft_consensus.cc:1275] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.219805 20678 consensus_queue.cc:1048] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.250514 20406 raft_consensus.cc:1275] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 4 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:25.251784 20678 consensus_queue.cc:1048] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39a0b8166c94ec18a862a996ca7cabc" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 46189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:25.260850 20481 raft_consensus.cc:1275] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 4 FOLLOWER]: Refusing update from remote peer 86c10dcab93143cd9717e9e1d3d7e027: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:25.263489 20677 consensus_queue.cc:1048] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54eb901d3e9e4b6889bea6c4d962d6cf" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 44555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:25.513582 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:25.519433 20199 tablet_server.cc:179] TabletServer@127.19.185.193:0 shutting down...
W20260709 13:09:25.524600 20449 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:25.528088 20449 consensus_peers.cc:597] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf -> Peer 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721): Couldn't send request to peer 86c10dcab93143cd9717e9e1d3d7e027. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.554329 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:25.555068 20375 consensus_peers.cc:597] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc -> Peer 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721): Couldn't send request to peer 86c10dcab93143cd9717e9e1d3d7e027. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.555191 20199 tablet_replica.cc:333] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.556301 20199 raft_consensus.cc:2243] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.557192 20199 raft_consensus.cc:2272] T 48a4b56af3de4f298525e04fedae5bb5 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.559769 20199 tablet_replica.cc:333] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.560320 20199 raft_consensus.cc:2243] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.560689 20199 raft_consensus.cc:2272] T 62150089d1b746c49d450831b974c766 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.562574 20199 tablet_replica.cc:333] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.563163 20199 raft_consensus.cc:2243] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.563858 20199 raft_consensus.cc:2272] T 6ee6e2517301414cb216d1dffbae7f77 P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.565641 20199 tablet_replica.cc:333] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.566131 20199 raft_consensus.cc:2243] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.566792 20199 raft_consensus.cc:2272] T 35348fc7cc9243b7b6b4b5e08a32f36d P 86c10dcab93143cd9717e9e1d3d7e027 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.568707 20199 tablet_replica.cc:333] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.569173 20199 raft_consensus.cc:2243] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.569640 20199 raft_consensus.cc:2272] T 1a23b6bf55644e07bfe843c7542681b0 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.571350 20199 tablet_replica.cc:333] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.571858 20199 raft_consensus.cc:2243] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.572376 20199 raft_consensus.cc:2272] T a1063d92f77243c5a8d67a57251aaa78 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.574474 20199 tablet_replica.cc:333] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.574944 20199 raft_consensus.cc:2243] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.575363 20199 raft_consensus.cc:2272] T 9fa97bf3df114fc982944c3bd3c8f379 P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.576907 20199 tablet_replica.cc:333] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.577355 20199 raft_consensus.cc:2243] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.577759 20199 raft_consensus.cc:2272] T e69471876aad4f46b1651f45a14b9bdd P 86c10dcab93143cd9717e9e1d3d7e027 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.579233 20199 tablet_replica.cc:333] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027: stopping tablet replica
I20260709 13:09:25.579661 20199 raft_consensus.cc:2243] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.580089 20199 raft_consensus.cc:2272] T 61286bda6a3a4fb59941bc9661d599b4 P 86c10dcab93143cd9717e9e1d3d7e027 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:25.593134 20375 consensus_peers.cc:597] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc -> Peer 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721): Couldn't send request to peer 86c10dcab93143cd9717e9e1d3d7e027. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.674455 20199 tablet_server.cc:196] TabletServer@127.19.185.193:0 shutdown complete.
W20260709 13:09:25.691596 20449 consensus_peers.cc:597] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf -> Peer 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721): Couldn't send request to peer 86c10dcab93143cd9717e9e1d3d7e027. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:39721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.697132 20199 tablet_server.cc:179] TabletServer@127.19.185.194:0 shutting down...
W20260709 13:09:25.719581 20375 consensus_peers.cc:597] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc -> Peer 86c10dcab93143cd9717e9e1d3d7e027 (127.19.185.193:39721): Couldn't send request to peer 86c10dcab93143cd9717e9e1d3d7e027. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:39721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.724911 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:25.725548 20199 tablet_replica.cc:333] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.726163 20199 raft_consensus.cc:2243] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.726581 20199 raft_consensus.cc:2272] T 62150089d1b746c49d450831b974c766 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.728703 20199 tablet_replica.cc:333] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.729229 20199 raft_consensus.cc:2243] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.729617 20199 raft_consensus.cc:2272] T 48a4b56af3de4f298525e04fedae5bb5 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.731622 20199 tablet_replica.cc:333] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.732179 20199 raft_consensus.cc:2243] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.732885 20199 raft_consensus.cc:2272] T 9fa97bf3df114fc982944c3bd3c8f379 P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.734375 20199 tablet_replica.cc:333] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.734841 20199 raft_consensus.cc:2243] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.735219 20199 raft_consensus.cc:2272] T 6ee6e2517301414cb216d1dffbae7f77 P c39a0b8166c94ec18a862a996ca7cabc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.737192 20199 tablet_replica.cc:333] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.737680 20199 raft_consensus.cc:2243] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.738054 20199 raft_consensus.cc:2272] T 35348fc7cc9243b7b6b4b5e08a32f36d P c39a0b8166c94ec18a862a996ca7cabc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.740446 20199 tablet_replica.cc:333] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.741148 20199 raft_consensus.cc:2243] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:25.741626 20449 consensus_peers.cc:597] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf -> Peer c39a0b8166c94ec18a862a996ca7cabc (127.19.185.194:46189): Couldn't send request to peer c39a0b8166c94ec18a862a996ca7cabc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.741714 20199 raft_consensus.cc:2272] T e69471876aad4f46b1651f45a14b9bdd P c39a0b8166c94ec18a862a996ca7cabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.744105 20199 tablet_replica.cc:333] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.744711 20199 raft_consensus.cc:2243] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.745093 20199 raft_consensus.cc:2272] T a1063d92f77243c5a8d67a57251aaa78 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.746860 20199 tablet_replica.cc:333] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.747327 20199 raft_consensus.cc:2243] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.748070 20199 raft_consensus.cc:2272] T 1a23b6bf55644e07bfe843c7542681b0 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.749658 20199 tablet_replica.cc:333] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc: stopping tablet replica
I20260709 13:09:25.750066 20199 raft_consensus.cc:2243] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.750778 20199 raft_consensus.cc:2272] T 61286bda6a3a4fb59941bc9661d599b4 P c39a0b8166c94ec18a862a996ca7cabc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.778333 20199 tablet_server.cc:196] TabletServer@127.19.185.194:0 shutdown complete.
I20260709 13:09:25.795297 20199 tablet_server.cc:179] TabletServer@127.19.185.195:0 shutting down...
I20260709 13:09:25.820979 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:25.821746 20199 tablet_replica.cc:333] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.822404 20199 raft_consensus.cc:2243] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.822921 20199 raft_consensus.cc:2272] T 9fa97bf3df114fc982944c3bd3c8f379 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.824815 20199 tablet_replica.cc:333] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.825322 20199 raft_consensus.cc:2243] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.826022 20199 raft_consensus.cc:2272] T e69471876aad4f46b1651f45a14b9bdd P 54eb901d3e9e4b6889bea6c4d962d6cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.827621 20199 tablet_replica.cc:333] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.828169 20199 raft_consensus.cc:2243] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.828899 20199 raft_consensus.cc:2272] T a1063d92f77243c5a8d67a57251aaa78 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.831033 20199 tablet_replica.cc:333] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.831511 20199 raft_consensus.cc:2243] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.831912 20199 raft_consensus.cc:2272] T 1a23b6bf55644e07bfe843c7542681b0 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.833447 20199 tablet_replica.cc:333] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.833982 20199 raft_consensus.cc:2243] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.834467 20199 raft_consensus.cc:2272] T 35348fc7cc9243b7b6b4b5e08a32f36d P 54eb901d3e9e4b6889bea6c4d962d6cf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.836867 20199 tablet_replica.cc:333] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.837323 20199 raft_consensus.cc:2243] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.837730 20199 raft_consensus.cc:2272] T 6ee6e2517301414cb216d1dffbae7f77 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.839635 20199 tablet_replica.cc:333] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.840137 20199 raft_consensus.cc:2243] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:25.840785 20199 raft_consensus.cc:2272] T 62150089d1b746c49d450831b974c766 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.842435 20199 tablet_replica.cc:333] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.842830 20199 raft_consensus.cc:2243] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.843173 20199 raft_consensus.cc:2272] T 48a4b56af3de4f298525e04fedae5bb5 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.845175 20199 tablet_replica.cc:333] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf: stopping tablet replica
I20260709 13:09:25.845559 20199 raft_consensus.cc:2243] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:25.845909 20199 raft_consensus.cc:2272] T 61286bda6a3a4fb59941bc9661d599b4 P 54eb901d3e9e4b6889bea6c4d962d6cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:25.900434 20199 tablet_server.cc:196] TabletServer@127.19.185.195:0 shutdown complete.
I20260709 13:09:25.917361 20199 master.cc:562] Master@127.19.185.254:36219 shutting down...
I20260709 13:09:26.115978 20199 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:26.116565 20199 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:26.116927 20199 tablet_replica.cc:333] T 00000000000000000000000000000000 P 271b47335bec4874926c9d7225094ddb: stopping tablet replica
I20260709 13:09:26.135547 20199 master.cc:584] Master@127.19.185.254:36219 shutdown complete.
54eb901d3e9e4b6889bea6c4d962d6cf  1
86c10dcab93143cd9717e9e1d3d7e027  4
c39a0b8166c94ec18a862a996ca7cabc  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13028 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:09:26.180413 20199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.185.254:33301
I20260709 13:09:26.181636 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:26.187237 20703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.188444 20704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.188989 20706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:26.189258 20199 server_base.cc:1061] running on GCE node
I20260709 13:09:26.190274 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:26.190464 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:26.190685 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602566190653 us; error 0 us; skew 500 ppm
I20260709 13:09:26.191252 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:26.193837 20199 webserver.cc:533] Webserver started at http://127.19.185.254:41173/ using document root <none> and password file <none>
I20260709 13:09:26.194381 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:26.194554 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:26.194928 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:26.196218 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/master-0-root/instance:
uuid: "6a6a179665f543809050667ae9a3d7ef"
format_stamp: "Formatted at 2026-07-09 13:09:26 on dist-test-slave-rrf3"
I20260709 13:09:26.201134 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:26.204720 20711 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.205624 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:09:26.205870 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/master-0-root
uuid: "6a6a179665f543809050667ae9a3d7ef"
format_stamp: "Formatted at 2026-07-09 13:09:26 on dist-test-slave-rrf3"
I20260709 13:09:26.206115 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:26.215770 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:26.217054 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:26.254963 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.254:33301
I20260709 13:09:26.255052 20762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.254:33301 every 8 connection(s)
I20260709 13:09:26.258886 20763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.267858 20763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef: Bootstrap starting.
I20260709 13:09:26.272408 20763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.276536 20763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef: No bootstrap required, opened a new log
I20260709 13:09:26.278564 20763 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6a179665f543809050667ae9a3d7ef" member_type: VOTER }
I20260709 13:09:26.278946 20763 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.279117 20763 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a6a179665f543809050667ae9a3d7ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.279671 20763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6a179665f543809050667ae9a3d7ef" member_type: VOTER }
I20260709 13:09:26.280133 20763 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:26.280326 20763 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:26.280536 20763 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.284346 20763 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6a179665f543809050667ae9a3d7ef" member_type: VOTER }
I20260709 13:09:26.284801 20763 leader_election.cc:304] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a6a179665f543809050667ae9a3d7ef; no voters: 
I20260709 13:09:26.285892 20763 leader_election.cc:290] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:26.286273 20766 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.287633 20766 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 1 LEADER]: Becoming Leader. State: Replica: 6a6a179665f543809050667ae9a3d7ef, State: Running, Role: LEADER
I20260709 13:09:26.288368 20766 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6a179665f543809050667ae9a3d7ef" member_type: VOTER }
I20260709 13:09:26.288829 20763 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:26.293048 20768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a6a179665f543809050667ae9a3d7ef. Latest consensus state: current_term: 1 leader_uuid: "6a6a179665f543809050667ae9a3d7ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6a179665f543809050667ae9a3d7ef" member_type: VOTER } }
I20260709 13:09:26.293687 20768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:26.293524 20767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a6a179665f543809050667ae9a3d7ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6a179665f543809050667ae9a3d7ef" member_type: VOTER } }
I20260709 13:09:26.294108 20767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:26.299294 20773 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:26.305626 20773 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:26.307026 20199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:26.315203 20773 catalog_manager.cc:1383] Generated new cluster ID: 6f25ba61b2364f3c8eef8f4a43213cd2
I20260709 13:09:26.315599 20773 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:26.334157 20773 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:26.335474 20773 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:26.360482 20773 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef: Generated new TSK 0
I20260709 13:09:26.361114 20773 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:26.374176 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:26.380402 20784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.381524 20785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.383002 20787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:26.383816 20199 server_base.cc:1061] running on GCE node
I20260709 13:09:26.384656 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:26.384867 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:26.385031 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602566385009 us; error 0 us; skew 500 ppm
I20260709 13:09:26.385530 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:26.387660 20199 webserver.cc:533] Webserver started at http://127.19.185.193:43973/ using document root <none> and password file <none>
I20260709 13:09:26.388197 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:26.388404 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:26.388661 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:26.389746 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-0-root/instance:
uuid: "6e0ad5535d514f248afc3efe32b123e0"
format_stamp: "Formatted at 2026-07-09 13:09:26 on dist-test-slave-rrf3"
I20260709 13:09:26.394079 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:26.397260 20792 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.397948 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:26.398244 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "6e0ad5535d514f248afc3efe32b123e0"
format_stamp: "Formatted at 2026-07-09 13:09:26 on dist-test-slave-rrf3"
I20260709 13:09:26.398494 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:26.412672 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:26.413924 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:26.415342 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:26.417614 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:26.417848 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.418079 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:26.418257 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.457746 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:37635
I20260709 13:09:26.457839 20854 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:37635 every 8 connection(s)
I20260709 13:09:26.462550 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:26.469363 20859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.470239 20860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.473690 20863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:26.474596 20199 server_base.cc:1061] running on GCE node
I20260709 13:09:26.475517 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:26.475716 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:26.475895 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602566475877 us; error 0 us; skew 500 ppm
I20260709 13:09:26.476433 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:26.478634 20199 webserver.cc:533] Webserver started at http://127.19.185.194:44715/ using document root <none> and password file <none>
I20260709 13:09:26.479135 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:26.479323 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:26.479604 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:26.480746 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-1-root/instance:
uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
format_stamp: "Formatted at 2026-07-09 13:09:26 on dist-test-slave-rrf3"
I20260709 13:09:26.485302 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:26.487879 20855 heartbeater.cc:344] Connected to a master server at 127.19.185.254:33301
I20260709 13:09:26.488263 20855 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:26.489172 20855 heartbeater.cc:507] Master 127.19.185.254:33301 requested a full tablet report, sending...
I20260709 13:09:26.489236 20867 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.490176 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:26.490536 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-1-root
uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
format_stamp: "Formatted at 2026-07-09 13:09:26 on dist-test-slave-rrf3"
I20260709 13:09:26.490872 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:26.491923 20728 ts_manager.cc:194] Registered new tserver with Master: 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635)
I20260709 13:09:26.494441 20728 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43238
I20260709 13:09:26.517287 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:26.518982 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:26.520829 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:26.523134 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:26.523365 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.523644 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:26.523828 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.562671 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.194:42357
I20260709 13:09:26.562760 20929 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.194:42357 every 8 connection(s)
I20260709 13:09:26.567457 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:26.574988 20934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.575379 20933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:26.577832 20199 server_base.cc:1061] running on GCE node
W20260709 13:09:26.578545 20936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:26.579092 20930 heartbeater.cc:344] Connected to a master server at 127.19.185.254:33301
I20260709 13:09:26.579439 20930 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:26.579586 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:26.579838 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:26.580019 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602566580002 us; error 0 us; skew 500 ppm
I20260709 13:09:26.580214 20930 heartbeater.cc:507] Master 127.19.185.254:33301 requested a full tablet report, sending...
I20260709 13:09:26.580663 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:26.582408 20728 ts_manager.cc:194] Registered new tserver with Master: 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:26.583397 20199 webserver.cc:533] Webserver started at http://127.19.185.195:42897/ using document root <none> and password file <none>
I20260709 13:09:26.584010 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:26.584273 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:26.584214 20728 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43246
I20260709 13:09:26.584683 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:26.586127 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-2-root/instance:
uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
format_stamp: "Formatted at 2026-07-09 13:09:26 on dist-test-slave-rrf3"
I20260709 13:09:26.590515 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:09:26.593516 20941 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.594329 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:26.594633 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-2-root
uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
format_stamp: "Formatted at 2026-07-09 13:09:26 on dist-test-slave-rrf3"
I20260709 13:09:26.594905 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602552983791-20199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:26.613729 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:26.614912 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:26.616397 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:26.618477 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:26.618675 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.618940 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:26.619100 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.658308 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.195:37265
I20260709 13:09:26.658394 21003 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.195:37265 every 8 connection(s)
I20260709 13:09:26.672214 21004 heartbeater.cc:344] Connected to a master server at 127.19.185.254:33301
I20260709 13:09:26.672559 21004 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:26.673354 21004 heartbeater.cc:507] Master 127.19.185.254:33301 requested a full tablet report, sending...
I20260709 13:09:26.675400 20728 ts_manager.cc:194] Registered new tserver with Master: c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:26.675884 20199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014393901s
I20260709 13:09:26.676770 20728 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43254
I20260709 13:09:26.702634 20728 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43266:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:26.705811 20728 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:26.778331 20819 tablet_service.cc:1511] Processing CreateTablet for tablet f21a7565bbd1425c9b8d1a4f2f93ca4d (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:26.778555 20820 tablet_service.cc:1511] Processing CreateTablet for tablet d97fe48e860b4d1fbe6ddcb1a977fc23 (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:26.780059 20819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21a7565bbd1425c9b8d1a4f2f93ca4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.780782 20820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97fe48e860b4d1fbe6ddcb1a977fc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.780725 20967 tablet_service.cc:1511] Processing CreateTablet for tablet 71100d86e7cb445988f6eacd1b8da6fc (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:26.781291 20968 tablet_service.cc:1511] Processing CreateTablet for tablet f21a7565bbd1425c9b8d1a4f2f93ca4d (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:26.781590 20818 tablet_service.cc:1511] Processing CreateTablet for tablet 71100d86e7cb445988f6eacd1b8da6fc (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:26.782485 20967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71100d86e7cb445988f6eacd1b8da6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.782866 20818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71100d86e7cb445988f6eacd1b8da6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.783272 20969 tablet_service.cc:1511] Processing CreateTablet for tablet d97fe48e860b4d1fbe6ddcb1a977fc23 (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:26.784533 20969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97fe48e860b4d1fbe6ddcb1a977fc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.787865 20895 tablet_service.cc:1511] Processing CreateTablet for tablet d97fe48e860b4d1fbe6ddcb1a977fc23 (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:26.788412 20968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21a7565bbd1425c9b8d1a4f2f93ca4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.789301 20895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97fe48e860b4d1fbe6ddcb1a977fc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.791213 20894 tablet_service.cc:1511] Processing CreateTablet for tablet f21a7565bbd1425c9b8d1a4f2f93ca4d (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:26.792609 20894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21a7565bbd1425c9b8d1a4f2f93ca4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.796953 20893 tablet_service.cc:1511] Processing CreateTablet for tablet 71100d86e7cb445988f6eacd1b8da6fc (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:26.798331 20893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71100d86e7cb445988f6eacd1b8da6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.815893 20817 tablet_service.cc:1511] Processing CreateTablet for tablet d9285fe1151f4766babfe7d4ff1251ee (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:26.817289 20817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9285fe1151f4766babfe7d4ff1251ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.817866 20892 tablet_service.cc:1511] Processing CreateTablet for tablet d9285fe1151f4766babfe7d4ff1251ee (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:26.819561 20892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9285fe1151f4766babfe7d4ff1251ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.822669 20891 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa875727b446e5b59cb2a893617c51 (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:26.823153 20816 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa875727b446e5b59cb2a893617c51 (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:26.824509 20816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa875727b446e5b59cb2a893617c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.825583 20966 tablet_service.cc:1511] Processing CreateTablet for tablet d9285fe1151f4766babfe7d4ff1251ee (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:26.827265 20966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9285fe1151f4766babfe7d4ff1251ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.830128 20965 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa875727b446e5b59cb2a893617c51 (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:26.828429 20891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa875727b446e5b59cb2a893617c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.831813 20965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa875727b446e5b59cb2a893617c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.856423 20817 tablet_service.cc:1511] Processing CreateTablet for tablet b0e0edc648b54bd28ee12629001811ee (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:26.858279 20817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e0edc648b54bd28ee12629001811ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.870332 20890 tablet_service.cc:1511] Processing CreateTablet for tablet b0e0edc648b54bd28ee12629001811ee (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:26.871747 20890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e0edc648b54bd28ee12629001811ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.872725 20969 tablet_service.cc:1511] Processing CreateTablet for tablet b0e0edc648b54bd28ee12629001811ee (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:26.874008 20969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e0edc648b54bd28ee12629001811ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.877063 20819 tablet_service.cc:1511] Processing CreateTablet for tablet c604cad1f4894c798a8448addc5c20ba (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:26.878381 20819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c604cad1f4894c798a8448addc5c20ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.884819 21020 tablet_bootstrap.cc:492] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:26.899111 21019 tablet_bootstrap.cc:492] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:26.938668 21020 tablet_bootstrap.cc:654] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.943210 20891 tablet_service.cc:1511] Processing CreateTablet for tablet c604cad1f4894c798a8448addc5c20ba (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:26.944589 20891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c604cad1f4894c798a8448addc5c20ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.944640 20968 tablet_service.cc:1511] Processing CreateTablet for tablet c604cad1f4894c798a8448addc5c20ba (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:26.948277 20968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c604cad1f4894c798a8448addc5c20ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.947362 21021 tablet_bootstrap.cc:492] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:26.962167 20893 tablet_service.cc:1511] Processing CreateTablet for tablet c7bef223621e49a3bd38050cdc8dcdfe (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:26.963464 20893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bef223621e49a3bd38050cdc8dcdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.963336 20967 tablet_service.cc:1511] Processing CreateTablet for tablet c7bef223621e49a3bd38050cdc8dcdfe (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:26.964655 20967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bef223621e49a3bd38050cdc8dcdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.951826 20817 tablet_service.cc:1511] Processing CreateTablet for tablet c7bef223621e49a3bd38050cdc8dcdfe (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:26.954104 21020 tablet_bootstrap.cc:492] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:26.968497 21020 ts_tablet_manager.cc:1403] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.000s
I20260709 13:09:26.968775 20817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bef223621e49a3bd38050cdc8dcdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.968425 20819 tablet_service.cc:1511] Processing CreateTablet for tablet 660f3f79224a4c4aa0fec7a1150e9daf (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:26.970755 20819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660f3f79224a4c4aa0fec7a1150e9daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.970851 20965 tablet_service.cc:1511] Processing CreateTablet for tablet 660f3f79224a4c4aa0fec7a1150e9daf (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:26.971490 21020 raft_consensus.cc:359] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:26.972113 20965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660f3f79224a4c4aa0fec7a1150e9daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.972316 21020 raft_consensus.cc:385] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.946297 21019 tablet_bootstrap.cc:654] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.972664 21020 raft_consensus.cc:740] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.974084 21020 consensus_queue.cc:260] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:26.977245 21021 tablet_bootstrap.cc:654] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.976334 20890 tablet_service.cc:1511] Processing CreateTablet for tablet 660f3f79224a4c4aa0fec7a1150e9daf (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:26.983923 20891 tablet_service.cc:1511] Processing CreateTablet for tablet b70e5a7bc2d54638a1cc7028f78451da (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:26.990720 20816 tablet_service.cc:1511] Processing CreateTablet for tablet b70e5a7bc2d54638a1cc7028f78451da (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:26.991783 20969 tablet_service.cc:1511] Processing CreateTablet for tablet b70e5a7bc2d54638a1cc7028f78451da (DEFAULT_TABLE table=test-workload [id=a65654dd095149beb3f444d824d5b2a8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:26.997330 20890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660f3f79224a4c4aa0fec7a1150e9daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:27.003423 20891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70e5a7bc2d54638a1cc7028f78451da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:27.005059 20816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70e5a7bc2d54638a1cc7028f78451da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:27.007745 20969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70e5a7bc2d54638a1cc7028f78451da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:27.008771 21021 tablet_bootstrap.cc:492] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.013130 21020 ts_tablet_manager.cc:1434] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:09:27.020534 21021 ts_tablet_manager.cc:1403] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.005s
I20260709 13:09:27.021039 21020 tablet_bootstrap.cc:492] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.014144 21004 heartbeater.cc:499] Master 127.19.185.254:33301 was elected leader, sending a full tablet report...
I20260709 13:09:27.017030 21019 tablet_bootstrap.cc:492] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.023703 21021 raft_consensus.cc:359] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.024464 21019 ts_tablet_manager.cc:1403] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.000s
I20260709 13:09:27.024657 21021 raft_consensus.cc:385] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.025085 21021 raft_consensus.cc:740] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.026100 21021 consensus_queue.cc:260] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.031540 21020 tablet_bootstrap.cc:654] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.027474 21019 raft_consensus.cc:359] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.038719 21019 raft_consensus.cc:385] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.039168 21019 raft_consensus.cc:740] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.041850 21019 consensus_queue.cc:260] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.050429 21021 ts_tablet_manager.cc:1434] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 13:09:27.050966 20930 heartbeater.cc:499] Master 127.19.185.254:33301 was elected leader, sending a full tablet report...
I20260709 13:09:27.051713 21021 tablet_bootstrap.cc:492] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.058765 21021 tablet_bootstrap.cc:654] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.074223 21023 raft_consensus.cc:493] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.074980 21023 raft_consensus.cc:515] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.077554 20855 heartbeater.cc:499] Master 127.19.185.254:33301 was elected leader, sending a full tablet report...
I20260709 13:09:27.077910 21019 ts_tablet_manager.cc:1434] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.053s	user 0.019s	sys 0.018s
I20260709 13:09:27.078950 21019 tablet_bootstrap.cc:492] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.085692 21019 tablet_bootstrap.cc:654] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.091673 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
W20260709 13:09:27.094544 20942 leader_election.cc:343] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.099722 21023 leader_election.cc:290] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.106827 21021 tablet_bootstrap.cc:492] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.107527 21021 ts_tablet_manager.cc:1403] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.056s	user 0.030s	sys 0.023s
I20260709 13:09:27.110519 21021 raft_consensus.cc:359] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.111372 21021 raft_consensus.cc:385] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.111747 21021 raft_consensus.cc:740] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.112717 21021 consensus_queue.cc:260] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.113659 21020 tablet_bootstrap.cc:492] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.114301 21020 ts_tablet_manager.cc:1403] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.022s
I20260709 13:09:27.115386 21021 ts_tablet_manager.cc:1434] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:09:27.116382 21021 tablet_bootstrap.cc:492] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.118028 21020 raft_consensus.cc:359] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.119009 21020 raft_consensus.cc:385] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.119402 21020 raft_consensus.cc:740] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.123384 21021 tablet_bootstrap.cc:654] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.123701 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" is_pre_election: true
I20260709 13:09:27.123925 21020 consensus_queue.cc:260] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.124467 20905 raft_consensus.cc:2468] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 0.
I20260709 13:09:27.125873 20944 leader_election.cc:304] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:27.127146 21023 raft_consensus.cc:2804] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.127523 21023 raft_consensus.cc:493] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.127864 21023 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.130775 21020 ts_tablet_manager.cc:1434] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:09:27.131444 21019 tablet_bootstrap.cc:492] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.131743 21020 tablet_bootstrap.cc:492] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.132099 21019 ts_tablet_manager.cc:1403] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.033s
I20260709 13:09:27.134332 21023 raft_consensus.cc:515] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.135239 21019 raft_consensus.cc:359] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.136062 21019 raft_consensus.cc:385] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.136377 21019 raft_consensus.cc:740] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.137125 21019 consensus_queue.cc:260] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.137727 21021 tablet_bootstrap.cc:492] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.138319 21021 ts_tablet_manager.cc:1403] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.022s	user 0.000s	sys 0.014s
I20260709 13:09:27.138582 21020 tablet_bootstrap.cc:654] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.138633 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:27.139372 20830 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.139492 21019 ts_tablet_manager.cc:1434] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:27.140570 21019 tablet_bootstrap.cc:492] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.141660 21021 raft_consensus.cc:359] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.142436 21021 raft_consensus.cc:385] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.142793 21021 raft_consensus.cc:740] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.143652 21021 consensus_queue.cc:260] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.146237 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:27.146811 20905 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.149137 21021 ts_tablet_manager.cc:1434] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:27.149179 21019 tablet_bootstrap.cc:654] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.150559 21021 tablet_bootstrap.cc:492] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.154930 20905 raft_consensus.cc:2468] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 1.
I20260709 13:09:27.156236 20944 leader_election.cc:304] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:27.157004 21021 tablet_bootstrap.cc:654] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.158511 21020 tablet_bootstrap.cc:492] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.159082 21020 ts_tablet_manager.cc:1403] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.006s
I20260709 13:09:27.160933 21019 tablet_bootstrap.cc:492] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.161449 21019 ts_tablet_manager.cc:1403] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.010s
I20260709 13:09:27.161341 20830 raft_consensus.cc:2468] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 1.
I20260709 13:09:27.162545 21020 raft_consensus.cc:359] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.163378 21020 raft_consensus.cc:385] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.163662 21023 leader_election.cc:290] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.163731 21020 raft_consensus.cc:740] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.164568 21023 raft_consensus.cc:2804] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.165169 21023 raft_consensus.cc:697] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Becoming Leader. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:27.164999 21020 consensus_queue.cc:260] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.166074 21019 raft_consensus.cc:359] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.166254 21023 consensus_queue.cc:237] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.167128 21019 raft_consensus.cc:385] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.167649 21019 raft_consensus.cc:740] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.169080 21019 consensus_queue.cc:260] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.173008 21019 ts_tablet_manager.cc:1434] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:09:27.174505 21019 tablet_bootstrap.cc:492] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.178170 21028 raft_consensus.cc:493] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.178718 21028 raft_consensus.cc:515] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.191792 21028 leader_election.cc:290] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.178175 21020 ts_tablet_manager.cc:1434] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.008s
I20260709 13:09:27.193506 21020 tablet_bootstrap.cc:492] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.203002 21020 tablet_bootstrap.cc:654] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.209836 21019 tablet_bootstrap.cc:654] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.213136 20728 catalog_manager.cc:5697] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.215083 21021 tablet_bootstrap.cc:492] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.215626 21021 ts_tablet_manager.cc:1403] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.065s	user 0.039s	sys 0.013s
I20260709 13:09:27.218762 21020 tablet_bootstrap.cc:492] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.218602 21021 raft_consensus.cc:359] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.219378 21020 ts_tablet_manager.cc:1403] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 13:09:27.219617 21021 raft_consensus.cc:385] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.220070 21021 raft_consensus.cc:740] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.220929 21021 consensus_queue.cc:260] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.222820 21020 raft_consensus.cc:359] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.223686 21020 raft_consensus.cc:385] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.224076 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" is_pre_election: true
I20260709 13:09:27.225591 21021 ts_tablet_manager.cc:1434] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 13:09:27.225834 20795 leader_election.cc:343] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.224056 21020 raft_consensus.cc:740] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.227684 21020 consensus_queue.cc:260] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.230283 21020 ts_tablet_manager.cc:1434] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:09:27.230839 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" is_pre_election: true
I20260709 13:09:27.231401 21020 tablet_bootstrap.cc:492] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.231607 20979 raft_consensus.cc:2468] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 0.
I20260709 13:09:27.232059 21019 tablet_bootstrap.cc:492] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.232664 21019 ts_tablet_manager.cc:1403] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.002s
I20260709 13:09:27.233412 20793 leader_election.cc:304] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 6fdd76f2a5e0443ea62b3e41b7fd9301
I20260709 13:09:27.234745 21028 raft_consensus.cc:2804] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.235139 21028 raft_consensus.cc:493] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.235530 21028 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.238075 21021 tablet_bootstrap.cc:492] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.239619 21020 tablet_bootstrap.cc:654] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.240226 21019 raft_consensus.cc:359] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.243422 21019 raft_consensus.cc:385] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.243782 21019 raft_consensus.cc:740] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.244671 21021 tablet_bootstrap.cc:654] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.244601 21019 consensus_queue.cc:260] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.250731 21028 raft_consensus.cc:515] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.251982 21020 tablet_bootstrap.cc:492] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.252552 21020 ts_tablet_manager.cc:1403] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:09:27.255738 21020 raft_consensus.cc:359] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.256727 21020 raft_consensus.cc:385] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.257071 21020 raft_consensus.cc:740] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.257862 21020 consensus_queue.cc:260] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.259732 21028 leader_election.cc:290] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 1 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.260612 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:27.261247 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:27.261986 20979 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:27.262184 20795 leader_election.cc:343] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.267625 21020 ts_tablet_manager.cc:1434] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:09:27.268816 21020 tablet_bootstrap.cc:492] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.272898 21023 raft_consensus.cc:493] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.273756 21021 tablet_bootstrap.cc:492] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.273377 21023 raft_consensus.cc:515] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.274209 21021 ts_tablet_manager.cc:1403] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.009s
I20260709 13:09:27.275614 21023 leader_election.cc:290] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.276475 21020 tablet_bootstrap.cc:654] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.277153 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.278277 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" is_pre_election: true
W20260709 13:09:27.278508 20942 leader_election.cc:343] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.271836 20979 raft_consensus.cc:2468] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 1.
I20260709 13:09:27.278923 20905 raft_consensus.cc:2468] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 0.
I20260709 13:09:27.280161 20944 leader_election.cc:304] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:27.280412 21021 raft_consensus.cc:359] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.281100 21021 raft_consensus.cc:385] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.281406 21021 raft_consensus.cc:740] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.281693 21034 raft_consensus.cc:2804] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.282047 21034 raft_consensus.cc:493] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.282404 21034 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.282135 21021 consensus_queue.cc:260] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.284348 20793 leader_election.cc:304] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 6fdd76f2a5e0443ea62b3e41b7fd9301
I20260709 13:09:27.285970 21021 ts_tablet_manager.cc:1434] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:27.287369 21021 tablet_bootstrap.cc:492] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.279443 21023 raft_consensus.cc:493] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.288558 21023 raft_consensus.cc:515] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.293572 21034 raft_consensus.cc:515] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.295538 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97fe48e860b4d1fbe6ddcb1a977fc23" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.296739 20830 raft_consensus.cc:2468] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 0.
I20260709 13:09:27.297890 20942 leader_election.cc:304] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:27.298326 21034 leader_election.cc:290] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.298997 21023 leader_election.cc:290] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.299100 21034 raft_consensus.cc:2804] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.295922 21021 tablet_bootstrap.cc:654] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.299579 21034 raft_consensus.cc:493] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.299731 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
W20260709 13:09:27.301096 20776 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:27.301342 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97fe48e860b4d1fbe6ddcb1a977fc23" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" is_pre_election: true
W20260709 13:09:27.303249 20942 leader_election.cc:343] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.303825 20905 raft_consensus.cc:2468] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 0.
I20260709 13:09:27.301791 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:27.305658 20904 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.306864 21021 tablet_bootstrap.cc:492] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.307286 21021 ts_tablet_manager.cc:1403] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 13:09:27.309556 21021 raft_consensus.cc:359] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.310098 21021 raft_consensus.cc:385] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.310359 21021 raft_consensus.cc:740] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.311003 21021 consensus_queue.cc:260] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.300369 21043 raft_consensus.cc:2804] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.313117 21021 ts_tablet_manager.cc:1434] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:27.313835 21043 raft_consensus.cc:697] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:27.314138 21021 tablet_bootstrap.cc:492] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.315104 21043 consensus_queue.cc:237] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.302419 21019 ts_tablet_manager.cc:1434] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.025s
I20260709 13:09:27.321044 21021 tablet_bootstrap.cc:654] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.322126 21019 tablet_bootstrap.cc:492] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.300001 21034 raft_consensus.cc:3060] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.330423 21021 tablet_bootstrap.cc:492] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.330862 21021 ts_tablet_manager.cc:1403] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:09:27.333367 21021 raft_consensus.cc:359] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.327796 20904 raft_consensus.cc:2468] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 1.
I20260709 13:09:27.334097 21021 raft_consensus.cc:385] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.334476 21021 raft_consensus.cc:740] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.335350 21021 consensus_queue.cc:260] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.336570 20944 leader_election.cc:304] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:27.337775 21023 raft_consensus.cc:2804] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.338269 21023 raft_consensus.cc:697] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Becoming Leader. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:27.339143 21023 consensus_queue.cc:237] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.339963 21034 raft_consensus.cc:515] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.340425 21019 tablet_bootstrap.cc:654] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.341120 21020 tablet_bootstrap.cc:492] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.341658 21020 ts_tablet_manager.cc:1403] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.045s
I20260709 13:09:27.345645 21020 raft_consensus.cc:359] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.346762 21020 raft_consensus.cc:385] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.347198 21020 raft_consensus.cc:740] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.349737 21020 consensus_queue.cc:260] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.354637 21021 ts_tablet_manager.cc:1434] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:27.355628 21020 ts_tablet_manager.cc:1434] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:09:27.355700 21021 tablet_bootstrap.cc:492] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.356971 21020 tablet_bootstrap.cc:492] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.357688 20726 catalog_manager.cc:5697] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.359302 20725 catalog_manager.cc:5697] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.362049 21019 tablet_bootstrap.cc:492] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.362653 21019 ts_tablet_manager.cc:1403] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.002s
I20260709 13:09:27.362751 21021 tablet_bootstrap.cc:654] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.365976 21034 leader_election.cc:290] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.368309 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97fe48e860b4d1fbe6ddcb1a977fc23" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:27.368496 21019 raft_consensus.cc:359] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.368995 20830 raft_consensus.cc:3060] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.369210 21019 raft_consensus.cc:385] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.369534 21019 raft_consensus.cc:740] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.370287 21019 consensus_queue.cc:260] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.371845 21020 tablet_bootstrap.cc:654] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.372277 21026 raft_consensus.cc:493] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.372969 21019 ts_tablet_manager.cc:1434] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:09:27.372778 21026 raft_consensus.cc:515] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.373994 21019 tablet_bootstrap.cc:492] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.377887 21026 leader_election.cc:290] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.384258 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97fe48e860b4d1fbe6ddcb1a977fc23" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:27.384894 20904 raft_consensus.cc:3060] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.391573 20904 raft_consensus.cc:2468] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 1.
I20260709 13:09:27.393059 20830 raft_consensus.cc:2468] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 1.
I20260709 13:09:27.396189 20944 leader_election.cc:304] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:27.397151 21034 raft_consensus.cc:2804] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.397689 21034 raft_consensus.cc:697] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Becoming Leader. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:27.398563 21034 consensus_queue.cc:237] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:27.410643 21019 tablet_bootstrap.cc:654] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.419643 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.420377 20830 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.420991 20728 catalog_manager.cc:5697] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.421816 20868 leader_election.cc:304] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:27.422603 21026 raft_consensus.cc:2804] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.422979 21026 raft_consensus.cc:493] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.423303 21026 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.430296 21020 tablet_bootstrap.cc:492] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.430856 21020 ts_tablet_manager.cc:1403] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.004s
I20260709 13:09:27.430553 21026 raft_consensus.cc:515] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.416872 21021 tablet_bootstrap.cc:492] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.433271 21021 ts_tablet_manager.cc:1403] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.078s	user 0.034s	sys 0.011s
I20260709 13:09:27.433262 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" is_pre_election: true
I20260709 13:09:27.433971 20979 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.435885 21021 raft_consensus.cc:359] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.435770 21020 raft_consensus.cc:359] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.436601 21020 raft_consensus.cc:385] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.436980 21020 raft_consensus.cc:740] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.437618 21026 leader_election.cc:290] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.437752 21020 consensus_queue.cc:260] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.438441 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:27.439028 20830 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.439755 21019 tablet_bootstrap.cc:492] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.440003 21020 ts_tablet_manager.cc:1434] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:27.440244 21019 ts_tablet_manager.cc:1403] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.015s
I20260709 13:09:27.441046 21020 tablet_bootstrap.cc:492] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.444478 21019 raft_consensus.cc:359] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.445247 21019 raft_consensus.cc:385] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.445572 21019 raft_consensus.cc:740] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.446473 20830 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.446571 21019 consensus_queue.cc:260] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.447862 21020 tablet_bootstrap.cc:654] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.448132 20868 leader_election.cc:304] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:27.448943 21026 raft_consensus.cc:2804] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.448125 21021 raft_consensus.cc:385] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.450970 21021 raft_consensus.cc:740] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.451646 21021 consensus_queue.cc:260] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.453419 21019 ts_tablet_manager.cc:1434] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:09:27.454898 21019 tablet_bootstrap.cc:492] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.450485 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:27.455618 20979 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.460588 21026 raft_consensus.cc:697] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Leader. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:27.461560 21026 consensus_queue.cc:237] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.464731 21019 tablet_bootstrap.cc:654] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.483392 20979 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.491487 21021 ts_tablet_manager.cc:1434] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.058s	user 0.020s	sys 0.002s
I20260709 13:09:27.492522 21021 tablet_bootstrap.cc:492] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.492954 21020 tablet_bootstrap.cc:492] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.493513 21020 ts_tablet_manager.cc:1403] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.017s
I20260709 13:09:27.494318 21019 tablet_bootstrap.cc:492] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.494493 21026 raft_consensus.cc:493] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.494839 21019 ts_tablet_manager.cc:1403] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.017s
I20260709 13:09:27.495846 21059 raft_consensus.cc:493] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.494776 20728 catalog_manager.cc:5697] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.497010 21059 raft_consensus.cc:515] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.498010 21021 tablet_bootstrap.cc:654] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.498413 21019 raft_consensus.cc:359] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.499153 21019 raft_consensus.cc:385] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.499424 21019 raft_consensus.cc:740] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.500063 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.500660 20830 raft_consensus.cc:2468] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.500294 21019 consensus_queue.cc:260] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.503368 21019 ts_tablet_manager.cc:1434] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:09:27.504669 21019 tablet_bootstrap.cc:492] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.506587 20868 leader_election.cc:304] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:27.507436 21057 raft_consensus.cc:2804] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.507822 21057 raft_consensus.cc:493] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.508159 21057 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.496373 21026 raft_consensus.cc:515] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.510540 21026 leader_election.cc:290] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.512588 21019 tablet_bootstrap.cc:654] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.513526 21021 tablet_bootstrap.cc:492] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.513958 21021 ts_tablet_manager.cc:1403] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:09:27.514420 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" is_pre_election: true
I20260709 13:09:27.516578 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.517171 20830 raft_consensus.cc:2468] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.517035 21021 raft_consensus.cc:359] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.517989 21021 raft_consensus.cc:385] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.518350 21021 raft_consensus.cc:740] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.519322 21021 consensus_queue.cc:260] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.521345 20868 leader_election.cc:304] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:27.522044 21021 ts_tablet_manager.cc:1434] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 13:09:27.522243 20868 leader_election.cc:343] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.523165 21026 raft_consensus.cc:2804] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.523242 21021 tablet_bootstrap.cc:492] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301: Bootstrap starting.
I20260709 13:09:27.523622 21026 raft_consensus.cc:493] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.523981 21026 raft_consensus.cc:3060] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.526665 21057 raft_consensus.cc:515] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.529569 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" is_pre_election: true
I20260709 13:09:27.530213 20979 raft_consensus.cc:2468] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.531381 21021 tablet_bootstrap.cc:654] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.531567 21059 leader_election.cc:290] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.533901 21020 raft_consensus.cc:359] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.534585 21020 raft_consensus.cc:385] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.534842 21020 raft_consensus.cc:740] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.536710 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:27.537298 20830 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.544421 21021 tablet_bootstrap.cc:492] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301: No bootstrap required, opened a new log
I20260709 13:09:27.545176 21021 ts_tablet_manager.cc:1403] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 13:09:27.545130 21026 raft_consensus.cc:515] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.545636 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:27.547386 20979 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.548621 21026 leader_election.cc:290] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.548902 21021 raft_consensus.cc:359] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.549794 21021 raft_consensus.cc:385] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.550118 21021 raft_consensus.cc:740] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.551025 21021 consensus_queue.cc:260] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.553277 20830 raft_consensus.cc:2468] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.554828 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:27.555437 20868 leader_election.cc:304] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:27.556324 21026 raft_consensus.cc:2804] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.546877 21057 leader_election.cc:290] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.553457 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:27.557058 20829 raft_consensus.cc:3060] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:27.557111 20868 leader_election.cc:343] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.553666 21021 ts_tablet_manager.cc:1434] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:27.552328 20979 raft_consensus.cc:2468] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.563966 20829 raft_consensus.cc:2468] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.564322 21026 raft_consensus.cc:697] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Leader. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:27.565212 20868 leader_election.cc:304] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: c2c7409ba50b4f7f8d646a48b24106cb
I20260709 13:09:27.567082 21057 raft_consensus.cc:2804] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.567811 21057 raft_consensus.cc:697] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Leader. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:27.567188 21026 consensus_queue.cc:237] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.568643 21057 consensus_queue.cc:237] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.565382 21020 consensus_queue.cc:260] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.572551 21020 ts_tablet_manager.cc:1434] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.079s	user 0.003s	sys 0.003s
I20260709 13:09:27.573428 21020 tablet_bootstrap.cc:492] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.575168 21019 tablet_bootstrap.cc:492] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.575904 21019 ts_tablet_manager.cc:1403] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.053s
I20260709 13:09:27.579572 21019 raft_consensus.cc:359] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.580736 21019 raft_consensus.cc:385] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.581130 21020 tablet_bootstrap.cc:654] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.581177 21019 raft_consensus.cc:740] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.582468 21019 consensus_queue.cc:260] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.585907 21019 ts_tablet_manager.cc:1434] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:27.586776 21019 tablet_bootstrap.cc:492] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.592314 21019 tablet_bootstrap.cc:654] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.592993 21020 tablet_bootstrap.cc:492] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.593431 21020 ts_tablet_manager.cc:1403] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:09:27.596045 21020 raft_consensus.cc:359] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.596732 21020 raft_consensus.cc:385] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.596988 21020 raft_consensus.cc:740] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.597842 21019 tablet_bootstrap.cc:492] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.597602 21020 consensus_queue.cc:260] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.598249 21019 ts_tablet_manager.cc:1403] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:09:27.600901 21019 raft_consensus.cc:359] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.601399 21019 raft_consensus.cc:385] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.601399 21020 ts_tablet_manager.cc:1434] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:27.601936 21019 raft_consensus.cc:740] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.600239 20726 catalog_manager.cc:5697] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.602658 21020 tablet_bootstrap.cc:492] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb: Bootstrap starting.
I20260709 13:09:27.602658 21019 consensus_queue.cc:260] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.603104 20726 catalog_manager.cc:5697] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.605139 21019 ts_tablet_manager.cc:1434] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:27.606797 21019 tablet_bootstrap.cc:492] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0: Bootstrap starting.
I20260709 13:09:27.611586 21020 tablet_bootstrap.cc:654] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.612459 21019 tablet_bootstrap.cc:654] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.617776 21019 tablet_bootstrap.cc:492] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0: No bootstrap required, opened a new log
I20260709 13:09:27.618229 21019 ts_tablet_manager.cc:1403] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:09:27.618892 21034 raft_consensus.cc:493] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.619357 21034 raft_consensus.cc:515] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.619968 21020 tablet_bootstrap.cc:492] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb: No bootstrap required, opened a new log
I20260709 13:09:27.620406 21020 ts_tablet_manager.cc:1403] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:09:27.620894 21019 raft_consensus.cc:359] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.621413 21034 leader_election.cc:290] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.621572 21019 raft_consensus.cc:385] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.621933 21019 raft_consensus.cc:740] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.622112 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.622609 21019 consensus_queue.cc:260] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.622937 21020 raft_consensus.cc:359] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.623667 21020 raft_consensus.cc:385] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.623960 21020 raft_consensus.cc:740] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.625013 21019 ts_tablet_manager.cc:1434] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.623500 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" is_pre_election: true
I20260709 13:09:27.625083 21020 consensus_queue.cc:260] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.626869 21020 ts_tablet_manager.cc:1434] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:27.622900 20829 raft_consensus.cc:2393] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2c7409ba50b4f7f8d646a48b24106cb in current term 1: Already voted for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in this term.
I20260709 13:09:27.628129 20942 leader_election.cc:304] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2c7409ba50b4f7f8d646a48b24106cb; no voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301
I20260709 13:09:27.631558 21034 raft_consensus.cc:3060] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.637998 21034 raft_consensus.cc:2749] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.640682 21023 consensus_queue.cc:1048] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.653405 21036 consensus_queue.cc:1048] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.664966 21057 raft_consensus.cc:493] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.665503 21057 raft_consensus.cc:515] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.667426 21057 leader_election.cc:290] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.668682 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660f3f79224a4c4aa0fec7a1150e9daf" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" is_pre_election: true
I20260709 13:09:27.668594 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660f3f79224a4c4aa0fec7a1150e9daf" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.669373 20829 raft_consensus.cc:2468] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.669350 20979 raft_consensus.cc:2468] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.670620 20868 leader_election.cc:304] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:27.671375 21057 raft_consensus.cc:2804] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.671736 21057 raft_consensus.cc:493] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.672093 21057 raft_consensus.cc:3060] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.676651 21057 raft_consensus.cc:515] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.678265 21057 leader_election.cc:290] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.678980 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660f3f79224a4c4aa0fec7a1150e9daf" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:27.679270 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660f3f79224a4c4aa0fec7a1150e9daf" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:27.679472 20829 raft_consensus.cc:3060] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.679798 20979 raft_consensus.cc:3060] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.684017 20829 raft_consensus.cc:2468] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.684088 20979 raft_consensus.cc:2468] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.685178 20868 leader_election.cc:304] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:27.685797 21057 raft_consensus.cc:2804] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.686182 21057 raft_consensus.cc:697] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Leader. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:27.686959 21057 consensus_queue.cc:237] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.690503 21057 raft_consensus.cc:493] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.691008 21057 raft_consensus.cc:515] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.693166 21057 leader_election.cc:290] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.693861 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.694382 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" is_pre_election: true
I20260709 13:09:27.694319 20728 catalog_manager.cc:5697] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.695196 20979 raft_consensus.cc:2393] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in current term 1: Already voted for candidate 6e0ad5535d514f248afc3efe32b123e0 in this term.
I20260709 13:09:27.696165 21057 raft_consensus.cc:493] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.696295 20868 leader_election.cc:304] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb
I20260709 13:09:27.696655 21057 raft_consensus.cc:515] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.697050 21026 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.699124 21057 leader_election.cc:290] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.700829 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bef223621e49a3bd38050cdc8dcdfe" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" is_pre_election: true
I20260709 13:09:27.701447 20979 raft_consensus.cc:2468] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.702510 20868 leader_election.cc:304] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:27.702726 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bef223621e49a3bd38050cdc8dcdfe" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.703353 20829 raft_consensus.cc:2468] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 0.
I20260709 13:09:27.703394 21057 raft_consensus.cc:2804] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.704133 21026 raft_consensus.cc:2749] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.703905 21057 raft_consensus.cc:493] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.704895 21057 raft_consensus.cc:3060] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.709152 21036 raft_consensus.cc:493] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.709290 21057 raft_consensus.cc:515] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.709551 21036 raft_consensus.cc:515] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.710935 21057 leader_election.cc:290] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.711369 21036 leader_election.cc:290] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.712137 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bef223621e49a3bd38050cdc8dcdfe" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:27.712528 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bef223621e49a3bd38050cdc8dcdfe" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:27.712697 20830 raft_consensus.cc:3060] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.713032 20979 raft_consensus.cc:3060] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.713544 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e5a7bc2d54638a1cc7028f78451da" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0" is_pre_election: true
I20260709 13:09:27.714145 20829 raft_consensus.cc:2468] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 0.
I20260709 13:09:27.712896 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e5a7bc2d54638a1cc7028f78451da" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" is_pre_election: true
I20260709 13:09:27.715097 20904 raft_consensus.cc:2468] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 0.
I20260709 13:09:27.715394 20942 leader_election.cc:304] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:27.716368 21036 raft_consensus.cc:2804] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.716729 21036 raft_consensus.cc:493] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.717041 21036 raft_consensus.cc:3060] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.720597 20979 raft_consensus.cc:2468] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.720575 20830 raft_consensus.cc:2468] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 1.
I20260709 13:09:27.721925 20868 leader_election.cc:304] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:27.722616 21057 raft_consensus.cc:2804] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.723117 21057 raft_consensus.cc:697] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Leader. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:27.723946 21057 consensus_queue.cc:237] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.725095 21036 raft_consensus.cc:515] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.727201 21036 leader_election.cc:290] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:27.728379 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e5a7bc2d54638a1cc7028f78451da" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:27.728634 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e5a7bc2d54638a1cc7028f78451da" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:27.729173 20830 raft_consensus.cc:3060] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.729245 20904 raft_consensus.cc:3060] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.733955 20904 raft_consensus.cc:2468] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 1.
I20260709 13:09:27.733835 20728 catalog_manager.cc:5697] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.734997 20944 leader_election.cc:304] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:27.735661 21036 raft_consensus.cc:2804] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.736126 21036 raft_consensus.cc:697] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Becoming Leader. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:27.736806 20830 raft_consensus.cc:2468] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 1.
I20260709 13:09:27.736871 21036 consensus_queue.cc:237] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.744668 20725 catalog_manager.cc:5697] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.848323 21036 consensus_queue.cc:1048] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.858824 21034 consensus_queue.cc:1048] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.865082 21043 consensus_queue.cc:1048] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.893894 21085 consensus_queue.cc:1048] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.898636 21034 consensus_queue.cc:1048] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.906862 21085 raft_consensus.cc:493] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.907388 21085 raft_consensus.cc:515] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.909734 21085 leader_election.cc:290] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:27.909722 20979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97fe48e860b4d1fbe6ddcb1a977fc23"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41302
I20260709 13:09:27.910454 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" is_pre_election: true
I20260709 13:09:27.910893 20979 raft_consensus.cc:606] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:27.911805 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" is_pre_election: true
I20260709 13:09:27.913372 20793 leader_election.cc:304] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0; no voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb
I20260709 13:09:27.914495 21085 raft_consensus.cc:2749] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.917999 20978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41302
I20260709 13:09:27.918244 20830 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.918639 20978 raft_consensus.cc:606] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:27.926244 21034 consensus_queue.cc:1048] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.943154 20904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc"
dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:59450
I20260709 13:09:27.943804 20904 raft_consensus.cc:606] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:27.951812 20904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51"
dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:59450
I20260709 13:09:27.952431 20904 raft_consensus.cc:606] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:27.958069 20978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
mode: GRACEFUL
new_leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
 from {username='slave'} at 127.0.0.1:41302
I20260709 13:09:27.958894 20978 raft_consensus.cc:606] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Received request to transfer leadership to TS 6fdd76f2a5e0443ea62b3e41b7fd9301
I20260709 13:09:27.977272 21057 consensus_queue.cc:1048] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.979941 21057 consensus_queue.cc:1048] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.985324 21026 raft_consensus.cc:993] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:27.985764 21026 raft_consensus.cc:1081] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:27.987855 20829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41072
I20260709 13:09:27.988461 20829 raft_consensus.cc:493] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:27.988791 20829 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.993920 21026 consensus_queue.cc:1048] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.996511 20829 raft_consensus.cc:515] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:27.992746 21094 consensus_queue.cc:1048] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:27.998387 20830 raft_consensus.cc:1240] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Rejecting Update request from peer 6fdd76f2a5e0443ea62b3e41b7fd9301 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:28.001639 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:28.002274 20979 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.003297 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:28.004024 20904 raft_consensus.cc:3055] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.004455 20904 raft_consensus.cc:740] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:28.005524 20904 consensus_queue.cc:260] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.006778 20904 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.008580 20979 raft_consensus.cc:2468] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:28.009871 20793 leader_election.cc:304] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:28.012509 21085 raft_consensus.cc:2804] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.012962 21085 raft_consensus.cc:697] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:28.013684 21085 consensus_queue.cc:237] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.014632 20829 leader_election.cc:290] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:28.020295 20978 raft_consensus.cc:1240] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Rejecting Update request from peer 6fdd76f2a5e0443ea62b3e41b7fd9301 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:09:28.021634 20904 raft_consensus.cc:2468] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:28.026194 20725 catalog_manager.cc:5697] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 1 to 2, leader changed from 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.077221 21026 consensus_queue.cc:1048] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.088438 21094 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.090154 21057 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.097078 21057 consensus_queue.cc:1048] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.098624 21059 raft_consensus.cc:993] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:28.099069 21059 raft_consensus.cc:1081] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:28.109917 20830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41072
I20260709 13:09:28.111406 20830 raft_consensus.cc:493] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.111824 20830 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.118764 20830 raft_consensus.cc:515] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.123143 20830 leader_election.cc:290] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:28.123322 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:28.123929 20904 raft_consensus.cc:3055] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.124297 20904 raft_consensus.cc:740] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:28.124445 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:28.124922 20978 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.125118 20904 consensus_queue.cc:260] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.126422 20904 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.130779 20978 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:28.131704 20793 leader_election.cc:304] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:28.132594 21085 raft_consensus.cc:2804] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.133064 21085 raft_consensus.cc:697] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:28.134167 20904 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:28.133863 21085 consensus_queue.cc:237] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.135257 21094 consensus_queue.cc:1048] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.141976 20728 catalog_manager.cc:5697] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 1 to 2, leader changed from 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.151069 21059 consensus_queue.cc:1048] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.173486 21034 consensus_queue.cc:1048] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.184827 21034 consensus_queue.cc:1048] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.246016 21036 raft_consensus.cc:993] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:28.246546 21034 raft_consensus.cc:1081] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:28.248021 20830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41070
I20260709 13:09:28.248570 20830 raft_consensus.cc:493] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.248906 20830 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.253472 20830 raft_consensus.cc:515] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.255036 20830 leader_election.cc:290] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:28.255983 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:28.256110 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:28.256574 20904 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.256711 20978 raft_consensus.cc:3055] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.257079 20978 raft_consensus.cc:740] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:28.257745 20978 consensus_queue.cc:260] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.258693 20978 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.261327 20904 raft_consensus.cc:2468] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:28.262419 20795 leader_election.cc:304] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:28.263115 21085 raft_consensus.cc:2804] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.263677 21085 raft_consensus.cc:697] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:28.264312 20978 raft_consensus.cc:2468] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:28.264600 21085 consensus_queue.cc:237] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.270897 20725 catalog_manager.cc:5697] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 1 to 2, leader changed from c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.376216 21036 raft_consensus.cc:993] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb: : Instructing follower 6fdd76f2a5e0443ea62b3e41b7fd9301 to start an election
I20260709 13:09:28.376693 21034 raft_consensus.cc:1081] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Signalling peer 6fdd76f2a5e0443ea62b3e41b7fd9301 to start an election
I20260709 13:09:28.378175 20904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee"
dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
 from {username='slave'} at 127.0.0.1:59432
I20260709 13:09:28.378639 20904 raft_consensus.cc:493] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.378890 20904 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.383574 20904 raft_consensus.cc:515] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.385175 20904 leader_election.cc:290] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 2 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:28.386117 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:28.386458 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:28.386773 20830 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.386994 20978 raft_consensus.cc:3055] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.387332 20978 raft_consensus.cc:740] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:28.388177 20978 consensus_queue.cc:260] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.389446 20978 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.393770 20830 raft_consensus.cc:2468] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 2.
I20260709 13:09:28.395519 20868 leader_election.cc:304] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:28.396425 20978 raft_consensus.cc:2468] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 2.
I20260709 13:09:28.396503 21059 raft_consensus.cc:2804] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.397171 21059 raft_consensus.cc:697] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 LEADER]: Becoming Leader. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:28.397943 21059 consensus_queue.cc:237] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:28.404110 20725 catalog_manager.cc:5697] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 reported cstate change: term changed from 1 to 2, leader changed from c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195) to 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.438045 21036 raft_consensus.cc:993] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:28.438524 21034 raft_consensus.cc:1081] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:28.439954 20830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d97fe48e860b4d1fbe6ddcb1a977fc23"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41070
I20260709 13:09:28.440510 20830 raft_consensus.cc:493] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.440852 20830 raft_consensus.cc:3060] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.445899 20830 raft_consensus.cc:515] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:28.447685 20830 leader_election.cc:290] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Requested vote from peers c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:28.448741 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97fe48e860b4d1fbe6ddcb1a977fc23" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:28.449194 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97fe48e860b4d1fbe6ddcb1a977fc23" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:28.449296 20979 raft_consensus.cc:3055] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.449831 20904 raft_consensus.cc:3060] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.449776 20979 raft_consensus.cc:740] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:28.450745 20979 consensus_queue.cc:260] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:28.451630 20979 raft_consensus.cc:3060] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.455250 20904 raft_consensus.cc:2468] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:28.455993 20979 raft_consensus.cc:2468] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:28.456341 20795 leader_election.cc:304] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:28.457193 21085 raft_consensus.cc:2804] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.457571 21085 raft_consensus.cc:697] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:28.458273 21085 consensus_queue.cc:237] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } }
I20260709 13:09:28.464351 20725 catalog_manager.cc:5697] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 1 to 2, leader changed from c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.475317 20979 raft_consensus.cc:1275] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.476584 21085 consensus_queue.cc:1048] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.486130 20904 raft_consensus.cc:1275] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.487725 21082 consensus_queue.cc:1048] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.513700 20979 raft_consensus.cc:1275] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.514858 21086 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.522169 20904 raft_consensus.cc:1275] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.523447 21082 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.818408 20979 raft_consensus.cc:1275] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.819721 21082 consensus_queue.cc:1048] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.828163 20904 raft_consensus.cc:1275] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.829641 21086 consensus_queue.cc:1048] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.852133 20904 raft_consensus.cc:1275] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.853336 21086 consensus_queue.cc:1048] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.860385 20979 raft_consensus.cc:1275] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:28.861874 21082 consensus_queue.cc:1048] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.001097 20979 raft_consensus.cc:1275] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Refusing update from remote peer 6fdd76f2a5e0443ea62b3e41b7fd9301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.002406 21059 consensus_queue.cc:1048] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.004853 20830 raft_consensus.cc:1275] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Refusing update from remote peer 6fdd76f2a5e0443ea62b3e41b7fd9301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.006223 21059 consensus_queue.cc:1048] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.002421 20199 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:09:31.003398 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.018680 20830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
mode: GRACEFUL
new_leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:09:31.019127 20830 raft_consensus.cc:606] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Received request to transfer leadership to TS c2c7409ba50b4f7f8d646a48b24106cb
I20260709 13:09:31.021438 20830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
mode: GRACEFUL
new_leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:09:31.021938 20830 raft_consensus.cc:606] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 LEADER]: Received request to transfer leadership to TS c2c7409ba50b4f7f8d646a48b24106cb
I20260709 13:09:31.022866 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:31.023339 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:31.033895 21086 raft_consensus.cc:993] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0: : Instructing follower c2c7409ba50b4f7f8d646a48b24106cb to start an election
I20260709 13:09:31.034323 21118 raft_consensus.cc:1081] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Signalling peer c2c7409ba50b4f7f8d646a48b24106cb to start an election
I20260709 13:09:31.035765 20979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
 from {username='slave'} at 127.0.0.1:41280
I20260709 13:09:31.036273 20979 raft_consensus.cc:493] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.036584 20979 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.040990 20979 raft_consensus.cc:515] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:31.042339 20979 leader_election.cc:290] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 3 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:31.043355 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:31.043429 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:31.043836 20830 raft_consensus.cc:3055] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:31.043988 20904 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.044234 20830 raft_consensus.cc:740] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:31.044993 20830 consensus_queue.cc:260] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:31.045801 20830 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.048781 20904 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 3.
I20260709 13:09:31.049680 20830 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 3.
I20260709 13:09:31.049782 20944 leader_election.cc:304] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:31.050571 21034 raft_consensus.cc:2804] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:31.051607 21034 raft_consensus.cc:697] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 3 LEADER]: Becoming Leader. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:31.052362 21034 consensus_queue.cc:237] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:31.058765 20728 catalog_manager.cc:5697] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb reported cstate change: term changed from 2 to 3, leader changed from 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193) to c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195). New cstate: current_term: 3 leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.574071 21118 raft_consensus.cc:993] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0: : Instructing follower c2c7409ba50b4f7f8d646a48b24106cb to start an election
I20260709 13:09:31.574522 21125 raft_consensus.cc:1081] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 LEADER]: Signalling peer c2c7409ba50b4f7f8d646a48b24106cb to start an election
I20260709 13:09:31.575865 20978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
 from {username='slave'} at 127.0.0.1:41280
I20260709 13:09:31.576390 20978 raft_consensus.cc:493] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.576710 20978 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.581423 20978 raft_consensus.cc:515] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:31.583025 20978 leader_election.cc:290] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 2 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:31.584175 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:31.584177 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:31.584697 20830 raft_consensus.cc:3055] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.584755 20904 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.585028 20830 raft_consensus.cc:740] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:31.585623 20830 consensus_queue.cc:260] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:31.586531 20830 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.588879 20904 raft_consensus.cc:2468] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 2.
I20260709 13:09:31.589761 20944 leader_election.cc:304] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:31.590397 20830 raft_consensus.cc:2468] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 2.
I20260709 13:09:31.590469 21034 raft_consensus.cc:2804] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.591722 21034 raft_consensus.cc:697] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 LEADER]: Becoming Leader. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:31.592698 21034 consensus_queue.cc:237] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:31.598886 20728 catalog_manager.cc:5697] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb reported cstate change: term changed from 1 to 2, leader changed from 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193) to c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195). New cstate: current_term: 2 leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.641528 20830 raft_consensus.cc:1275] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Refusing update from remote peer c2c7409ba50b4f7f8d646a48b24106cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.642722 21034 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:31.654382 20904 raft_consensus.cc:1275] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Refusing update from remote peer c2c7409ba50b4f7f8d646a48b24106cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.655894 21135 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:32.024199 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:32.039815 20978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41302
I20260709 13:09:32.040423 20978 raft_consensus.cc:606] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 3 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:32.045341 20978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41302
I20260709 13:09:32.045858 20978 raft_consensus.cc:606] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:32.053390 20904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee"
dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:59450
I20260709 13:09:32.053858 20904 raft_consensus.cc:606] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:32.058334 20904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba"
dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:59450
I20260709 13:09:32.058759 20904 raft_consensus.cc:606] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:32.063198 20904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bef223621e49a3bd38050cdc8dcdfe"
dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
mode: GRACEFUL
new_leader_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:59450
I20260709 13:09:32.063654 20904 raft_consensus.cc:606] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Received request to transfer leadership to TS 6e0ad5535d514f248afc3efe32b123e0
I20260709 13:09:32.096590 21138 raft_consensus.cc:993] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.097078 21113 raft_consensus.cc:1081] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.098603 20829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41072
I20260709 13:09:32.099130 20829 raft_consensus.cc:493] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.099447 20829 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.104136 20829 raft_consensus.cc:515] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.105762 20829 leader_election.cc:290] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 3 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:32.106554 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:32.107188 20904 raft_consensus.cc:3055] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:32.107589 20904 raft_consensus.cc:740] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:32.107213 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e0edc648b54bd28ee12629001811ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:32.108552 20978 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.108696 20904 consensus_queue.cc:260] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.109884 20904 raft_consensus.cc:3060] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.115897 20904 raft_consensus.cc:2468] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 3.
I20260709 13:09:32.117050 20978 raft_consensus.cc:2468] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 3.
I20260709 13:09:32.118608 20795 leader_election.cc:304] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:32.119428 21118 raft_consensus.cc:2804] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:32.119983 21118 raft_consensus.cc:697] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:32.121220 21126 raft_consensus.cc:993] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.120898 21118 consensus_queue.cc:237] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.121662 21034 raft_consensus.cc:1081] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 3 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.124102 20829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41070
I20260709 13:09:32.124696 20829 raft_consensus.cc:493] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.125154 20829 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:32.133647 20829 raft_consensus.cc:515] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.134852 20728 catalog_manager.cc:5697] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 2 to 3, leader changed from 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 3 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.135798 20829 leader_election.cc:290] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 4 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:32.136831 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:32.136775 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:32.137475 20904 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:32.137598 20978 raft_consensus.cc:3055] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:32.137995 20978 raft_consensus.cc:740] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:32.139165 20978 consensus_queue.cc:260] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.140976 20978 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:32.141741 20904 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 4.
I20260709 13:09:32.142891 20795 leader_election.cc:304] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, 6fdd76f2a5e0443ea62b3e41b7fd9301; no voters: 
I20260709 13:09:32.143688 21118 raft_consensus.cc:2804] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:32.144328 21118 raft_consensus.cc:697] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 4 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:32.145284 21118 consensus_queue.cc:237] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.148416 20978 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 4.
I20260709 13:09:32.149434 20904 raft_consensus.cc:1275] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Refusing update from remote peer c2c7409ba50b4f7f8d646a48b24106cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.150794 21126 consensus_queue.cc:1048] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.157522 20728 catalog_manager.cc:5697] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 3 to 4, leader changed from c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 4 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.158767 20829 raft_consensus.cc:1275] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Refusing update from remote peer c2c7409ba50b4f7f8d646a48b24106cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.160132 21126 consensus_queue.cc:1048] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.180390 21034 raft_consensus.cc:993] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.180904 21134 raft_consensus.cc:1081] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.182616 20829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41070
I20260709 13:09:32.183260 20829 raft_consensus.cc:493] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.183681 20829 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.185932 21138 raft_consensus.cc:993] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.186383 21113 raft_consensus.cc:1081] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.187907 20830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41072
I20260709 13:09:32.188405 20830 raft_consensus.cc:493] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.188714 20830 raft_consensus.cc:3060] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.189713 20829 raft_consensus.cc:515] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.192152 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:32.192510 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:32.192663 20904 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.193017 20978 raft_consensus.cc:3055] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:32.193322 20978 raft_consensus.cc:740] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:32.194038 20978 consensus_queue.cc:260] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.195017 20978 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.195178 20830 raft_consensus.cc:515] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.198378 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:32.198450 20830 leader_election.cc:290] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:32.198629 20979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c604cad1f4894c798a8448addc5c20ba" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:32.198992 20904 raft_consensus.cc:2468] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 3.
I20260709 13:09:32.198983 20905 raft_consensus.cc:3055] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:32.199172 20979 raft_consensus.cc:3060] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.199541 20905 raft_consensus.cc:740] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:32.200438 20905 consensus_queue.cc:260] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.201705 20905 raft_consensus.cc:3060] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.204131 20829 leader_election.cc:290] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 3 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:32.204931 20979 raft_consensus.cc:2468] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:32.205089 20978 raft_consensus.cc:2468] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 3.
I20260709 13:09:32.206862 20793 leader_election.cc:304] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:32.207733 21118 raft_consensus.cc:2804] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:32.207795 20793 leader_election.cc:304] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:32.208299 21118 raft_consensus.cc:697] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:32.209093 21118 consensus_queue.cc:237] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.209408 20905 raft_consensus.cc:2468] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:32.211246 21147 raft_consensus.cc:2804] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:32.211645 21147 raft_consensus.cc:697] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:32.212320 21147 consensus_queue.cc:237] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.217338 20728 catalog_manager.cc:5697] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 1 to 2, leader changed from 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.228018 20728 catalog_manager.cc:5697] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 2 to 3, leader changed from c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 3 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.385339 21138 raft_consensus.cc:993] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301: : Instructing follower 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.385779 21138 raft_consensus.cc:1081] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Signalling peer 6e0ad5535d514f248afc3efe32b123e0 to start an election
I20260709 13:09:32.387418 20830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7bef223621e49a3bd38050cdc8dcdfe"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
 from {username='slave'} at 127.0.0.1:41072
I20260709 13:09:32.387866 20830 raft_consensus.cc:493] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.388175 20830 raft_consensus.cc:3060] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.392434 20830 raft_consensus.cc:515] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.393993 20830 leader_election.cc:290] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Requested vote from peers 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:32.394979 20905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bef223621e49a3bd38050cdc8dcdfe" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:32.395262 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bef223621e49a3bd38050cdc8dcdfe" candidate_uuid: "6e0ad5535d514f248afc3efe32b123e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:32.395630 20905 raft_consensus.cc:3055] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:32.395778 20978 raft_consensus.cc:3060] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.396004 20905 raft_consensus.cc:740] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:32.396912 20905 consensus_queue.cc:260] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.398089 20905 raft_consensus.cc:3060] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.403141 20978 raft_consensus.cc:2468] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:32.404458 20793 leader_election.cc:304] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:32.404735 20905 raft_consensus.cc:2468] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e0ad5535d514f248afc3efe32b123e0 in term 2.
I20260709 13:09:32.405200 21147 raft_consensus.cc:2804] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:32.405721 21147 raft_consensus.cc:697] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Leader. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:32.406426 21147 consensus_queue.cc:237] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:32.412840 20728 catalog_manager.cc:5697] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 reported cstate change: term changed from 1 to 2, leader changed from 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194) to 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "6e0ad5535d514f248afc3efe32b123e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.611387 20905 raft_consensus.cc:1275] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.612778 21147 consensus_queue.cc:1048] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.621160 20978 raft_consensus.cc:1275] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.623150 21118 consensus_queue.cc:1048] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.668764 20905 raft_consensus.cc:1275] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:32.670889 21125 consensus_queue.cc:1048] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:32.672799 20905 raft_consensus.cc:1275] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 4 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:32.674098 21125 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:32.680161 20979 raft_consensus.cc:1275] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:32.682482 21118 consensus_queue.cc:1048] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:32.689539 20978 raft_consensus.cc:1275] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 4 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:32.691335 21147 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:32.788163 20978 raft_consensus.cc:1275] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:32.789363 21125 consensus_queue.cc:1048] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:32.797312 20905 raft_consensus.cc:1275] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:32.798930 21125 consensus_queue.cc:1048] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:32.961465 20905 raft_consensus.cc:1275] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.962764 21125 consensus_queue.cc:1048] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.978471 20978 raft_consensus.cc:1275] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Refusing update from remote peer 6e0ad5535d514f248afc3efe32b123e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.979760 21159 consensus_queue.cc:1048] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.071018 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:35.078498 20830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
mode: GRACEFUL
new_leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:09:35.079147 20830 raft_consensus.cc:606] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Received request to transfer leadership to TS 6fdd76f2a5e0443ea62b3e41b7fd9301
I20260709 13:09:35.081682 20830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
mode: GRACEFUL
new_leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:09:35.082168 20830 raft_consensus.cc:606] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 4 LEADER]: Received request to transfer leadership to TS 6fdd76f2a5e0443ea62b3e41b7fd9301
I20260709 13:09:35.084586 20830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
mode: GRACEFUL
new_leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:09:35.085050 20830 raft_consensus.cc:606] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 LEADER]: Received request to transfer leadership to TS c2c7409ba50b4f7f8d646a48b24106cb
I20260709 13:09:35.087020 20830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d"
dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
mode: GRACEFUL
new_leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
 from {username='slave'} at 127.0.0.1:35748
I20260709 13:09:35.087394 20830 raft_consensus.cc:606] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Received request to transfer leadership to TS c2c7409ba50b4f7f8d646a48b24106cb
I20260709 13:09:35.088343 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:35.088714 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:35.099591 21158 raft_consensus.cc:993] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0: : Instructing follower c2c7409ba50b4f7f8d646a48b24106cb to start an election
I20260709 13:09:35.100159 21147 raft_consensus.cc:1081] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Signalling peer c2c7409ba50b4f7f8d646a48b24106cb to start an election
I20260709 13:09:35.101884 20978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
 from {username='slave'} at 127.0.0.1:41280
I20260709 13:09:35.102345 20978 raft_consensus.cc:493] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.102643 20978 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.107391 20978 raft_consensus.cc:515] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.108968 20978 leader_election.cc:290] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 3 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:35.109947 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:35.110150 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21a7565bbd1425c9b8d1a4f2f93ca4d" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:35.110636 20830 raft_consensus.cc:3055] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:35.110761 20904 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.110941 20830 raft_consensus.cc:740] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:35.111747 20830 consensus_queue.cc:260] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.112733 20830 raft_consensus.cc:3060] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.115365 20904 raft_consensus.cc:2468] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 3.
I20260709 13:09:35.116410 20944 leader_election.cc:304] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:35.117167 21134 raft_consensus.cc:2804] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:35.117259 20830 raft_consensus.cc:2468] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 3.
I20260709 13:09:35.118197 21134 raft_consensus.cc:697] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 3 LEADER]: Becoming Leader. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:35.119042 21134 consensus_queue.cc:237] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.125907 20728 catalog_manager.cc:5697] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb reported cstate change: term changed from 2 to 3, leader changed from 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193) to c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195). New cstate: current_term: 3 leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.158331 21158 raft_consensus.cc:993] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0: : Instructing follower c2c7409ba50b4f7f8d646a48b24106cb to start an election
I20260709 13:09:35.158813 21158 raft_consensus.cc:1081] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 LEADER]: Signalling peer c2c7409ba50b4f7f8d646a48b24106cb to start an election
I20260709 13:09:35.160497 20978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee"
dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
 from {username='slave'} at 127.0.0.1:41280
I20260709 13:09:35.161059 20978 raft_consensus.cc:493] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.161355 20978 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.165465 20978 raft_consensus.cc:515] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.167212 20978 leader_election.cc:290] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 4 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357)
I20260709 13:09:35.167963 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:35.168506 20830 raft_consensus.cc:3055] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:35.168952 20830 raft_consensus.cc:740] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:35.169812 20830 consensus_queue.cc:260] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.171252 20830 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.168408 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9285fe1151f4766babfe7d4ff1251ee" candidate_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
I20260709 13:09:35.176362 20904 raft_consensus.cc:3060] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.176918 20830 raft_consensus.cc:2468] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 4.
I20260709 13:09:35.178049 20942 leader_election.cc:304] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e0ad5535d514f248afc3efe32b123e0, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:35.178774 21134 raft_consensus.cc:2804] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:35.179183 21134 raft_consensus.cc:697] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 4 LEADER]: Becoming Leader. State: Replica: c2c7409ba50b4f7f8d646a48b24106cb, State: Running, Role: LEADER
I20260709 13:09:35.180012 21134 consensus_queue.cc:237] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.180821 20904 raft_consensus.cc:2468] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c7409ba50b4f7f8d646a48b24106cb in term 4.
I20260709 13:09:35.187276 20728 catalog_manager.cc:5697] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb reported cstate change: term changed from 3 to 4, leader changed from 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193) to c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195). New cstate: current_term: 4 leader_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.229416 21158 raft_consensus.cc:993] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0: : Instructing follower 6fdd76f2a5e0443ea62b3e41b7fd9301 to start an election
I20260709 13:09:35.229846 21158 raft_consensus.cc:1081] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Signalling peer 6fdd76f2a5e0443ea62b3e41b7fd9301 to start an election
I20260709 13:09:35.231238 20904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51"
dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
 from {username='slave'} at 127.0.0.1:59448
I20260709 13:09:35.231666 20904 raft_consensus.cc:493] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.231956 20904 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.235908 20904 raft_consensus.cc:515] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.237370 20904 leader_election.cc:290] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 3 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:35.238292 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:35.238647 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa875727b446e5b59cb2a893617c51" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:35.238844 20830 raft_consensus.cc:3055] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:35.239158 20830 raft_consensus.cc:740] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:35.239171 20978 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.239920 20830 consensus_queue.cc:260] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.240830 20830 raft_consensus.cc:3060] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.243402 20978 raft_consensus.cc:2468] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 3.
I20260709 13:09:35.244530 20868 leader_election.cc:304] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:35.244680 20830 raft_consensus.cc:2468] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 3.
I20260709 13:09:35.245424 21138 raft_consensus.cc:2804] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:35.246434 21138 raft_consensus.cc:697] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 LEADER]: Becoming Leader. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:35.247277 21138 consensus_queue.cc:237] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.254382 20728 catalog_manager.cc:5697] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 reported cstate change: term changed from 2 to 3, leader changed from 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193) to 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.519253 21158 raft_consensus.cc:993] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0: : Instructing follower 6fdd76f2a5e0443ea62b3e41b7fd9301 to start an election
I20260709 13:09:35.519681 21147 raft_consensus.cc:1081] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 4 LEADER]: Signalling peer 6fdd76f2a5e0443ea62b3e41b7fd9301 to start an election
I20260709 13:09:35.521207 20904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc"
dest_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301"
 from {username='slave'} at 127.0.0.1:59448
I20260709 13:09:35.521592 20904 raft_consensus.cc:493] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.521808 20904 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.526345 20904 raft_consensus.cc:515] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.527871 20904 leader_election.cc:290] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 5 election: Requested vote from peers 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635), c2c7409ba50b4f7f8d646a48b24106cb (127.19.185.195:37265)
I20260709 13:09:35.528707 20830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6e0ad5535d514f248afc3efe32b123e0"
I20260709 13:09:35.529206 20830 raft_consensus.cc:3055] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:35.529124 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71100d86e7cb445988f6eacd1b8da6fc" candidate_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c2c7409ba50b4f7f8d646a48b24106cb"
I20260709 13:09:35.529466 20830 raft_consensus.cc:740] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e0ad5535d514f248afc3efe32b123e0, State: Running, Role: LEADER
I20260709 13:09:35.529585 20978 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.530233 20830 consensus_queue.cc:260] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.531062 20830 raft_consensus.cc:3060] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.533795 20978 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 5.
I20260709 13:09:35.534721 20868 leader_election.cc:304] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fdd76f2a5e0443ea62b3e41b7fd9301, c2c7409ba50b4f7f8d646a48b24106cb; no voters: 
I20260709 13:09:35.535167 20830 raft_consensus.cc:2468] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fdd76f2a5e0443ea62b3e41b7fd9301 in term 5.
I20260709 13:09:35.535591 21138 raft_consensus.cc:2804] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:35.536104 21138 raft_consensus.cc:697] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 5 LEADER]: Becoming Leader. State: Replica: 6fdd76f2a5e0443ea62b3e41b7fd9301, State: Running, Role: LEADER
I20260709 13:09:35.536846 21138 consensus_queue.cc:237] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } }
I20260709 13:09:35.543479 20728 catalog_manager.cc:5697] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 reported cstate change: term changed from 4 to 5, leader changed from 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193) to 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194). New cstate: current_term: 5 leader_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.659360 20904 raft_consensus.cc:1275] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 4 FOLLOWER]: Refusing update from remote peer c2c7409ba50b4f7f8d646a48b24106cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:35.660988 21163 consensus_queue.cc:1048] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:35.662662 20904 raft_consensus.cc:1275] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Refusing update from remote peer c2c7409ba50b4f7f8d646a48b24106cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.663940 21163 consensus_queue.cc:1048] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fdd76f2a5e0443ea62b3e41b7fd9301" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:35.675376 20830 raft_consensus.cc:1275] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Refusing update from remote peer 6fdd76f2a5e0443ea62b3e41b7fd9301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.686798 21138 consensus_queue.cc:1048] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:35.688958 20829 raft_consensus.cc:1275] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 4 FOLLOWER]: Refusing update from remote peer c2c7409ba50b4f7f8d646a48b24106cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:35.690922 20830 raft_consensus.cc:1275] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Refusing update from remote peer c2c7409ba50b4f7f8d646a48b24106cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.693379 21176 consensus_queue.cc:1048] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:35.693679 21134 consensus_queue.cc:1048] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:35.718135 20978 raft_consensus.cc:1275] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Refusing update from remote peer 6fdd76f2a5e0443ea62b3e41b7fd9301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.720045 21138 consensus_queue.cc:1048] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:35.993085 20829 raft_consensus.cc:1275] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 5 FOLLOWER]: Refusing update from remote peer 6fdd76f2a5e0443ea62b3e41b7fd9301: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:35.994391 21170 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e0ad5535d514f248afc3efe32b123e0" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:36.003795 20978 raft_consensus.cc:1275] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 5 FOLLOWER]: Refusing update from remote peer 6fdd76f2a5e0443ea62b3e41b7fd9301: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:36.005139 21170 consensus_queue.cc:1048] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c7409ba50b4f7f8d646a48b24106cb" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:36.089538 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:36.098445 20199 tablet_server.cc:179] TabletServer@127.19.185.193:0 shutting down...
W20260709 13:09:36.115391 20942 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:09:36.122684 20942 consensus_peers.cc:597] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb -> Peer 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635): Couldn't send request to peer 6e0ad5535d514f248afc3efe32b123e0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:36.131903 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:36.132937 20199 tablet_replica.cc:333] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.133589 20199 raft_consensus.cc:2243] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.134135 20199 raft_consensus.cc:2272] T 660f3f79224a4c4aa0fec7a1150e9daf P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.136111 20199 tablet_replica.cc:333] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.136703 20199 raft_consensus.cc:2243] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.137481 20199 raft_consensus.cc:2272] T c604cad1f4894c798a8448addc5c20ba P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.139240 20199 tablet_replica.cc:333] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.139744 20199 raft_consensus.cc:2243] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.140173 20199 raft_consensus.cc:2272] T 34fa875727b446e5b59cb2a893617c51 P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.142225 20199 tablet_replica.cc:333] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.142773 20199 raft_consensus.cc:2243] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.143247 20199 raft_consensus.cc:2272] T b70e5a7bc2d54638a1cc7028f78451da P 6e0ad5535d514f248afc3efe32b123e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.145011 20199 tablet_replica.cc:333] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.145512 20199 raft_consensus.cc:2243] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.145901 20199 raft_consensus.cc:2272] T d9285fe1151f4766babfe7d4ff1251ee P 6e0ad5535d514f248afc3efe32b123e0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.148248 20199 tablet_replica.cc:333] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.148803 20199 raft_consensus.cc:2243] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.149216 20199 raft_consensus.cc:2272] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.151401 20199 tablet_replica.cc:333] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.151966 20199 raft_consensus.cc:2243] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.152485 20199 raft_consensus.cc:2272] T 71100d86e7cb445988f6eacd1b8da6fc P 6e0ad5535d514f248afc3efe32b123e0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.154663 20199 tablet_replica.cc:333] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.155167 20199 raft_consensus.cc:2243] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.155876 20199 raft_consensus.cc:2272] T c7bef223621e49a3bd38050cdc8dcdfe P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.157820 20199 tablet_replica.cc:333] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.158326 20199 raft_consensus.cc:2243] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.158998 20199 raft_consensus.cc:2272] T b0e0edc648b54bd28ee12629001811ee P 6e0ad5535d514f248afc3efe32b123e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.160696 20199 tablet_replica.cc:333] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0: stopping tablet replica
I20260709 13:09:36.161199 20199 raft_consensus.cc:2243] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.161911 20199 raft_consensus.cc:2272] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6e0ad5535d514f248afc3efe32b123e0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:36.168908 20868 consensus_peers.cc:597] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 -> Peer 6e0ad5535d514f248afc3efe32b123e0 (127.19.185.193:37635): Couldn't send request to peer 6e0ad5535d514f248afc3efe32b123e0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:36.192911 20199 tablet_server.cc:196] TabletServer@127.19.185.193:0 shutdown complete.
I20260709 13:09:36.214423 20199 tablet_server.cc:179] TabletServer@127.19.185.194:0 shutting down...
I20260709 13:09:36.239109 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:36.239790 20199 tablet_replica.cc:333] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.240414 20199 raft_consensus.cc:2243] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.241225 20199 raft_consensus.cc:2272] T 660f3f79224a4c4aa0fec7a1150e9daf P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.243160 20199 tablet_replica.cc:333] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.243650 20199 raft_consensus.cc:2243] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.244108 20199 raft_consensus.cc:2272] T b70e5a7bc2d54638a1cc7028f78451da P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.245703 20199 tablet_replica.cc:333] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.246178 20199 raft_consensus.cc:2243] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.246590 20199 raft_consensus.cc:2272] T d9285fe1151f4766babfe7d4ff1251ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.249122 20199 tablet_replica.cc:333] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.249600 20199 raft_consensus.cc:2243] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.250020 20199 raft_consensus.cc:2272] T c604cad1f4894c798a8448addc5c20ba P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.251605 20199 tablet_replica.cc:333] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.252133 20199 raft_consensus.cc:2243] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.252839 20199 raft_consensus.cc:2272] T 34fa875727b446e5b59cb2a893617c51 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.254748 20199 tablet_replica.cc:333] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.255225 20199 raft_consensus.cc:2243] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.255681 20199 raft_consensus.cc:2272] T c7bef223621e49a3bd38050cdc8dcdfe P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.257241 20199 tablet_replica.cc:333] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.257688 20199 raft_consensus.cc:2243] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.258086 20199 raft_consensus.cc:2272] T d97fe48e860b4d1fbe6ddcb1a977fc23 P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.259687 20199 tablet_replica.cc:333] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.260231 20199 raft_consensus.cc:2243] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.260612 20199 raft_consensus.cc:2272] T b0e0edc648b54bd28ee12629001811ee P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.262269 20199 tablet_replica.cc:333] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.262696 20199 raft_consensus.cc:2243] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.263087 20199 raft_consensus.cc:2272] T f21a7565bbd1425c9b8d1a4f2f93ca4d P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.265494 20199 tablet_replica.cc:333] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301: stopping tablet replica
I20260709 13:09:36.265937 20199 raft_consensus.cc:2243] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.266619 20199 raft_consensus.cc:2272] T 71100d86e7cb445988f6eacd1b8da6fc P 6fdd76f2a5e0443ea62b3e41b7fd9301 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:36.275446 20944 consensus_peers.cc:597] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb -> Peer 6fdd76f2a5e0443ea62b3e41b7fd9301 (127.19.185.194:42357): Couldn't send request to peer 6fdd76f2a5e0443ea62b3e41b7fd9301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:36.295058 20199 tablet_server.cc:196] TabletServer@127.19.185.194:0 shutdown complete.
I20260709 13:09:36.313476 20199 tablet_server.cc:179] TabletServer@127.19.185.195:0 shutting down...
I20260709 13:09:36.334836 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:36.335456 20199 tablet_replica.cc:333] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.335955 20199 raft_consensus.cc:2243] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.336431 20199 raft_consensus.cc:2272] T c604cad1f4894c798a8448addc5c20ba P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.338073 20199 tablet_replica.cc:333] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.338534 20199 raft_consensus.cc:2243] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.338888 20199 raft_consensus.cc:2272] T 660f3f79224a4c4aa0fec7a1150e9daf P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.340427 20199 tablet_replica.cc:333] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.340857 20199 raft_consensus.cc:2243] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.341197 20199 raft_consensus.cc:2272] T 34fa875727b446e5b59cb2a893617c51 P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.343629 20199 tablet_replica.cc:333] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.344146 20199 raft_consensus.cc:2243] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.344790 20199 raft_consensus.cc:2272] T b70e5a7bc2d54638a1cc7028f78451da P c2c7409ba50b4f7f8d646a48b24106cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.346318 20199 tablet_replica.cc:333] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.346714 20199 raft_consensus.cc:2243] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.347337 20199 raft_consensus.cc:2272] T d9285fe1151f4766babfe7d4ff1251ee P c2c7409ba50b4f7f8d646a48b24106cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.349145 20199 tablet_replica.cc:333] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.349561 20199 raft_consensus.cc:2243] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.349887 20199 raft_consensus.cc:2272] T 71100d86e7cb445988f6eacd1b8da6fc P c2c7409ba50b4f7f8d646a48b24106cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.351663 20199 tablet_replica.cc:333] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.352140 20199 raft_consensus.cc:2243] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.352481 20199 raft_consensus.cc:2272] T c7bef223621e49a3bd38050cdc8dcdfe P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.353904 20199 tablet_replica.cc:333] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.354295 20199 raft_consensus.cc:2243] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.354640 20199 raft_consensus.cc:2272] T d97fe48e860b4d1fbe6ddcb1a977fc23 P c2c7409ba50b4f7f8d646a48b24106cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.356415 20199 tablet_replica.cc:333] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.356851 20199 raft_consensus.cc:2243] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:36.357256 20199 raft_consensus.cc:2272] T b0e0edc648b54bd28ee12629001811ee P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.358764 20199 tablet_replica.cc:333] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb: stopping tablet replica
I20260709 13:09:36.359179 20199 raft_consensus.cc:2243] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.359854 20199 raft_consensus.cc:2272] T f21a7565bbd1425c9b8d1a4f2f93ca4d P c2c7409ba50b4f7f8d646a48b24106cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.379112 20199 tablet_server.cc:196] TabletServer@127.19.185.195:0 shutdown complete.
I20260709 13:09:36.397051 20199 master.cc:562] Master@127.19.185.254:33301 shutting down...
I20260709 13:09:36.416713 20199 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:36.417276 20199 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:36.417621 20199 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6a6a179665f543809050667ae9a3d7ef: stopping tablet replica
I20260709 13:09:36.436667 20199 master.cc:584] Master@127.19.185.254:33301 shutdown complete.
6e0ad5535d514f248afc3efe32b123e0  5
6fdd76f2a5e0443ea62b3e41b7fd9301  4
c2c7409ba50b4f7f8d646a48b24106cb  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10296 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:09:36.476254 20199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.185.254:40067
I20260709 13:09:36.477358 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:36.483174 21194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:36.483292 21195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:36.483580 21197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:36.484535 20199 server_base.cc:1061] running on GCE node
I20260709 13:09:36.485451 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:36.485644 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:36.485805 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602576485774 us; error 0 us; skew 500 ppm
I20260709 13:09:36.486330 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:36.488680 20199 webserver.cc:533] Webserver started at http://127.19.185.254:44775/ using document root <none> and password file <none>
I20260709 13:09:36.489171 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:36.489357 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:36.489637 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:36.490756 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/master-0-root/instance:
uuid: "5338d281947a4ef192ba752d67ec0067"
format_stamp: "Formatted at 2026-07-09 13:09:36 on dist-test-slave-rrf3"
I20260709 13:09:36.495482 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:36.498735 21202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.499477 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:36.499778 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/master-0-root
uuid: "5338d281947a4ef192ba752d67ec0067"
format_stamp: "Formatted at 2026-07-09 13:09:36 on dist-test-slave-rrf3"
I20260709 13:09:36.500073 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:36.508358 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:36.509557 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:36.549482 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.254:40067
I20260709 13:09:36.549609 21253 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.254:40067 every 8 connection(s)
I20260709 13:09:36.553385 21254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:36.564854 21254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Bootstrap starting.
I20260709 13:09:36.570024 21254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.574621 21254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: No bootstrap required, opened a new log
I20260709 13:09:36.576949 21254 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5338d281947a4ef192ba752d67ec0067" member_type: VOTER }
I20260709 13:09:36.577382 21254 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.577695 21254 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5338d281947a4ef192ba752d67ec0067, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.578374 21254 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5338d281947a4ef192ba752d67ec0067" member_type: VOTER }
I20260709 13:09:36.578892 21254 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:36.579118 21254 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:36.579438 21254 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.584096 21254 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5338d281947a4ef192ba752d67ec0067" member_type: VOTER }
I20260709 13:09:36.584703 21254 leader_election.cc:304] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5338d281947a4ef192ba752d67ec0067; no voters: 
I20260709 13:09:36.585913 21254 leader_election.cc:290] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:36.586264 21257 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.587718 21257 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 1 LEADER]: Becoming Leader. State: Replica: 5338d281947a4ef192ba752d67ec0067, State: Running, Role: LEADER
I20260709 13:09:36.588435 21257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5338d281947a4ef192ba752d67ec0067" member_type: VOTER }
I20260709 13:09:36.589274 21254 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:36.593762 21259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5338d281947a4ef192ba752d67ec0067. Latest consensus state: current_term: 1 leader_uuid: "5338d281947a4ef192ba752d67ec0067" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5338d281947a4ef192ba752d67ec0067" member_type: VOTER } }
I20260709 13:09:36.594087 21258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5338d281947a4ef192ba752d67ec0067" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5338d281947a4ef192ba752d67ec0067" member_type: VOTER } }
I20260709 13:09:36.594684 21259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:36.594880 21258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:36.597034 21264 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:36.601874 21264 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:36.606693 20199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:36.610894 21264 catalog_manager.cc:1383] Generated new cluster ID: 485fdf370cb44504910b69d52829e7ac
I20260709 13:09:36.611244 21264 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:36.649101 21264 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:36.650386 21264 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:36.664001 21264 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Generated new TSK 0
I20260709 13:09:36.664696 21264 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:36.674270 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:36.679924 21275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:36.681567 21276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:36.682521 21278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:36.683449 20199 server_base.cc:1061] running on GCE node
I20260709 13:09:36.684468 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:36.684667 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:36.684888 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602576684850 us; error 0 us; skew 500 ppm
I20260709 13:09:36.685528 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:36.687837 20199 webserver.cc:533] Webserver started at http://127.19.185.193:39331/ using document root <none> and password file <none>
I20260709 13:09:36.688355 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:36.688548 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:36.688831 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:36.689898 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/instance:
uuid: "058db415e9884ea0ba23f1e1ff59127a"
format_stamp: "Formatted at 2026-07-09 13:09:36 on dist-test-slave-rrf3"
I20260709 13:09:36.694459 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:36.697640 21283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.698351 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:36.698645 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "058db415e9884ea0ba23f1e1ff59127a"
format_stamp: "Formatted at 2026-07-09 13:09:36 on dist-test-slave-rrf3"
I20260709 13:09:36.698938 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:36.731812 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:36.733258 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:36.734892 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:36.737329 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:36.737572 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.737847 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:36.738061 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.780673 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:45701
I20260709 13:09:36.780766 21345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:45701 every 8 connection(s)
I20260709 13:09:36.786168 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:36.793081 21350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:36.794691 21351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:36.797984 20199 server_base.cc:1061] running on GCE node
W20260709 13:09:36.797932 21354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:36.799346 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:36.799576 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:36.799793 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602576799777 us; error 0 us; skew 500 ppm
I20260709 13:09:36.800485 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:36.803448 20199 webserver.cc:533] Webserver started at http://127.19.185.194:44505/ using document root <none> and password file <none>
I20260709 13:09:36.804126 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:36.804324 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:36.804603 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:36.806174 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/instance:
uuid: "d41c71e861344f0b90e8d44a8d0a3173"
format_stamp: "Formatted at 2026-07-09 13:09:36 on dist-test-slave-rrf3"
I20260709 13:09:36.807525 21346 heartbeater.cc:344] Connected to a master server at 127.19.185.254:40067
I20260709 13:09:36.807878 21346 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:36.808662 21346 heartbeater.cc:507] Master 127.19.185.254:40067 requested a full tablet report, sending...
I20260709 13:09:36.810947 21219 ts_manager.cc:194] Registered new tserver with Master: 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
I20260709 13:09:36.811519 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:36.812903 21219 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40750
I20260709 13:09:36.815111 21358 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.816005 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:36.816458 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root
uuid: "d41c71e861344f0b90e8d44a8d0a3173"
format_stamp: "Formatted at 2026-07-09 13:09:36 on dist-test-slave-rrf3"
I20260709 13:09:36.816813 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:36.838505 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:36.839783 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:36.841406 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:36.843775 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:36.844044 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.844358 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:36.844548 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.886552 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.194:41493
I20260709 13:09:36.886675 21420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.194:41493 every 8 connection(s)
I20260709 13:09:36.891896 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:36.899552 21424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:36.901690 21425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:36.904294 21421 heartbeater.cc:344] Connected to a master server at 127.19.185.254:40067
I20260709 13:09:36.904796 21421 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:36.905740 21421 heartbeater.cc:507] Master 127.19.185.254:40067 requested a full tablet report, sending...
I20260709 13:09:36.905918 20199 server_base.cc:1061] running on GCE node
W20260709 13:09:36.906354 21428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:36.907545 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:36.907795 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:36.907999 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602576907982 us; error 0 us; skew 500 ppm
I20260709 13:09:36.908263 21219 ts_manager.cc:194] Registered new tserver with Master: d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:36.908701 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:36.909823 21219 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40758
I20260709 13:09:36.911562 20199 webserver.cc:533] Webserver started at http://127.19.185.195:37827/ using document root <none> and password file <none>
I20260709 13:09:36.912142 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:36.912354 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:36.912613 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:36.913693 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/instance:
uuid: "33be1cb5cfc143fc90e164888c96cc6f"
format_stamp: "Formatted at 2026-07-09 13:09:36 on dist-test-slave-rrf3"
I20260709 13:09:36.918749 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:09:36.922010 21432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.922870 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:36.923187 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root
uuid: "33be1cb5cfc143fc90e164888c96cc6f"
format_stamp: "Formatted at 2026-07-09 13:09:36 on dist-test-slave-rrf3"
I20260709 13:09:36.923467 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:36.953796 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:36.955029 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:36.956681 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:36.958948 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:36.959188 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:36.959432 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:36.959602 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:37.005817 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.195:45119
I20260709 13:09:37.005924 21494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.195:45119 every 8 connection(s)
I20260709 13:09:37.019963 21495 heartbeater.cc:344] Connected to a master server at 127.19.185.254:40067
I20260709 13:09:37.020473 21495 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:37.021275 21495 heartbeater.cc:507] Master 127.19.185.254:40067 requested a full tablet report, sending...
I20260709 13:09:37.023300 21219 ts_manager.cc:194] Registered new tserver with Master: 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:37.023675 20199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014680312s
I20260709 13:09:37.024819 21219 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40774
I20260709 13:09:37.050046 21219 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40780:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:37.056281 21219 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:37.258921 21310 tablet_service.cc:1511] Processing CreateTablet for tablet ee8ee0dfd2df46d583c09b3893e01a89 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:37.260438 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8ee0dfd2df46d583c09b3893e01a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.262542 21306 tablet_service.cc:1511] Processing CreateTablet for tablet 9d344e412d584b97b86c32794fb7fb2b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:37.263182 21305 tablet_service.cc:1511] Processing CreateTablet for tablet 67210417ec2d4ac885d194a18af541f3 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:37.265172 21307 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0d19b3841a44cdbbb32daa4e1ddc06 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:37.266360 21458 tablet_service.cc:1511] Processing CreateTablet for tablet daddf6dabfd442eb82ef13b979cf0aa7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:37.267072 21309 tablet_service.cc:1511] Processing CreateTablet for tablet daddf6dabfd442eb82ef13b979cf0aa7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:37.267778 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daddf6dabfd442eb82ef13b979cf0aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.268152 21455 tablet_service.cc:1511] Processing CreateTablet for tablet 9d344e412d584b97b86c32794fb7fb2b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:37.269434 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d344e412d584b97b86c32794fb7fb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.269237 21308 tablet_service.cc:1511] Processing CreateTablet for tablet 30bf17cca2e64e76b923a076142551ff (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:37.271418 21311 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2d5354d62e4be08f444a5f6556b8dc (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:37.272306 21454 tablet_service.cc:1511] Processing CreateTablet for tablet 67210417ec2d4ac885d194a18af541f3 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:37.273178 21456 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0d19b3841a44cdbbb32daa4e1ddc06 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:37.273667 21454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67210417ec2d4ac885d194a18af541f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.263914 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d344e412d584b97b86c32794fb7fb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.274468 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0d19b3841a44cdbbb32daa4e1ddc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.275601 21304 tablet_service.cc:1511] Processing CreateTablet for tablet e6c1e6c7efbf499daf584842b0aca96c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:37.277027 21304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c1e6c7efbf499daf584842b0aca96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.277243 21384 tablet_service.cc:1511] Processing CreateTablet for tablet daddf6dabfd442eb82ef13b979cf0aa7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:37.278596 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daddf6dabfd442eb82ef13b979cf0aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.278906 21386 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2d5354d62e4be08f444a5f6556b8dc (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:37.280356 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bf17cca2e64e76b923a076142551ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.281201 21383 tablet_service.cc:1511] Processing CreateTablet for tablet 30bf17cca2e64e76b923a076142551ff (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:37.277246 21457 tablet_service.cc:1511] Processing CreateTablet for tablet 30bf17cca2e64e76b923a076142551ff (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:37.282653 21460 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2d5354d62e4be08f444a5f6556b8dc (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:37.283591 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bf17cca2e64e76b923a076142551ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.265202 21459 tablet_service.cc:1511] Processing CreateTablet for tablet ee8ee0dfd2df46d583c09b3893e01a89 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:37.284364 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2d5354d62e4be08f444a5f6556b8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.284984 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8ee0dfd2df46d583c09b3893e01a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.275681 21385 tablet_service.cc:1511] Processing CreateTablet for tablet ee8ee0dfd2df46d583c09b3893e01a89 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:37.288153 21460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2d5354d62e4be08f444a5f6556b8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.288378 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67210417ec2d4ac885d194a18af541f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.290057 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daddf6dabfd442eb82ef13b979cf0aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.294842 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0d19b3841a44cdbbb32daa4e1ddc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.297887 21453 tablet_service.cc:1511] Processing CreateTablet for tablet e6c1e6c7efbf499daf584842b0aca96c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:37.299366 21453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c1e6c7efbf499daf584842b0aca96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.301741 21382 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0d19b3841a44cdbbb32daa4e1ddc06 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:37.304975 21381 tablet_service.cc:1511] Processing CreateTablet for tablet 9d344e412d584b97b86c32794fb7fb2b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:37.306788 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2d5354d62e4be08f444a5f6556b8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.306380 21303 tablet_service.cc:1511] Processing CreateTablet for tablet 077d2ef89a5347dc8b8e863085f1d4e2 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:37.311875 21303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077d2ef89a5347dc8b8e863085f1d4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.316427 21383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bf17cca2e64e76b923a076142551ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.317528 21380 tablet_service.cc:1511] Processing CreateTablet for tablet 67210417ec2d4ac885d194a18af541f3 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:37.318909 21380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67210417ec2d4ac885d194a18af541f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.318805 21378 tablet_service.cc:1511] Processing CreateTablet for tablet 077d2ef89a5347dc8b8e863085f1d4e2 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:37.320304 21378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077d2ef89a5347dc8b8e863085f1d4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.321271 21452 tablet_service.cc:1511] Processing CreateTablet for tablet 077d2ef89a5347dc8b8e863085f1d4e2 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:37.323614 21452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077d2ef89a5347dc8b8e863085f1d4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.325209 21302 tablet_service.cc:1511] Processing CreateTablet for tablet 624d76b3bc214b53b7565f644d236663 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:37.325996 21379 tablet_service.cc:1511] Processing CreateTablet for tablet e6c1e6c7efbf499daf584842b0aca96c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:37.327911 21302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 624d76b3bc214b53b7565f644d236663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.328250 21451 tablet_service.cc:1511] Processing CreateTablet for tablet 624d76b3bc214b53b7565f644d236663 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:37.330552 21451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 624d76b3bc214b53b7565f644d236663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.340016 21377 tablet_service.cc:1511] Processing CreateTablet for tablet 624d76b3bc214b53b7565f644d236663 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:37.344460 21381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d344e412d584b97b86c32794fb7fb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.348405 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c1e6c7efbf499daf584842b0aca96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.349777 21385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8ee0dfd2df46d583c09b3893e01a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.350888 21382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0d19b3841a44cdbbb32daa4e1ddc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.354691 21377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 624d76b3bc214b53b7565f644d236663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.393373 21454 tablet_service.cc:1511] Processing CreateTablet for tablet ce267b84e93f48afa7ad5caa450b982a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:37.394788 21454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce267b84e93f48afa7ad5caa450b982a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.403185 21305 tablet_service.cc:1511] Processing CreateTablet for tablet ce267b84e93f48afa7ad5caa450b982a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:37.407598 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce267b84e93f48afa7ad5caa450b982a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.417017 21384 tablet_service.cc:1511] Processing CreateTablet for tablet ce267b84e93f48afa7ad5caa450b982a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:37.444353 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce267b84e93f48afa7ad5caa450b982a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.452837 21510 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:37.466039 21455 tablet_service.cc:1511] Processing CreateTablet for tablet e7cc0b64eb784638b78409562870a2db (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:37.466813 21510 tablet_bootstrap.cc:654] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.467466 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7cc0b64eb784638b78409562870a2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.463945 21511 tablet_bootstrap.cc:492] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:37.451480 21378 tablet_service.cc:1511] Processing CreateTablet for tablet e7cc0b64eb784638b78409562870a2db (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:37.485080 21378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7cc0b64eb784638b78409562870a2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.486789 21303 tablet_service.cc:1511] Processing CreateTablet for tablet 904858d649144d589875f088692f104f (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:37.490279 21303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904858d649144d589875f088692f104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.480520 21309 tablet_service.cc:1511] Processing CreateTablet for tablet e7cc0b64eb784638b78409562870a2db (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:37.502698 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7cc0b64eb784638b78409562870a2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.507033 21511 tablet_bootstrap.cc:654] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.496101 21512 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:37.513259 21307 tablet_service.cc:1511] Processing CreateTablet for tablet 24db01a278af4a82a16f038fedabf4d3 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:37.514596 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24db01a278af4a82a16f038fedabf4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.514776 21383 tablet_service.cc:1511] Processing CreateTablet for tablet 904858d649144d589875f088692f104f (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:37.516121 21383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904858d649144d589875f088692f104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.517616 21512 tablet_bootstrap.cc:654] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.518054 21458 tablet_service.cc:1511] Processing CreateTablet for tablet 24db01a278af4a82a16f038fedabf4d3 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:37.521751 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24db01a278af4a82a16f038fedabf4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.525172 21456 tablet_service.cc:1511] Processing CreateTablet for tablet 904858d649144d589875f088692f104f (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:37.526499 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904858d649144d589875f088692f104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.529438 21382 tablet_service.cc:1511] Processing CreateTablet for tablet 24db01a278af4a82a16f038fedabf4d3 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:37.553416 21311 tablet_service.cc:1511] Processing CreateTablet for tablet 1e997d08de0c4a8b9b07e0741628b23f (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:37.554740 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e997d08de0c4a8b9b07e0741628b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.556406 21382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24db01a278af4a82a16f038fedabf4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.560498 21454 tablet_service.cc:1511] Processing CreateTablet for tablet 1e997d08de0c4a8b9b07e0741628b23f (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:37.561821 21454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e997d08de0c4a8b9b07e0741628b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.562291 21308 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2910eb954d42858344d5b85eefd955 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:37.563512 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2910eb954d42858344d5b85eefd955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.568756 21378 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2910eb954d42858344d5b85eefd955 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:37.572454 21452 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2910eb954d42858344d5b85eefd955 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:37.573158 21510 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:37.573638 21510 ts_tablet_manager.cc:1403] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.121s	user 0.007s	sys 0.005s
I20260709 13:09:37.573814 21452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2910eb954d42858344d5b85eefd955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.578929 21378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2910eb954d42858344d5b85eefd955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.580812 21512 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:37.581329 21512 ts_tablet_manager.cc:1403] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.008s
I20260709 13:09:37.585124 21307 tablet_service.cc:1511] Processing CreateTablet for tablet da4a8cf8f0864a8390aba6652b02015e (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:37.586033 21383 tablet_service.cc:1511] Processing CreateTablet for tablet da4a8cf8f0864a8390aba6652b02015e (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:37.587337 21383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4a8cf8f0864a8390aba6652b02015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.588210 21512 raft_consensus.cc:359] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.586427 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4a8cf8f0864a8390aba6652b02015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.588972 21512 raft_consensus.cc:385] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.589315 21512 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.589596 21511 tablet_bootstrap.cc:492] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:37.590026 21511 ts_tablet_manager.cc:1403] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.004s
I20260709 13:09:37.590345 21510 raft_consensus.cc:359] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.591137 21510 raft_consensus.cc:385] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.591035 21460 tablet_service.cc:1511] Processing CreateTablet for tablet da4a8cf8f0864a8390aba6652b02015e (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:37.591503 21510 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.592428 21460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4a8cf8f0864a8390aba6652b02015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.592319 21510 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.593147 21511 raft_consensus.cc:359] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.593847 21511 raft_consensus.cc:385] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.594130 21511 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.597121 21302 tablet_service.cc:1511] Processing CreateTablet for tablet 4cfcdfda7a4840b78d5a89acd61b8d23 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:37.598392 21302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cfcdfda7a4840b78d5a89acd61b8d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.600343 21453 tablet_service.cc:1511] Processing CreateTablet for tablet 4cfcdfda7a4840b78d5a89acd61b8d23 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:37.601644 21453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cfcdfda7a4840b78d5a89acd61b8d23. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:37.602207 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:37.594969 21511 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.590044 21512 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.606468 21305 tablet_service.cc:1511] Processing CreateTablet for tablet 26e3d859a1534f11ba508b90ad562a1b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:37.607756 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e3d859a1534f11ba508b90ad562a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.612785 21377 tablet_service.cc:1511] Processing CreateTablet for tablet 4cfcdfda7a4840b78d5a89acd61b8d23 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:37.620357 21382 tablet_service.cc:1511] Processing CreateTablet for tablet 26e3d859a1534f11ba508b90ad562a1b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:37.623191 21384 tablet_service.cc:1511] Processing CreateTablet for tablet 1e997d08de0c4a8b9b07e0741628b23f (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:37.623528 21459 tablet_service.cc:1511] Processing CreateTablet for tablet 26e3d859a1534f11ba508b90ad562a1b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:37.624778 21386 tablet_service.cc:1511] Processing CreateTablet for tablet 96bf4c40f9a04c6290d5223c4a18640d (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:37.633263 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e3d859a1534f11ba508b90ad562a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.634029 21385 tablet_service.cc:1511] Processing CreateTablet for tablet 462e641564c94eedaaaa398b75fb188e (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:37.626477 21309 tablet_service.cc:1511] Processing CreateTablet for tablet 96bf4c40f9a04c6290d5223c4a18640d (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:37.635524 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bf4c40f9a04c6290d5223c4a18640d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.636322 21451 tablet_service.cc:1511] Processing CreateTablet for tablet 462e641564c94eedaaaa398b75fb188e (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:37.637547 21451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462e641564c94eedaaaa398b75fb188e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.628494 21457 tablet_service.cc:1511] Processing CreateTablet for tablet 96bf4c40f9a04c6290d5223c4a18640d (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:37.630131 21306 tablet_service.cc:1511] Processing CreateTablet for tablet 462e641564c94eedaaaa398b75fb188e (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:37.643338 21421 heartbeater.cc:499] Master 127.19.185.254:40067 was elected leader, sending a full tablet report...
I20260709 13:09:37.651012 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462e641564c94eedaaaa398b75fb188e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.651017 21381 tablet_service.cc:1511] Processing CreateTablet for tablet aff1f323e1c14a199b956742e2f69120 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:37.654246 21511 ts_tablet_manager.cc:1434] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.064s	user 0.003s	sys 0.012s
I20260709 13:09:37.654678 21379 tablet_service.cc:1511] Processing CreateTablet for tablet 89e2aa178e8e4c63a6f5f660d5314ba7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:37.656659 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bf4c40f9a04c6290d5223c4a18640d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.660688 21455 tablet_service.cc:1511] Processing CreateTablet for tablet aff1f323e1c14a199b956742e2f69120 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:37.661814 21346 heartbeater.cc:499] Master 127.19.185.254:40067 was elected leader, sending a full tablet report...
I20260709 13:09:37.667769 21456 tablet_service.cc:1511] Processing CreateTablet for tablet 89e2aa178e8e4c63a6f5f660d5314ba7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:37.670922 21380 tablet_service.cc:1511] Processing CreateTablet for tablet 4a81f5eab37044228b941f7eb2be5912 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:37.671382 21310 tablet_service.cc:1511] Processing CreateTablet for tablet 89e2aa178e8e4c63a6f5f660d5314ba7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:37.672751 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e2aa178e8e4c63a6f5f660d5314ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.677294 21512 ts_tablet_manager.cc:1434] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.096s	user 0.013s	sys 0.016s
I20260709 13:09:37.677032 21304 tablet_service.cc:1511] Processing CreateTablet for tablet 4a81f5eab37044228b941f7eb2be5912 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:37.678306 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff1f323e1c14a199b956742e2f69120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.678364 21304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a81f5eab37044228b941f7eb2be5912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.679076 21454 tablet_service.cc:1511] Processing CreateTablet for tablet 4a81f5eab37044228b941f7eb2be5912 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:37.685047 21510 ts_tablet_manager.cc:1434] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.111s	user 0.010s	sys 0.005s
I20260709 13:09:37.688840 21495 heartbeater.cc:499] Master 127.19.185.254:40067 was elected leader, sending a full tablet report...
I20260709 13:09:37.696852 21305 tablet_service.cc:1511] Processing CreateTablet for tablet f384b96e64eb4aa9a99fd8372643b01c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:37.698228 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f384b96e64eb4aa9a99fd8372643b01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.705562 21454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a81f5eab37044228b941f7eb2be5912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.706615 21385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462e641564c94eedaaaa398b75fb188e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.708555 21377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cfcdfda7a4840b78d5a89acd61b8d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.709847 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e2aa178e8e4c63a6f5f660d5314ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.712575 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e2aa178e8e4c63a6f5f660d5314ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.716565 21382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e3d859a1534f11ba508b90ad562a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.717384 21380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a81f5eab37044228b941f7eb2be5912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.720371 21381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff1f323e1c14a199b956742e2f69120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.723475 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bf4c40f9a04c6290d5223c4a18640d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.727200 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e997d08de0c4a8b9b07e0741628b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.727550 21512 tablet_bootstrap.cc:492] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:37.736526 21511 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:37.745321 21378 tablet_service.cc:1511] Processing CreateTablet for tablet a40320a19af04e62afc637834ab759b2 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:37.746994 21378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40320a19af04e62afc637834ab759b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.695930 21303 tablet_service.cc:1511] Processing CreateTablet for tablet a40320a19af04e62afc637834ab759b2 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:37.753535 21303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40320a19af04e62afc637834ab759b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.766376 21452 tablet_service.cc:1511] Processing CreateTablet for tablet a40320a19af04e62afc637834ab759b2 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:37.771203 21452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40320a19af04e62afc637834ab759b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.767079 21510 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:37.779132 21381 tablet_service.cc:1511] Processing CreateTablet for tablet f384b96e64eb4aa9a99fd8372643b01c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:37.786513 21458 tablet_service.cc:1511] Processing CreateTablet for tablet c90920283ad9436b891dae0b916f29d7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:37.787357 21455 tablet_service.cc:1511] Processing CreateTablet for tablet f384b96e64eb4aa9a99fd8372643b01c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:37.774366 21512 tablet_bootstrap.cc:654] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.754840 21308 tablet_service.cc:1511] Processing CreateTablet for tablet a55c6ecc97b34d419d7290080bc4a2c8 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:37.791352 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c6ecc97b34d419d7290080bc4a2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.796607 21511 tablet_bootstrap.cc:654] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.800746 21510 tablet_bootstrap.cc:654] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.801152 21459 tablet_service.cc:1511] Processing CreateTablet for tablet a55c6ecc97b34d419d7290080bc4a2c8 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:37.804733 21381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f384b96e64eb4aa9a99fd8372643b01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.788023 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90920283ad9436b891dae0b916f29d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.808444 21311 tablet_service.cc:1511] Processing CreateTablet for tablet aff1f323e1c14a199b956742e2f69120 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:37.817946 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff1f323e1c14a199b956742e2f69120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.820099 21379 tablet_service.cc:1511] Processing CreateTablet for tablet a55c6ecc97b34d419d7290080bc4a2c8 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:37.825623 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c6ecc97b34d419d7290080bc4a2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.821879 21304 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2812c891d248ecafa8f302d2b72c45 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:37.830276 21302 tablet_service.cc:1511] Processing CreateTablet for tablet c90920283ad9436b891dae0b916f29d7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:37.823596 21453 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2812c891d248ecafa8f302d2b72c45 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:37.830776 21304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2812c891d248ecafa8f302d2b72c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.838553 21384 tablet_service.cc:1511] Processing CreateTablet for tablet c90920283ad9436b891dae0b916f29d7 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:37.843293 21310 tablet_service.cc:1511] Processing CreateTablet for tablet 71b8185650734d438c79a9d575a2b2f5 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:37.835460 21460 tablet_service.cc:1511] Processing CreateTablet for tablet 71b8185650734d438c79a9d575a2b2f5 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:37.850661 21378 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2812c891d248ecafa8f302d2b72c45 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:37.839929 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90920283ad9436b891dae0b916f29d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.856244 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f384b96e64eb4aa9a99fd8372643b01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.858009 21385 tablet_service.cc:1511] Processing CreateTablet for tablet 71b8185650734d438c79a9d575a2b2f5 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:37.872251 21302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90920283ad9436b891dae0b916f29d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.872435 21385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b8185650734d438c79a9d575a2b2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.880746 21378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2812c891d248ecafa8f302d2b72c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.882638 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c6ecc97b34d419d7290080bc4a2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.892721 21380 tablet_service.cc:1511] Processing CreateTablet for tablet d7bf8c65f80c468c8e47986515ea7c80 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:37.894169 21380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bf8c65f80c468c8e47986515ea7c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.896159 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b8185650734d438c79a9d575a2b2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.898999 21510 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:37.899554 21510 ts_tablet_manager.cc:1403] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.140s	user 0.013s	sys 0.009s
I20260709 13:09:37.899170 21377 tablet_service.cc:1511] Processing CreateTablet for tablet 06666c92a06645dc8a8977e923b51e37 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:37.901847 21511 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:37.902194 21377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06666c92a06645dc8a8977e923b51e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.902382 21511 ts_tablet_manager.cc:1403] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.018s
I20260709 13:09:37.905812 21381 tablet_service.cc:1511] Processing CreateTablet for tablet 099cc7d3a89e468b91e21306fa23a0be (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:37.888765 21456 tablet_service.cc:1511] Processing CreateTablet for tablet c368bc506e8e4024b128c98b0a2a3ae4 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:37.908213 21517 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.927546 21517 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.928529 21512 tablet_bootstrap.cc:492] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:37.929072 21512 ts_tablet_manager.cc:1403] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.202s	user 0.016s	sys 0.004s
I20260709 13:09:37.931634 21517 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:37.913370 21451 tablet_service.cc:1511] Processing CreateTablet for tablet d7bf8c65f80c468c8e47986515ea7c80 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:37.913898 21303 tablet_service.cc:1511] Processing CreateTablet for tablet c368bc506e8e4024b128c98b0a2a3ae4 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:37.915019 21510 raft_consensus.cc:359] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.917131 21386 tablet_service.cc:1511] Processing CreateTablet for tablet c368bc506e8e4024b128c98b0a2a3ae4 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:37.921682 21511 raft_consensus.cc:359] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.942121 21303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c368bc506e8e4024b128c98b0a2a3ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.932364 21453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2812c891d248ecafa8f302d2b72c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.938581 21511 raft_consensus.cc:385] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.950421 21511 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.951304 21511 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.954435 21511 ts_tablet_manager.cc:1434] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:09:37.938774 21510 raft_consensus.cc:385] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.962216 21451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bf8c65f80c468c8e47986515ea7c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.983419 21510 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.984216 21510 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.984712 21457 tablet_service.cc:1511] Processing CreateTablet for tablet 06666c92a06645dc8a8977e923b51e37 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:37.986742 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06666c92a06645dc8a8977e923b51e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.988437 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c368bc506e8e4024b128c98b0a2a3ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.988904 21510 ts_tablet_manager.cc:1434] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.005s
I20260709 13:09:37.989894 21510 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:37.996565 21460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b8185650734d438c79a9d575a2b2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.963003 21383 tablet_service.cc:1511] Processing CreateTablet for tablet 849cad40897e412da9a737986240fc35 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:37.964421 21512 raft_consensus.cc:359] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:37.968911 21309 tablet_service.cc:1511] Processing CreateTablet for tablet d7bf8c65f80c468c8e47986515ea7c80 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:37.981969 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c368bc506e8e4024b128c98b0a2a3ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:37.999008 21512 raft_consensus.cc:385] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.000269 21512 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.002190 21381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099cc7d3a89e468b91e21306fa23a0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.002519 21512 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.005406 21516 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.005882 21516 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.000087 21510 tablet_bootstrap.cc:654] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.009083 21512 ts_tablet_manager.cc:1434] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 13:09:38.010958 21516 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:38.015746 21383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849cad40897e412da9a737986240fc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.030092 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bf8c65f80c468c8e47986515ea7c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.031461 21512 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:38.034915 21307 tablet_service.cc:1511] Processing CreateTablet for tablet 849cad40897e412da9a737986240fc35 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:38.035449 21305 tablet_service.cc:1511] Processing CreateTablet for tablet 06666c92a06645dc8a8977e923b51e37 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:38.041242 21458 tablet_service.cc:1511] Processing CreateTablet for tablet 099cc7d3a89e468b91e21306fa23a0be (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:38.043299 21511 tablet_bootstrap.cc:492] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:38.044174 21384 tablet_service.cc:1511] Processing CreateTablet for tablet efd59ed9e9fc41bbae9dde704923fee4 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:38.059355 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd59ed9e9fc41bbae9dde704923fee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.060210 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099cc7d3a89e468b91e21306fa23a0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.045914 21304 tablet_service.cc:1511] Processing CreateTablet for tablet efd59ed9e9fc41bbae9dde704923fee4 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:38.047808 21306 tablet_service.cc:1511] Processing CreateTablet for tablet f8909ec5d582450ba80932fa543ad4a1 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:38.050732 21512 tablet_bootstrap.cc:654] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.079764 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849cad40897e412da9a737986240fc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.096876 21385 tablet_service.cc:1511] Processing CreateTablet for tablet f8909ec5d582450ba80932fa543ad4a1 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:38.098295 21385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8909ec5d582450ba80932fa543ad4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.101691 21518 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.102334 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8909ec5d582450ba80932fa543ad4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.102229 21518 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.108371 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06666c92a06645dc8a8977e923b51e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.109959 21511 tablet_bootstrap.cc:654] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.111510 21310 tablet_service.cc:1511] Processing CreateTablet for tablet bb2ce5a5a1e3461d8e0031fdfef61569 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:38.113618 21304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd59ed9e9fc41bbae9dde704923fee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.116488 21517 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.117158 21517 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.122999 21517 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:38.125312 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2ce5a5a1e3461d8e0031fdfef61569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.125669 21302 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5dc87735964c6b97851e73311aee5a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:38.127041 21302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5dc87735964c6b97851e73311aee5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.132649 21308 tablet_service.cc:1511] Processing CreateTablet for tablet 099cc7d3a89e468b91e21306fa23a0be (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:38.134121 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099cc7d3a89e468b91e21306fa23a0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.134891 21379 tablet_service.cc:1511] Processing CreateTablet for tablet fbc8cdcfe1ff495b82553486dbada070 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:38.136390 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc8cdcfe1ff495b82553486dbada070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.119482 21303 tablet_service.cc:1511] Processing CreateTablet for tablet 6629858a6e4c4461a471763a94f0effa (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:38.139504 21303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6629858a6e4c4461a471763a94f0effa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.149243 21452 tablet_service.cc:1511] Processing CreateTablet for tablet 849cad40897e412da9a737986240fc35 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:38.150727 21452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849cad40897e412da9a737986240fc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.152340 21518 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:38.155222 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:38.157039 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:38.158998 21362 leader_election.cc:343] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:38.167009 21362 leader_election.cc:343] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.172340 21518 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.180730 21518 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.182914 21518 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:38.184957 21456 tablet_service.cc:1511] Processing CreateTablet for tablet efd59ed9e9fc41bbae9dde704923fee4 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:38.186440 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd59ed9e9fc41bbae9dde704923fee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.189177 21459 tablet_service.cc:1511] Processing CreateTablet for tablet f8909ec5d582450ba80932fa543ad4a1 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:38.190542 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8909ec5d582450ba80932fa543ad4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.192397 21516 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.192903 21516 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.195122 21516 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:38.147874 21311 tablet_service.cc:1511] Processing CreateTablet for tablet fbc8cdcfe1ff495b82553486dbada070 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:38.224833 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc8cdcfe1ff495b82553486dbada070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.226889 21511 tablet_bootstrap.cc:492] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:38.227401 21511 ts_tablet_manager.cc:1403] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.031s
I20260709 13:09:38.239722 21305 tablet_service.cc:1511] Processing CreateTablet for tablet 85584105b0f74652871311c68f5de4db (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:38.241626 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85584105b0f74652871311c68f5de4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.245195 21377 tablet_service.cc:1511] Processing CreateTablet for tablet 6629858a6e4c4461a471763a94f0effa (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:38.247077 21377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6629858a6e4c4461a471763a94f0effa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.210701 21512 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:38.257931 21512 ts_tablet_manager.cc:1403] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.227s	user 0.020s	sys 0.014s
I20260709 13:09:38.259982 21382 tablet_service.cc:1511] Processing CreateTablet for tablet bb2ce5a5a1e3461d8e0031fdfef61569 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:38.260972 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:38.263041 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:38.264891 21360 leader_election.cc:343] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.271528 21382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2ce5a5a1e3461d8e0031fdfef61569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.272141 21511 raft_consensus.cc:359] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.272893 21511 raft_consensus.cc:385] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.273201 21511 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.268160 21360 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:09:38.274853 21360 leader_election.cc:343] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.274904 21517 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.275413 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:38.276412 21517 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.279280 21512 raft_consensus.cc:359] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.280079 21512 raft_consensus.cc:385] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.280439 21512 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.281028 21451 tablet_service.cc:1511] Processing CreateTablet for tablet bb2ce5a5a1e3461d8e0031fdfef61569 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:38.282938 21451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2ce5a5a1e3461d8e0031fdfef61569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.284323 21512 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.285087 21458 tablet_service.cc:1511] Processing CreateTablet for tablet 6629858a6e4c4461a471763a94f0effa (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:38.286302 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6629858a6e4c4461a471763a94f0effa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.289395 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:38.291400 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:38.291975 21320 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
W20260709 13:09:38.293076 21436 leader_election.cc:343] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.294174 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:38.294979 21516 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.295322 21516 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.295663 21516 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.296955 21452 tablet_service.cc:1511] Processing CreateTablet for tablet fbc8cdcfe1ff495b82553486dbada070 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:38.298276 21452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc8cdcfe1ff495b82553486dbada070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.303020 21516 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.310169 21380 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5dc87735964c6b97851e73311aee5a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:38.312328 21380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5dc87735964c6b97851e73311aee5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.319231 21453 tablet_service.cc:1511] Processing CreateTablet for tablet 85584105b0f74652871311c68f5de4db (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:38.320123 21457 tablet_service.cc:1511] Processing CreateTablet for tablet d0f870524af94ba487ca21790bc003cc (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:38.322422 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f870524af94ba487ca21790bc003cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.324901 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:38.326433 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:38.332908 21455 tablet_service.cc:1511] Processing CreateTablet for tablet 424be00d78cc41f1a80d41735ad881ae (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:38.348922 21516 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:09:38.328296 21434 leader_election.cc:343] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.350809 21434 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:38.328931 21453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85584105b0f74652871311c68f5de4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.353406 21517 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.351950 21434 leader_election.cc:343] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.335639 21510 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:38.358675 21510 ts_tablet_manager.cc:1403] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.369s	user 0.010s	sys 0.011s
I20260709 13:09:38.354914 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424be00d78cc41f1a80d41735ad881ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.354478 21517 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.330713 21384 tablet_service.cc:1511] Processing CreateTablet for tablet 85584105b0f74652871311c68f5de4db (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:38.361822 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85584105b0f74652871311c68f5de4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.361781 21517 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:38.361974 21510 raft_consensus.cc:359] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.362941 21510 raft_consensus.cc:385] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.363282 21510 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.364081 21510 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.364372 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:38.357239 21456 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5dc87735964c6b97851e73311aee5a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:09:38.370530 21360 leader_election.cc:343] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.371270 21512 ts_tablet_manager.cc:1434] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 13:09:38.372399 21512 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:38.380426 21381 tablet_service.cc:1511] Processing CreateTablet for tablet 1adedb939e97489f9d96abf3bff7f1bd (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:38.381147 21459 tablet_service.cc:1511] Processing CreateTablet for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:38.385445 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:38.388767 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:38.390035 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:38.365433 21516 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:38.390488 21362 leader_election.cc:343] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.390993 21362 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:38.392093 21517 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.390589 21320 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.394672 21304 tablet_service.cc:1511] Processing CreateTablet for tablet 424be00d78cc41f1a80d41735ad881ae (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:38.395902 21304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424be00d78cc41f1a80d41735ad881ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.396248 21310 tablet_service.cc:1511] Processing CreateTablet for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:38.389808 21309 tablet_service.cc:1511] Processing CreateTablet for tablet d0f870524af94ba487ca21790bc003cc (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:38.397454 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.402998 21378 tablet_service.cc:1511] Processing CreateTablet for tablet d0f870524af94ba487ca21790bc003cc (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:38.384549 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5dc87735964c6b97851e73311aee5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.366230 21511 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.407320 21511 ts_tablet_manager.cc:1434] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.180s	user 0.009s	sys 0.000s
I20260709 13:09:38.408249 21306 tablet_service.cc:1511] Processing CreateTablet for tablet 1adedb939e97489f9d96abf3bff7f1bd (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:38.415249 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f870524af94ba487ca21790bc003cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.415308 21381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1adedb939e97489f9d96abf3bff7f1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.416105 21378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f870524af94ba487ca21790bc003cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.420295 21320 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:38.424839 21511 tablet_bootstrap.cc:492] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:38.426167 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:38.331243 21383 tablet_service.cc:1511] Processing CreateTablet for tablet 424be00d78cc41f1a80d41735ad881ae (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:09:38.405097 21434 leader_election.cc:343] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.385617 21379 tablet_service.cc:1511] Processing CreateTablet for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:38.439793 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.448765 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:38.453090 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:38.453433 21386 tablet_service.cc:1511] Processing CreateTablet for tablet d1e856d5af49457aa83cfe00a413716d (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:38.453894 21469 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:38.449113 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1adedb939e97489f9d96abf3bff7f1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.456409 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:38.462239 21511 tablet_bootstrap.cc:654] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.463027 21383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424be00d78cc41f1a80d41735ad881ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.463747 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e856d5af49457aa83cfe00a413716d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.439783 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:38.464692 21308 tablet_service.cc:1511] Processing CreateTablet for tablet dffab1617f544c36913eb55e6bad723c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:38.465662 21516 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:38.465556 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61258.7us
I20260709 13:09:38.466293 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffab1617f544c36913eb55e6bad723c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.466238 21516 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:38.467422 21516 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.438638 21302 tablet_service.cc:1511] Processing CreateTablet for tablet d1e856d5af49457aa83cfe00a413716d (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:38.477334 21510 ts_tablet_manager.cc:1434] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.022s
W20260709 13:09:38.483657 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59569.5us
I20260709 13:09:38.485391 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.491631 21458 tablet_service.cc:1511] Processing CreateTablet for tablet 1adedb939e97489f9d96abf3bff7f1bd (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:38.492985 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1adedb939e97489f9d96abf3bff7f1bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:38.493120 21285 leader_election.cc:343] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.491994 21311 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ec37b4f0643d4b4d60d35243b93d8 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:09:38.506610 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63453.8us
W20260709 13:09:38.507304 21285 leader_election.cc:343] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.507721 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:38.508496 21518 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:38.509666 21285 leader_election.cc:343] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.509939 21457 tablet_service.cc:1511] Processing CreateTablet for tablet d1e856d5af49457aa83cfe00a413716d (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:38.510342 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:38.511056 21518 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.512172 21382 tablet_service.cc:1511] Processing CreateTablet for tablet dffab1617f544c36913eb55e6bad723c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:38.513394 21382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffab1617f544c36913eb55e6bad723c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.516696 21510 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:38.517166 21460 tablet_service.cc:1511] Processing CreateTablet for tablet dffab1617f544c36913eb55e6bad723c (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:38.503429 21302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e856d5af49457aa83cfe00a413716d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.520418 21380 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ec37b4f0643d4b4d60d35243b93d8 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:38.521674 21380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ec37b4f0643d4b4d60d35243b93d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.523355 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e856d5af49457aa83cfe00a413716d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.525017 21460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffab1617f544c36913eb55e6bad723c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.525504 21518 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.525945 21518 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.529011 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:38.529662 21395 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:38.530989 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:38.531523 21455 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ec37b4f0643d4b4d60d35243b93d8 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:38.533254 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ec37b4f0643d4b4d60d35243b93d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.555311 21518 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:38.555939 21518 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.561334 21518 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.561702 21518 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:38.564352 21204 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 45037.2us
I20260709 13:09:38.569310 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:38.570885 21285 leader_election.cc:343] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.573454 21217 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.578365 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ec37b4f0643d4b4d60d35243b93d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.578685 21518 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.579622 21511 tablet_bootstrap.cc:492] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:38.580128 21511 ts_tablet_manager.cc:1403] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.003s
I20260709 13:09:38.581647 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:38.582234 21395 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.583181 21511 raft_consensus.cc:359] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.583918 21511 raft_consensus.cc:385] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.589231 21395 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:38.591163 21511 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.592142 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:38.591970 21511 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.593197 21539 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.584928 21512 tablet_bootstrap.cc:654] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.597520 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:38.598026 21305 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4b245b41e47f6bf08fa982e5c1db1 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:09:38.598912 21285 leader_election.cc:343] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.599363 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4b245b41e47f6bf08fa982e5c1db1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:38.615343 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:38.616868 21308 tablet_service.cc:1511] Processing CreateTablet for tablet e7b73223e6ab497f810757f895658e8b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:38.599483 21518 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:38.626255 21377 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4b245b41e47f6bf08fa982e5c1db1 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:38.626621 21456 tablet_service.cc:1511] Processing CreateTablet for tablet e7b73223e6ab497f810757f895658e8b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:38.627897 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b73223e6ab497f810757f895658e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.628897 21377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4b245b41e47f6bf08fa982e5c1db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.629750 21384 tablet_service.cc:1511] Processing CreateTablet for tablet e7b73223e6ab497f810757f895658e8b (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:38.631124 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b73223e6ab497f810757f895658e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.636467 21457 tablet_service.cc:1511] Processing CreateTablet for tablet fcf4b245b41e47f6bf08fa982e5c1db1 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:38.637913 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf4b245b41e47f6bf08fa982e5c1db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.639140 21516 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.642624 21516 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.638623 21510 tablet_bootstrap.cc:654] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.644748 21516 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:38.653399 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:38.654039 21304 tablet_service.cc:1511] Processing CreateTablet for tablet 603c27f4d3de4b40878c1d29bcc0708a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:09:38.655057 21434 leader_election.cc:343] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.652252 21539 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:38.666265 21511 ts_tablet_manager.cc:1434] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.086s	user 0.018s	sys 0.025s
I20260709 13:09:38.668164 21309 tablet_service.cc:1511] Processing CreateTablet for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:38.670938 21303 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:38.673257 21307 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3784e213304c30beba718dd813ab39 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:38.673857 21512 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:38.682933 21512 ts_tablet_manager.cc:1403] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.311s	user 0.016s	sys 0.008s
I20260709 13:09:38.684731 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b73223e6ab497f810757f895658e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.693531 21381 tablet_service.cc:1511] Processing CreateTablet for tablet 603c27f4d3de4b40878c1d29bcc0708a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:38.695878 21381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603c27f4d3de4b40878c1d29bcc0708a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.695739 21386 tablet_service.cc:1511] Processing CreateTablet for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:38.697032 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.697198 21512 raft_consensus.cc:359] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.697926 21512 raft_consensus.cc:385] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.698221 21512 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.700631 21453 tablet_service.cc:1511] Processing CreateTablet for tablet 603c27f4d3de4b40878c1d29bcc0708a (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:38.701946 21453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603c27f4d3de4b40878c1d29bcc0708a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.701725 21512 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.714593 21379 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:38.717031 21378 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3784e213304c30beba718dd813ab39 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:38.716964 21451 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:38.715983 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.722278 21454 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3784e213304c30beba718dd813ab39 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:38.723357 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:38.723816 21454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3784e213304c30beba718dd813ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.719482 21452 tablet_service.cc:1511] Processing CreateTablet for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:38.719486 21512 ts_tablet_manager.cc:1434] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
W20260709 13:09:38.726312 21436 leader_election.cc:343] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.726646 21512 tablet_bootstrap.cc:492] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:38.726296 21385 tablet_service.cc:1511] Processing CreateTablet for tablet 3549d7d86f4c404f95fae0e1f6b84210 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:38.726909 21436 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:38.728050 21516 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.690230 21539 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.727123 21451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.730595 21306 tablet_service.cc:1511] Processing CreateTablet for tablet c4e9f5b52ad74d0d8f492da1f7ef4721 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:38.732414 21511 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:38.732224 21456 tablet_service.cc:1511] Processing CreateTablet for tablet c4e9f5b52ad74d0d8f492da1f7ef4721 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:38.732955 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e9f5b52ad74d0d8f492da1f7ef4721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.733459 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e9f5b52ad74d0d8f492da1f7ef4721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.724436 21378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3784e213304c30beba718dd813ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.736829 21385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3549d7d86f4c404f95fae0e1f6b84210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.738343 21452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.766607 21303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.767367 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3784e213304c30beba718dd813ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.766613 21382 tablet_service.cc:1511] Processing CreateTablet for tablet c4e9f5b52ad74d0d8f492da1f7ef4721 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:38.770826 21382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e9f5b52ad74d0d8f492da1f7ef4721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.767971 21304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603c27f4d3de4b40878c1d29bcc0708a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.785933 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.791066 21542 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.791590 21542 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.793803 21542 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:38.796422 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:38.797616 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:38.798182 21310 tablet_service.cc:1511] Processing CreateTablet for tablet 3549d7d86f4c404f95fae0e1f6b84210 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:09:38.799343 21285 leader_election.cc:343] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:38.800107 21285 leader_election.cc:343] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.800534 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:38.800823 21458 tablet_service.cc:1511] Processing CreateTablet for tablet 3549d7d86f4c404f95fae0e1f6b84210 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:38.801822 21542 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.802812 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3549d7d86f4c404f95fae0e1f6b84210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.799592 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3549d7d86f4c404f95fae0e1f6b84210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.819196 21510 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:38.819728 21510 ts_tablet_manager.cc:1403] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.317s	user 0.017s	sys 0.005s
I20260709 13:09:38.826807 21311 tablet_service.cc:1511] Processing CreateTablet for tablet c0b7a12853fc411b980438f7ae62ad14 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:38.807391 21302 tablet_service.cc:1511] Processing CreateTablet for tablet 984d063a64ef47f7b0783e2181604515 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:38.826820 21510 raft_consensus.cc:359] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.847921 21510 raft_consensus.cc:385] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.848424 21510 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.849382 21510 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:38.859161 21510 ts_tablet_manager.cc:1434] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:09:38.866326 21379 tablet_service.cc:1511] Processing CreateTablet for tablet c0b7a12853fc411b980438f7ae62ad14 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:38.867738 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b7a12853fc411b980438f7ae62ad14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.869596 21459 tablet_service.cc:1511] Processing CreateTablet for tablet c0b7a12853fc411b980438f7ae62ad14 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:38.870244 21512 tablet_bootstrap.cc:654] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.870908 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b7a12853fc411b980438f7ae62ad14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.872469 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b7a12853fc411b980438f7ae62ad14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.873027 21384 tablet_service.cc:1511] Processing CreateTablet for tablet 984d063a64ef47f7b0783e2181604515 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:38.874320 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984d063a64ef47f7b0783e2181604515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.876649 21510 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:38.877157 21455 tablet_service.cc:1511] Processing CreateTablet for tablet 984d063a64ef47f7b0783e2181604515 (DEFAULT_TABLE table=test-workload [id=e5d315cdd408479a84b8508fcc025e2e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:38.878409 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984d063a64ef47f7b0783e2181604515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.881667 21516 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.884404 21395 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.885422 21511 tablet_bootstrap.cc:654] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.902061 21516 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.929095 21302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984d063a64ef47f7b0783e2181604515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.938848 21219 catalog_manager.cc:5697] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.991819 21510 tablet_bootstrap.cc:654] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.002712 21511 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.003347 21511 ts_tablet_manager.cc:1403] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.275s	user 0.010s	sys 0.036s
I20260709 13:09:39.007014 21511 raft_consensus.cc:359] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.008005 21511 raft_consensus.cc:385] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.008401 21511 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.009564 21511 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.012795 21511 ts_tablet_manager.cc:1434] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:09:39.014154 21511 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:39.022691 21511 tablet_bootstrap.cc:654] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.037150 21512 tablet_bootstrap.cc:492] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.037794 21512 ts_tablet_manager.cc:1403] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.311s	user 0.023s	sys 0.006s
I20260709 13:09:39.041747 21512 raft_consensus.cc:359] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.042466 21512 raft_consensus.cc:385] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.042747 21512 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.043627 21512 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.046227 21512 ts_tablet_manager.cc:1434] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:39.047626 21512 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.060698 21539 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.061432 21539 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.064702 21539 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.066929 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:39.069527 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.070382 21395 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
W20260709 13:09:39.071696 21285 leader_election.cc:343] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.073148 21285 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:39.073733 21517 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.074544 21539 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.074381 21517 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.075095 21539 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.075585 21539 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.077714 21517 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.078449 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:39.079628 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.080264 21321 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
W20260709 13:09:39.080276 21360 leader_election.cc:343] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.082206 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:39.083297 21517 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.083619 21517 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.083909 21517 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.091343 21517 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.094091 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.095057 21321 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.095949 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:09:39.097440 21360 leader_election.cc:343] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.098060 21517 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.101698 21321 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:39.091995 21512 tablet_bootstrap.cc:654] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.102957 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:39.103951 21511 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.104852 21517 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.105952 21511 ts_tablet_manager.cc:1403] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.092s	user 0.022s	sys 0.034s
I20260709 13:09:39.109751 21511 raft_consensus.cc:359] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.110908 21511 raft_consensus.cc:385] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.113654 21511 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.113263 21512 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.115070 21512 ts_tablet_manager.cc:1403] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.007s
I20260709 13:09:39.118486 21511 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.121521 21539 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.120919 21512 raft_consensus.cc:359] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.122237 21512 raft_consensus.cc:385] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.122537 21512 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.123281 21512 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.121071 21510 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.124462 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:39.125016 21510 ts_tablet_manager.cc:1403] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.249s	user 0.058s	sys 0.068s
I20260709 13:09:39.125172 21396 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.128062 21510 raft_consensus.cc:359] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.128904 21510 raft_consensus.cc:385] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.129187 21510 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.130101 21510 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.125145 21511 ts_tablet_manager.cc:1434] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:09:39.132332 21510 ts_tablet_manager.cc:1434] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:39.134495 21510 tablet_bootstrap.cc:492] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.132403 21511 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:39.141156 21516 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.141875 21516 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.145810 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.146522 21395 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.146981 21510 tablet_bootstrap.cc:654] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.147383 21516 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.145977 21396 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:39.149578 21285 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.150475 21542 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.150938 21542 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:39.151027 21511 tablet_bootstrap.cc:654] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.151345 21512 ts_tablet_manager.cc:1434] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.008s
I20260709 13:09:39.151808 21542 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.152352 21512 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.154579 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.155479 21516 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.155876 21516 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.156270 21516 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.159137 21512 tablet_bootstrap.cc:654] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.162681 21511 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.165086 21510 tablet_bootstrap.cc:492] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.165550 21510 ts_tablet_manager.cc:1403] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.004s
I20260709 13:09:39.164054 21511 ts_tablet_manager.cc:1403] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.007s
I20260709 13:09:39.168593 21510 raft_consensus.cc:359] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.169404 21510 raft_consensus.cc:385] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.169730 21510 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.170478 21510 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.172735 21510 ts_tablet_manager.cc:1434] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:39.173715 21510 tablet_bootstrap.cc:492] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.175912 21511 raft_consensus.cc:359] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.177054 21511 raft_consensus.cc:385] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.177548 21511 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.176286 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:39.182979 21436 leader_election.cc:343] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.185372 21510 tablet_bootstrap.cc:654] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.186038 21516 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.184724 21511 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.189260 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:09:39.191321 21436 leader_election.cc:343] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.193252 21511 ts_tablet_manager.cc:1434] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:09:39.194356 21512 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.194437 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:39.194932 21512 ts_tablet_manager.cc:1403] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.005s
I20260709 13:09:39.194957 21511 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
W20260709 13:09:39.196004 21285 leader_election.cc:343] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.196755 21539 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.198043 21512 raft_consensus.cc:359] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.198822 21512 raft_consensus.cc:385] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.199110 21512 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.199834 21512 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.202203 21512 ts_tablet_manager.cc:1434] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:39.203183 21512 tablet_bootstrap.cc:492] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.206079 21511 tablet_bootstrap.cc:654] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.205709 21217 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.212913 21517 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:39.214942 21510 tablet_bootstrap.cc:492] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.214222 21517 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.215440 21510 ts_tablet_manager.cc:1403] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.004s
I20260709 13:09:39.218531 21510 raft_consensus.cc:359] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.219328 21510 raft_consensus.cc:385] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.219609 21510 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.219550 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:39.220104 21516 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.220278 21396 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.213227 21512 tablet_bootstrap.cc:654] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.224198 21510 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.227942 21396 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:39.229264 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:39.230279 21516 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.230834 21516 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:39.231510 21516 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.234155 21511 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.234623 21511 ts_tablet_manager.cc:1403] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.010s
I20260709 13:09:39.235257 21216 catalog_manager.cc:5697] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.237514 21510 ts_tablet_manager.cc:1434] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:09:39.237596 21511 raft_consensus.cc:359] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.238353 21511 raft_consensus.cc:385] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.238612 21511 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.239320 21511 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.240542 21512 tablet_bootstrap.cc:492] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.240998 21512 ts_tablet_manager.cc:1403] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:09:39.241605 21511 ts_tablet_manager.cc:1434] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:39.242532 21511 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:39.243458 21512 raft_consensus.cc:359] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.244112 21512 raft_consensus.cc:385] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.244380 21512 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.245028 21512 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.246989 21512 ts_tablet_manager.cc:1434] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:39.247854 21512 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.248131 21511 tablet_bootstrap.cc:654] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.238651 21510 tablet_bootstrap.cc:492] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.253379 21512 tablet_bootstrap.cc:654] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.253428 21511 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.254055 21511 ts_tablet_manager.cc:1403] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:09:39.254952 21542 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.257117 21511 raft_consensus.cc:359] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.258078 21511 raft_consensus.cc:385] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.258447 21511 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.259409 21510 tablet_bootstrap.cc:654] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.259465 21511 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.265403 21219 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.274029 21511 ts_tablet_manager.cc:1434] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:09:39.275581 21511 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:39.296123 21512 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.296182 21510 tablet_bootstrap.cc:492] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.296485 21511 tablet_bootstrap.cc:654] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.296845 21512 ts_tablet_manager.cc:1403] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.026s
I20260709 13:09:39.297011 21510 ts_tablet_manager.cc:1403] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.020s
I20260709 13:09:39.300267 21510 raft_consensus.cc:359] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.299917 21512 raft_consensus.cc:359] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.301246 21510 raft_consensus.cc:385] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.301319 21512 raft_consensus.cc:385] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.301652 21510 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.301859 21512 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.302673 21510 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.302922 21512 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.304927 21510 ts_tablet_manager.cc:1434] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:39.306881 21512 ts_tablet_manager.cc:1434] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
W20260709 13:09:39.307035 21285 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:39.308130 21512 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.317771 21512 tablet_bootstrap.cc:654] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.323706 21516 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.324530 21516 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.325105 21510 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.328560 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.331668 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.332366 21320 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.329478 21395 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.333611 21510 tablet_bootstrap.cc:654] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.334854 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.335865 21536 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.336232 21536 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.336551 21536 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.336736 21512 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.337195 21512 ts_tablet_manager.cc:1403] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.005s
I20260709 13:09:39.339895 21510 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.339833 21512 raft_consensus.cc:359] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.340521 21510 ts_tablet_manager.cc:1403] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:09:39.340621 21512 raft_consensus.cc:385] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.341022 21512 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.341272 21516 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.341773 21516 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.341952 21512 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.342200 21516 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.343580 21510 raft_consensus.cc:359] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.344352 21510 raft_consensus.cc:385] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.344662 21510 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.345427 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.345379 21510 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.347108 21512 ts_tablet_manager.cc:1434] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:09:39.347361 21510 ts_tablet_manager.cc:1434] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:39.348049 21512 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.351228 21510 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.351155 21536 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.357636 21510 tablet_bootstrap.cc:654] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.354671 21512 tablet_bootstrap.cc:654] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.355064 21517 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.358424 21517 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.359846 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.360482 21321 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.360586 21517 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.362731 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.357009 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.370626 21320 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:39.363302 21560 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.362012 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:39.371265 21560 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.371970 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:09:39.370647 21362 leader_election.cc:343] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:39.373243 21360 leader_election.cc:343] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.373507 21560 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.356993 21516 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.373713 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:39.374061 21510 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.374334 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.374482 21510 ts_tablet_manager.cc:1403] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:09:39.374980 21320 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:39.375881 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:39.376308 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.376509 21469 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:39.377151 21517 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.377498 21510 raft_consensus.cc:359] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.377907 21517 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.378181 21510 raft_consensus.cc:385] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.378559 21510 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.378422 21517 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.379016 21517 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.379269 21510 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.374531 21516 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.381326 21510 ts_tablet_manager.cc:1434] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:39.386324 21512 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.386818 21512 ts_tablet_manager.cc:1403] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.004s
I20260709 13:09:39.389518 21516 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.389657 21510 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.389608 21512 raft_consensus.cc:359] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.390681 21512 raft_consensus.cc:385] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.390990 21512 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.391767 21512 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.394292 21512 ts_tablet_manager.cc:1434] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:39.396667 21510 tablet_bootstrap.cc:654] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.397397 21512 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.403870 21512 tablet_bootstrap.cc:654] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.410209 21510 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.410595 21512 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.410672 21510 ts_tablet_manager.cc:1403] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 13:09:39.411146 21512 ts_tablet_manager.cc:1403] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:09:39.411545 21516 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.412007 21516 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.413502 21510 raft_consensus.cc:359] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.414160 21510 raft_consensus.cc:385] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.414424 21510 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.414490 21560 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.414801 21511 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.414937 21560 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.415236 21510 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.416970 21560 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.417616 21510 ts_tablet_manager.cc:1434] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:39.415251 21511 ts_tablet_manager.cc:1403] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.140s	user 0.022s	sys 0.001s
I20260709 13:09:39.420950 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:39.421571 21469 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:39.421519 21511 raft_consensus.cc:359] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.422278 21511 raft_consensus.cc:385] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.422528 21511 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.423094 21510 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.424453 21517 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.424831 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.426034 21561 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.426421 21561 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.426606 21517 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.426779 21561 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.427258 21517 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.426657 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.427678 21517 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.429039 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.429633 21319 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.429793 21510 tablet_bootstrap.cc:654] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.429711 21517 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.430512 21511 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.431053 21512 raft_consensus.cc:359] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.431713 21512 raft_consensus.cc:385] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.431965 21512 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.415865 21536 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.432740 21511 ts_tablet_manager.cc:1434] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:39.433168 21512 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.433621 21320 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:39.434989 21512 ts_tablet_manager.cc:1434] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:39.435894 21512 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.436312 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:39.436861 21469 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.437043 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.437706 21511 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:39.439466 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:39.440081 21470 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:39.437716 21318 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:39.441613 21512 tablet_bootstrap.cc:654] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.442067 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.442965 21517 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.443337 21517 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.443673 21517 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.444010 21511 tablet_bootstrap.cc:654] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.449843 21510 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.450313 21510 ts_tablet_manager.cc:1403] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 13:09:39.454113 21561 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.464049 21517 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.455046 21516 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.455669 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:39.456056 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.465291 21396 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.466008 21561 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.466539 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.467139 21516 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.456926 21510 raft_consensus.cc:359] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.461162 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.468003 21510 raft_consensus.cc:385] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.468222 21320 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.399712 21321 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:39.468663 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.468852 21395 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.462653 21512 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.469238 21318 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.469594 21512 ts_tablet_manager.cc:1403] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.011s
I20260709 13:09:39.470443 21436 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:39.471273 21536 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.471737 21536 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:39.472127 21512 raft_consensus.cc:359] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.472517 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.467614 21516 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.459929 21511 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.468312 21510 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.473266 21317 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.473577 21511 ts_tablet_manager.cc:1403] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.004s
I20260709 13:09:39.472569 21536 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.473798 21510 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.475785 21510 ts_tablet_manager.cc:1434] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.003s
I20260709 13:09:39.467088 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:39.476282 21470 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.464700 21319 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:39.476586 21511 raft_consensus.cc:359] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.473284 21516 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.477360 21511 raft_consensus.cc:385] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.477746 21511 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.477901 21510 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.478513 21511 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.472822 21512 raft_consensus.cc:385] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.480217 21512 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.480916 21512 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.482153 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.483914 21560 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.485116 21511 ts_tablet_manager.cc:1434] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:39.487850 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:39.488706 21468 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.490388 21512 ts_tablet_manager.cc:1434] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:09:39.497017 21512 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.504969 21578 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.507230 21511 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:39.505568 21578 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.511010 21578 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.511732 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.490247 21517 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.520246 21317 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:39.520539 21318 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:39.522370 21395 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:39.513556 21470 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:39.524057 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.524693 21219 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.526588 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.516770 21560 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:39.527393 21561 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.527892 21561 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:39.526716 21517 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.529950 21561 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.514822 21516 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.537375 21560 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.549068 21468 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:39.533293 21469 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:39.538429 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.538976 21578 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.559091 21578 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.559732 21541 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.560247 21541 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.561326 21578 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.562294 21541 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.562510 21511 tablet_bootstrap.cc:654] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.566020 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:39.566157 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.567153 21317 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.570170 21588 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.571777 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.572654 21396 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:39.573958 21436 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:39.574219 21285 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.575241 21541 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.575191 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.575693 21541 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.575914 21395 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.576086 21541 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.576844 21588 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.577209 21588 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.577500 21588 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.580090 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:39.581344 21516 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.581934 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.582557 21317 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.582896 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:39.579316 21517 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:39.583436 21395 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.583925 21517 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } }
I20260709 13:09:39.589247 21317 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:39.590430 21436 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:39.594940 21512 tablet_bootstrap.cc:654] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.595045 21395 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:39.596505 21516 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.597327 21516 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:39.598133 21516 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.603060 21589 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.606956 21588 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.609186 21468 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:39.609543 21510 tablet_bootstrap.cc:654] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.610255 21511 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.610677 21511 ts_tablet_manager.cc:1403] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.003s
I20260709 13:09:39.605481 21218 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.614689 21541 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.616703 21541 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.615126 21511 raft_consensus.cc:359] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.617683 21511 raft_consensus.cc:385] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.618067 21511 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.619009 21511 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.622210 21511 ts_tablet_manager.cc:1434] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:09:39.623025 21511 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
W20260709 13:09:39.623634 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:39.637490 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:39.638124 21395 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.639045 21511 tablet_bootstrap.cc:654] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.639799 21588 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.642400 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:39.643282 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:39.644330 21468 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:39.647439 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.647579 21285 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:39.648375 21318 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:09:39.648731 21539 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.648926 21468 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.651351 21318 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.667214 21219 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.669463 21219 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.676370 21512 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.676996 21512 ts_tablet_manager.cc:1403] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.180s	user 0.033s	sys 0.018s
I20260709 13:09:39.682700 21541 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.679876 21218 catalog_manager.cc:5697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.689118 21512 raft_consensus.cc:359] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.689771 21512 raft_consensus.cc:385] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.690052 21512 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.697055 21512 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.701239 21512 ts_tablet_manager.cc:1434] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.002s
I20260709 13:09:39.702559 21512 tablet_bootstrap.cc:492] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:39.702960 21578 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.703545 21578 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.705739 21516 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.707727 21588 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.712873 21510 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:39.713352 21510 ts_tablet_manager.cc:1403] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.236s	user 0.020s	sys 0.005s
I20260709 13:09:39.727509 21588 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.728317 21588 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.719442 21541 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:39.732386 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.736433 21510 raft_consensus.cc:359] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.737500 21510 raft_consensus.cc:385] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.737860 21510 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.742344 21511 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.742818 21511 ts_tablet_manager.cc:1403] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.015s
I20260709 13:09:39.744762 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.745584 21392 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.746737 21511 raft_consensus.cc:359] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.747349 21511 raft_consensus.cc:385] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.747565 21511 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.735250 21588 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.752772 21510 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.759155 21578 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.752821 21511 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:39.740262 21436 leader_election.cc:343] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.739946 21517 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.754690 21589 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.763631 21510 ts_tablet_manager.cc:1434] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:09:39.765046 21510 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:39.766781 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.767357 21511 ts_tablet_manager.cc:1434] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:09:39.767803 21517 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.768584 21511 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:39.769917 21517 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.768333 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:39.773402 21395 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:39.775593 21578 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.775993 21578 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.776362 21578 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.776553 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:39.777678 21516 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.779897 21516 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:39.780418 21470 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.780879 21516 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.787587 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:39.785981 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.804873 21536 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.805442 21536 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.807147 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.814674 21511 tablet_bootstrap.cc:654] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.803122 21318 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:39.814565 21536 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.817070 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.818925 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:09:39.819116 21436 leader_election.cc:343] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.819835 21517 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.820349 21517 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.822885 21360 leader_election.cc:343] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.820721 21517 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.835445 21512 tablet_bootstrap.cc:654] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.848166 21510 tablet_bootstrap.cc:654] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.847208 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:39.847522 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:39.860244 21395 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.861636 21434 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:39.873020 21578 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.879653 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.880266 21319 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.887130 21319 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:39.889719 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:39.876296 21517 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.888475 21578 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.892726 21216 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.893433 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:39.896873 21318 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.901836 21578 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.902392 21578 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.902916 21578 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.910830 21606 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.911572 21606 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:39.912770 21606 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.893468 21517 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:39.924445 21516 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.924703 21318 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:39.927546 21511 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:39.927994 21511 ts_tablet_manager.cc:1403] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.160s	user 0.004s	sys 0.012s
I20260709 13:09:39.927637 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:39.931250 21511 raft_consensus.cc:359] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.932201 21511 raft_consensus.cc:385] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.932551 21511 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.934115 21511 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.937819 21510 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
W20260709 13:09:39.937949 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 76404.3us
I20260709 13:09:39.938284 21510 ts_tablet_manager.cc:1403] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.173s	user 0.006s	sys 0.012s
I20260709 13:09:39.933171 21517 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.940250 21517 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:39.940765 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:39.941341 21395 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.941136 21517 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.941895 21510 raft_consensus.cc:359] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.942536 21510 raft_consensus.cc:385] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.942782 21510 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.943418 21510 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.945309 21511 ts_tablet_manager.cc:1434] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
W20260709 13:09:39.935675 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46054us
I20260709 13:09:39.946246 21511 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:39.944319 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:39.949276 21510 ts_tablet_manager.cc:1434] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:09:39.950233 21510 tablet_bootstrap.cc:492] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
W20260709 13:09:39.953649 21360 leader_election.cc:343] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.954908 21608 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.955938 21395 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:39.955952 21609 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:39.955443 21608 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.976053 21608 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:39.977612 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:39.978277 21319 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:39.983669 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:39.983943 21512 tablet_bootstrap.cc:492] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:39.984670 21512 ts_tablet_manager.cc:1403] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.282s	user 0.008s	sys 0.016s
I20260709 13:09:39.984625 21608 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.985296 21608 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.985831 21608 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.989552 21511 tablet_bootstrap.cc:654] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.989677 21512 raft_consensus.cc:359] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.990628 21512 raft_consensus.cc:385] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.991003 21512 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.974582 21578 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.991938 21512 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:39.979892 21218 catalog_manager.cc:5697] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.996780 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.002180 21589 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.998718 21512 ts_tablet_manager.cc:1434] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:09:40.007115 21512 tablet_bootstrap.cc:492] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.008368 21589 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.010591 21510 tablet_bootstrap.cc:654] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:40.019564 21434 leader_election.cc:343] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.016209 21217 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.028007 21606 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.032938 21589 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.055198 21578 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.057128 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:40.058701 21393 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.063305 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:09:40.065819 21436 leader_election.cc:343] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.066625 21606 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.089425 21587 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.093389 21512 tablet_bootstrap.cc:654] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.099414 21588 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.125344 21587 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.146916 21393 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:40.148418 21434 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:40.149590 21578 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.150228 21578 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:40.151202 21578 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.168293 21589 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.168960 21589 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:40.192046 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43721.5us
I20260709 13:09:40.197016 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.200188 21517 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:40.199777 21362 leader_election.cc:343] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.202320 21589 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.203509 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:40.210512 21360 leader_election.cc:343] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.206434 21511 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.211633 21511 ts_tablet_manager.cc:1403] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.266s	user 0.016s	sys 0.004s
I20260709 13:09:40.210985 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:40.215077 21517 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.213161 21608 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.258186 21511 raft_consensus.cc:359] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.258721 21511 raft_consensus.cc:385] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.258980 21511 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.260150 21511 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.265321 21511 ts_tablet_manager.cc:1434] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:09:40.266496 21608 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.266287 21511 tablet_bootstrap.cc:492] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.267876 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:09:40.269588 21434 leader_election.cc:343] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.278702 21510 tablet_bootstrap.cc:492] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.279150 21510 ts_tablet_manager.cc:1403] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.329s	user 0.025s	sys 0.027s
I20260709 13:09:40.281862 21510 raft_consensus.cc:359] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.282519 21510 raft_consensus.cc:385] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.282836 21510 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.283660 21510 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.285745 21510 ts_tablet_manager.cc:1434] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:40.286625 21510 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.282568 21512 tablet_bootstrap.cc:492] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.287931 21512 ts_tablet_manager.cc:1403] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.281s	user 0.018s	sys 0.013s
I20260709 13:09:40.288404 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:40.288311 21608 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.288944 21321 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.294952 21321 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:40.297706 21216 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.299350 21511 tablet_bootstrap.cc:654] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.299350 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:40.300640 21588 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.302090 21588 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.302671 21588 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:40.302196 21510 tablet_bootstrap.cc:654] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.303759 21588 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.310499 21512 raft_consensus.cc:359] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.311199 21512 raft_consensus.cc:385] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.313890 21512 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.314652 21512 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.321070 21512 ts_tablet_manager.cc:1434] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:09:40.330780 21510 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.331310 21510 ts_tablet_manager.cc:1403] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.006s
I20260709 13:09:40.334216 21510 raft_consensus.cc:359] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.334949 21510 raft_consensus.cc:385] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.335253 21510 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.336100 21510 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.338048 21510 ts_tablet_manager.cc:1434] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:09:40.338986 21510 tablet_bootstrap.cc:492] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.341975 21512 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.344790 21510 tablet_bootstrap.cc:654] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.347286 21588 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.347798 21588 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.350466 21588 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.350384 21219 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.351492 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.352140 21395 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:40.352268 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.353428 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:09:40.353962 21436 leader_election.cc:343] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.354849 21614 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.355232 21614 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.355552 21614 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.358067 21511 tablet_bootstrap.cc:492] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.358681 21511 ts_tablet_manager.cc:1403] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.011s
I20260709 13:09:40.364068 21588 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.364705 21588 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.365171 21578 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.368340 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.369834 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.370190 21588 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.370625 21512 tablet_bootstrap.cc:654] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.371053 21317 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:40.377228 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:40.378726 21578 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.369776 21614 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.387233 21511 raft_consensus.cc:359] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.385771 21512 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.389268 21512 ts_tablet_manager.cc:1403] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.000s
I20260709 13:09:40.389780 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:09:40.391645 21436 leader_election.cc:343] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.388522 21511 raft_consensus.cc:385] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.391940 21578 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.393143 21511 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.393836 21614 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.394366 21511 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.395037 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:40.395723 21395 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.400297 21512 raft_consensus.cc:359] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.401283 21512 raft_consensus.cc:385] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.401620 21512 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.402381 21512 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.404733 21512 ts_tablet_manager.cc:1434] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:40.406756 21512 tablet_bootstrap.cc:492] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.411845 21395 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:40.412828 21510 tablet_bootstrap.cc:492] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.413100 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:40.413283 21510 ts_tablet_manager.cc:1403] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.074s	user 0.026s	sys 0.035s
I20260709 13:09:40.413327 21512 tablet_bootstrap.cc:654] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.416091 21510 raft_consensus.cc:359] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.416757 21510 raft_consensus.cc:385] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.416709 21588 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.417223 21510 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.418936 21614 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.417522 21588 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:40.422386 21510 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.424587 21510 ts_tablet_manager.cc:1434] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:09:40.424448 21587 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.425417 21510 tablet_bootstrap.cc:492] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.425959 21588 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.431843 21510 tablet_bootstrap.cc:654] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.434365 21542 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.434882 21542 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.438140 21542 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.439082 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:40.439594 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.440352 21393 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:40.437649 21578 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.441260 21578 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.441676 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:40.442994 21511 ts_tablet_manager.cc:1434] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.084s	user 0.011s	sys 0.000s
I20260709 13:09:40.442940 21542 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.444132 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.444792 21318 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:40.444141 21511 tablet_bootstrap.cc:492] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.447160 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:40.448076 21614 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.448454 21614 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.448792 21614 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.448940 21510 tablet_bootstrap.cc:492] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.449438 21510 ts_tablet_manager.cc:1403] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.013s
I20260709 13:09:40.450897 21542 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.452152 21510 raft_consensus.cc:359] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.452822 21510 raft_consensus.cc:385] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.453084 21510 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.453272 21578 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.453970 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:09:40.455470 21434 leader_election.cc:343] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.453950 21510 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.458575 21510 ts_tablet_manager.cc:1434] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:40.459594 21510 tablet_bootstrap.cc:492] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.461763 21614 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.465374 21510 tablet_bootstrap.cc:654] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.472915 21561 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.478734 21510 tablet_bootstrap.cc:492] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.478734 21511 tablet_bootstrap.cc:654] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.479368 21510 ts_tablet_manager.cc:1403] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 13:09:40.482100 21510 raft_consensus.cc:359] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.483165 21510 raft_consensus.cc:385] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.483533 21510 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.484591 21510 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.487139 21510 ts_tablet_manager.cc:1434] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:09:40.488402 21510 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.494598 21510 tablet_bootstrap.cc:654] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.500128 21218 catalog_manager.cc:5697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.504908 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:09:40.506464 21434 leader_election.cc:343] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.504906 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:40.507560 21511 tablet_bootstrap.cc:492] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.507637 21318 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.508127 21511 ts_tablet_manager.cc:1403] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.008s
I20260709 13:09:40.508590 21510 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.509339 21510 ts_tablet_manager.cc:1403] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:09:40.511101 21511 raft_consensus.cc:359] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.511806 21511 raft_consensus.cc:385] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.511724 21510 raft_consensus.cc:359] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.512250 21511 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.512441 21510 raft_consensus.cc:385] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.512696 21510 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.513007 21511 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.513314 21510 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.515074 21318 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:40.515910 21510 ts_tablet_manager.cc:1434] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:40.516350 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:40.516776 21510 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.517119 21588 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.517808 21588 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:40.518116 21614 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.518644 21588 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.522004 21511 ts_tablet_manager.cc:1434] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:09:40.522604 21512 tablet_bootstrap.cc:492] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.523635 21512 ts_tablet_manager.cc:1403] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.117s	user 0.038s	sys 0.037s
I20260709 13:09:40.526337 21512 raft_consensus.cc:359] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.527016 21512 raft_consensus.cc:385] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.527287 21512 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.528318 21511 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.527976 21512 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.532169 21512 ts_tablet_manager.cc:1434] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:09:40.533166 21512 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.535418 21510 tablet_bootstrap.cc:654] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.536615 21511 tablet_bootstrap.cc:654] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.539284 21512 tablet_bootstrap.cc:654] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.555001 21219 catalog_manager.cc:5697] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.559011 21510 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.559897 21510 ts_tablet_manager.cc:1403] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.001s
I20260709 13:09:40.564293 21511 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.564720 21511 ts_tablet_manager.cc:1403] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.001s
I20260709 13:09:40.564284 21510 raft_consensus.cc:359] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.565267 21510 raft_consensus.cc:385] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.565546 21510 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.566195 21510 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.567216 21511 raft_consensus.cc:359] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.567745 21510 ts_tablet_manager.cc:1434] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:09:40.567893 21511 raft_consensus.cc:385] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.568310 21511 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.568938 21510 tablet_bootstrap.cc:492] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.569388 21511 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.573330 21511 ts_tablet_manager.cc:1434] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:40.574241 21511 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.580291 21511 tablet_bootstrap.cc:654] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.581198 21512 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.581465 21510 tablet_bootstrap.cc:654] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.581705 21512 ts_tablet_manager.cc:1403] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.008s
I20260709 13:09:40.585599 21512 raft_consensus.cc:359] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.586815 21512 raft_consensus.cc:385] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.587273 21512 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.588438 21512 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.595283 21510 tablet_bootstrap.cc:492] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.595791 21510 ts_tablet_manager.cc:1403] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.013s
I20260709 13:09:40.598728 21510 raft_consensus.cc:359] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.599316 21512 ts_tablet_manager.cc:1434] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:09:40.599404 21510 raft_consensus.cc:385] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.599793 21510 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.600759 21511 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.601877 21511 ts_tablet_manager.cc:1403] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.001s
I20260709 13:09:40.602553 21512 tablet_bootstrap.cc:492] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.604624 21511 raft_consensus.cc:359] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.605176 21511 raft_consensus.cc:385] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.605399 21511 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.600755 21510 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.605995 21511 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.608134 21511 ts_tablet_manager.cc:1434] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:40.608244 21510 ts_tablet_manager.cc:1434] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:09:40.609246 21511 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.609555 21510 tablet_bootstrap.cc:492] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.613643 21614 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.615643 21511 tablet_bootstrap.cc:654] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.616832 21512 tablet_bootstrap.cc:654] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.620368 21510 tablet_bootstrap.cc:654] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.646236 21614 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.647912 21512 tablet_bootstrap.cc:492] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.648430 21512 ts_tablet_manager.cc:1403] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.007s
I20260709 13:09:40.650163 21510 tablet_bootstrap.cc:492] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.650889 21510 ts_tablet_manager.cc:1403] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.015s
I20260709 13:09:40.651077 21512 raft_consensus.cc:359] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.651811 21512 raft_consensus.cc:385] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.652100 21512 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.652842 21512 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.655411 21512 ts_tablet_manager.cc:1434] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:09:40.657285 21614 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.657861 21614 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.661357 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.661857 21512 tablet_bootstrap.cc:492] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
W20260709 13:09:40.662814 21434 leader_election.cc:343] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.665771 21510 raft_consensus.cc:359] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.667378 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.668087 21321 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:40.670262 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:40.670830 21510 raft_consensus.cc:385] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.671399 21510 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.672449 21510 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.676286 21608 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.676738 21608 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.677083 21608 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.678237 21512 tablet_bootstrap.cc:654] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.685081 21510 ts_tablet_manager.cc:1434] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:09:40.687348 21510 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.688015 21561 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.688715 21561 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.692379 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.693210 21318 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:40.693550 21560 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.694679 21561 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.694844 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:40.694188 21511 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.696285 21360 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:40.696532 21516 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.696928 21614 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.697000 21516 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.694162 21560 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.699131 21516 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.699884 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.700541 21560 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.701081 21560 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:40.701666 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:40.701076 21511 ts_tablet_manager.cc:1403] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.032s
I20260709 13:09:40.704007 21608 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:40.704627 21436 leader_election.cc:343] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.705346 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.704775 21511 raft_consensus.cc:359] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.706008 21511 raft_consensus.cc:385] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.707412 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:40.707639 21511 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.708086 21318 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.708593 21511 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.709513 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:40.710747 21512 tablet_bootstrap.cc:492] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.710872 21511 ts_tablet_manager.cc:1434] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:09:40.711218 21512 ts_tablet_manager.cc:1403] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.050s	user 0.004s	sys 0.020s
I20260709 13:09:40.711916 21511 tablet_bootstrap.cc:492] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.712013 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.712697 21394 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
W20260709 13:09:40.707083 21362 leader_election.cc:343] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.706081 21608 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.713868 21512 raft_consensus.cc:359] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.715315 21512 raft_consensus.cc:385] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.715634 21512 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
W20260709 13:09:40.716691 21434 leader_election.cc:343] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.716480 21512 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.693574 21510 tablet_bootstrap.cc:654] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.715169 21318 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:40.719452 21512 ts_tablet_manager.cc:1434] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:40.719748 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:40.719435 21511 tablet_bootstrap.cc:654] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.721387 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:40.720927 21512 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.721987 21468 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:40.723229 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:40.723973 21589 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.724346 21589 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.724714 21589 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.728286 21608 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.728690 21608 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.729012 21608 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.730624 21560 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.732687 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:40.734340 21578 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.734810 21578 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:40.736164 21542 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.735769 21578 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.736644 21542 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.739728 21608 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.738633 21542 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.743172 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:40.745328 21608 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:09:40.745859 21436 leader_election.cc:343] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.746378 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:40.746961 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.747604 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:40.751730 21394 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:40.755208 21511 tablet_bootstrap.cc:492] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.755988 21511 ts_tablet_manager.cc:1403] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.011s
I20260709 13:09:40.756508 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:40.757366 21541 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.757742 21541 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.758081 21541 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.753089 21468 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:40.759769 21511 raft_consensus.cc:359] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.760885 21511 raft_consensus.cc:385] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.761318 21511 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.762351 21511 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.765487 21512 tablet_bootstrap.cc:654] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.766465 21541 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.768570 21589 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.765482 21511 ts_tablet_manager.cc:1434] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:40.769640 21393 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:40.770643 21511 tablet_bootstrap.cc:492] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.773046 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:40.774175 21588 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.775573 21588 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.782414 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:40.782775 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:40.783071 21393 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:40.785364 21362 leader_election.cc:343] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.787585 21511 tablet_bootstrap.cc:654] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.788118 21510 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.789462 21510 ts_tablet_manager.cc:1403] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.000s
I20260709 13:09:40.789893 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:40.790417 21541 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.790797 21470 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:40.792054 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:40.792902 21560 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.793115 21510 raft_consensus.cc:359] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.794305 21510 raft_consensus.cc:385] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.794729 21510 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.795639 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:40.796298 21468 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.799427 21588 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.803311 21512 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.804080 21512 ts_tablet_manager.cc:1403] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.012s
I20260709 13:09:40.808130 21589 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.795653 21510 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.811160 21511 tablet_bootstrap.cc:492] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.811568 21510 ts_tablet_manager.cc:1434] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:09:40.807737 21512 raft_consensus.cc:359] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.812077 21512 raft_consensus.cc:385] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.812469 21512 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.812708 21511 ts_tablet_manager.cc:1403] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.003s
I20260709 13:09:40.813416 21512 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.814661 21510 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:40.815752 21512 ts_tablet_manager.cc:1434] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:40.816740 21512 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.815455 21511 raft_consensus.cc:359] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.817632 21511 raft_consensus.cc:385] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.817914 21511 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.792902 21393 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:40.818696 21511 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.820017 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:40.821062 21542 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.821511 21511 ts_tablet_manager.cc:1434] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:09:40.821473 21542 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:40.822467 21511 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.822371 21542 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.822903 21218 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.825572 21468 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:40.840269 21670 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.852941 21436 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.871277 21512 tablet_bootstrap.cc:654] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.871992 21542 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.872503 21542 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.847572 21670 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.874101 21510 tablet_bootstrap.cc:654] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.874925 21670 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.876616 21542 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.879752 21578 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.880250 21578 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.882681 21578 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.882871 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.883512 21321 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:40.884675 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:40.884862 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.885509 21394 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:40.885639 21578 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.886169 21578 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.886571 21578 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.886824 21512 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.887296 21512 ts_tablet_manager.cc:1403] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.003s
I20260709 13:09:40.886513 21216 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.890205 21511 tablet_bootstrap.cc:654] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.889868 21512 raft_consensus.cc:359] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.890524 21512 raft_consensus.cc:385] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.890851 21512 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.891492 21512 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.891829 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.892517 21394 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:40.894925 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:40.895504 21394 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:40.895897 21578 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.897794 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:40.898991 21512 ts_tablet_manager.cc:1434] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:40.901849 21512 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.904592 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:40.905365 21578 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.907474 21512 tablet_bootstrap.cc:654] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.907517 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:40.908227 21321 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.916416 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:40.917073 21394 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.921347 21512 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.921851 21512 ts_tablet_manager.cc:1403] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.005s
I20260709 13:09:40.922017 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:40.922925 21542 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.922991 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:40.923504 21542 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.923856 21670 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.924002 21542 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.924275 21670 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.924693 21670 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.926154 21512 raft_consensus.cc:359] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.926877 21512 raft_consensus.cc:385] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.927155 21512 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.928089 21512 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.932154 21670 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.934139 21670 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.934206 21542 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.936879 21542 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.938644 21512 ts_tablet_manager.cc:1434] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:09:40.938973 21578 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.939458 21578 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.941481 21578 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:40.942752 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.944332 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:09:40.945609 21285 leader_election.cc:343] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:40.946141 21434 leader_election.cc:343] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:40.946499 21285 leader_election.cc:343] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.948170 21512 tablet_bootstrap.cc:492] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
W20260709 13:09:40.947657 21436 leader_election.cc:343] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.948999 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:40.948495 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:40.950583 21516 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.950990 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:40.951548 21393 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.951849 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:40.954396 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:40.954888 21512 tablet_bootstrap.cc:654] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.954941 21395 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.954804 21578 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.955909 21394 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:40.957237 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:40.958462 21578 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.958930 21578 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:40.959704 21578 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.961774 21512 tablet_bootstrap.cc:492] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:40.962234 21512 ts_tablet_manager.cc:1403] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.007s
I20260709 13:09:40.963723 21511 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:40.964239 21561 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.964975 21561 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.964704 21512 raft_consensus.cc:359] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.966107 21512 raft_consensus.cc:385] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.966410 21512 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.967128 21561 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.967139 21512 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.968808 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:40.969403 21468 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:40.969673 21512 ts_tablet_manager.cc:1434] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:40.969657 21395 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:40.969885 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.970789 21512 tablet_bootstrap.cc:492] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:40.970584 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:40.964217 21511 ts_tablet_manager.cc:1403] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.142s	user 0.006s	sys 0.006s
I20260709 13:09:40.971508 21561 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.971859 21561 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.972198 21561 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.973599 21511 raft_consensus.cc:359] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.974277 21511 raft_consensus.cc:385] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.970633 21318 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:40.974535 21511 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.975385 21511 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.977528 21511 ts_tablet_manager.cc:1434] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:40.978845 21511 tablet_bootstrap.cc:492] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:40.979805 21393 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:40.942988 21321 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:40.981133 21512 tablet_bootstrap.cc:654] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.984148 21561 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.981776 21510 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:40.985185 21510 ts_tablet_manager.cc:1403] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.171s	user 0.031s	sys 0.023s
I20260709 13:09:40.986137 21560 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.986655 21560 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:40.989851 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:40.991266 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:40.991832 21468 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:40.993039 21362 leader_election.cc:343] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.994148 21560 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:40.996868 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:40.997532 21321 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.998203 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:40.998847 21470 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:41.000145 21561 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.001468 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:41.002254 21561 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.003937 21560 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.006084 21560 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.007421 21516 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.009212 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.009985 21317 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:41.010959 21511 tablet_bootstrap.cc:654] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.011252 21560 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.002606 21561 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.012799 21468 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:41.016114 21510 raft_consensus.cc:359] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.023926 21510 raft_consensus.cc:385] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.024353 21510 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.024609 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:41.017344 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.025427 21589 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.025427 21510 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.021816 21560 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.039656 21541 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.954813 21285 leader_election.cc:343] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.069916 21510 ts_tablet_manager.cc:1434] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.071s	user 0.014s	sys 0.020s
I20260709 13:09:41.071369 21512 tablet_bootstrap.cc:492] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:41.071822 21512 ts_tablet_manager.cc:1403] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.018s
I20260709 13:09:41.016198 21561 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.045215 21516 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.075714 21510 tablet_bootstrap.cc:492] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
W20260709 13:09:41.072135 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 117349us
I20260709 13:09:41.061947 21560 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:41.080892 21285 leader_election.cc:343] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.073863 21360 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:41.086539 21560 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.072662 21541 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.087294 21321 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:41.087634 21512 raft_consensus.cc:359] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.088305 21512 raft_consensus.cc:385] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.088457 21541 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.088603 21512 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.089347 21512 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.082724 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:41.091262 21541 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.091835 21541 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:41.091965 21512 ts_tablet_manager.cc:1434] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:09:41.090480 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.092665 21541 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.093367 21317 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:41.077129 21516 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.095458 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.093472 21681 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.095682 21362 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:41.097301 21394 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.093020 21512 tablet_bootstrap.cc:492] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
W20260709 13:09:41.100783 21360 leader_election.cc:343] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.102289 21560 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.102442 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.102712 21560 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.103044 21560 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:41.103802 21436 leader_election.cc:343] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.106210 21216 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.108348 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:41.109752 21516 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:41.115211 21614 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.110363 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.117100 21670 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.117583 21670 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:41.117885 21589 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:41.118311 21670 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.118716 21589 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.113261 21560 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.114025 21561 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:41.124419 21434 leader_election.cc:343] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.126806 21434 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.127604 21608 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.146308 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.148308 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.149359 21512 tablet_bootstrap.cc:654] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.149362 21394 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:09:41.152350 21285 leader_election.cc:343] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.152829 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:41.153407 21321 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.154902 21510 tablet_bootstrap.cc:654] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.155205 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.158872 21560 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.160048 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:41.161253 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:09:41.163134 21362 leader_election.cc:343] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:41.163213 21360 leader_election.cc:343] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.167786 21681 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.172868 21511 tablet_bootstrap.cc:492] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:41.174247 21321 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:41.168886 21561 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.174787 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:41.178864 21470 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.178929 21362 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:41.180126 21589 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.180778 21589 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:41.174403 21216 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.177038 21511 ts_tablet_manager.cc:1403] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.015s
I20260709 13:09:41.181546 21589 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.181366 21219 catalog_manager.cc:5697] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.183710 21511 raft_consensus.cc:359] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.177912 21670 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.184394 21511 raft_consensus.cc:385] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.184707 21511 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.185452 21511 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.187717 21511 ts_tablet_manager.cc:1434] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:41.188815 21511 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:41.189369 21512 tablet_bootstrap.cc:492] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:41.189816 21512 ts_tablet_manager.cc:1403] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.000s
I20260709 13:09:41.197139 21470 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:41.198380 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:41.199283 21561 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.199772 21561 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:41.200651 21561 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.203462 21511 tablet_bootstrap.cc:654] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.215757 21512 raft_consensus.cc:359] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.216580 21512 raft_consensus.cc:385] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.216845 21512 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.217495 21512 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.218092 21218 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.219843 21512 ts_tablet_manager.cc:1434] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:09:41.220867 21512 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:41.221501 21510 tablet_bootstrap.cc:492] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:41.221429 21670 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.222519 21510 ts_tablet_manager.cc:1403] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.147s	user 0.006s	sys 0.017s
I20260709 13:09:41.229300 21512 tablet_bootstrap.cc:654] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.231827 21670 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.239203 21510 raft_consensus.cc:359] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.240589 21510 raft_consensus.cc:385] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.241012 21510 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.260351 21510 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.264163 21510 ts_tablet_manager.cc:1434] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:09:41.266196 21510 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:41.259425 21218 catalog_manager.cc:5697] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.273142 21511 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:41.273664 21511 ts_tablet_manager.cc:1403] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.024s
I20260709 13:09:41.273571 21218 catalog_manager.cc:5697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.278999 21511 raft_consensus.cc:359] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.279695 21511 raft_consensus.cc:385] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.279953 21511 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.280596 21511 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.283460 21614 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.284345 21510 tablet_bootstrap.cc:654] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.290091 21511 ts_tablet_manager.cc:1434] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:41.291286 21511 tablet_bootstrap.cc:492] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:41.297078 21511 tablet_bootstrap.cc:654] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.305202 21561 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.305928 21561 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.310974 21511 tablet_bootstrap.cc:492] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:41.311163 21588 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.311482 21511 ts_tablet_manager.cc:1403] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 13:09:41.311934 21606 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.311851 21588 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.314221 21511 raft_consensus.cc:359] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.314898 21511 raft_consensus.cc:385] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.314760 21588 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:41.315315 21511 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.316061 21511 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.316847 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.317437 21321 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:41.318107 21511 ts_tablet_manager.cc:1434] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:41.318990 21511 tablet_bootstrap.cc:492] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:41.319442 21436 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:41.319780 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:09:41.322151 21434 leader_election.cc:343] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.322430 21608 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.323015 21608 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.323441 21608 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.336333 21511 tablet_bootstrap.cc:654] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.339644 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.340791 21561 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:09:41.341794 21362 leader_election.cc:343] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.342221 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:41.343963 21360 leader_election.cc:343] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.344631 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:41.350092 21561 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.353807 21511 tablet_bootstrap.cc:492] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:41.354328 21511 ts_tablet_manager.cc:1403] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 13:09:41.356904 21511 raft_consensus.cc:359] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.357584 21511 raft_consensus.cc:385] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.357857 21511 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.370031 21608 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.373965 21511 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.375351 21608 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:41.376128 21511 ts_tablet_manager.cc:1434] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:09:41.377419 21511 tablet_bootstrap.cc:492] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:41.376092 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:41.380609 21512 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:41.381064 21512 ts_tablet_manager.cc:1403] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.160s	user 0.044s	sys 0.061s
I20260709 13:09:41.378201 21321 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.383811 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:41.389766 21512 raft_consensus.cc:359] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.390591 21512 raft_consensus.cc:385] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:41.390869 21434 leader_election.cc:343] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.390872 21512 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.394798 21510 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:41.395260 21510 ts_tablet_manager.cc:1403] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.129s	user 0.033s	sys 0.033s
I20260709 13:09:41.395325 21512 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.398001 21321 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:41.398609 21511 tablet_bootstrap.cc:654] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.399371 21436 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.402575 21512 ts_tablet_manager.cc:1434] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:41.402920 21608 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.403545 21512 tablet_bootstrap.cc:492] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:41.404136 21608 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:41.405043 21608 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.403891 21510 raft_consensus.cc:359] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.408488 21510 raft_consensus.cc:385] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.408804 21510 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.409874 21512 tablet_bootstrap.cc:654] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.409474 21510 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.411108 21606 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.411900 21510 ts_tablet_manager.cc:1434] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:41.411580 21606 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.414517 21606 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:41.416265 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.417062 21393 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:09:41.418852 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.421710 21510 tablet_bootstrap.cc:492] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:41.422705 21512 tablet_bootstrap.cc:492] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:41.421774 21218 catalog_manager.cc:5697] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.423159 21512 ts_tablet_manager.cc:1403] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.006s
I20260709 13:09:41.424494 21436 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.425349 21606 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.429939 21512 raft_consensus.cc:359] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.430686 21512 raft_consensus.cc:385] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.430951 21512 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.432934 21606 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.433447 21512 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.437464 21510 tablet_bootstrap.cc:654] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.437951 21512 ts_tablet_manager.cc:1434] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:09:41.438889 21512 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:41.452059 21511 tablet_bootstrap.cc:492] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:41.452525 21511 ts_tablet_manager.cc:1403] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.014s
I20260709 13:09:41.452859 21510 tablet_bootstrap.cc:492] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:41.453302 21510 ts_tablet_manager.cc:1403] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 13:09:41.455057 21510 raft_consensus.cc:359] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.454995 21511 raft_consensus.cc:359] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.455699 21510 raft_consensus.cc:385] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.455773 21511 raft_consensus.cc:385] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.457221 21511 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.455982 21510 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.456079 21512 tablet_bootstrap.cc:654] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.458127 21510 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.460603 21510 ts_tablet_manager.cc:1434] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:41.460441 21511 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.461762 21510 tablet_bootstrap.cc:492] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:41.462431 21511 ts_tablet_manager.cc:1434] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.003s
I20260709 13:09:41.464596 21512 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:41.465683 21512 ts_tablet_manager.cc:1403] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:09:41.467945 21510 tablet_bootstrap.cc:654] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.468825 21512 raft_consensus.cc:359] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.469597 21512 raft_consensus.cc:385] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.469916 21512 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.470847 21512 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.476959 21512 ts_tablet_manager.cc:1434] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:41.477999 21512 tablet_bootstrap.cc:492] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:41.481050 21511 tablet_bootstrap.cc:492] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:41.481067 21510 tablet_bootstrap.cc:492] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:41.481719 21510 ts_tablet_manager.cc:1403] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:09:41.483971 21512 tablet_bootstrap.cc:654] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.484171 21510 raft_consensus.cc:359] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.484874 21510 raft_consensus.cc:385] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.485167 21510 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.485987 21510 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.486997 21511 tablet_bootstrap.cc:654] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.487290 21542 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.487728 21542 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.489811 21542 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.492234 21510 ts_tablet_manager.cc:1434] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:41.492136 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.493248 21510 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:41.493356 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:41.495088 21285 leader_election.cc:343] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:41.495762 21285 leader_election.cc:343] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.496243 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.497700 21542 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.498466 21511 tablet_bootstrap.cc:492] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:41.498917 21511 ts_tablet_manager.cc:1403] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:09:41.499644 21510 tablet_bootstrap.cc:654] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.501535 21511 raft_consensus.cc:359] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.505640 21511 raft_consensus.cc:385] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.505973 21511 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.506711 21511 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.507328 21512 tablet_bootstrap.cc:492] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:41.507323 21510 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:41.507891 21510 ts_tablet_manager.cc:1403] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:09:41.507891 21512 ts_tablet_manager.cc:1403] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 13:09:41.508524 21511 ts_tablet_manager.cc:1434] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:09:41.510931 21511 tablet_bootstrap.cc:492] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:41.510596 21510 raft_consensus.cc:359] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.510773 21512 raft_consensus.cc:359] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.511354 21512 raft_consensus.cc:385] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.511327 21510 raft_consensus.cc:385] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.511778 21512 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.511816 21510 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.512703 21512 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.512869 21510 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.517356 21510 ts_tablet_manager.cc:1434] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:41.522449 21608 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:09:41.541432 21510 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:41.541996 21511 tablet_bootstrap.cc:654] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.543920 21561 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.548638 21510 tablet_bootstrap.cc:654] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.522550 21470 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.532789 21512 ts_tablet_manager.cc:1434] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:09:41.560190 21512 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:41.582990 21608 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.588969 21510 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:41.589473 21510 ts_tablet_manager.cc:1403] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.001s
I20260709 13:09:41.589389 21588 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.583559 21608 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.592072 21608 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:41.592573 21510 raft_consensus.cc:359] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.593257 21510 raft_consensus.cc:385] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.593505 21510 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.593552 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.594172 21395 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:41.594192 21510 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.595491 21434 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:41.596261 21578 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.596515 21510 ts_tablet_manager.cc:1434] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:41.596607 21578 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.596985 21578 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.597469 21510 tablet_bootstrap.cc:492] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:41.600293 21608 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.600801 21608 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.605515 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:41.608007 21436 leader_election.cc:343] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.609756 21682 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.610530 21682 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.629364 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.629390 21578 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:41.631712 21362 leader_election.cc:343] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.632107 21608 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:41.631716 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.635993 21561 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.641366 21578 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:41.641856 21542 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.643474 21542 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.643899 21670 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.645546 21542 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.647948 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.648193 21466 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.648643 21469 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:41.647735 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.653157 21360 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:41.653435 21467 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:41.653903 21561 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.654340 21561 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.658036 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.658917 21395 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:41.649406 21682 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.654495 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.663527 21511 tablet_bootstrap.cc:492] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:41.664063 21511 ts_tablet_manager.cc:1403] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.153s	user 0.031s	sys 0.048s
I20260709 13:09:41.655448 21561 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.668316 21511 raft_consensus.cc:359] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.668627 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.671171 21511 raft_consensus.cc:385] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.671885 21511 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.672642 21511 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.661087 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:41.681517 21511 ts_tablet_manager.cc:1434] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:41.680917 21670 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.687176 21321 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:41.690896 21511 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:41.687985 21393 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.693065 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:41.699352 21608 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.700417 21608 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.702217 21512 tablet_bootstrap.cc:654] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:41.703450 21436 leader_election.cc:343] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.704084 21608 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:41.707216 21560 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.709321 21542 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.709971 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.709873 21542 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:41.711323 21434 leader_election.cc:343] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.717053 21671 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.717787 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.719420 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.727475 21436 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.721019 21682 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:41.729681 21608 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.734303 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.741009 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.741850 21671 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.745532 21670 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:41.747174 21436 leader_election.cc:343] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.747591 21436 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.711925 21542 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.749866 21510 tablet_bootstrap.cc:654] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.748212 21686 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:41.748484 21606 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.772101 21542 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.773505 21542 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.773959 21542 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.788355 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.795044 21686 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.765830 21670 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:09:41.775909 21542 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.801092 21318 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.807643 21512 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:41.795558 21686 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.810163 21511 tablet_bootstrap.cc:654] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.811066 21512 ts_tablet_manager.cc:1403] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.251s	user 0.020s	sys 0.016s
I20260709 13:09:41.798211 21561 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.838459 21317 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.839113 21512 raft_consensus.cc:359] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.839718 21512 raft_consensus.cc:385] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.839998 21512 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.842316 21512 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.831944 21686 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.847427 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.848232 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.856837 21393 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
W20260709 13:09:41.859122 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:41.860402 21434 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:41.861843 21578 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.862324 21578 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:41.862995 21561 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.863157 21578 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:41.892272 21360 leader_election.cc:343] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.894644 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.903213 21686 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.903810 21686 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.912618 21686 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.913833 21542 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.914347 21542 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.919423 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.933379 21512 ts_tablet_manager.cc:1434] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.122s	user 0.015s	sys 0.011s
I20260709 13:09:41.934482 21512 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:41.941956 21510 tablet_bootstrap.cc:492] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:41.942665 21510 ts_tablet_manager.cc:1403] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.345s	user 0.024s	sys 0.031s
I20260709 13:09:41.943010 21542 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:09:41.947497 21285 leader_election.cc:343] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.949014 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.949926 21541 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.961966 21671 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.964691 21671 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.955473 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.966645 21671 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:41.966770 21466 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:41.971308 21510 raft_consensus.cc:359] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.972985 21510 raft_consensus.cc:385] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.973417 21510 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.966696 21394 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.971046 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:41.975340 21393 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:41.976158 21510 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:41.968767 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.978914 21510 ts_tablet_manager.cc:1434] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:09:41.970853 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:41.988389 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:41.988893 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:41.981101 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:41.993481 21670 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.996510 21719 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.996949 21719 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.997273 21719 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.997545 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:41.998422 21319 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:41.996542 21670 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.000516 21670 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.000227 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:42.001168 21467 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.002971 21362 leader_election.cc:343] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.003468 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:09:42.002053 21285 leader_election.cc:343] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.007809 21686 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.012410 21719 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.017622 21510 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:42.023092 21670 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.024586 21516 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.025517 21670 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.029654 21218 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.030793 21512 tablet_bootstrap.cc:654] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:42.034332 21729 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:09:42.035102 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:42.020160 21724 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:42.037297 21578 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.039635 21511 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:42.040153 21511 ts_tablet_manager.cc:1403] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.349s	user 0.033s	sys 0.009s
W20260709 13:09:42.021339 21362 leader_election.cc:343] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.043444 21719 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.045269 21467 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:42.043524 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:42.055843 21360 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:42.046522 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:42.057910 21724 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.058818 21724 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:42.058987 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:42.059600 21396 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.059649 21724 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.057955 21686 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.061199 21468 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.066763 21285 leader_election.cc:343] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.073064 21511 raft_consensus.cc:359] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.073801 21511 raft_consensus.cc:385] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.073731 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:42.074234 21511 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.074918 21511 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.077553 21510 tablet_bootstrap.cc:654] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:42.081422 21285 leader_election.cc:343] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.086694 21468 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:42.092072 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:42.094337 21719 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.095497 21511 ts_tablet_manager.cc:1434] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.001s
I20260709 13:09:42.095615 21719 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:42.096657 21511 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:42.101744 21719 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.105250 21510 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:42.105731 21510 ts_tablet_manager.cc:1403] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.000s
I20260709 13:09:42.108166 21510 raft_consensus.cc:359] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.108870 21510 raft_consensus.cc:385] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.109139 21510 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.109802 21510 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.111943 21510 ts_tablet_manager.cc:1434] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:42.112820 21510 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:42.115797 21512 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:42.119866 21512 ts_tablet_manager.cc:1403] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.013s
I20260709 13:09:42.121904 21511 tablet_bootstrap.cc:654] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.137954 21396 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:42.140785 21511 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:42.139395 21512 raft_consensus.cc:359] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.141464 21512 raft_consensus.cc:385] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.141460 21511 ts_tablet_manager.cc:1403] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.007s
I20260709 13:09:42.141893 21512 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.142685 21512 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.144497 21510 tablet_bootstrap.cc:654] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.144912 21512 ts_tablet_manager.cc:1434] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:42.144938 21511 raft_consensus.cc:359] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.146116 21511 raft_consensus.cc:385] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.147747 21511 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.148476 21511 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.150884 21511 ts_tablet_manager.cc:1434] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:42.152104 21511 tablet_bootstrap.cc:492] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:42.155964 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:42.157409 21719 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.157891 21719 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:42.158655 21719 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.160156 21511 tablet_bootstrap.cc:654] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.146598 21512 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:42.185614 21512 tablet_bootstrap.cc:654] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.186854 21510 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:42.187408 21510 ts_tablet_manager.cc:1403] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.023s
I20260709 13:09:42.188290 21511 tablet_bootstrap.cc:492] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:42.188783 21511 ts_tablet_manager.cc:1403] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.029s
I20260709 13:09:42.202992 21217 catalog_manager.cc:5697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.204881 21510 raft_consensus.cc:359] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.205574 21510 raft_consensus.cc:385] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.206369 21510 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.206772 21511 raft_consensus.cc:359] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.207000 21510 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.207507 21511 raft_consensus.cc:385] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.207890 21511 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.209339 21510 ts_tablet_manager.cc:1434] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:09:42.210242 21510 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:42.210850 21511 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.213212 21511 ts_tablet_manager.cc:1434] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:09:42.214217 21719 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.214680 21719 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.216735 21719 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.217211 21511 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:42.218325 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:42.219003 21394 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:42.220253 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.220932 21467 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:42.222503 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:42.223287 21719 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.220449 21510 tablet_bootstrap.cc:654] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.223634 21719 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.224086 21719 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.226985 21512 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:42.227545 21512 ts_tablet_manager.cc:1403] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.011s
I20260709 13:09:42.230768 21719 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.232769 21512 raft_consensus.cc:359] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.233428 21512 raft_consensus.cc:385] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.233712 21512 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.233891 21719 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.234530 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:42.234386 21512 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.235148 21394 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.229028 21724 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.236486 21512 ts_tablet_manager.cc:1434] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:42.236241 21724 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.236624 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:42.237136 21468 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.237339 21512 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:42.238328 21724 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.241192 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:42.242110 21394 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:42.242887 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.234728 21511 tablet_bootstrap.cc:654] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.243686 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:42.243995 21512 tablet_bootstrap.cc:654] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.244607 21719 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.245111 21719 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:42.245950 21719 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:42.246699 21362 leader_election.cc:343] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:42.248262 21360 leader_election.cc:343] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.248744 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:42.251916 21723 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.254398 21468 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:42.259344 21510 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:42.259986 21510 ts_tablet_manager.cc:1403] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.002s
I20260709 13:09:42.261660 21216 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.265556 21512 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:42.266166 21512 ts_tablet_manager.cc:1403] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.029s	user 0.002s	sys 0.024s
I20260709 13:09:42.268707 21512 raft_consensus.cc:359] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.269410 21512 raft_consensus.cc:385] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.270305 21510 raft_consensus.cc:359] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.270792 21512 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.271016 21510 raft_consensus.cc:385] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.271337 21510 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.271519 21512 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.283735 21512 ts_tablet_manager.cc:1434] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:42.284694 21512 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:42.273065 21318 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.290467 21512 tablet_bootstrap.cc:654] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.274928 21510 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.294134 21510 ts_tablet_manager.cc:1434] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:09:42.295032 21510 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:42.303390 21614 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.306926 21512 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:42.307492 21512 ts_tablet_manager.cc:1403] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.010s
I20260709 13:09:42.310179 21219 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.310911 21512 raft_consensus.cc:359] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.311728 21512 raft_consensus.cc:385] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.312084 21512 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.311849 21219 catalog_manager.cc:5697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.312783 21512 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.314392 21512 ts_tablet_manager.cc:1434] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:42.315274 21512 tablet_bootstrap.cc:492] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:42.320873 21511 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:42.321376 21511 ts_tablet_manager.cc:1403] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.017s
I20260709 13:09:42.321640 21512 tablet_bootstrap.cc:654] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.324112 21511 raft_consensus.cc:359] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.325150 21511 raft_consensus.cc:385] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.325492 21511 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.326479 21511 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.329200 21512 tablet_bootstrap.cc:492] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:42.328939 21606 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.329619 21512 ts_tablet_manager.cc:1403] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:09:42.331116 21511 ts_tablet_manager.cc:1434] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:42.332234 21512 raft_consensus.cc:359] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.333106 21512 raft_consensus.cc:385] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.333377 21512 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.333559 21511 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:42.334007 21512 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.335515 21512 ts_tablet_manager.cc:1434] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:42.336401 21512 tablet_bootstrap.cc:492] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:42.336398 21510 tablet_bootstrap.cc:654] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.339375 21723 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.339879 21723 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.342046 21516 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.342530 21516 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.344669 21516 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:42.345501 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:42.349181 21436 leader_election.cc:343] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.359943 21578 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.360467 21578 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.362463 21578 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:42.363210 21723 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.365072 21512 tablet_bootstrap.cc:654] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.364449 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.366045 21468 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:42.367025 21511 tablet_bootstrap.cc:654] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.362847 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:42.367548 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:42.367702 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:42.372080 21723 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.372474 21723 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.372840 21723 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.376209 21394 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:42.383114 21393 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:42.431540 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:42.432498 21318 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:42.436968 21434 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:42.438045 21606 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.438596 21606 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.439023 21606 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.440709 21434 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:42.441540 21578 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.442296 21578 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.442644 21578 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.449383 21511 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:42.449981 21511 ts_tablet_manager.cc:1403] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.015s
I20260709 13:09:42.450747 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:42.449121 21578 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.451465 21319 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:42.453215 21511 raft_consensus.cc:359] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.453948 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:42.454118 21511 raft_consensus.cc:385] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.454567 21396 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.454577 21511 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.455427 21578 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:42.455657 21511 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.458205 21606 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.459265 21511 ts_tablet_manager.cc:1434] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:42.459765 21512 tablet_bootstrap.cc:492] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:42.460263 21512 ts_tablet_manager.cc:1403] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.003s
I20260709 13:09:42.460528 21511 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:42.461323 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:42.461867 21392 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.462561 21606 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:42.464016 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:42.463791 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:42.464900 21319 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.465188 21436 leader_election.cc:343] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.467650 21511 tablet_bootstrap.cc:654] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.463122 21512 raft_consensus.cc:359] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.472775 21512 raft_consensus.cc:385] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.473212 21512 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.474160 21512 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.476203 21396 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:42.477705 21434 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:42.478225 21392 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:42.479787 21719 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.479981 21319 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:42.480664 21578 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.480352 21719 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.484408 21723 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.485810 21719 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.481266 21434 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:42.487792 21510 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:42.488430 21516 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.483520 21512 ts_tablet_manager.cc:1434] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:09:42.488191 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.488989 21516 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:42.489617 21512 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:42.489861 21516 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.490417 21724 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.491154 21724 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:42.496343 21285 leader_election.cc:343] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.493407 21578 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:42.496801 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:42.497474 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:42.497538 21318 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:42.498159 21578 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.499027 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:09:42.499240 21285 leader_election.cc:343] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.499408 21724 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.499717 21285 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:42.499997 21589 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:42.500422 21589 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.500825 21589 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.502238 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.502319 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:42.502888 21470 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:42.502992 21468 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.500825 21670 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.488266 21510 ts_tablet_manager.cc:1403] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.193s	user 0.028s	sys 0.023s
I20260709 13:09:42.504555 21723 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.510751 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:42.511394 21319 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.512869 21589 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.514318 21511 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:42.514797 21511 ts_tablet_manager.cc:1403] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.009s
I20260709 13:09:42.515586 21589 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.516124 21723 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.517019 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:42.517627 21467 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.520974 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:42.521453 21670 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.521646 21318 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.521906 21670 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.524230 21670 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.517638 21511 raft_consensus.cc:359] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.525395 21511 raft_consensus.cc:385] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.525645 21511 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.526203 21511 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.531188 21468 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:42.532147 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:42.532356 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:42.534902 21724 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.535476 21724 raft_consensus.cc:697] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:42.536547 21511 ts_tablet_manager.cc:1434] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:42.538002 21511 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:42.520247 21510 raft_consensus.cc:359] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.540279 21510 raft_consensus.cc:385] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.540539 21510 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.542616 21510 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.544788 21510 ts_tablet_manager.cc:1434] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:09:42.545077 21724 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.545774 21510 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:42.548374 21467 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:09:42.549738 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:42.551038 21723 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:42.556051 21589 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.556888 21723 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:42.557825 21723 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.556911 21589 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.564390 21589 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.566229 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.566474 21318 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:09:42.568928 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.566905 21467 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:42.583623 21614 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.584372 21614 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.587579 21614 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:42.597262 21512 tablet_bootstrap.cc:654] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.610919 21512 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:42.611392 21512 ts_tablet_manager.cc:1403] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.006s
I20260709 13:09:42.575516 21319 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:42.622643 21219 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.625130 21219 catalog_manager.cc:5697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.613425 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:42.636533 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:09:42.639950 21362 leader_election.cc:343] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.634296 21511 tablet_bootstrap.cc:654] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.634079 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:42.620564 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:42.647786 21512 raft_consensus.cc:359] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.648566 21512 raft_consensus.cc:385] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.649014 21512 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.646960 21321 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:42.642299 21589 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.649775 21512 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.647684 21396 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:42.657033 21589 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.657452 21589 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.657562 21512 ts_tablet_manager.cc:1434] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:09:42.657675 21723 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.658525 21512 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:42.658217 21723 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.638608 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:42.674819 21670 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.676117 21723 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.676410 21541 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:42.680614 21285 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.683380 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:42.684549 21614 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.684962 21614 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.685345 21614 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.689692 21315 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.693518 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:42.702816 21217 catalog_manager.cc:5697] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:42.711181 21362 leader_election.cc:343] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.714733 21396 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.722081 21510 tablet_bootstrap.cc:654] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.728762 21541 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.731033 21589 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.731772 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.737694 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:09:42.741812 21362 leader_election.cc:343] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.743016 21682 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.743511 21682 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.745927 21541 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.758366 21670 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:42.759995 21682 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.759698 21614 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:42.762359 21360 leader_election.cc:343] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.762861 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:42.764688 21686 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.765329 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:42.765904 21313 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.758819 21589 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:42.782042 21313 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:42.785835 21686 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.788619 21511 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:42.836760 21511 ts_tablet_manager.cc:1403] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.299s	user 0.020s	sys 0.017s
I20260709 13:09:42.838071 21436 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:42.840204 21614 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:42.841684 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:42.842254 21606 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.842281 21395 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.842808 21606 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:42.804134 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:42.843672 21606 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.796768 21217 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 2, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.852167 21395 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:42.856313 21511 raft_consensus.cc:359] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.856997 21511 raft_consensus.cc:385] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.857276 21511 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.789322 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:42.859993 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:42.869903 21467 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.900511 21614 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:42.899389 21768 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:09:42.895974 21360 leader_election.cc:343] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.905092 21511 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.896605 21318 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:42.912660 21511 ts_tablet_manager.cc:1434] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.005s
I20260709 13:09:42.913625 21511 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:42.914245 21512 tablet_bootstrap.cc:654] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.918313 21362 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:42.920710 21589 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.921123 21589 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.921521 21589 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.923317 21321 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.931718 21670 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.942560 21510 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:42.943269 21510 ts_tablet_manager.cc:1403] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.398s	user 0.032s	sys 0.020s
I20260709 13:09:42.950455 21467 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:42.956405 21614 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.958547 21511 tablet_bootstrap.cc:654] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.967628 21510 raft_consensus.cc:359] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.968750 21510 raft_consensus.cc:385] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.969092 21510 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.969931 21510 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:42.977384 21510 ts_tablet_manager.cc:1434] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:09:42.961333 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:42.987349 21766 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.987938 21766 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:42.988517 21468 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:42.988785 21766 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.010448 21510 tablet_bootstrap.cc:492] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:43.022737 21219 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.995820 21589 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.032356 21510 tablet_bootstrap.cc:654] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.000478 21682 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:09:43.039636 21512 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:43.040199 21512 ts_tablet_manager.cc:1403] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.382s	user 0.022s	sys 0.036s
I20260709 13:09:43.048379 21512 raft_consensus.cc:359] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.048971 21512 raft_consensus.cc:385] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.049258 21512 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.051640 21512 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.053885 21512 ts_tablet_manager.cc:1434] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:09:43.054908 21512 tablet_bootstrap.cc:492] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:43.098426 21511 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:43.099025 21511 ts_tablet_manager.cc:1403] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.186s	user 0.013s	sys 0.014s
I20260709 13:09:43.082343 21588 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:43.104406 21588 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.104925 21588 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.106899 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:43.107498 21321 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.123054 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:43.123739 21470 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.104430 21589 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.169291 21315 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:43.174705 21765 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:43.176767 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:43.169337 21511 raft_consensus.cc:359] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.177675 21511 raft_consensus.cc:385] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.177934 21511 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.179493 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:43.180263 21682 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:43.182015 21789 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:09:43.166625 21470 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:43.183754 21511 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.186623 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:43.187405 21589 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.187863 21589 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:43.186216 21511 ts_tablet_manager.cc:1434] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260709 13:09:43.186262 21219 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.190037 21511 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:43.188690 21589 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.185177 21682 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:09:43.188716 21588 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:43.207226 21512 tablet_bootstrap.cc:654] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.214011 21321 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:43.209306 21588 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:43.226594 21589 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.227113 21589 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.243799 21670 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.249099 21670 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.257102 21670 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.258864 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:43.259153 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:43.259708 21470 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:43.260584 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:43.255348 21511 tablet_bootstrap.cc:654] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.264716 21589 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.270746 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:43.272101 21362 leader_election.cc:343] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.278257 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:43.279443 21285 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:43.280308 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:43.280644 21781 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.278219 21510 tablet_bootstrap.cc:492] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:43.282320 21510 ts_tablet_manager.cc:1403] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.273s	user 0.018s	sys 0.011s
I20260709 13:09:43.299327 21790 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:43.318035 21795 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:43.335429 21781 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:43.355839 21798 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:09:43.345146 21360 leader_election.cc:343] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.368273 21360 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:43.369099 21767 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.369940 21790 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.372521 21510 raft_consensus.cc:359] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.373184 21510 raft_consensus.cc:385] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.373449 21510 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.374049 21510 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:43.380698 21801 log.cc:927] Time spent T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:43.381000 21510 ts_tablet_manager.cc:1434] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.000s
I20260709 13:09:43.383113 21510 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:43.386759 21512 tablet_bootstrap.cc:492] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:43.387333 21512 ts_tablet_manager.cc:1403] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.333s	user 0.013s	sys 0.006s
I20260709 13:09:43.388183 21511 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:43.388665 21511 ts_tablet_manager.cc:1403] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.199s	user 0.032s	sys 0.039s
W20260709 13:09:43.423611 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53063.8us
I20260709 13:09:43.433424 21512 raft_consensus.cc:359] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.433881 21511 raft_consensus.cc:359] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.443027 21512 raft_consensus.cc:385] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.443028 21511 raft_consensus.cc:385] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.443857 21511 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.443627 21512 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.449347 21686 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.455734 21217 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.444989 21511 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.449402 21510 tablet_bootstrap.cc:654] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.465392 21511 ts_tablet_manager.cc:1434] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.006s
I20260709 13:09:43.470225 21512 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.480249 21512 ts_tablet_manager.cc:1434] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.004s
I20260709 13:09:43.499567 21791 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.513561 21512 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:43.519181 21511 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:43.575982 21512 tablet_bootstrap.cc:654] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.577653 21510 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:43.581622 21510 ts_tablet_manager.cc:1403] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.199s	user 0.008s	sys 0.020s
I20260709 13:09:43.584182 21686 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.584950 21510 raft_consensus.cc:359] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.585647 21510 raft_consensus.cc:385] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.585932 21510 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.586649 21510 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.587929 21511 tablet_bootstrap.cc:654] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.602753 21510 ts_tablet_manager.cc:1434] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:09:43.604350 21510 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:43.627187 21765 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.638095 21511 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:43.641736 21511 ts_tablet_manager.cc:1403] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.155s	user 0.018s	sys 0.000s
I20260709 13:09:43.643029 21512 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:43.640877 21686 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:43.647058 21511 raft_consensus.cc:359] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.648090 21512 ts_tablet_manager.cc:1403] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.009s
I20260709 13:09:43.649248 21511 raft_consensus.cc:385] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.651576 21788 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.652118 21788 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.650020 21511 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.653345 21511 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.655059 21788 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.658341 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:43.660315 21285 leader_election.cc:343] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.661082 21511 ts_tablet_manager.cc:1434] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:09:43.662434 21511 tablet_bootstrap.cc:492] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:43.664449 21790 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.664898 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:43.665598 21392 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:43.664942 21790 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.669240 21790 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:43.670746 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:43.664444 21512 raft_consensus.cc:359] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.672724 21512 raft_consensus.cc:385] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.673069 21512 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.675469 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:43.676492 21512 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.677965 21392 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:43.678216 21512 ts_tablet_manager.cc:1434] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:09:43.678535 21788 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.680876 21466 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.681427 21788 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.682358 21788 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.684340 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:43.687412 21436 leader_election.cc:343] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.698529 21510 tablet_bootstrap.cc:654] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.699249 21511 tablet_bootstrap.cc:654] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.709988 21512 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:43.707486 21788 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.715016 21779 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.715545 21779 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.736666 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:43.726147 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:43.747453 21394 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.749387 21511 tablet_bootstrap.cc:492] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:43.761440 21686 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.824818 21510 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:43.826483 21511 ts_tablet_manager.cc:1403] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.013s
I20260709 13:09:43.826689 21510 ts_tablet_manager.cc:1403] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.004s
I20260709 13:09:43.760838 21779 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.826532 21686 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.828250 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:43.828492 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:43.725374 21788 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.771365 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:09:43.831028 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59869.8us
I20260709 13:09:43.831336 21510 raft_consensus.cc:359] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.832019 21510 raft_consensus.cc:385] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.832319 21510 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.832931 21588 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.833365 21588 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.833031 21510 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.833714 21588 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.833740 21511 raft_consensus.cc:359] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.834564 21511 raft_consensus.cc:385] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.834844 21511 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.835493 21511 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:43.771755 21285 leader_election.cc:343] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:43.837949 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 66239.4us
W20260709 13:09:43.839018 21285 leader_election.cc:343] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.839254 21511 ts_tablet_manager.cc:1434] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:09:43.839459 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:43.844007 21511 tablet_bootstrap.cc:492] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:43.844208 21606 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:09:43.844060 21362 leader_election.cc:343] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.844748 21606 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.845754 21588 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.847774 21588 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:43.850915 21511 tablet_bootstrap.cc:654] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:43.852429 21285 leader_election.cc:343] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.853050 21606 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:43.854661 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:43.852855 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:43.856106 21686 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.856742 21781 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:43.857446 21360 leader_election.cc:343] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.858100 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:43.860427 21686 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.811295 21394 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:43.867748 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:43.868762 21511 tablet_bootstrap.cc:492] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:43.868822 21781 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.869829 21781 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:43.870683 21781 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.874580 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:43.877030 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:43.826774 21512 tablet_bootstrap.cc:654] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:43.881139 21436 leader_election.cc:343] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.869318 21511 ts_tablet_manager.cc:1403] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.005s
I20260709 13:09:43.886533 21511 raft_consensus.cc:359] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.887192 21511 raft_consensus.cc:385] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.887456 21511 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.888397 21511 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.890606 21511 ts_tablet_manager.cc:1434] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:43.891623 21511 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:43.893718 21219 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.897394 21781 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.897857 21781 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.898177 21510 ts_tablet_manager.cc:1434] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 13:09:43.899776 21510 tablet_bootstrap.cc:492] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:43.899889 21781 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.902015 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:43.902709 21394 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
W20260709 13:09:43.904469 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 72008.2us
I20260709 13:09:43.908648 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:43.909421 21781 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.909448 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:43.909866 21781 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.910238 21781 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.910591 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:43.910161 21391 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.919488 21781 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.919940 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:43.921435 21285 leader_election.cc:343] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.921959 21511 tablet_bootstrap.cc:654] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.930721 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:43.933599 21790 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:43.944079 21781 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:43.945442 21510 tablet_bootstrap.cc:654] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.946069 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:43.954381 21512 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:43.954856 21512 ts_tablet_manager.cc:1403] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.246s	user 0.012s	sys 0.002s
I20260709 13:09:43.957525 21511 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:43.957492 21512 raft_consensus.cc:359] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.958118 21511 ts_tablet_manager.cc:1403] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.006s
I20260709 13:09:43.958251 21512 raft_consensus.cc:385] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.958585 21512 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
W20260709 13:09:43.960476 21285 leader_election.cc:343] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.960731 21511 raft_consensus.cc:359] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.961562 21511 raft_consensus.cc:385] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.961848 21511 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.962467 21511 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.964375 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:43.964751 21511 ts_tablet_manager.cc:1434] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:43.964951 21394 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.965175 21818 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.963454 21512 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.965679 21818 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:43.967350 21511 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:43.947806 21391 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:43.976365 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:43.977072 21315 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:43.979866 21394 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:43.981257 21512 ts_tablet_manager.cc:1434] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:09:43.982431 21512 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:43.967945 21818 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:43.985072 21511 tablet_bootstrap.cc:654] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.986488 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:43.990150 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:43.990695 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:43.991166 21781 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.991824 21781 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:43.992576 21819 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.992995 21819 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.992863 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:43.993458 21819 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.992699 21781 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:43.995472 21434 leader_election.cc:343] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.996192 21818 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.996701 21818 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:43.997503 21818 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.004266 21512 tablet_bootstrap.cc:654] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.022904 21819 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.028388 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:44.028699 21819 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:44.028892 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:44.028990 21315 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:44.030283 21434 leader_election.cc:343] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.030081 21217 catalog_manager.cc:5697] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.036888 21510 tablet_bootstrap.cc:492] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:44.037384 21510 ts_tablet_manager.cc:1403] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.017s
I20260709 13:09:44.038044 21315 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:44.038683 21512 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:44.039175 21512 ts_tablet_manager.cc:1403] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.011s
I20260709 13:09:44.039314 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:44.040930 21819 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.040684 21510 raft_consensus.cc:359] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.041388 21510 raft_consensus.cc:385] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.041409 21819 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:44.042131 21512 raft_consensus.cc:359] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.043437 21511 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:44.042510 21819 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.043871 21511 ts_tablet_manager.cc:1403] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.014s
I20260709 13:09:44.047088 21511 raft_consensus.cc:359] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.047770 21511 raft_consensus.cc:385] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.041690 21510 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.048074 21511 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.048732 21510 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.042824 21512 raft_consensus.cc:385] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.049058 21218 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.049630 21512 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.050889 21512 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.051481 21510 ts_tablet_manager.cc:1434] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:44.048748 21511 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.052786 21510 tablet_bootstrap.cc:492] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:44.053495 21512 ts_tablet_manager.cc:1434] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:44.054382 21511 ts_tablet_manager.cc:1434] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:44.054554 21512 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:44.055495 21511 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:44.060284 21510 tablet_bootstrap.cc:654] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.060505 21512 tablet_bootstrap.cc:654] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.080701 21511 tablet_bootstrap.cc:654] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.082417 21510 tablet_bootstrap.cc:492] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:44.082859 21510 ts_tablet_manager.cc:1403] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.016s
I20260709 13:09:44.082160 21217 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.084636 21512 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:44.085430 21512 ts_tablet_manager.cc:1403] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.001s
I20260709 13:09:44.085754 21510 raft_consensus.cc:359] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.086524 21510 raft_consensus.cc:385] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.086810 21510 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.087455 21510 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.089974 21510 ts_tablet_manager.cc:1434] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:44.089737 21512 raft_consensus.cc:359] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.091037 21510 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:44.091049 21512 raft_consensus.cc:385] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.091632 21512 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.092783 21512 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.096138 21512 ts_tablet_manager.cc:1434] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:09:44.098201 21510 tablet_bootstrap.cc:654] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.099584 21511 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:44.099711 21512 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:44.101482 21511 ts_tablet_manager.cc:1403] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.007s
I20260709 13:09:44.104679 21511 raft_consensus.cc:359] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.105630 21511 raft_consensus.cc:385] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.106010 21511 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.107553 21512 tablet_bootstrap.cc:654] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.106667 21511 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.113639 21510 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:44.114111 21510 ts_tablet_manager.cc:1403] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.002s
I20260709 13:09:44.115041 21511 ts_tablet_manager.cc:1434] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:09:44.116024 21511 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:44.117240 21510 raft_consensus.cc:359] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.119105 21510 raft_consensus.cc:385] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.119441 21510 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.120195 21510 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.121428 21512 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:44.121901 21512 ts_tablet_manager.cc:1403] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 13:09:44.122721 21510 ts_tablet_manager.cc:1434] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:44.124511 21512 raft_consensus.cc:359] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.125362 21512 raft_consensus.cc:385] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.125677 21512 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.126016 21510 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:44.126438 21512 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.132488 21512 ts_tablet_manager.cc:1434] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:09:44.134662 21779 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.138599 21512 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:44.136812 21779 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.144496 21511 tablet_bootstrap.cc:654] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.148957 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:09:44.152016 21285 leader_election.cc:343] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.152594 21779 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.153473 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:44.155406 21285 leader_election.cc:343] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.155838 21285 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:44.157090 21511 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:44.157545 21511 ts_tablet_manager.cc:1403] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.006s
I20260709 13:09:44.157119 21781 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.158851 21510 tablet_bootstrap.cc:654] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.160216 21511 raft_consensus.cc:359] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.160923 21511 raft_consensus.cc:385] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.161175 21511 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.161818 21512 tablet_bootstrap.cc:654] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.161775 21511 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.163910 21511 ts_tablet_manager.cc:1434] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:44.165177 21511 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:44.166788 21819 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.167280 21819 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.170269 21819 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:44.171928 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:44.172334 21511 tablet_bootstrap.cc:654] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.172606 21313 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:44.174557 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:44.174791 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:44.176172 21394 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:44.176014 21819 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.184331 21510 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:44.184844 21510 ts_tablet_manager.cc:1403] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.001s
I20260709 13:09:44.190805 21512 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:44.191463 21512 ts_tablet_manager.cc:1403] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.011s
I20260709 13:09:44.181880 21819 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.192447 21819 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.198565 21512 raft_consensus.cc:359] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.199594 21512 raft_consensus.cc:385] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.199924 21512 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.200860 21512 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.203639 21512 ts_tablet_manager.cc:1434] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:09:44.205528 21510 raft_consensus.cc:359] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.206478 21510 raft_consensus.cc:385] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.206807 21510 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.207595 21510 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.210461 21510 ts_tablet_manager.cc:1434] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:09:44.211834 21512 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:44.215986 21819 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.217790 21510 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:44.218923 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:44.219530 21313 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.219484 21682 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.222256 21682 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.224785 21682 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.229806 21512 tablet_bootstrap.cc:654] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.238372 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:44.239230 21315 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:44.239544 21510 tablet_bootstrap.cc:654] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.246840 21819 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:44.249639 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:44.250236 21394 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.267067 21469 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.269979 21313 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:44.271435 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:44.278258 21791 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.278841 21791 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:44.279639 21791 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.288331 21766 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.289126 21766 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.261878 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:44.302731 21511 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:44.303242 21511 ts_tablet_manager.cc:1403] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.138s	user 0.027s	sys 0.052s
I20260709 13:09:44.303352 21360 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:44.305606 21394 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:44.306649 21511 raft_consensus.cc:359] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.307526 21511 raft_consensus.cc:385] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.310971 21840 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.307868 21511 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.315600 21682 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.316222 21682 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.316795 21511 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.318323 21510 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:44.319914 21510 ts_tablet_manager.cc:1403] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.020s
I20260709 13:09:44.328912 21682 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.333806 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:44.335438 21511 ts_tablet_manager.cc:1434] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 13:09:44.336537 21511 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:44.342036 21766 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.328819 21510 raft_consensus.cc:359] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.343452 21510 raft_consensus.cc:385] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.345616 21510 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.349424 21510 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.344764 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:44.343932 21788 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.355131 21510 ts_tablet_manager.cc:1434] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:09:44.346414 21819 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.358946 21819 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.361114 21819 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:44.346328 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:44.353343 21466 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:44.361931 21313 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
W20260709 13:09:44.356218 21362 leader_election.cc:343] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.364353 21362 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:44.365198 21510 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:44.365388 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:44.345813 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:44.371562 21434 leader_election.cc:343] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.373695 21840 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.367357 21360 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:44.368518 21766 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.383095 21682 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.383311 21766 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.383625 21682 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.384090 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:44.384112 21682 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.384809 21313 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 0.
I20260709 13:09:44.386128 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:44.386543 21511 tablet_bootstrap.cc:654] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.389038 21510 tablet_bootstrap.cc:654] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.384130 21766 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.390250 21818 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.400303 21818 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.400676 21818 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.402132 21779 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.403829 21779 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.407680 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:09:44.383128 21360 leader_election.cc:343] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.408454 21394 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:44.410856 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:44.408368 21781 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.427443 21512 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:44.428301 21512 ts_tablet_manager.cc:1403] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.217s	user 0.021s	sys 0.009s
I20260709 13:09:44.435062 21779 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.435678 21779 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.419451 21781 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:44.449852 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:44.444166 21779 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.455801 21217 catalog_manager.cc:5697] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.455132 21779 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.465703 21512 raft_consensus.cc:359] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.466354 21512 raft_consensus.cc:385] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.466595 21512 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.467471 21512 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.468922 21766 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.469034 21682 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.474546 21820 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:44.475078 21766 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.475373 21682 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.475839 21512 ts_tablet_manager.cc:1434] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.003s
I20260709 13:09:44.478812 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:44.479097 21781 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.479430 21512 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:44.479388 21321 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.482472 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:44.473743 21845 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.480046 21510 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:44.484124 21510 ts_tablet_manager.cc:1403] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.006s
I20260709 13:09:44.467181 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:44.489871 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:44.492959 21511 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:44.493494 21511 ts_tablet_manager.cc:1403] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.003s
I20260709 13:09:44.494778 21510 raft_consensus.cc:359] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.495430 21510 raft_consensus.cc:385] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.495141 21818 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:44.495584 21362 leader_election.cc:343] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.495738 21510 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
W20260709 13:09:44.496366 21360 leader_election.cc:343] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.496716 21510 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.499461 21510 ts_tablet_manager.cc:1434] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:09:44.497937 21511 raft_consensus.cc:359] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.499984 21511 raft_consensus.cc:385] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.500293 21511 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.500416 21510 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:44.501040 21511 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:44.501207 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46487.9us
I20260709 13:09:44.517407 21321 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:44.511511 21846 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.530047 21820 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.530531 21820 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.530411 21846 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:44.534684 21285 leader_election.cc:343] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.535286 21511 ts_tablet_manager.cc:1434] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:09:44.536547 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:44.538503 21315 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.539844 21512 tablet_bootstrap.cc:654] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.540735 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:09:44.541882 21434 leader_election.cc:343] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.537122 21818 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:44.543147 21820 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:44.544142 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:44.526046 21851 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260709 13:09:44.544858 21394 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:09:44.543179 21511 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:44.491532 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:44.546542 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:44.558537 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:44.559165 21321 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.559351 21468 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.555629 21466 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.560927 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:44.571725 21362 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:44.573181 21766 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.573659 21766 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:44.574469 21766 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.574824 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:44.576840 21779 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.579653 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:44.579998 21779 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.580348 21313 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:44.581677 21362 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:44.582638 21818 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.488997 21845 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.584214 21682 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.584649 21682 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.585641 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:44.585831 21682 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:44.591398 21360 leader_election.cc:343] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.594810 21321 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:09:44.595969 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:44.584769 21846 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.613387 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:44.621742 21852 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:44.601789 21818 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.637655 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:44.642144 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:44.639900 21392 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.638262 21818 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:09:44.641099 21779 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.653275 21818 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.652100 21779 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.657480 21851 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.660481 21820 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.660813 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:44.664556 21362 leader_election.cc:343] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.669562 21779 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.674261 21845 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.677232 21510 tablet_bootstrap.cc:654] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.677935 21606 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:44.674294 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:44.678494 21217 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.688843 21395 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:44.689505 21512 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:44.690008 21512 ts_tablet_manager.cc:1403] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.211s	user 0.007s	sys 0.007s
I20260709 13:09:44.702289 21511 tablet_bootstrap.cc:654] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.703971 21512 raft_consensus.cc:359] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.709010 21512 raft_consensus.cc:385] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.709409 21512 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.710141 21512 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.712359 21512 ts_tablet_manager.cc:1434] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.005s
I20260709 13:09:44.715395 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:44.703430 21791 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:44.722884 21360 leader_election.cc:343] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.723366 21360 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:44.725170 21845 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.721947 21791 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.726078 21855 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:09:44.728638 21862 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:44.730806 21512 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:44.735453 21682 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:44.736086 21285 leader_election.cc:343] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.736825 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:44.742520 21466 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:44.744268 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:44.746591 21779 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:44.763121 21856 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:09:44.763361 21392 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:44.770293 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:44.777223 21791 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:44.778366 21855 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.788287 21855 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:44.789508 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:44.798666 21511 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:44.799227 21511 ts_tablet_manager.cc:1403] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.256s	user 0.010s	sys 0.014s
I20260709 13:09:44.789127 21855 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.796355 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:44.787649 21360 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:09:44.824714 21434 leader_election.cc:343] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.824846 21682 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:44.825336 21511 raft_consensus.cc:359] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.826030 21511 raft_consensus.cc:385] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.826294 21511 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.826844 21511 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:44.832314 21436 leader_election.cc:343] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.832682 21436 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:44.827912 21840 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.835312 21840 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:44.836118 21840 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.841218 21818 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.843441 21606 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:44.843698 21779 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:44.842849 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 62257.8us
I20260709 13:09:44.848634 21511 ts_tablet_manager.cc:1434] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:09:44.850051 21511 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:44.860901 21512 tablet_bootstrap.cc:654] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.862022 21510 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:44.862632 21510 ts_tablet_manager.cc:1403] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.362s	user 0.019s	sys 0.022s
I20260709 13:09:44.864861 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:44.865500 21315 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.869549 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:44.873917 21510 raft_consensus.cc:359] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.874667 21510 raft_consensus.cc:385] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.874940 21510 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.875545 21510 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:44.877480 21360 leader_election.cc:343] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.887689 21510 ts_tablet_manager.cc:1434] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:44.888805 21510 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
W20260709 13:09:44.890982 21866 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:44.891404 21315 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:44.892589 21362 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:44.893698 21840 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.894163 21840 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:44.894817 21511 tablet_bootstrap.cc:654] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.897071 21840 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:44.901552 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 58394.5us
I20260709 13:09:44.912761 21217 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.943826 21512 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:44.944346 21512 ts_tablet_manager.cc:1403] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.214s	user 0.017s	sys 0.002s
I20260709 13:09:44.949468 21606 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:44.962682 21512 raft_consensus.cc:359] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.970686 21512 raft_consensus.cc:385] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.970988 21512 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.966741 21510 tablet_bootstrap.cc:654] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.975829 21512 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:44.978134 21218 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.996484 21512 ts_tablet_manager.cc:1434] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:09:45.022887 21511 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:45.023401 21511 ts_tablet_manager.cc:1403] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.174s	user 0.022s	sys 0.039s
I20260709 13:09:45.026335 21511 raft_consensus.cc:359] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.027393 21511 raft_consensus.cc:385] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.028264 21512 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:45.027649 21511 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.031963 21511 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.040961 21511 ts_tablet_manager.cc:1434] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:09:45.041914 21511 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:45.044922 21512 tablet_bootstrap.cc:654] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.047484 21219 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:45.051123 21360 consensus_peers.cc:597] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.055218 21511 tablet_bootstrap.cc:654] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.056402 21510 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:45.056860 21510 ts_tablet_manager.cc:1403] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.168s	user 0.028s	sys 0.021s
I20260709 13:09:45.059505 21510 raft_consensus.cc:359] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.062211 21510 raft_consensus.cc:385] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.062530 21510 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.064742 21512 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:45.064167 21510 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.065219 21512 ts_tablet_manager.cc:1403] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 13:09:45.067255 21510 ts_tablet_manager.cc:1434] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:45.067919 21512 raft_consensus.cc:359] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.068591 21512 raft_consensus.cc:385] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.068615 21510 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:45.068943 21512 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.069600 21512 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.071745 21512 ts_tablet_manager.cc:1434] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:45.072636 21512 tablet_bootstrap.cc:492] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:45.078778 21852 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.079908 21512 tablet_bootstrap.cc:654] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.079454 21852 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.085871 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:45.086726 21391 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:45.088276 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:45.089320 21781 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.089870 21781 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.090286 21781 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.092335 21511 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:45.092860 21511 ts_tablet_manager.cc:1403] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.033s
I20260709 13:09:45.095395 21511 raft_consensus.cc:359] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.097056 21840 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.096102 21511 raft_consensus.cc:385] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.097708 21511 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.097505 21840 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.098488 21511 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.099538 21840 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.099918 21879 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.100387 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:45.101183 21314 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 1: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:09:45.101187 21511 ts_tablet_manager.cc:1434] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:45.105309 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.106868 21511 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:45.107415 21360 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:45.108640 21840 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.110587 21852 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.112684 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.113305 21512 tablet_bootstrap.cc:492] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:45.113761 21512 ts_tablet_manager.cc:1403] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
W20260709 13:09:45.114234 21285 leader_election.cc:343] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.088406 21217 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.116524 21512 raft_consensus.cc:359] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.117213 21512 raft_consensus.cc:385] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.117475 21512 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.118103 21512 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.125619 21512 ts_tablet_manager.cc:1434] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:09:45.126747 21845 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.127058 21512 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:45.127250 21845 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.117761 21781 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.133309 21871 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.135316 21781 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.137056 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:45.137058 21511 tablet_bootstrap.cc:654] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.138798 21845 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.139498 21391 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.140460 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:45.142319 21360 leader_election.cc:343] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.152807 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:09:45.154714 21285 leader_election.cc:343] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.152097 21845 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.155507 21845 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.156977 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:45.157675 21845 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.157639 21317 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:45.160909 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.163352 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:45.163695 21469 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:45.164855 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:45.165617 21845 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.165727 21362 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:45.165992 21845 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.166343 21845 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.166791 21510 tablet_bootstrap.cc:654] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:45.166795 21362 leader_election.cc:343] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.169883 21840 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.172049 21871 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.172421 21871 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.172735 21871 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.176779 21512 tablet_bootstrap.cc:654] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.234534 21845 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.236776 21466 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.236671 21879 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.239463 21879 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.241689 21879 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:45.243076 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:45.245563 21879 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.251507 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:45.257311 21391 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:45.237941 21511 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:45.258226 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:45.258785 21511 ts_tablet_manager.cc:1403] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.152s	user 0.022s	sys 0.025s
I20260709 13:09:45.259338 21879 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.261981 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:45.262749 21851 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.263216 21851 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:45.264078 21851 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.270452 21871 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.273859 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:45.275401 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:45.281698 21871 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:09:45.282207 21360 leader_election.cc:343] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.275810 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:45.283126 21470 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.278604 21511 raft_consensus.cc:359] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:45.283653 21362 leader_election.cc:343] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.273484 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:45.283984 21511 raft_consensus.cc:385] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.284309 21315 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.284341 21511 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.286336 21511 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.291469 21315 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:45.298038 21511 ts_tablet_manager.cc:1434] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:09:45.298350 21510 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:45.298890 21510 ts_tablet_manager.cc:1403] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.231s	user 0.007s	sys 0.008s
I20260709 13:09:45.299017 21511 tablet_bootstrap.cc:492] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:45.300558 21362 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:45.302266 21840 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.304229 21840 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:45.305083 21840 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.310804 21511 tablet_bootstrap.cc:654] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.311430 21470 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:45.314395 21779 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.319195 21845 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.301805 21510 raft_consensus.cc:359] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.322147 21779 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.323978 21510 raft_consensus.cc:385] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.328069 21511 tablet_bootstrap.cc:492] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:45.328259 21510 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.328655 21511 ts_tablet_manager.cc:1403] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 13:09:45.328058 21871 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:45.332851 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:09:45.332442 21218 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.333997 21845 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.334751 21845 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:45.335645 21845 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.331835 21511 raft_consensus.cc:359] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.341329 21511 raft_consensus.cc:385] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.341593 21511 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.348323 21510 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.350736 21510 ts_tablet_manager.cc:1434] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 13:09:45.351778 21510 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:45.351902 21682 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:45.358204 21851 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.358701 21851 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.361470 21851 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.361688 21217 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.356666 21512 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:45.363463 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:45.363660 21512 ts_tablet_manager.cc:1403] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.237s	user 0.013s	sys 0.014s
I20260709 13:09:45.344269 21511 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:45.364671 21285 leader_election.cc:343] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.367762 21511 ts_tablet_manager.cc:1434] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:09:45.368790 21511 tablet_bootstrap.cc:492] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:45.377571 21512 raft_consensus.cc:359] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.378803 21512 raft_consensus.cc:385] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.379161 21512 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.381421 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:45.382898 21285 leader_election.cc:343] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.383306 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:45.384467 21852 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.385854 21512 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.388077 21512 ts_tablet_manager.cc:1434] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 13:09:45.389297 21512 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:45.378432 21851 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.391286 21851 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.393365 21851 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.396845 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:09:45.398306 21285 leader_election.cc:343] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.399339 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.413708 21511 tablet_bootstrap.cc:654] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:45.417537 21285 leader_election.cc:343] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.417996 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:45.419386 21851 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.427186 21510 tablet_bootstrap.cc:654] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.435256 21219 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.443650 21512 tablet_bootstrap.cc:654] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.434818 21851 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.449203 21851 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.454911 21851 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.456271 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.456959 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:45.458005 21682 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.458488 21682 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.459932 21511 tablet_bootstrap.cc:492] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:45.460536 21511 ts_tablet_manager.cc:1403] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.000s
W20260709 13:09:45.462034 21285 leader_election.cc:343] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:45.462581 21285 leader_election.cc:343] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.462808 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:45.463657 21682 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.464260 21855 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.464731 21512 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:45.463615 21511 raft_consensus.cc:359] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.465217 21512 ts_tablet_manager.cc:1403] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.076s	user 0.001s	sys 0.014s
I20260709 13:09:45.465305 21511 raft_consensus.cc:385] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.464834 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:45.465648 21511 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
W20260709 13:09:45.466586 21362 leader_election.cc:343] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.466280 21511 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.467483 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.467845 21512 raft_consensus.cc:359] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.468609 21512 raft_consensus.cc:385] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:45.468670 21360 leader_election.cc:343] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.468918 21512 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.469122 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:45.469565 21512 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.470203 21845 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.471547 21512 ts_tablet_manager.cc:1434] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:45.472492 21512 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:45.472638 21511 ts_tablet_manager.cc:1434] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:09:45.473506 21511 tablet_bootstrap.cc:492] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:45.480120 21512 tablet_bootstrap.cc:654] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.483959 21510 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:45.484412 21510 ts_tablet_manager.cc:1403] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.010s
I20260709 13:09:45.486802 21510 raft_consensus.cc:359] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.487438 21510 raft_consensus.cc:385] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.487674 21510 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.493829 21510 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.498041 21510 ts_tablet_manager.cc:1434] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:09:45.498474 21511 tablet_bootstrap.cc:654] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.504317 21512 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:45.504817 21512 ts_tablet_manager.cc:1403] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.008s
I20260709 13:09:45.507537 21510 tablet_bootstrap.cc:492] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:45.507336 21512 raft_consensus.cc:359] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:45.514159 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:45.514334 21512 raft_consensus.cc:385] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.514628 21512 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.515280 21512 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.516002 21845 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.518750 21512 ts_tablet_manager.cc:1434] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:45.520349 21512 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:45.526464 21510 tablet_bootstrap.cc:654] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.532905 21465 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.545404 21512 tablet_bootstrap.cc:654] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.551352 21845 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.568835 21511 tablet_bootstrap.cc:492] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:45.569552 21511 ts_tablet_manager.cc:1403] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.096s	user 0.031s	sys 0.019s
I20260709 13:09:45.572888 21511 raft_consensus.cc:359] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.574156 21511 raft_consensus.cc:385] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.574496 21511 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.575320 21511 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.577913 21469 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.577662 21511 ts_tablet_manager.cc:1434] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:45.586386 21511 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:45.596413 21510 tablet_bootstrap.cc:492] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:45.596909 21510 ts_tablet_manager.cc:1403] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.015s
I20260709 13:09:45.599066 21511 tablet_bootstrap.cc:654] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.599905 21510 raft_consensus.cc:359] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.600668 21510 raft_consensus.cc:385] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.600939 21510 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.601751 21510 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.603958 21510 ts_tablet_manager.cc:1434] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:45.604882 21510 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:45.609680 21512 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:45.610141 21512 ts_tablet_manager.cc:1403] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.018s
I20260709 13:09:45.610508 21510 tablet_bootstrap.cc:654] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.622220 21512 raft_consensus.cc:359] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.623209 21512 raft_consensus.cc:385] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.623550 21512 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.628772 21512 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.636449 21512 ts_tablet_manager.cc:1434] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 13:09:45.637413 21512 tablet_bootstrap.cc:492] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:45.655212 21511 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:45.655702 21511 ts_tablet_manager.cc:1403] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.004s
I20260709 13:09:45.658188 21511 raft_consensus.cc:359] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.658857 21511 raft_consensus.cc:385] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.659137 21511 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.660445 21511 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.664201 21510 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:45.664686 21510 ts_tablet_manager.cc:1403] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.035s
I20260709 13:09:45.666427 21511 ts_tablet_manager.cc:1434] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:09:45.667647 21510 raft_consensus.cc:359] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.668434 21510 raft_consensus.cc:385] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.669114 21510 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.669893 21510 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.672333 21510 ts_tablet_manager.cc:1434] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:45.672662 21511 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:45.673386 21510 tablet_bootstrap.cc:492] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:45.674028 21512 tablet_bootstrap.cc:654] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.681715 21511 tablet_bootstrap.cc:654] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.685218 21469 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.686147 21512 tablet_bootstrap.cc:492] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:45.686616 21512 ts_tablet_manager.cc:1403] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.004s
I20260709 13:09:45.687534 21851 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.689157 21512 raft_consensus.cc:359] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.689836 21512 raft_consensus.cc:385] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.690091 21512 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.690920 21512 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.692476 21512 ts_tablet_manager.cc:1434] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:09:45.693370 21512 tablet_bootstrap.cc:492] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
I20260709 13:09:45.693305 21855 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.707486 21511 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:45.707970 21511 ts_tablet_manager.cc:1403] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.005s
I20260709 13:09:45.710829 21510 tablet_bootstrap.cc:654] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.711102 21511 raft_consensus.cc:359] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.712599 21511 raft_consensus.cc:385] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.712929 21511 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.713577 21511 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.716331 21511 ts_tablet_manager.cc:1434] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:45.717283 21511 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:45.719149 21512 tablet_bootstrap.cc:654] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.719238 21470 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.723675 21511 tablet_bootstrap.cc:654] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.731663 21845 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.738224 21851 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.738832 21851 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.740906 21851 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.742574 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.754348 21855 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.765695 21285 leader_election.cc:343] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.754484 21862 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.765780 21855 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.766793 21862 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.768196 21845 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.768680 21845 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.755124 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:45.770262 21391 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:45.763863 21766 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.771409 21766 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:45.773072 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:45.771971 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:45.773962 21851 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.774319 21851 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.774652 21851 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.775663 21862 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:45.771826 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.772558 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:45.781805 21845 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:09:45.783391 21360 leader_election.cc:343] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:45.783394 21436 leader_election.cc:343] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.787940 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:45.789183 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:45.790185 21362 leader_election.cc:343] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:45.980293 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 190143us
W20260709 13:09:45.984069 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 159850us
I20260709 13:09:45.790383 21766 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.851872 21840 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.799886 21855 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:45.857824 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:45.860380 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:45.779935 21851 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.012753 21855 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.038555 21851 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.007036 21840 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.041903 21511 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:46.041958 21312 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 1: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:09:46.044169 21510 tablet_bootstrap.cc:492] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:46.044641 21922 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.045606 21512 tablet_bootstrap.cc:492] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:46.053300 21512 ts_tablet_manager.cc:1403] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.360s	user 0.034s	sys 0.024s
I20260709 13:09:46.047570 21511 ts_tablet_manager.cc:1403] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.330s	user 0.013s	sys 0.015s
I20260709 13:09:46.052605 21510 ts_tablet_manager.cc:1403] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.379s	user 0.030s	sys 0.021s
I20260709 13:09:46.047410 21855 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.055234 21922 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.081336 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:46.082572 21466 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:46.087651 21285 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:46.101296 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:09:46.111202 21285 leader_election.cc:343] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:46.111202 21434 leader_election.cc:343] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.113447 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:46.118191 21922 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.118779 21930 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.119566 21855 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.123711 21511 raft_consensus.cc:359] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.124408 21511 raft_consensus.cc:385] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.124682 21511 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.125274 21511 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.126852 21512 raft_consensus.cc:359] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.128166 21512 raft_consensus.cc:385] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.128432 21512 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.129042 21512 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.141448 21510 raft_consensus.cc:359] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.142238 21510 raft_consensus.cc:385] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.142252 21511 ts_tablet_manager.cc:1434] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.002s
I20260709 13:09:46.142609 21510 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.145092 21510 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:09:46.157805 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 78061.3us
W20260709 13:09:46.162745 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50889.9us
I20260709 13:09:46.176937 21510 ts_tablet_manager.cc:1434] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.123s	user 0.006s	sys 0.002s
I20260709 13:09:46.162467 21920 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.170854 21840 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.188881 21510 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:46.190151 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:46.190650 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:46.191262 21468 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
W20260709 13:09:46.194968 21285 leader_election.cc:343] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.205142 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:46.187296 21928 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.206094 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.214946 21511 tablet_bootstrap.cc:492] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Bootstrap starting.
I20260709 13:09:46.290136 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:46.298501 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 92485.6us
W20260709 13:09:46.248898 21347 tablet.cc:2406] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:46.301064 21321 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
W20260709 13:09:46.299680 21360 leader_election.cc:343] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.303702 21360 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.304796 21923 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.298343 21855 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.306520 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:46.307075 21855 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.309193 21855 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.309805 21766 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.311815 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:46.258052 21840 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.206735 21933 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.258665 21930 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.322094 21933 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.301088 21928 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.322710 21933 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.319151 21840 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.323452 21766 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.228186 21512 ts_tablet_manager.cc:1434] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.175s	user 0.006s	sys 0.023s
I20260709 13:09:46.326854 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:46.327564 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:46.331664 21394 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:46.327692 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:46.328379 21840 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.334337 21512 tablet_bootstrap.cc:492] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Bootstrap starting.
W20260709 13:09:46.334846 21285 leader_election.cc:343] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.340852 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:46.355337 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:09:46.357784 21360 leader_election.cc:343] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.342952 21390 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:46.372488 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:46.373149 21394 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:46.353199 21928 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.385031 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:46.532395 21318 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:46.375058 21871 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:46.423442 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48735.6us
I20260709 13:09:46.520256 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:46.538686 21512 tablet_bootstrap.cc:654] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.533161 21871 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.394028 21393 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:46.541656 21511 tablet_bootstrap.cc:654] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.539049 21840 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:46.539132 21871 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:46.548038 21360 leader_election.cc:343] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.541930 21312 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:46.610026 21510 tablet_bootstrap.cc:654] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.604229 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:46.604694 21840 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:46.612635 21360 leader_election.cc:343] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.612346 21840 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.616362 21933 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.616778 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.618445 21951 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.618782 21951 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.618805 21933 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.619065 21951 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.625833 21840 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.628055 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:09:46.629528 21360 leader_election.cc:343] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.630630 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:46.631513 21319 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 0.
I20260709 13:09:46.652384 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.653196 21851 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.653818 21851 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.654275 21851 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.654376 21951 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.656781 21951 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.689327 21512 tablet_bootstrap.cc:492] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: No bootstrap required, opened a new log
I20260709 13:09:46.689906 21512 ts_tablet_manager.cc:1403] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Time spent bootstrapping tablet: real 0.356s	user 0.026s	sys 0.020s
I20260709 13:09:46.697340 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.702585 21851 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.704198 21938 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:09:46.707496 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.710474 21512 raft_consensus.cc:359] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.714027 21512 raft_consensus.cc:385] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.714298 21512 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.718021 21512 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.711676 21938 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.719440 21938 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.719774 21938 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.730535 21925 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:09:46.738410 21871 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.742666 21871 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.718858 21951 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.754604 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:46.755240 21469 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.756515 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:46.760331 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:46.760805 21511 tablet_bootstrap.cc:492] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: No bootstrap required, opened a new log
I20260709 13:09:46.760928 21394 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.761277 21511 ts_tablet_manager.cc:1403] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Time spent bootstrapping tablet: real 0.547s	user 0.040s	sys 0.053s
I20260709 13:09:46.765516 21851 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.770224 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:09:46.770661 21360 leader_election.cc:343] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.770885 21393 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.775163 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:46.775796 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:46.777384 21394 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:46.777660 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:09:46.778800 21267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:46.775765 21392 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.778280 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:46.781608 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:46.782006 21779 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.782451 21779 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:46.783291 21469 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:46.783317 21779 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.785712 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.786469 21682 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.786803 21682 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.787123 21682 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.793834 21682 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.797221 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:09:46.798542 21360 leader_election.cc:343] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.801025 21512 ts_tablet_manager.cc:1434] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.000s
W20260709 13:09:46.801911 21285 leader_election.cc:343] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:46.802529 21285 leader_election.cc:343] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.804694 21510 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:46.805172 21510 ts_tablet_manager.cc:1403] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.622s	user 0.030s	sys 0.020s
I20260709 13:09:46.806402 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:46.813293 21319 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.814194 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:46.814786 21320 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.815467 21393 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:46.815989 21766 raft_consensus.cc:2764] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:46.820968 21392 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:46.751286 21951 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:46.822185 21951 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.833101 21320 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:46.808331 21682 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.803586 21938 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.839217 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.842650 21766 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.843057 21938 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:46.843309 21766 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:46.844564 21766 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.845405 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:09:46.846881 21360 leader_election.cc:343] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.836582 21319 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:46.852907 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.853546 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.854923 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:46.864114 21511 raft_consensus.cc:359] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.865203 21511 raft_consensus.cc:385] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.865600 21511 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.872303 21511 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.863847 21855 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.903891 21511 ts_tablet_manager.cc:1434] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Time spent starting tablet: real 0.142s	user 0.009s	sys 0.000s
I20260709 13:09:46.910701 21924 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.911299 21924 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:46.912228 21939 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.914048 21510 raft_consensus.cc:359] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.914754 21510 raft_consensus.cc:385] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.915006 21510 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.900309 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:09:46.916390 21510 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.905735 21855 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:46.934324 21855 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.930850 21319 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.938774 21510 ts_tablet_manager.cc:1434] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.132s	user 0.005s	sys 0.002s
I20260709 13:09:46.919739 21939 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:46.912278 21924 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.950809 21510 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:46.953928 21939 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:46.991401 21319 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:09:46.997601 21219 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.010427 21510 tablet_bootstrap.cc:654] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.998754 21216 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.016515 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:09:47.018139 21871 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.018641 21871 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:09:47.019532 21871 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.029924 21510 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:47.030416 21510 ts_tablet_manager.cc:1403] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.005s
I20260709 13:09:47.032977 21510 raft_consensus.cc:359] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.033625 21510 raft_consensus.cc:385] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.033885 21510 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.034529 21510 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.036734 21510 ts_tablet_manager.cc:1434] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:47.037938 21510 tablet_bootstrap.cc:492] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:47.044287 21510 tablet_bootstrap.cc:654] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.053001 21510 tablet_bootstrap.cc:492] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:47.053478 21510 ts_tablet_manager.cc:1403] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:09:47.062666 21510 raft_consensus.cc:359] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.065218 21510 raft_consensus.cc:385] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.065488 21510 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.066061 21510 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.068316 21510 ts_tablet_manager.cc:1434] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:09:47.069248 21510 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:47.069496 21219 catalog_manager.cc:5697] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.071009 21219 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 0 to 1, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.074769 21510 tablet_bootstrap.cc:654] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.081301 21510 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:47.082952 21510 ts_tablet_manager.cc:1403] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:09:47.085742 21510 raft_consensus.cc:359] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.086391 21510 raft_consensus.cc:385] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.086652 21510 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.087268 21510 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.089214 21510 ts_tablet_manager.cc:1434] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:47.090065 21510 tablet_bootstrap.cc:492] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:47.095768 21510 tablet_bootstrap.cc:654] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.098160 21879 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.099808 21879 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.102105 21879 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:47.103399 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:47.104866 21510 tablet_bootstrap.cc:492] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:47.105311 21510 ts_tablet_manager.cc:1403] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:09:47.105923 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:47.106757 21317 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:47.107882 21436 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:47.108633 21879 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.108382 21510 raft_consensus.cc:359] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.109617 21510 raft_consensus.cc:385] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.109882 21510 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.113086 21510 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.113611 21219 catalog_manager.cc:5697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.115007 21879 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.115139 21510 ts_tablet_manager.cc:1434] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:09:47.116751 21510 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Bootstrap starting.
I20260709 13:09:47.117050 21219 catalog_manager.cc:5697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.119086 21219 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.122243 21510 tablet_bootstrap.cc:654] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.129580 21510 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: No bootstrap required, opened a new log
I20260709 13:09:47.130002 21510 ts_tablet_manager.cc:1403] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 13:09:47.132830 21510 raft_consensus.cc:359] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.133508 21510 raft_consensus.cc:385] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.133764 21510 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.134364 21510 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.136462 21510 ts_tablet_manager.cc:1434] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:47.168560 21939 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.169130 21939 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.172420 21939 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:47.173092 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:47.173813 21391 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:47.173964 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:09:47.174605 21466 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 0.
I20260709 13:09:47.174998 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:09:47.175631 21939 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.175983 21939 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.176270 21939 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.181680 21939 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.183490 21939 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:47.184084 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:09:47.184432 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:09:47.184677 21391 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.185019 21466 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.191489 21466 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:47.191480 21391 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:09:47.192723 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:09:47.193322 21939 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.193773 21939 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:09:47.194496 21939 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.205200 21217 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 0 to 1, leader changed from <none> to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.216786 21939 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.226473 21852 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.251478 21466 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.260319 21852 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.273404 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:09:47.280243 21606 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.280759 21606 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.282660 21606 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:47.284291 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:47.286595 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:47.287402 21319 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:09:47.292711 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:47.293938 21879 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:47.295487 21983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:47.300765 21852 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:47.303578 21984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:47.306135 21946 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.306943 21946 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.309758 21946 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:47.311971 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:09:47.316499 21988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:47.317576 20199 server_base.cc:1061] running on GCE node
I20260709 13:09:47.319384 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:47.319728 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:47.319991 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602587319971 us; error 0 us; skew 500 ppm
I20260709 13:09:47.320854 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:47.321007 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:47.321821 21395 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:09:47.327833 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:47.330024 21862 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.334535 21934 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.335104 21934 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:09:47.337538 21934 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:47.338644 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:09:47.339229 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:09:47.340189 21393 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 1: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:09:47.343350 21434 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:09:47.344919 21606 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.348161 21862 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.354305 21606 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.357136 21879 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.358740 20199 webserver.cc:533] Webserver started at http://127.19.185.196:46559/ using document root <none> and password file <none>
I20260709 13:09:47.359536 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:47.359889 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:47.360422 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:47.361621 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-3-root/instance:
uuid: "bfcd9560f8f44414b25f8069384c5a73"
format_stamp: "Formatted at 2026-07-09 13:09:47 on dist-test-slave-rrf3"
I20260709 13:09:47.368451 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:47.371330 21852 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.377971 21992 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:47.379276 20199 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:09:47.380389 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-3-root
uuid: "bfcd9560f8f44414b25f8069384c5a73"
format_stamp: "Formatted at 2026-07-09 13:09:47 on dist-test-slave-rrf3"
I20260709 13:09:47.380858 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:47.389163 21855 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:47.401739 21938 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.413326 21855 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.436728 21871 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.447633 21469 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.449319 21871 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:47.477350 21871 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.485988 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:47.486871 21766 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.489223 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:47.498142 21954 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.506652 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:47.513638 21871 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.538060 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:47.538498 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:47.538882 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:47.539187 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:47.577214 21779 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:47.596705 21930 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.701663 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.196:44175
I20260709 13:09:47.702040 22066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.196:44175 every 8 connection(s)
I20260709 13:09:47.707762 20199 auto_leader_rebalancer-test.cc:384] add a tserver: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:47.732594 22067 heartbeater.cc:344] Connected to a master server at 127.19.185.254:40067
I20260709 13:09:47.733134 22067 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:47.733973 22067 heartbeater.cc:507] Master 127.19.185.254:40067 requested a full tablet report, sending...
I20260709 13:09:47.735903 21217 ts_manager.cc:194] Registered new tserver with Master: bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:09:47.737298 21217 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38388
I20260709 13:09:47.855368 21391 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:47.863412 21464 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:47.865144 21317 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:47.866508 21840 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.867385 21924 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:47.886318 21359 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 624d76b3bc214b53b7565f644d236663. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.901069 21924 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:47.911821 21317 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:47.921391 21464 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:47.931759 21395 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:47.933085 21217 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:47.938797 21317 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:47.940263 21924 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:47.946143 21359 consensus_peers.cc:597] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb2ce5a5a1e3461d8e0031fdfef61569. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.949573 21469 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:47.951004 21840 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.003506 21840 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.011801 21317 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.027696 21469 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.036926 21317 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.041006 21216 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.049547 21469 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:48.052826 21930 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.053995 21391 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:48.058629 21954 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:48.086872 21284 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d5dc87735964c6b97851e73311aee5a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.096276 21954 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.098105 21466 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.102181 21391 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.114220 21217 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.146011 21466 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.153072 21391 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:48.155974 21862 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.159448 21317 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:48.161057 21862 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:48.183178 21433 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6629858a6e4c4461a471763a94f0effa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.187428 21606 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.191824 21391 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.195892 21319 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:48.206329 21219 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.341332 22094 ts_tablet_manager.cc:933] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:48.343504 22094 tablet_copy_client.cc:323] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:48.355609 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 624d76b3bc214b53b7565f644d236663 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:48.356349 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 624d76b3bc214b53b7565f644d236663 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-624d76b3bc214b53b7565f644d236663
I20260709 13:09:48.369673 21406 tablet_copy_source_session.cc:215] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:48.373587 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 624d76b3bc214b53b7565f644d236663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:48.392416 22094 tablet_copy_client.cc:806] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:48.393086 22094 tablet_copy_client.cc:670] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:48.399411 22094 tablet_copy_client.cc:538] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:48.406862 22094 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:48.425971 22097 ts_tablet_manager.cc:933] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:48.435866 22097 tablet_copy_client.cc:323] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:48.437608 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet bb2ce5a5a1e3461d8e0031fdfef61569 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:48.437932 22094 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.438172 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet bb2ce5a5a1e3461d8e0031fdfef61569 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-bb2ce5a5a1e3461d8e0031fdfef61569
I20260709 13:09:48.438880 22094 tablet_bootstrap.cc:492] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:48.439606 22094 ts_tablet_manager.cc:1403] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.016s
I20260709 13:09:48.447391 21406 tablet_copy_source_session.cc:215] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:48.450822 22097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2ce5a5a1e3461d8e0031fdfef61569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:48.451711 22094 raft_consensus.cc:359] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.452641 22094 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:48.453311 22094 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.455559 22067 heartbeater.cc:499] Master 127.19.185.254:40067 was elected leader, sending a full tablet report...
I20260709 13:09:48.456043 22094 ts_tablet_manager.cc:1434] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:09:48.458508 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-624d76b3bc214b53b7565f644d236663 received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:48.458951 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-624d76b3bc214b53b7565f644d236663 on tablet 624d76b3bc214b53b7565f644d236663 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:48.483314 22097 tablet_copy_client.cc:806] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:48.483955 22097 tablet_copy_client.cc:670] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:48.487424 22097 tablet_copy_client.cc:538] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:48.493984 22097 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:48.517189 22097 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.518934 22097 tablet_bootstrap.cc:492] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:48.519589 22097 ts_tablet_manager.cc:1403] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:09:48.522403 22097 raft_consensus.cc:359] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.523306 22097 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:48.532564 22097 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.535477 22097 ts_tablet_manager.cc:1434] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:48.537727 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-bb2ce5a5a1e3461d8e0031fdfef61569 received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:48.538196 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-bb2ce5a5a1e3461d8e0031fdfef61569 on tablet bb2ce5a5a1e3461d8e0031fdfef61569 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:48.634199 22097 ts_tablet_manager.cc:933] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:48.645797 22097 tablet_copy_client.cc:323] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:09:48.657214 22094 ts_tablet_manager.cc:933] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
I20260709 13:09:48.660007 22094 tablet_copy_client.cc:323] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.193:45701
I20260709 13:09:48.667626 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 6629858a6e4c4461a471763a94f0effa from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:09:48.668548 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 6629858a6e4c4461a471763a94f0effa from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-6629858a6e4c4461a471763a94f0effa
I20260709 13:09:48.679881 21480 tablet_copy_source_session.cc:215] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:48.687554 21331 tablet_copy_service.cc:140] P 058db415e9884ea0ba23f1e1ff59127a: Received BeginTabletCopySession request for tablet 6d5dc87735964c6b97851e73311aee5a from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:33484)
I20260709 13:09:48.688177 21331 tablet_copy_service.cc:161] P 058db415e9884ea0ba23f1e1ff59127a: Beginning new tablet copy session on tablet 6d5dc87735964c6b97851e73311aee5a from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:33484: session id = bfcd9560f8f44414b25f8069384c5a73-6d5dc87735964c6b97851e73311aee5a
I20260709 13:09:48.692126 22097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6629858a6e4c4461a471763a94f0effa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:48.699352 21331 tablet_copy_source_session.cc:215] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:48.703830 22094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5dc87735964c6b97851e73311aee5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:48.723217 22094 tablet_copy_client.cc:806] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:48.723865 22094 tablet_copy_client.cc:670] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:48.734967 22094 tablet_copy_client.cc:538] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:48.742779 22097 tablet_copy_client.cc:806] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:48.743737 22097 tablet_copy_client.cc:670] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:48.744477 22094 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:48.748059 22097 tablet_copy_client.cc:538] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:48.758581 22097 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:48.766340 22094 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.767223 22094 tablet_bootstrap.cc:492] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:48.767879 22094 ts_tablet_manager.cc:1403] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:09:48.770723 22094 raft_consensus.cc:359] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.771615 22094 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:48.772253 22094 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.774518 22094 ts_tablet_manager.cc:1434] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:48.778717 21331 tablet_copy_service.cc:342] P 058db415e9884ea0ba23f1e1ff59127a: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-6d5dc87735964c6b97851e73311aee5a received from {username='slave'} at 127.0.0.1:33484
I20260709 13:09:48.779181 21331 tablet_copy_service.cc:434] P 058db415e9884ea0ba23f1e1ff59127a: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-6d5dc87735964c6b97851e73311aee5a on tablet 6d5dc87735964c6b97851e73311aee5a with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:48.785708 22097 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.786677 22097 tablet_bootstrap.cc:492] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:48.787377 22097 ts_tablet_manager.cc:1403] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.013s
I20260709 13:09:48.790314 22097 raft_consensus.cc:359] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.791169 22097 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:48.791755 22097 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:48.793915 22097 ts_tablet_manager.cc:1434] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:09:48.796559 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-6629858a6e4c4461a471763a94f0effa received from {username='slave'} at 127.0.0.1:59692
I20260709 13:09:48.796998 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-6629858a6e4c4461a471763a94f0effa on tablet 6629858a6e4c4461a471763a94f0effa with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:48.872938 22042 raft_consensus.cc:1217] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:48.951756 22042 raft_consensus.cc:1217] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:49.073783 22042 raft_consensus.cc:1217] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:49.206225 22042 raft_consensus.cc:1217] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:49.438889 21871 raft_consensus.cc:1064] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:49.442159 21871 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:49.461717 21466 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.461961 21319 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.463287 21871 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.464816 21840 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.471153 22042 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.475937 21840 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.494711 22112 raft_consensus.cc:1064] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:49.497277 22112 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:49.513649 21954 raft_consensus.cc:1064] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:49.517812 21954 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:49.532301 21469 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.533893 21840 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.541457 21314 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.543960 21924 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.547824 22041 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.551764 22102 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:49.552619 21871 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.557579 21464 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.572844 22042 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.578497 21924 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:49.582688 21463 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.585316 21855 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.603348 21217 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.608354 21393 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.610131 21319 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.606583 22040 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.612593 21855 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.621495 21855 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.627780 22039 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.661773 21871 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.665282 22042 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.734524 21466 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:09:49.734524 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 65658.5us
I20260709 13:09:49.753198 21319 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.766134 21879 raft_consensus.cc:1064] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:49.767998 21879 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:49.774646 22039 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.776826 21879 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.779204 21395 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:49.787459 21464 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:49.790375 21466 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.792647 21314 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.794589 22121 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:49.801087 22042 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:49.804126 21393 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:49.798559 21879 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:09:49.787923 21216 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.826009 21871 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.835009 22112 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:49.835837 21606 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.838281 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb2ce5a5a1e3461d8e0031fdfef61569 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:49.836714 21464 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.851190 21395 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.863910 21606 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.872756 21390 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:49.859247 22042 raft_consensus.cc:2955] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.881950 21319 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.893925 22040 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:49.900101 21840 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:49.903169 21391 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.914086 21924 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.928293 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 624d76b3bc214b53b7565f644d236663 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:49.927803 22042 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:09:49.938299 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47325.9us
I20260709 13:09:49.941131 21319 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:49.945864 21215 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.951001 21924 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:49.951077 21218 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.955431 22039 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.956554 21314 raft_consensus.cc:2955] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.991576 21219 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.994024 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet bb2ce5a5a1e3461d8e0031fdfef61569 with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:09:49.993747 21219 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:49.995362 21319 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:50.032685 22039 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:50.034601 22102 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:50.037985 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet 624d76b3bc214b53b7565f644d236663 with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:09:50.043866 22127 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:50.046306 22039 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:50.049873 21469 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:50.052906 22102 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:50.056653 21206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6d5dc87735964c6b97851e73311aee5a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:50.058394 21466 raft_consensus.cc:2955] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:50.069489 22136 tablet_replica.cc:333] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:09:50.070457 22136 raft_consensus.cc:2243] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:50.071230 22136 raft_consensus.cc:2272] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:50.075871 22137 tablet_replica.cc:333] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:09:50.078866 22137 raft_consensus.cc:2243] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:50.079979 22137 raft_consensus.cc:2272] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:50.081455 21219 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:50.089673 21466 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:50.097034 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d5dc87735964c6b97851e73311aee5a with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:09:50.103937 22136 ts_tablet_manager.cc:1916] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:50.105103 21218 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 6d5dc87735964c6b97851e73311aee5a with cas_config_opid_index 3: aborting the task: latest config opid_index 4; task opid_index 3
I20260709 13:09:50.120358 22039 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:50.127110 22110 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:50.138608 22139 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:50.140166 22039 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:50.144639 21319 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:50.149864 22137 ts_tablet_manager.cc:1916] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:50.150899 22110 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:50.155778 22138 tablet_replica.cc:333] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:09:50.156893 22138 raft_consensus.cc:2243] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:50.156080 21314 raft_consensus.cc:2955] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:50.157630 22138 raft_consensus.cc:2272] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:50.160578 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6629858a6e4c4461a471763a94f0effa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:50.172454 22138 ts_tablet_manager.cc:1916] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:50.167169 21218 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.205668 22137 ts_tablet_manager.cc:1929] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:50.208618 22137 log.cc:1199] T 624d76b3bc214b53b7565f644d236663 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/624d76b3bc214b53b7565f644d236663
I20260709 13:09:50.208948 22136 ts_tablet_manager.cc:1929] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:50.209398 22136 log.cc:1199] T bb2ce5a5a1e3461d8e0031fdfef61569 P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/bb2ce5a5a1e3461d8e0031fdfef61569
I20260709 13:09:50.211220 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet bb2ce5a5a1e3461d8e0031fdfef61569 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:50.213466 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet 624d76b3bc214b53b7565f644d236663 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:50.214133 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 6629858a6e4c4461a471763a94f0effa with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:09:50.222872 22138 ts_tablet_manager.cc:1929] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:50.223376 22138 log.cc:1199] T 6d5dc87735964c6b97851e73311aee5a P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/6d5dc87735964c6b97851e73311aee5a
I20260709 13:09:50.225061 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 6d5dc87735964c6b97851e73311aee5a (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:50.225167 22138 tablet_replica.cc:333] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:09:50.226270 22138 raft_consensus.cc:2243] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:50.226951 22138 raft_consensus.cc:2272] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:50.229919 22138 ts_tablet_manager.cc:1916] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:50.240757 22138 ts_tablet_manager.cc:1929] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:50.241127 22138 log.cc:1199] T 6629858a6e4c4461a471763a94f0effa P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/6629858a6e4c4461a471763a94f0effa
I20260709 13:09:50.242357 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 6629858a6e4c4461a471763a94f0effa (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:51.279197 21391 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:09:51.286892 21359 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1e856d5af49457aa83cfe00a413716d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.288959 21466 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:51.288959 21319 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:51.290921 22121 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.291857 21924 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.299158 22143 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.301076 21469 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.301076 21319 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.312639 21393 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:51.317332 21218 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.332201 21314 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:51.333590 21469 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:51.334017 21359 consensus_peers.cc:597] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 849cad40897e412da9a737986240fc35. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.335558 21924 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.337198 22121 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.346594 21924 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.359503 21469 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.363761 21319 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.365979 21391 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:09:51.380849 21359 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7710ca7bd20a4aa6959c7bf3ebd05f87. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.381544 21469 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:51.382879 22121 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.396478 21215 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.401077 21319 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:51.405874 21466 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.407212 22121 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.412123 21924 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.422185 21319 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.437609 21215 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.440708 21466 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:51.448858 21391 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:51.449596 21433 consensus_peers.cc:597] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8909ec5d582450ba80932fa543ad4a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.450667 21319 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:51.451833 22156 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.453433 22139 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.462922 22141 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.471092 21395 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.481794 21314 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:51.494885 21215 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.690711 22163 ts_tablet_manager.cc:933] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:51.693287 22163 tablet_copy_client.cc:323] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:51.694973 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet d1e856d5af49457aa83cfe00a413716d from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:51.695501 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet d1e856d5af49457aa83cfe00a413716d from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-d1e856d5af49457aa83cfe00a413716d
I20260709 13:09:51.702946 21406 tablet_copy_source_session.cc:215] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:51.705811 22163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e856d5af49457aa83cfe00a413716d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.721856 22163 tablet_copy_client.cc:806] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:51.722491 22163 tablet_copy_client.cc:670] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:51.725956 22163 tablet_copy_client.cc:538] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:51.733230 22163 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:51.748327 22166 ts_tablet_manager.cc:933] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:51.751307 22166 tablet_copy_client.cc:323] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:51.753180 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 849cad40897e412da9a737986240fc35 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:51.753723 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 849cad40897e412da9a737986240fc35 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-849cad40897e412da9a737986240fc35
I20260709 13:09:51.755088 22163 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.755820 22163 tablet_bootstrap.cc:492] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:51.756762 22163 ts_tablet_manager.cc:1403] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:09:51.759606 22163 raft_consensus.cc:359] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:51.760496 22163 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:51.761154 22163 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:51.761623 21406 tablet_copy_source_session.cc:215] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:51.763914 22163 ts_tablet_manager.cc:1434] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:51.766726 21405 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-d1e856d5af49457aa83cfe00a413716d received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:51.767151 21405 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-d1e856d5af49457aa83cfe00a413716d on tablet d1e856d5af49457aa83cfe00a413716d with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:51.769310 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849cad40897e412da9a737986240fc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.790359 22166 tablet_copy_client.cc:806] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:51.791087 22166 tablet_copy_client.cc:670] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:51.795756 22166 tablet_copy_client.cc:538] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:51.802784 22166 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:51.821100 22166 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.822312 22166 tablet_bootstrap.cc:492] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:51.822980 22166 ts_tablet_manager.cc:1403] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:09:51.826263 22166 raft_consensus.cc:359] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:51.827099 22166 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:51.827719 22166 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:51.830144 22166 ts_tablet_manager.cc:1434] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:51.831733 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-849cad40897e412da9a737986240fc35 received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:51.832217 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-849cad40897e412da9a737986240fc35 on tablet 849cad40897e412da9a737986240fc35 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:51.842876 22166 ts_tablet_manager.cc:933] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:51.845536 22166 tablet_copy_client.cc:323] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:09:51.847154 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet f8909ec5d582450ba80932fa543ad4a1 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:09:51.847635 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet f8909ec5d582450ba80932fa543ad4a1 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-f8909ec5d582450ba80932fa543ad4a1
I20260709 13:09:51.853456 21480 tablet_copy_source_session.cc:215] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:51.856398 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8909ec5d582450ba80932fa543ad4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.868784 22166 tablet_copy_client.cc:806] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:51.869325 22166 tablet_copy_client.cc:670] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:51.872860 22166 tablet_copy_client.cc:538] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:51.882843 22166 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:51.901403 22166 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.902318 22166 tablet_bootstrap.cc:492] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:51.902894 22166 ts_tablet_manager.cc:1403] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:09:51.905766 22166 raft_consensus.cc:359] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:51.906445 22166 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:51.907059 22166 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:51.909175 22166 ts_tablet_manager.cc:1434] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:51.910805 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-f8909ec5d582450ba80932fa543ad4a1 received from {username='slave'} at 127.0.0.1:59692
I20260709 13:09:51.911201 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-f8909ec5d582450ba80932fa543ad4a1 on tablet f8909ec5d582450ba80932fa543ad4a1 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:51.998023 22166 ts_tablet_manager.cc:933] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:51.999665 22166 tablet_copy_client.cc:323] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:52.001134 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:52.001722 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-7710ca7bd20a4aa6959c7bf3ebd05f87
I20260709 13:09:52.008886 21406 tablet_copy_source_session.cc:215] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:52.011931 22166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.027853 22166 tablet_copy_client.cc:806] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:52.028458 22166 tablet_copy_client.cc:670] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:52.040262 22166 tablet_copy_client.cc:538] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:52.056676 22166 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:52.079962 22166 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.080829 22166 tablet_bootstrap.cc:492] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:52.081435 22166 ts_tablet_manager.cc:1403] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:09:52.084587 22166 raft_consensus.cc:359] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:52.085155 22166 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:52.085701 22166 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:52.087564 22166 ts_tablet_manager.cc:1434] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:52.089218 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-7710ca7bd20a4aa6959c7bf3ebd05f87 received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:52.089643 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-7710ca7bd20a4aa6959c7bf3ebd05f87 on tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:52.166436 22042 raft_consensus.cc:1217] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:52.177790 22042 raft_consensus.cc:1217] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:52.354454 22042 raft_consensus.cc:1217] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:52.444764 22042 raft_consensus.cc:1217] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:52.707693 22146 raft_consensus.cc:1064] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:52.710311 22146 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:52.716725 22042 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.718708 21319 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.718962 21469 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.718971 22143 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:52.720489 21924 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.723268 22143 raft_consensus.cc:1064] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:52.726161 22143 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:52.727111 22146 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.750723 21924 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.755952 22039 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.756857 21469 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.758706 22181 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.760383 22175 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.759982 21466 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.778602 22042 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.780939 21215 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.790537 21314 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.798972 21314 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.808725 22175 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:52.814873 22175 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.818646 21469 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.848740 22042 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.903609 21393 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:52.909847 21219 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.925228 22162 raft_consensus.cc:1064] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:52.930552 21464 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:52.932613 22175 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:52.932054 21314 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.927711 22162 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:52.934532 22042 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:52.946247 21391 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:52.951592 21924 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:52.953502 21924 raft_consensus.cc:1064] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:52.955678 21924 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:52.959517 22039 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:52.962482 22143 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.967774 22182 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:52.977201 21466 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.979573 22146 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.987346 21319 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:52.972640 21464 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:52.989370 22146 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:52.976682 22042 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.995445 21314 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.996933 22173 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.999454 22173 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.999145 22175 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.004669 21314 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.012751 22040 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:53.018155 21391 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:53.021014 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1e856d5af49457aa83cfe00a413716d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:53.023330 22039 raft_consensus.cc:2955] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.033993 21216 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.047051 21924 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.048310 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet d1e856d5af49457aa83cfe00a413716d with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:09:53.048756 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 849cad40897e412da9a737986240fc35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:53.053040 22197 tablet_replica.cc:333] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:09:53.053133 21319 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:53.054147 22197 raft_consensus.cc:2243] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.055348 22173 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.070140 22173 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.056078 22181 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.062978 22197 raft_consensus.cc:2272] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.063452 21219 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.079867 21317 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.081156 22197 ts_tablet_manager.cc:1916] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:53.115221 22042 raft_consensus.cc:2955] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.124061 22040 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.131497 22197 ts_tablet_manager.cc:1929] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:53.132934 22197 log.cc:1199] T d1e856d5af49457aa83cfe00a413716d P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/d1e856d5af49457aa83cfe00a413716d
I20260709 13:09:53.134472 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet d1e856d5af49457aa83cfe00a413716d (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:53.139052 21218 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.160542 21391 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.172751 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet 849cad40897e412da9a737986240fc35 with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:09:53.200510 22175 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.202510 22039 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.206869 21464 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:53.213016 21466 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.220012 21219 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.222584 22042 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:53.221705 21391 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:53.225190 22200 tablet_replica.cc:333] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:09:53.226222 21319 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.226263 22200 raft_consensus.cc:2243] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.230353 22200 raft_consensus.cc:2272] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.235910 22200 ts_tablet_manager.cc:1916] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:53.237815 22190 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:53.245971 22162 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.248278 21391 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.256729 21393 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:53.261758 22193 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:53.267796 22042 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:53.269477 22143 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:53.271788 22039 raft_consensus.cc:2955] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.278779 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8909ec5d582450ba80932fa543ad4a1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:53.287189 22181 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.288655 22040 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.295729 21218 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.305153 21317 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:53.308948 22175 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:53.312264 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet f8909ec5d582450ba80932fa543ad4a1 with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:09:53.316381 21319 raft_consensus.cc:2955] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:09:53.325977 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57640.4us
I20260709 13:09:53.329097 21218 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:53.336632 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:53.345155 22200 ts_tablet_manager.cc:1929] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:53.346552 22200 log.cc:1199] T 849cad40897e412da9a737986240fc35 P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/849cad40897e412da9a737986240fc35
I20260709 13:09:53.348862 22200 tablet_replica.cc:333] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:09:53.349201 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet 849cad40897e412da9a737986240fc35 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:53.349982 22200 raft_consensus.cc:2243] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.350334 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:09:53.350739 22200 raft_consensus.cc:2272] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.352219 22197 tablet_replica.cc:333] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:09:53.353111 22197 raft_consensus.cc:2243] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.353751 22197 raft_consensus.cc:2272] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.354633 22200 ts_tablet_manager.cc:1916] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:53.356804 22197 ts_tablet_manager.cc:1916] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:53.391968 22200 ts_tablet_manager.cc:1929] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:53.392529 22200 log.cc:1199] T f8909ec5d582450ba80932fa543ad4a1 P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/f8909ec5d582450ba80932fa543ad4a1
I20260709 13:09:53.394083 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet f8909ec5d582450ba80932fa543ad4a1 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:53.396409 22197 ts_tablet_manager.cc:1929] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:53.396739 22197 log.cc:1199] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/7710ca7bd20a4aa6959c7bf3ebd05f87
I20260709 13:09:53.398747 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet 7710ca7bd20a4aa6959c7bf3ebd05f87 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:54.432370 21464 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:54.439468 21319 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:54.439944 21433 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b2812c891d248ecafa8f302d2b72c45. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.440141 21395 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:54.440989 22202 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:54.442092 22206 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:54.449612 22162 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.451553 21391 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.451778 21319 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.467770 21219 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.469920 21319 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:54.477986 21464 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:54.478945 21284 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3549d7d86f4c404f95fae0e1f6b84210. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.478607 21391 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:54.479809 22205 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:54.481033 22204 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:54.506249 22205 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.511512 21395 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.526434 21464 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.528019 21395 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:54.547297 21466 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:54.549170 22175 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:54.553696 21359 consensus_peers.cc:597] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7b73223e6ab497f810757f895658e8b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.553740 21218 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.575735 21319 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:54.580353 22146 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:54.582538 22146 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.583730 21466 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.595074 21319 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.604399 21466 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:54.604919 21216 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.615496 21395 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:54.616232 21433 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e997d08de0c4a8b9b07e0741628b23f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.617545 22206 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:54.632171 21314 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:54.633854 22206 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:54.636212 22202 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.638062 21395 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.655211 21216 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.665045 21319 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:54.978525 22227 ts_tablet_manager.cc:933] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:54.980780 22227 tablet_copy_client.cc:323] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:09:54.983140 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 3b2812c891d248ecafa8f302d2b72c45 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:09:54.983912 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 3b2812c891d248ecafa8f302d2b72c45 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-3b2812c891d248ecafa8f302d2b72c45
I20260709 13:09:55.001963 21480 tablet_copy_source_session.cc:215] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:55.005789 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2812c891d248ecafa8f302d2b72c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.006630 22229 ts_tablet_manager.cc:933] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:55.008674 22229 tablet_copy_client.cc:323] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:55.010483 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet e7b73223e6ab497f810757f895658e8b from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:55.010939 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet e7b73223e6ab497f810757f895658e8b from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-e7b73223e6ab497f810757f895658e8b
I20260709 13:09:55.018405 21406 tablet_copy_source_session.cc:215] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:55.028254 22229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b73223e6ab497f810757f895658e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.044792 22229 tablet_copy_client.cc:806] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:55.045440 22229 tablet_copy_client.cc:670] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:55.049214 22229 tablet_copy_client.cc:538] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:55.058142 22227 tablet_copy_client.cc:806] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:55.058820 22227 tablet_copy_client.cc:670] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:55.063436 22231 ts_tablet_manager.cc:933] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
I20260709 13:09:55.063962 22227 tablet_copy_client.cc:538] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:55.066107 22229 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:55.084803 22227 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:55.102383 22231 tablet_copy_client.cc:323] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.193:45701
I20260709 13:09:55.104743 21331 tablet_copy_service.cc:140] P 058db415e9884ea0ba23f1e1ff59127a: Received BeginTabletCopySession request for tablet 3549d7d86f4c404f95fae0e1f6b84210 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:33484)
I20260709 13:09:55.105309 21331 tablet_copy_service.cc:161] P 058db415e9884ea0ba23f1e1ff59127a: Beginning new tablet copy session on tablet 3549d7d86f4c404f95fae0e1f6b84210 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:33484: session id = bfcd9560f8f44414b25f8069384c5a73-3549d7d86f4c404f95fae0e1f6b84210
I20260709 13:09:55.113372 21331 tablet_copy_source_session.cc:215] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:55.116060 22227 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:55.116742 22229 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:55.117218 22231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3549d7d86f4c404f95fae0e1f6b84210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.117234 22227 tablet_bootstrap.cc:492] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:55.117733 22229 tablet_bootstrap.cc:492] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:55.118374 22229 ts_tablet_manager.cc:1403] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.012s
I20260709 13:09:55.118374 22227 ts_tablet_manager.cc:1403] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.004s
I20260709 13:09:55.121862 22229 raft_consensus.cc:359] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:55.124244 22229 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:55.123328 22227 raft_consensus.cc:359] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:55.125757 22227 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:55.126448 22227 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:55.129177 22229 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:55.142122 22229 ts_tablet_manager.cc:1434] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:09:55.142136 22231 tablet_copy_client.cc:806] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:55.143023 22231 tablet_copy_client.cc:670] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:55.145555 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-e7b73223e6ab497f810757f895658e8b received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:55.146235 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-e7b73223e6ab497f810757f895658e8b on tablet e7b73223e6ab497f810757f895658e8b with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:55.152877 22231 tablet_copy_client.cc:538] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:55.171592 22231 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:55.179934 22227 ts_tablet_manager.cc:1434] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.061s	user 0.011s	sys 0.009s
I20260709 13:09:55.183120 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-3b2812c891d248ecafa8f302d2b72c45 received from {username='slave'} at 127.0.0.1:59692
I20260709 13:09:55.183580 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-3b2812c891d248ecafa8f302d2b72c45 on tablet 3b2812c891d248ecafa8f302d2b72c45 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:55.203040 22231 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:55.203971 22231 tablet_bootstrap.cc:492] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:55.204730 22231 ts_tablet_manager.cc:1403] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.004s
I20260709 13:09:55.208418 22231 raft_consensus.cc:359] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:55.209802 22231 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:55.210482 22231 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:55.219182 22231 ts_tablet_manager.cc:1434] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:55.220213 22227 ts_tablet_manager.cc:933] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:55.222172 21331 tablet_copy_service.cc:342] P 058db415e9884ea0ba23f1e1ff59127a: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-3549d7d86f4c404f95fae0e1f6b84210 received from {username='slave'} at 127.0.0.1:33484
I20260709 13:09:55.222788 21331 tablet_copy_service.cc:434] P 058db415e9884ea0ba23f1e1ff59127a: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-3549d7d86f4c404f95fae0e1f6b84210 on tablet 3549d7d86f4c404f95fae0e1f6b84210 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:55.235006 22227 tablet_copy_client.cc:323] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:09:55.238154 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 1e997d08de0c4a8b9b07e0741628b23f from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:09:55.238708 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 1e997d08de0c4a8b9b07e0741628b23f from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-1e997d08de0c4a8b9b07e0741628b23f
I20260709 13:09:55.244640 21480 tablet_copy_source_session.cc:215] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:55.247772 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e997d08de0c4a8b9b07e0741628b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:55.263759 22227 tablet_copy_client.cc:806] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:55.264374 22227 tablet_copy_client.cc:670] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:55.271870 22227 tablet_copy_client.cc:538] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:55.279922 22227 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:55.304633 22227 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:55.305559 22227 tablet_bootstrap.cc:492] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:55.306226 22227 ts_tablet_manager.cc:1403] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:09:55.309351 22227 raft_consensus.cc:359] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:55.310186 22227 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:55.310788 22227 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:55.313257 22227 ts_tablet_manager.cc:1434] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:55.315171 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-1e997d08de0c4a8b9b07e0741628b23f received from {username='slave'} at 127.0.0.1:59692
I20260709 13:09:55.315625 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-1e997d08de0c4a8b9b07e0741628b23f on tablet 1e997d08de0c4a8b9b07e0741628b23f with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:55.479775 22040 raft_consensus.cc:1217] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:55.512674 22040 raft_consensus.cc:1217] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:55.595503 22040 raft_consensus.cc:1217] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:55.725880 22040 raft_consensus.cc:1217] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:55.924228 22146 raft_consensus.cc:1064] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:55.925997 22146 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:55.932121 21464 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:55.932272 22039 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:55.932420 21317 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:55.933933 22146 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:55.935788 22220 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:55.936770 22175 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:55.956658 22220 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:55.964417 22039 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:55.972244 21464 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:55.979297 21317 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:55.977874 21216 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.021978 22218 raft_consensus.cc:1064] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:56.030488 22218 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:56.045670 22039 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.046861 21464 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.047284 22218 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.053478 21395 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:56.054399 21393 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.066972 21464 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:56.068400 22247 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.070235 22247 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.073390 22040 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:56.075197 22220 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.081319 22175 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.086002 22206 raft_consensus.cc:1064] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:56.092111 22240 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.093024 22206 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:56.094722 22040 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.106874 22248 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.112759 21469 raft_consensus.cc:2955] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.117082 21464 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.145478 22039 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.156705 21395 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.160913 21218 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.165526 21219 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.176745 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet e7b73223e6ab497f810757f895658e8b with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:09:56.209112 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7b73223e6ab497f810757f895658e8b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:56.213320 22258 tablet_replica.cc:333] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:09:56.214567 22258 raft_consensus.cc:2243] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.215317 22258 raft_consensus.cc:2272] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.218823 22258 ts_tablet_manager.cc:1916] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:56.220896 22040 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.222470 22255 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:56.223372 21319 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:56.238710 22258 ts_tablet_manager.cc:1929] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:56.239228 22258 log.cc:1199] T e7b73223e6ab497f810757f895658e8b P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/e7b73223e6ab497f810757f895658e8b
I20260709 13:09:56.242290 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet e7b73223e6ab497f810757f895658e8b (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:56.242794 21395 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.243183 21314 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.244606 22042 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:56.245368 22202 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.246953 22226 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:56.247625 22204 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:09:56.259043 21395 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:56.259394 22248 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.260985 22039 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.271549 22218 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.278692 21215 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.278620 22226 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.288968 21206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3549d7d86f4c404f95fae0e1f6b84210 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:56.285524 21392 raft_consensus.cc:2955] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.293120 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet 3549d7d86f4c404f95fae0e1f6b84210 with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:09:56.297557 22206 raft_consensus.cc:1064] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:56.301337 21393 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.304313 22262 tablet_replica.cc:333] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:09:56.302006 22206 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:56.319304 21319 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.320868 22206 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.321374 21319 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.323796 22042 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.327517 21215 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.328754 21393 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:56.325923 22255 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:09:56.333182 22202 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.355695 22262 raft_consensus.cc:2243] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.356467 22262 raft_consensus.cc:2272] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.361609 22262 ts_tablet_manager.cc:1916] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:56.378113 22265 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.380134 21314 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.388691 22039 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.402912 21469 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:56.403466 22262 ts_tablet_manager.cc:1929] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:56.399557 21215 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.414875 21393 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.416087 21314 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:56.417641 22264 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:56.418097 22262 log.cc:1199] T 3549d7d86f4c404f95fae0e1f6b84210 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/3549d7d86f4c404f95fae0e1f6b84210
I20260709 13:09:56.419675 22042 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:56.424127 22206 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.424765 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet 3549d7d86f4c404f95fae0e1f6b84210 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:56.428237 22039 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.442468 22202 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.443748 21314 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.444693 22039 raft_consensus.cc:2955] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.448119 21469 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:56.456399 21319 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:56.457134 22039 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:56.458617 22266 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:56.459502 22265 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.465133 21219 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.466821 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b2812c891d248ecafa8f302d2b72c45 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:56.470007 21319 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.468565 22266 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.476778 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b2812c891d248ecafa8f302d2b72c45 with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:09:56.485862 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e997d08de0c4a8b9b07e0741628b23f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:56.499047 22270 tablet_replica.cc:333] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:09:56.500332 22039 raft_consensus.cc:2955] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.501288 22270 raft_consensus.cc:2243] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.511744 22270 raft_consensus.cc:2272] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.501067 21215 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:56.515228 22270 ts_tablet_manager.cc:1916] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:56.530092 22270 ts_tablet_manager.cc:1929] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:56.530581 22270 log.cc:1199] T 3b2812c891d248ecafa8f302d2b72c45 P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/3b2812c891d248ecafa8f302d2b72c45
I20260709 13:09:56.532244 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 3b2812c891d248ecafa8f302d2b72c45 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:56.537981 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e997d08de0c4a8b9b07e0741628b23f with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:09:56.538898 22270 tablet_replica.cc:333] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:09:56.540280 22270 raft_consensus.cc:2243] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.540807 22270 raft_consensus.cc:2272] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.543570 22270 ts_tablet_manager.cc:1916] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:56.555518 22270 ts_tablet_manager.cc:1929] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:56.555855 22270 log.cc:1199] T 1e997d08de0c4a8b9b07e0741628b23f P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/1e997d08de0c4a8b9b07e0741628b23f
I20260709 13:09:56.557271 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 1e997d08de0c4a8b9b07e0741628b23f (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:57.616297 21464 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:57.622792 21319 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:57.622809 21395 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:57.623767 21433 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 424be00d78cc41f1a80d41735ad881ae. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.624223 22271 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:57.625022 22264 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:57.632768 22264 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.634989 21319 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.638039 21395 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.646184 21393 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:57.652362 21215 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:57.676689 21359 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d344e412d584b97b86c32794fb7fb2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.687034 21469 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:57.688642 21319 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:57.688750 22279 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:57.690321 22220 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:57.713418 22279 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.717080 21319 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.730579 21469 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.744086 21393 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:57.739244 21218 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.754753 21469 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:57.756848 22240 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:57.760792 21359 consensus_peers.cc:597] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c2d5354d62e4be08f444a5f6556b8dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.764978 21314 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:57.766372 22175 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:57.768282 22279 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.772621 21469 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.778080 21319 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.788367 21395 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:57.791960 21218 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:57.803726 21359 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c90920283ad9436b891dae0b916f29d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.805207 21319 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:57.807329 22240 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:57.813360 21469 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:57.814942 22240 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:57.823781 21319 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.825681 21469 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.826007 22284 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:57.844378 21219 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:09:58.021135 22291 ts_tablet_manager.cc:933] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:09:58.023118 22291 tablet_copy_client.cc:323] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:09:58.024730 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 424be00d78cc41f1a80d41735ad881ae from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:09:58.025199 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 424be00d78cc41f1a80d41735ad881ae from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-424be00d78cc41f1a80d41735ad881ae
I20260709 13:09:58.031436 21480 tablet_copy_source_session.cc:215] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:58.036270 22291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424be00d78cc41f1a80d41735ad881ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.049150 22291 tablet_copy_client.cc:806] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:58.049716 22291 tablet_copy_client.cc:670] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:58.053452 22291 tablet_copy_client.cc:538] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:58.062716 22291 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:58.079785 22291 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:58.080758 22291 tablet_bootstrap.cc:492] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:58.081434 22291 ts_tablet_manager.cc:1403] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.004s
I20260709 13:09:58.084748 22291 raft_consensus.cc:359] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:58.085577 22291 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:58.086200 22291 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:58.102468 22291 ts_tablet_manager.cc:1434] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.016s
I20260709 13:09:58.106418 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-424be00d78cc41f1a80d41735ad881ae received from {username='slave'} at 127.0.0.1:59692
I20260709 13:09:58.106966 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-424be00d78cc41f1a80d41735ad881ae on tablet 424be00d78cc41f1a80d41735ad881ae with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:58.180506 22291 ts_tablet_manager.cc:933] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:58.182502 22291 tablet_copy_client.cc:323] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:58.184186 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 9d344e412d584b97b86c32794fb7fb2b from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:58.184692 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 9d344e412d584b97b86c32794fb7fb2b from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-9d344e412d584b97b86c32794fb7fb2b
I20260709 13:09:58.192520 21406 tablet_copy_source_session.cc:215] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:58.196969 22291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d344e412d584b97b86c32794fb7fb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.215000 22291 tablet_copy_client.cc:806] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:58.215597 22291 tablet_copy_client.cc:670] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:58.219465 22291 tablet_copy_client.cc:538] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:58.230180 22291 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:58.247824 22291 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:58.248788 22291 tablet_bootstrap.cc:492] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:58.249504 22291 ts_tablet_manager.cc:1403] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.008s
I20260709 13:09:58.250797 22297 ts_tablet_manager.cc:933] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:58.252666 22291 raft_consensus.cc:359] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:58.253537 22291 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:58.253628 22297 tablet_copy_client.cc:323] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:58.254202 22291 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:58.255633 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 5c2d5354d62e4be08f444a5f6556b8dc from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:58.256247 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 5c2d5354d62e4be08f444a5f6556b8dc from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-5c2d5354d62e4be08f444a5f6556b8dc
I20260709 13:09:58.256825 22291 ts_tablet_manager.cc:1434] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:58.260805 21405 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-9d344e412d584b97b86c32794fb7fb2b received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:58.261241 21405 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-9d344e412d584b97b86c32794fb7fb2b on tablet 9d344e412d584b97b86c32794fb7fb2b with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:58.264394 21406 tablet_copy_source_session.cc:215] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:58.267159 22297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2d5354d62e4be08f444a5f6556b8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.280710 22297 tablet_copy_client.cc:806] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:58.281350 22297 tablet_copy_client.cc:670] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:58.285029 22297 tablet_copy_client.cc:538] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:58.292534 22297 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:58.309280 22297 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:58.310274 22297 tablet_bootstrap.cc:492] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:58.310938 22297 ts_tablet_manager.cc:1403] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:09:58.313916 22297 raft_consensus.cc:359] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:58.314750 22297 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:58.315377 22297 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:58.317926 22297 ts_tablet_manager.cc:1434] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:58.319643 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-5c2d5354d62e4be08f444a5f6556b8dc received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:58.320077 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-5c2d5354d62e4be08f444a5f6556b8dc on tablet 5c2d5354d62e4be08f444a5f6556b8dc with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:58.417761 22297 ts_tablet_manager.cc:933] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:09:58.419459 22297 tablet_copy_client.cc:323] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:09:58.421012 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet c90920283ad9436b891dae0b916f29d7 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:09:58.421527 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet c90920283ad9436b891dae0b916f29d7 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-c90920283ad9436b891dae0b916f29d7
I20260709 13:09:58.429215 21406 tablet_copy_source_session.cc:215] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:58.432333 22297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90920283ad9436b891dae0b916f29d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.448346 22297 tablet_copy_client.cc:806] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:58.448922 22297 tablet_copy_client.cc:670] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:58.452623 22297 tablet_copy_client.cc:538] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:58.460240 22297 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:09:58.493330 22297 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:58.494045 22297 tablet_bootstrap.cc:492] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:09:58.494585 22297 ts_tablet_manager.cc:1403] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.016s
I20260709 13:09:58.496747 22297 raft_consensus.cc:359] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:58.497377 22297 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:09:58.497979 22297 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:09:58.500268 22297 ts_tablet_manager.cc:1434] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:09:58.503626 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-c90920283ad9436b891dae0b916f29d7 received from {username='slave'} at 127.0.0.1:36486
I20260709 13:09:58.504061 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-c90920283ad9436b891dae0b916f29d7 on tablet c90920283ad9436b891dae0b916f29d7 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:09:58.627069 22042 raft_consensus.cc:1217] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:58.734160 22042 raft_consensus.cc:1217] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:58.817063 22042 raft_consensus.cc:1217] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:58.824923 22042 raft_consensus.cc:1217] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:59.230583 22300 raft_consensus.cc:1064] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:59.230867 22266 raft_consensus.cc:1064] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:59.233145 22266 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:59.233145 22300 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:59.241474 21464 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.241684 21314 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.244204 22042 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.244830 22039 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.246025 22240 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:59.248193 21319 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.248600 22240 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:59.261035 22271 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.265203 22306 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:59.262980 22284 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.303912 21393 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.307610 22306 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.316850 22271 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:59.323849 22042 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.329022 22284 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.352679 21469 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.362782 21317 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.370208 21314 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.376888 22240 raft_consensus.cc:1064] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:59.382328 21219 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.379446 22240 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:59.396275 21393 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.399758 22040 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.409801 21216 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.421103 22279 raft_consensus.cc:1064] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:09:59.423579 22279 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:59.433985 21314 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.440775 22284 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.445081 21469 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.449574 22284 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:59.469208 22040 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.480149 22284 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.483399 21464 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.484977 22040 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.485172 21314 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:59.486825 22320 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.489473 22300 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.490278 22284 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.495357 21469 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:59.509963 21393 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:59.518007 21319 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:59.521263 21319 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:59.520920 22300 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.522819 22306 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:59.527163 22042 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:59.528144 22279 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:59.528272 21469 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.532146 22240 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:09:59.542387 22039 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:59.546527 22309 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:59.553035 22240 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.554493 21216 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.566071 22309 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.574566 21464 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.576249 22279 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.564811 21316 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.595211 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c90920283ad9436b891dae0b916f29d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:59.574643 22041 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.600209 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 424be00d78cc41f1a80d41735ad881ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:59.561697 21317 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.623677 21319 raft_consensus.cc:2955] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.641120 22042 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.655299 22039 raft_consensus.cc:2955] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:09:59.666277 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 87046.4us
I20260709 13:09:59.674960 21215 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.681579 21317 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.693251 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet c90920283ad9436b891dae0b916f29d7 with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:09:59.691745 22040 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.745419 22334 tablet_replica.cc:333] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:09:59.756515 22334 raft_consensus.cc:2243] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.756372 21219 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.757400 22334 raft_consensus.cc:2272] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:59.794946 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44578.8us
I20260709 13:09:59.806659 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 424be00d78cc41f1a80d41735ad881ae with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:09:59.806936 22334 ts_tablet_manager.cc:1916] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:59.808046 21215 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.826669 22339 tablet_replica.cc:333] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:09:59.829828 22339 raft_consensus.cc:2243] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.830576 22339 raft_consensus.cc:2272] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.837103 22339 ts_tablet_manager.cc:1916] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:59.841037 21392 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:59.849149 21319 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:59.849532 22041 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:59.850649 22240 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:59.851802 22300 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:59.858271 22320 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.860733 21319 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.865990 22334 ts_tablet_manager.cc:1929] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:59.866581 22334 log.cc:1199] T c90920283ad9436b891dae0b916f29d7 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/c90920283ad9436b891dae0b916f29d7
I20260709 13:09:59.868458 22040 raft_consensus.cc:2955] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.874742 21392 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:09:59.878031 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet c90920283ad9436b891dae0b916f29d7 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:59.888224 21215 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.900683 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9d344e412d584b97b86c32794fb7fb2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:59.901949 22339 ts_tablet_manager.cc:1929] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:59.902381 22339 log.cc:1199] T 424be00d78cc41f1a80d41735ad881ae P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/424be00d78cc41f1a80d41735ad881ae
I20260709 13:09:59.906036 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d344e412d584b97b86c32794fb7fb2b with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:09:59.906952 22334 tablet_replica.cc:333] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:09:59.907967 22334 raft_consensus.cc:2243] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.908188 22040 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:59.908727 22334 raft_consensus.cc:2272] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.912117 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 424be00d78cc41f1a80d41735ad881ae (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:59.913611 22334 ts_tablet_manager.cc:1916] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:59.912138 21464 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:59.914844 22331 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:59.918996 22240 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:59.926082 22240 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.931905 22334 ts_tablet_manager.cc:1929] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:59.931298 22041 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.932458 22334 log.cc:1199] T 9d344e412d584b97b86c32794fb7fb2b P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/9d344e412d584b97b86c32794fb7fb2b
I20260709 13:09:59.934119 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet 9d344e412d584b97b86c32794fb7fb2b (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:09:59.935731 21464 raft_consensus.cc:2955] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.938202 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c2d5354d62e4be08f444a5f6556b8dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:59.946628 21215 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:09:59.958020 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c2d5354d62e4be08f444a5f6556b8dc with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:09:59.960783 22340 tablet_replica.cc:333] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:09:59.961804 22340 raft_consensus.cc:2243] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.962486 22340 raft_consensus.cc:2272] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.965776 22340 ts_tablet_manager.cc:1916] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:59.976431 22340 ts_tablet_manager.cc:1929] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:59.976838 22340 log.cc:1199] T 5c2d5354d62e4be08f444a5f6556b8dc P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/5c2d5354d62e4be08f444a5f6556b8dc
I20260709 13:09:59.978440 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet 5c2d5354d62e4be08f444a5f6556b8dc (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:01.031370 21464 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.037252 21392 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:01.037305 21316 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:01.038260 21433 consensus_peers.cc:597] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30bf17cca2e64e76b923a076142551ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.038590 22306 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.039422 22343 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.047047 22266 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.049676 21316 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.054229 21392 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.058526 21464 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.062012 21219 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:01.093353 21433 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 904858d649144d589875f088692f104f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.097537 21390 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:01.098906 22343 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.101361 21316 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:01.102897 22343 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.121065 22266 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.129887 21316 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.133050 21390 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.137853 21464 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:10:01.146166 21433 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 099cc7d3a89e468b91e21306fa23a0be. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.149258 21216 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.152729 21319 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:01.154083 22343 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.164819 21390 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:01.169199 22343 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.191936 22266 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.194587 21319 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.196508 21390 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.208640 21395 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.215286 21216 catalog_manager.cc:5697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.225133 21464 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:01.225432 21359 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 603c27f4d3de4b40878c1d29bcc0708a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.227072 21319 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:01.228658 22341 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.231571 22240 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.239460 22240 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.242089 21464 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.254845 21219 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.261360 21319 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:01.461624 22361 ts_tablet_manager.cc:933] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:01.464718 22361 tablet_copy_client.cc:323] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:10:01.466482 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 30bf17cca2e64e76b923a076142551ff from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:10:01.467005 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 30bf17cca2e64e76b923a076142551ff from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-30bf17cca2e64e76b923a076142551ff
I20260709 13:10:01.474355 21480 tablet_copy_source_session.cc:215] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:01.477228 22361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bf17cca2e64e76b923a076142551ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.489691 22361 tablet_copy_client.cc:806] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:01.490363 22361 tablet_copy_client.cc:670] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:01.496403 22361 tablet_copy_client.cc:538] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:01.505537 22361 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:01.522671 22361 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.523689 22361 tablet_bootstrap.cc:492] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:01.524482 22361 ts_tablet_manager.cc:1403] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.010s
I20260709 13:10:01.526947 22361 raft_consensus.cc:359] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.527745 22361 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:01.528451 22361 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.531353 22361 ts_tablet_manager.cc:1434] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:10:01.534220 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-30bf17cca2e64e76b923a076142551ff received from {username='slave'} at 127.0.0.1:59692
I20260709 13:10:01.541435 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-30bf17cca2e64e76b923a076142551ff on tablet 30bf17cca2e64e76b923a076142551ff with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:01.548636 22361 ts_tablet_manager.cc:933] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:01.552106 22361 tablet_copy_client.cc:323] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:10:01.553633 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 099cc7d3a89e468b91e21306fa23a0be from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:10:01.554087 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 099cc7d3a89e468b91e21306fa23a0be from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-099cc7d3a89e468b91e21306fa23a0be
I20260709 13:10:01.561975 21480 tablet_copy_source_session.cc:215] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:01.565084 22361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099cc7d3a89e468b91e21306fa23a0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.581561 22361 tablet_copy_client.cc:806] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:01.582211 22361 tablet_copy_client.cc:670] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:01.585773 22361 tablet_copy_client.cc:538] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:01.593863 22361 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:01.614598 22361 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.616460 22361 tablet_bootstrap.cc:492] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:01.617204 22361 ts_tablet_manager.cc:1403] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:10:01.620007 22361 raft_consensus.cc:359] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.620939 22361 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:01.623098 22361 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.627660 22361 ts_tablet_manager.cc:1434] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 13:10:01.632606 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-099cc7d3a89e468b91e21306fa23a0be received from {username='slave'} at 127.0.0.1:59692
I20260709 13:10:01.633034 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-099cc7d3a89e468b91e21306fa23a0be on tablet 099cc7d3a89e468b91e21306fa23a0be with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:01.641644 22361 ts_tablet_manager.cc:933] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:01.661583 22361 tablet_copy_client.cc:323] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:10:01.663761 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 904858d649144d589875f088692f104f from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:10:01.664310 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 904858d649144d589875f088692f104f from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-904858d649144d589875f088692f104f
I20260709 13:10:01.671233 21480 tablet_copy_source_session.cc:215] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:01.674391 22361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904858d649144d589875f088692f104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.692793 22361 tablet_copy_client.cc:806] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:01.694116 22361 tablet_copy_client.cc:670] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:01.698072 22361 tablet_copy_client.cc:538] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:01.706682 22361 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:01.729867 22361 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.730964 22361 tablet_bootstrap.cc:492] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:01.731647 22361 ts_tablet_manager.cc:1403] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.005s
I20260709 13:10:01.734279 22361 raft_consensus.cc:359] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.735095 22361 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:01.735697 22361 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.740290 22361 ts_tablet_manager.cc:1434] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:10:01.741851 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-904858d649144d589875f088692f104f received from {username='slave'} at 127.0.0.1:59692
I20260709 13:10:01.742257 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-904858d649144d589875f088692f104f on tablet 904858d649144d589875f088692f104f with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:01.774299 22361 ts_tablet_manager.cc:933] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:01.775920 22361 tablet_copy_client.cc:323] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:10:01.777351 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 603c27f4d3de4b40878c1d29bcc0708a from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:10:01.777915 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 603c27f4d3de4b40878c1d29bcc0708a from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-603c27f4d3de4b40878c1d29bcc0708a
I20260709 13:10:01.785662 21406 tablet_copy_source_session.cc:215] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:01.788390 22361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603c27f4d3de4b40878c1d29bcc0708a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.801733 22361 tablet_copy_client.cc:806] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:01.802392 22361 tablet_copy_client.cc:670] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:01.805897 22361 tablet_copy_client.cc:538] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:01.811595 22361 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:01.826473 22361 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.827184 22361 tablet_bootstrap.cc:492] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:01.827775 22361 ts_tablet_manager.cc:1403] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.016s	user 0.019s	sys 0.000s
I20260709 13:10:01.829895 22361 raft_consensus.cc:359] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.830427 22361 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:01.830888 22361 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:01.832815 22361 ts_tablet_manager.cc:1434] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:01.834869 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-603c27f4d3de4b40878c1d29bcc0708a received from {username='slave'} at 127.0.0.1:36486
I20260709 13:10:01.835263 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-603c27f4d3de4b40878c1d29bcc0708a on tablet 603c27f4d3de4b40878c1d29bcc0708a with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:01.939949 22040 raft_consensus.cc:1217] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:02.044836 22041 raft_consensus.cc:1217] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:02.109674 22041 raft_consensus.cc:1217] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:02.209687 22040 raft_consensus.cc:1217] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:02.431833 22266 raft_consensus.cc:1064] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:02.434031 22266 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:02.440287 22040 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.440502 21390 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.441143 21319 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.441711 22372 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.442780 22306 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.443488 22266 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.485805 22372 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.489562 22040 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.490590 21316 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.509548 21219 catalog_manager.cc:5697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.512626 21395 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.531118 22373 raft_consensus.cc:1064] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:02.533828 22373 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:02.577847 21390 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.580904 22306 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.581146 22040 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.582677 22373 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.583631 21316 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.585036 22306 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.607573 21469 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:02.617949 22041 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.619148 21319 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.619390 22306 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.626611 22343 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.628892 22320 raft_consensus.cc:1064] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:02.631413 22320 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:02.642771 22373 raft_consensus.cc:1064] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:02.643313 22266 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.645380 22373 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:02.645114 22042 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.659386 21312 raft_consensus.cc:2955] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.661597 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 099cc7d3a89e468b91e21306fa23a0be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:02.680720 21312 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.682235 22240 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.687386 21469 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.689077 22389 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.694693 21392 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.695317 21319 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.696970 22039 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.698320 22266 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.701052 22372 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:02.702112 22373 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.722208 22042 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:02.723620 22240 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.730334 22266 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.728590 21216 catalog_manager.cc:5697] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.736701 22306 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.737208 22039 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.754705 21395 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.767329 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 099cc7d3a89e468b91e21306fa23a0be with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:10:02.777689 21469 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.772536 22389 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.794956 21215 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.817720 21316 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.819383 22398 tablet_replica.cc:333] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:10:02.820509 22398 raft_consensus.cc:2243] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:02.821323 22398 raft_consensus.cc:2272] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.826716 21312 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.829437 22398 ts_tablet_manager.cc:1916] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:02.839989 21319 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.841687 21216 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.849540 22042 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.863304 22040 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:10:02.865028 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46408.8us
I20260709 13:10:02.868005 21392 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.885430 21219 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.899367 22398 ts_tablet_manager.cc:1929] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:02.899829 22398 log.cc:1199] T 099cc7d3a89e468b91e21306fa23a0be P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/099cc7d3a89e468b91e21306fa23a0be
I20260709 13:10:02.901335 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 099cc7d3a89e468b91e21306fa23a0be (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:02.916697 21469 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:02.925822 21316 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.926316 22039 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.926831 21395 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:02.928844 22403 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:02.929747 22266 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.938928 21469 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:02.943996 22040 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.944888 21312 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.945911 22389 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.948050 22389 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.947609 22266 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.956243 22374 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.960120 21317 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.962004 22040 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.963230 21392 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.963450 22400 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.967943 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 603c27f4d3de4b40878c1d29bcc0708a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:02.970031 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 904858d649144d589875f088692f104f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:02.971763 22040 raft_consensus.cc:2955] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.972714 22400 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:02.976367 22402 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.985101 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 30bf17cca2e64e76b923a076142551ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:02.988758 22039 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:03.007754 21215 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:03.017661 21215 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:03.018366 22039 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:03.000957 21316 raft_consensus.cc:2955] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:03.023259 21392 raft_consensus.cc:2955] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:03.035138 21216 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.038062 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 904858d649144d589875f088692f104f with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:10:03.039155 22398 tablet_replica.cc:333] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:10:03.039911 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet 30bf17cca2e64e76b923a076142551ff with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:10:03.040274 22398 raft_consensus.cc:2243] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.041024 22398 raft_consensus.cc:2272] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.043309 22404 tablet_replica.cc:333] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:10:03.047052 22398 ts_tablet_manager.cc:1916] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:03.061574 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet 603c27f4d3de4b40878c1d29bcc0708a with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:10:03.072954 22398 ts_tablet_manager.cc:1929] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:03.073460 22398 log.cc:1199] T 904858d649144d589875f088692f104f P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/904858d649144d589875f088692f104f
I20260709 13:10:03.075075 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 904858d649144d589875f088692f104f (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:03.084666 22405 tablet_replica.cc:333] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:10:03.085284 22404 raft_consensus.cc:2243] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.085846 22405 raft_consensus.cc:2243] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.086128 22404 raft_consensus.cc:2272] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.087147 22405 raft_consensus.cc:2272] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.089351 22404 ts_tablet_manager.cc:1916] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:03.090557 22405 ts_tablet_manager.cc:1916] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:03.107152 22405 ts_tablet_manager.cc:1929] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:03.107152 22404 ts_tablet_manager.cc:1929] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:03.107831 22405 log.cc:1199] T 603c27f4d3de4b40878c1d29bcc0708a P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/603c27f4d3de4b40878c1d29bcc0708a
I20260709 13:10:03.107872 22404 log.cc:1199] T 30bf17cca2e64e76b923a076142551ff P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/30bf17cca2e64e76b923a076142551ff
I20260709 13:10:03.109678 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet 603c27f4d3de4b40878c1d29bcc0708a (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:03.109692 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet 30bf17cca2e64e76b923a076142551ff (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:04.157657 21392 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.164757 21312 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:04.165432 21359 consensus_peers.cc:597] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a3f0ee4cdba4795b8a75e55bdfd0512. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.166411 21463 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:04.166730 22408 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.167968 22389 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.176970 22374 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.179986 21312 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.182246 21463 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.198052 21312 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:10:04.207500 21284 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89e2aa178e8e4c63a6f5f660d5314ba7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.209019 21464 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:04.209193 21390 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:04.209666 21216 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.211236 22381 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.212885 22416 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.222636 22416 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.233337 21464 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.262519 21390 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.267977 21395 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:10:04.278469 21359 consensus_peers.cc:597] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dffab1617f544c36913eb55e6bad723c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.281327 21312 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:04.281148 21464 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:04.283082 22408 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.284876 22374 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.303706 21215 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.306236 22374 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.314098 21463 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.318042 21312 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.322260 21464 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.335433 21219 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.343890 21390 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:04.344317 21433 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4cfcdfda7a4840b78d5a89acd61b8d23. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.346097 22411 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.355545 21312 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:04.359306 22430 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:04.379065 21390 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.377830 21317 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.375919 22430 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.394814 21219 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:04.572113 22432 ts_tablet_manager.cc:933] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:04.576128 22432 tablet_copy_client.cc:323] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:10:04.578742 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:10:04.579391 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-4a3f0ee4cdba4795b8a75e55bdfd0512
I20260709 13:10:04.588083 21406 tablet_copy_source_session.cc:215] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:04.591696 22432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.608191 22432 tablet_copy_client.cc:806] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:04.608884 22432 tablet_copy_client.cc:670] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:04.612893 22432 tablet_copy_client.cc:538] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:04.622902 22432 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:04.643345 22432 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.644505 22432 tablet_bootstrap.cc:492] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:04.645325 22432 ts_tablet_manager.cc:1403] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 13:10:04.648954 22432 raft_consensus.cc:359] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.649925 22432 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:04.650658 22432 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.654558 22432 ts_tablet_manager.cc:1434] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:10:04.656493 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-4a3f0ee4cdba4795b8a75e55bdfd0512 received from {username='slave'} at 127.0.0.1:36486
I20260709 13:10:04.657002 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-4a3f0ee4cdba4795b8a75e55bdfd0512 on tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:04.729364 22432 ts_tablet_manager.cc:933] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
I20260709 13:10:04.734663 22432 tablet_copy_client.cc:323] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.193:45701
I20260709 13:10:04.736562 21331 tablet_copy_service.cc:140] P 058db415e9884ea0ba23f1e1ff59127a: Received BeginTabletCopySession request for tablet 89e2aa178e8e4c63a6f5f660d5314ba7 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:33484)
I20260709 13:10:04.737133 21331 tablet_copy_service.cc:161] P 058db415e9884ea0ba23f1e1ff59127a: Beginning new tablet copy session on tablet 89e2aa178e8e4c63a6f5f660d5314ba7 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:33484: session id = bfcd9560f8f44414b25f8069384c5a73-89e2aa178e8e4c63a6f5f660d5314ba7
I20260709 13:10:04.746102 21331 tablet_copy_source_session.cc:215] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:04.749742 22432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e2aa178e8e4c63a6f5f660d5314ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.766242 22432 tablet_copy_client.cc:806] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:04.766897 22432 tablet_copy_client.cc:670] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:04.770634 22432 tablet_copy_client.cc:538] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:04.778491 22432 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:04.828902 22437 ts_tablet_manager.cc:933] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:04.831723 22432 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.834370 22432 tablet_bootstrap.cc:492] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:04.835134 22432 ts_tablet_manager.cc:1403] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.012s
I20260709 13:10:04.839344 22432 raft_consensus.cc:359] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.840014 22432 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:04.840860 22437 tablet_copy_client.cc:323] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:10:04.842639 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet dffab1617f544c36913eb55e6bad723c from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:10:04.843168 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet dffab1617f544c36913eb55e6bad723c from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-dffab1617f544c36913eb55e6bad723c
I20260709 13:10:04.843036 22432 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.845975 22432 ts_tablet_manager.cc:1434] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:10:04.848321 21331 tablet_copy_service.cc:342] P 058db415e9884ea0ba23f1e1ff59127a: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-89e2aa178e8e4c63a6f5f660d5314ba7 received from {username='slave'} at 127.0.0.1:33484
I20260709 13:10:04.848793 21331 tablet_copy_service.cc:434] P 058db415e9884ea0ba23f1e1ff59127a: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-89e2aa178e8e4c63a6f5f660d5314ba7 on tablet 89e2aa178e8e4c63a6f5f660d5314ba7 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:04.851002 21406 tablet_copy_source_session.cc:215] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:04.854507 22437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffab1617f544c36913eb55e6bad723c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.867682 22432 ts_tablet_manager.cc:933] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:04.869673 22432 tablet_copy_client.cc:323] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:10:04.872184 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 4cfcdfda7a4840b78d5a89acd61b8d23 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:10:04.872735 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 4cfcdfda7a4840b78d5a89acd61b8d23 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-4cfcdfda7a4840b78d5a89acd61b8d23
I20260709 13:10:04.873386 22437 tablet_copy_client.cc:806] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:04.874049 22437 tablet_copy_client.cc:670] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:04.877719 22437 tablet_copy_client.cc:538] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:04.881592 21480 tablet_copy_source_session.cc:215] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:04.885447 22432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cfcdfda7a4840b78d5a89acd61b8d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.887348 22437 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:04.909175 22432 tablet_copy_client.cc:806] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:04.909940 22432 tablet_copy_client.cc:670] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:04.915798 22432 tablet_copy_client.cc:538] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:04.916924 22437 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.917954 22437 tablet_bootstrap.cc:492] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:04.920691 22437 ts_tablet_manager.cc:1403] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.005s
I20260709 13:10:04.924235 22437 raft_consensus.cc:359] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.925177 22437 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:04.925899 22437 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.931660 22432 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:04.933149 22437 ts_tablet_manager.cc:1434] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:04.935295 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-dffab1617f544c36913eb55e6bad723c received from {username='slave'} at 127.0.0.1:36486
I20260709 13:10:04.935706 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-dffab1617f544c36913eb55e6bad723c on tablet dffab1617f544c36913eb55e6bad723c with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:04.964527 22432 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.966228 22432 tablet_bootstrap.cc:492] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:04.967044 22432 ts_tablet_manager.cc:1403] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.009s
I20260709 13:10:04.969615 22432 raft_consensus.cc:359] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.970412 22432 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:04.971006 22432 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:04.973649 22432 ts_tablet_manager.cc:1434] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:04.975309 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-4cfcdfda7a4840b78d5a89acd61b8d23 received from {username='slave'} at 127.0.0.1:59692
I20260709 13:10:04.975692 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-4cfcdfda7a4840b78d5a89acd61b8d23 on tablet 4cfcdfda7a4840b78d5a89acd61b8d23 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:05.111747 22039 raft_consensus.cc:1217] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:05.194563 22039 raft_consensus.cc:1217] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:05.287352 22039 raft_consensus.cc:1217] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:05.368925 22039 raft_consensus.cc:1217] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:05.594916 22426 raft_consensus.cc:1064] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:05.597620 22426 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:05.605696 22042 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.607190 22389 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.611842 21464 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.613497 22426 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.615751 21317 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.617362 22447 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.631397 22447 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.633190 21464 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.640525 22042 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.648813 21219 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.649060 21317 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.745103 21390 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:05.762964 21464 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.763361 22042 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.765353 22389 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.767123 22374 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.773180 22410 raft_consensus.cc:1064] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:05.776115 22410 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:05.777604 22445 raft_consensus.cc:1064] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:05.780474 22445 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:05.781026 22389 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.792366 21469 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.831303 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:05.833112 21215 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.843715 22039 raft_consensus.cc:2955] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.846873 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:10:05.891852 22459 tablet_replica.cc:333] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:10:05.893922 22459 raft_consensus.cc:2243] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.896133 22459 raft_consensus.cc:2272] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.901369 22459 ts_tablet_manager.cc:1916] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:05.911228 22389 raft_consensus.cc:1064] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:05.923062 22389 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:05.925581 21317 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.929611 22445 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:05.930564 22039 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.933982 21395 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.935487 22428 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:05.965165 22444 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:05.974413 22458 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:05.979461 22445 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:05.996711 22039 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.998410 22416 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.006119 21469 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:06.008184 22453 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:06.013716 22459 ts_tablet_manager.cc:1929] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:06.014062 22039 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:06.016350 21390 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:06.018579 21312 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:06.021380 21464 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:06.023425 22447 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.022938 22410 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.025373 22426 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.014302 22459 log.cc:1199] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/4a3f0ee4cdba4795b8a75e55bdfd0512
I20260709 13:10:06.026648 22453 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.027169 22426 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.029647 22039 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.061910 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet 4a3f0ee4cdba4795b8a75e55bdfd0512 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:06.074048 21317 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.075071 21215 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:10:06.079779 22463 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.065s	user 0.003s	sys 0.000s
I20260709 13:10:06.088627 21390 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.097461 21469 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.112910 22040 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.126415 21218 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.131307 21464 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:06.143111 21317 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:06.145035 22400 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:06.151894 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97723.7us
I20260709 13:10:06.164217 22426 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.184281 22040 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.186573 22039 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:06.192315 21316 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.187932 22470 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.203383 21317 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.213267 21219 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.216984 22428 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:06.240890 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4cfcdfda7a4840b78d5a89acd61b8d23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:06.249395 21464 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.252472 22042 raft_consensus.cc:2955] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.255488 21219 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.278393 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cfcdfda7a4840b78d5a89acd61b8d23 with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:10:06.280896 22475 tablet_replica.cc:333] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:10:06.282531 22475 raft_consensus.cc:2243] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.283449 22475 pending_rounds.cc:70] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Trying to abort 1 pending ops.
I20260709 13:10:06.284417 22475 pending_rounds.cc:77] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636273270521856 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } } }
I20260709 13:10:06.285847 22475 raft_consensus.cc:2917] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:10:06.286317 22475 raft_consensus.cc:2889] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:06.287443 22475 raft_consensus.cc:2272] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.297176 22475 ts_tablet_manager.cc:1916] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:06.305999 21390 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:06.313015 21464 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:06.313745 22475 ts_tablet_manager.cc:1929] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:06.314288 22475 log.cc:1199] T 4cfcdfda7a4840b78d5a89acd61b8d23 P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/4cfcdfda7a4840b78d5a89acd61b8d23
I20260709 13:10:06.315622 22040 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:06.316145 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 4cfcdfda7a4840b78d5a89acd61b8d23 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:06.316978 22426 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:06.318468 22389 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:06.326598 22389 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.328255 22040 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.331332 21464 raft_consensus.cc:2955] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.336251 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dffab1617f544c36913eb55e6bad723c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:06.348258 21219 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.361150 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet dffab1617f544c36913eb55e6bad723c with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:10:06.362103 22459 tablet_replica.cc:333] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:10:06.363262 22459 raft_consensus.cc:2243] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.363953 22459 raft_consensus.cc:2272] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.373171 22459 ts_tablet_manager.cc:1916] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:06.389812 22459 ts_tablet_manager.cc:1929] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:06.400864 22459 log.cc:1199] T dffab1617f544c36913eb55e6bad723c P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/dffab1617f544c36913eb55e6bad723c
I20260709 13:10:06.402843 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet dffab1617f544c36913eb55e6bad723c (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:06.606593 21316 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:06.612454 22039 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:06.612532 21395 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:06.613902 22453 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:06.614741 22452 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:06.621980 22452 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.623597 21395 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.625284 22039 raft_consensus.cc:2955] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:06.638375 21206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89e2aa178e8e4c63a6f5f660d5314ba7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:06.641491 21218 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.661356 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e2aa178e8e4c63a6f5f660d5314ba7 with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:10:06.664505 22476 tablet_replica.cc:333] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:10:06.665565 22476 raft_consensus.cc:2243] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.666338 22476 raft_consensus.cc:2272] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.669037 22476 ts_tablet_manager.cc:1916] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:06.683441 22476 ts_tablet_manager.cc:1929] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:06.683940 22476 log.cc:1199] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/89e2aa178e8e4c63a6f5f660d5314ba7
I20260709 13:10:06.687048 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet 89e2aa178e8e4c63a6f5f660d5314ba7 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:07.709189 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:07.745635 21317 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:10:07.754271 21284 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff7ec37b4f0643d4b4d60d35243b93d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.756819 21466 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:07.760531 22452 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.768392 21390 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:07.769778 22453 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.771528 22480 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:07.773222 21466 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:07.781769 21317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:07.782532 21317 raft_consensus.cc:606] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:07.785372 21317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:07.785907 21317 raft_consensus.cc:606] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:07.790333 21464 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:07.795079 21390 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
W20260709 13:10:07.814277 21433 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06666c92a06645dc8a8977e923b51e37. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.814291 21214 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.817476 21392 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:07.819975 22428 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:07.825716 21317 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:07.827893 22428 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.837019 22487 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:07.828758 21464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:07.839555 21464 raft_consensus.cc:606] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:07.850303 22428 raft_consensus.cc:993] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:07.850876 22428 raft_consensus.cc:1081] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:07.852890 21316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:10:07.853595 21316 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.853924 21316 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.854979 21395 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:07.862068 21316 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:07.867874 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:07.868607 21466 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.868921 21466 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:07.870338 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:07.871148 21395 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.871783 21466 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:07.872936 21466 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.884061 21395 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:07.870390 21316 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:07.885442 21466 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:07.893186 21467 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:07.895550 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:07.898850 22453 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.899307 22453 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:07.900241 22453 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:07.918015 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:07.918758 21395 raft_consensus.cc:606] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:07.922168 21466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:07.922878 21466 raft_consensus.cc:606] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:07.925947 21466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:07.926855 21466 raft_consensus.cc:606] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:07.928622 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:07.930881 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:07.933835 21219 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.934767 21317 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
W20260709 13:10:07.965647 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 65064.2us
W20260709 13:10:07.968936 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50880.7us
I20260709 13:10:07.984334 21219 catalog_manager.cc:5697] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:07.988176 21433 consensus_peers.cc:597] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce267b84e93f48afa7ad5caa450b982a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.991106 21317 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:07.992667 22487 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.998867 21392 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:08.002210 22478 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.013270 22469 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:08.014984 21316 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:08.024303 21395 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:08.032349 21317 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.034654 21219 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:08.048252 21467 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:08.050048 22452 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.050325 21392 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:08.051182 21284 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 984d063a64ef47f7b0783e2181604515. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:08.052735 22452 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.062055 22480 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:08.066315 21395 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:08.075169 21466 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:08.087852 22428 raft_consensus.cc:993] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:08.088430 22469 raft_consensus.cc:1081] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:08.089988 21312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:10:08.090521 21312 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.090855 21312 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.097410 21312 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.099203 21312 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:08.089303 21214 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.104882 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:08.105114 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:08.105510 21467 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.105855 21467 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:08.106256 21395 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.106660 21467 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.109145 21467 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.113408 21395 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:08.116688 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:08.117529 22480 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.118021 22480 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:08.118129 21467 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:08.118885 22480 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.143859 21214 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.236858 22510 ts_tablet_manager.cc:933] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:08.238763 22510 tablet_copy_client.cc:323] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:10:08.240667 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 06666c92a06645dc8a8977e923b51e37 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:10:08.241235 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 06666c92a06645dc8a8977e923b51e37 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-06666c92a06645dc8a8977e923b51e37
I20260709 13:10:08.246820 21480 tablet_copy_source_session.cc:215] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:08.249776 22510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06666c92a06645dc8a8977e923b51e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.257354 22453 raft_consensus.cc:993] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:08.257936 22453 raft_consensus.cc:1081] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:08.259719 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42344
I20260709 13:10:08.260466 22042 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.260840 22042 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.266749 22510 tablet_copy_client.cc:806] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:08.267405 22510 tablet_copy_client.cc:670] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:08.267278 22042 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:08.272163 22042 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:08.273994 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:08.274334 22510 tablet_copy_client.cc:538] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:08.274619 21392 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.276005 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:08.276721 21312 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.277064 21312 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:08.277997 21312 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:08.279217 21312 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.282812 21392 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:08.284403 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:08.285562 22510 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:08.295434 21312 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:08.297538 22512 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.298655 22513 ts_tablet_manager.cc:933] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
I20260709 13:10:08.314949 22513 tablet_copy_client.cc:323] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.193:45701
I20260709 13:10:08.316879 21331 tablet_copy_service.cc:140] P 058db415e9884ea0ba23f1e1ff59127a: Received BeginTabletCopySession request for tablet ff7ec37b4f0643d4b4d60d35243b93d8 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:33484)
I20260709 13:10:08.317516 21331 tablet_copy_service.cc:161] P 058db415e9884ea0ba23f1e1ff59127a: Beginning new tablet copy session on tablet ff7ec37b4f0643d4b4d60d35243b93d8 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:33484: session id = bfcd9560f8f44414b25f8069384c5a73-ff7ec37b4f0643d4b4d60d35243b93d8
I20260709 13:10:08.316387 22512 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:08.318625 22512 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:08.317662 22510 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.321120 22510 tablet_bootstrap.cc:492] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:08.321903 22510 ts_tablet_manager.cc:1403] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.012s
I20260709 13:10:08.326617 22510 raft_consensus.cc:359] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.328244 22510 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:08.329322 22510 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.332703 22510 ts_tablet_manager.cc:1434] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:10:08.334529 22453 raft_consensus.cc:993] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:08.335222 22453 raft_consensus.cc:1081] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:08.339600 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-06666c92a06645dc8a8977e923b51e37 received from {username='slave'} at 127.0.0.1:59692
I20260709 13:10:08.340065 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-06666c92a06645dc8a8977e923b51e37 on tablet 06666c92a06645dc8a8977e923b51e37 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:08.341750 21331 tablet_copy_source_session.cc:215] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:08.343663 21214 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.346398 22513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ec37b4f0643d4b4d60d35243b93d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.347731 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42344
I20260709 13:10:08.348309 22042 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.348640 22042 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.355052 22042 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:08.359355 22042 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:08.360893 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:08.361593 21466 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.363091 22513 tablet_copy_client.cc:806] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:08.363651 22513 tablet_copy_client.cc:670] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:08.364369 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:08.364945 21312 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.365217 21312 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:08.365999 21312 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:08.372591 21312 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.375419 21466 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:08.376582 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:08.377732 22515 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.378252 22515 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:08.379220 22515 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:08.388875 21312 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:08.392056 22513 tablet_copy_client.cc:538] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:08.402113 21392 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.413353 22480 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:08.428586 22513 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:08.446314 21214 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.450294 22478 raft_consensus.cc:993] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:08.450847 22478 raft_consensus.cc:1081] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:08.458510 21317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:10:08.459353 21317 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.459750 21317 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.468053 22495 raft_consensus.cc:993] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:08.477443 22495 raft_consensus.cc:1081] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:08.480338 21312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45126
I20260709 13:10:08.480911 21312 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.481225 21312 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.525701 21317 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.526760 21466 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.534227 21317 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:08.536147 22510 ts_tablet_manager.cc:933] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
I20260709 13:10:08.541733 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:08.542694 21466 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.543154 21466 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:08.544287 21466 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.546677 21466 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.554169 21312 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.555305 22513 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.569839 22513 tablet_bootstrap.cc:492] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:08.572357 22513 ts_tablet_manager.cc:1403] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.144s	user 0.052s	sys 0.039s
I20260709 13:10:08.563100 22524 ts_tablet_manager.cc:933] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:08.564194 22510 tablet_copy_client.cc:323] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.193:45701
I20260709 13:10:08.567950 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:08.575038 21395 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.577234 21312 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:08.575356 22513 raft_consensus.cc:359] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.578615 22513 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:08.579468 22513 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.588013 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:08.588675 21467 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.588937 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:08.589515 21392 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.589784 21392 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:08.590467 21392 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.591624 21392 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.592996 21466 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:08.596061 22513 ts_tablet_manager.cc:1434] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:10:08.598517 21392 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:08.582803 21395 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:08.583382 22508 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.584401 22524 tablet_copy_client.cc:323] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:10:08.600337 21331 tablet_copy_service.cc:140] P 058db415e9884ea0ba23f1e1ff59127a: Received BeginTabletCopySession request for tablet 984d063a64ef47f7b0783e2181604515 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:33484)
I20260709 13:10:08.600009 21467 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:08.604339 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:08.601172 21330 tablet_copy_service.cc:342] P 058db415e9884ea0ba23f1e1ff59127a: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-ff7ec37b4f0643d4b4d60d35243b93d8 received from {username='slave'} at 127.0.0.1:33484
I20260709 13:10:08.627276 22480 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.627815 22480 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:08.628752 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet ce267b84e93f48afa7ad5caa450b982a from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:10:08.628842 22480 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.629408 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet ce267b84e93f48afa7ad5caa450b982a from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-ce267b84e93f48afa7ad5caa450b982a
I20260709 13:10:08.629799 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:08.630761 22452 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.631206 22452 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:08.631976 22452 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:08.627282 21330 tablet_copy_service.cc:434] P 058db415e9884ea0ba23f1e1ff59127a: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-ff7ec37b4f0643d4b4d60d35243b93d8 on tablet ff7ec37b4f0643d4b4d60d35243b93d8 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:08.644634 21395 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.638417 21331 tablet_copy_service.cc:161] P 058db415e9884ea0ba23f1e1ff59127a: Beginning new tablet copy session on tablet 984d063a64ef47f7b0783e2181604515 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:33484: session id = bfcd9560f8f44414b25f8069384c5a73-984d063a64ef47f7b0783e2181604515
I20260709 13:10:08.647426 22453 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.652814 21467 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.654146 21480 tablet_copy_source_session.cc:215] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:08.657729 22453 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.660359 22524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce267b84e93f48afa7ad5caa450b982a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.667665 21331 tablet_copy_source_session.cc:215] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:08.671038 22510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984d063a64ef47f7b0783e2181604515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.686224 22524 tablet_copy_client.cc:806] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:08.686841 22524 tablet_copy_client.cc:670] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:08.692256 22524 tablet_copy_client.cc:538] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:08.695207 21219 catalog_manager.cc:5697] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.715809 22524 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:08.730501 22042 raft_consensus.cc:1217] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:08.731918 22510 tablet_copy_client.cc:806] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:08.732630 22510 tablet_copy_client.cc:670] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:08.737911 22510 tablet_copy_client.cc:538] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:08.743228 21214 catalog_manager.cc:5697] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.753011 22510 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:08.757308 22524 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.758260 22524 tablet_bootstrap.cc:492] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:08.758944 22524 ts_tablet_manager.cc:1403] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.043s	user 0.023s	sys 0.006s
I20260709 13:10:08.763542 22524 raft_consensus.cc:359] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.765544 22524 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:08.766237 22524 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.772128 22524 ts_tablet_manager.cc:1434] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:10:08.773887 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-ce267b84e93f48afa7ad5caa450b982a received from {username='slave'} at 127.0.0.1:59692
I20260709 13:10:08.774315 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-ce267b84e93f48afa7ad5caa450b982a on tablet ce267b84e93f48afa7ad5caa450b982a with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:08.775282 21395 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:08.776830 22515 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:08.784597 21317 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:08.787827 22515 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:08.802042 21317 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:08.808501 22515 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:08.835245 22042 raft_consensus.cc:1217] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:08.838013 21466 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:08.840276 22512 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:08.871052 22510 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:08.873018 22510 tablet_bootstrap.cc:492] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:08.877442 22510 ts_tablet_manager.cc:1403] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.129s	user 0.026s	sys 0.003s
I20260709 13:10:08.884475 22510 raft_consensus.cc:359] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.885449 22510 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:08.886155 22510 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:08.889803 22510 ts_tablet_manager.cc:1434] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:08.893738 21331 tablet_copy_service.cc:342] P 058db415e9884ea0ba23f1e1ff59127a: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-984d063a64ef47f7b0783e2181604515 received from {username='slave'} at 127.0.0.1:33484
I20260709 13:10:08.894155 21331 tablet_copy_service.cc:434] P 058db415e9884ea0ba23f1e1ff59127a: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-984d063a64ef47f7b0783e2181604515 on tablet 984d063a64ef47f7b0783e2181604515 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:08.932097 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:08.970278 22041 raft_consensus.cc:1217] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:09.002372 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:09.055873 21393 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.056936 21463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:09.057510 21463 raft_consensus.cc:606] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:09.057396 22452 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.070885 21466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:09.071485 21466 raft_consensus.cc:606] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:09.078061 21466 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.079782 22453 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.080310 21312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:09.080881 21312 raft_consensus.cc:606] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:09.084272 21463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:09.086463 21463 raft_consensus.cc:606] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:09.088300 22428 raft_consensus.cc:993] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:09.088665 22428 raft_consensus.cc:1081] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:09.091542 21317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:09.092110 21317 raft_consensus.cc:606] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:09.094421 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42358
I20260709 13:10:09.094918 22042 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.095229 22042 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.100276 21393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:09.101204 21393 raft_consensus.cc:606] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:09.102566 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:09.104151 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:09.113169 22042 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.115808 22042 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:09.115835 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:09.116487 21317 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.116665 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:09.117205 21463 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.117463 21463 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:09.118144 21463 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.119180 21463 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.128202 21317 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:09.129839 21463 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:09.131091 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:09.132081 22537 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.132314 22042 raft_consensus.cc:1217] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:09.132557 22537 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:09.133425 22537 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.151647 21218 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.202078 21466 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.203267 22453 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.213050 21390 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.221266 22480 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.332782 22487 raft_consensus.cc:1064] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:09.334832 22487 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.339426 22480 raft_consensus.cc:1064] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:09.349543 22428 raft_consensus.cc:993] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:09.350091 22478 raft_consensus.cc:1081] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:09.352169 22042 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.353978 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42358
I20260709 13:10:09.343521 22480 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.354481 22478 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:09.356232 21317 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.355340 22042 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.354387 21390 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.357656 22487 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:09.358527 22042 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.364607 22478 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:10:09.419627 22502 raft_consensus.cc:993] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:09.420209 22500 raft_consensus.cc:1081] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:09.422631 22041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42342
I20260709 13:10:09.423177 22041 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.423571 22041 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.423015 22478 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.428946 21393 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.430390 22042 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.430835 22041 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.433153 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:09.433477 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:09.433779 21317 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.434016 21390 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.434310 21390 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:09.435002 21390 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.435959 21390 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.443619 21390 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:09.444854 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:09.446246 22512 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.446714 22512 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:09.447494 22512 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.455572 22041 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:09.456542 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:09.457211 21466 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.465235 22042 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:09.465981 21317 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:09.467051 21218 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.468909 22039 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.473196 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:09.473758 21463 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.474032 21463 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:09.474713 21463 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.476181 21463 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.476926 21466 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:09.476173 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:09.481647 22042 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.482966 22452 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:09.482865 21219 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.489339 22537 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.489894 22537 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:09.491102 21466 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.490780 22537 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.492594 22480 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:09.507572 21392 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.517571 22508 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:09.540410 22508 raft_consensus.cc:993] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:09.540978 22508 raft_consensus.cc:1081] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:09.544334 21467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56756
I20260709 13:10:09.545054 21467 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.546761 21467 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.548137 21463 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:09.560051 22487 raft_consensus.cc:1064] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:09.555943 22453 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.562604 22487 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.557631 22040 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.575153 21317 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.588868 21312 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:09.591943 22537 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:09.596118 21466 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:09.607535 21393 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.555583 21467 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:09.610607 22428 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:09.611613 21219 catalog_manager.cc:5697] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.612567 21467 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:09.614449 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:09.615057 21392 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.615908 22512 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:09.623544 22039 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.624084 21317 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:09.629424 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:09.630069 21312 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.630396 21312 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:09.630316 21463 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.631330 21312 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:09.649937 21312 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.634249 22428 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:09.638593 21214 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.644650 21464 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.656651 22469 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:09.670921 21312 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:09.688452 21392 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:09.710094 21436 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:09.711251 22452 raft_consensus.cc:993] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:09.711664 22478 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.711980 22555 raft_consensus.cc:993] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:09.712248 22478 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:09.712533 22555 raft_consensus.cc:1081] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:09.713128 22478 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:09.715214 22452 raft_consensus.cc:1081] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:09.717828 22040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42344
I20260709 13:10:09.719064 22040 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.719507 22040 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.744561 22453 raft_consensus.cc:1064] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:09.757093 22453 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.788973 22041 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:09.792296 22487 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:09.812361 22042 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:10:09.831589 22557 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:10:09.837143 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 127220us
I20260709 13:10:09.855615 22040 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.809237 22428 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.883882 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:09.884497 21317 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.884817 21317 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:09.885560 21317 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.887079 21317 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.909549 21317 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:09.913372 22040 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:09.912945 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:09.920858 22515 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.921460 22515 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:09.922513 22515 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:09.938855 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06666c92a06645dc8a8977e923b51e37 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:09.953457 21316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:10:09.954262 21316 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.954664 21316 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.970853 21316 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:09.973954 21393 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:09.982591 21317 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:10.011725 21316 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:10.016506 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:10.017297 21464 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:10.017613 21464 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:10.023993 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:10.024652 21391 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:10.025931 22555 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.033114 21390 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.029894 21464 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:10.034745 21464 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:10.037735 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 307617us
I20260709 13:10:10.042388 21391 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
W20260709 13:10:10.038277 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 98407.7us
I20260709 13:10:10.048828 22039 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.036506 22042 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.055658 22558 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:10:10.059844 22428 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:10.062819 21312 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:10.061625 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:10.071574 22453 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:10.072057 22453 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:10.097316 21466 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.106452 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:10.103793 22453 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:10.115309 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:10.115922 21393 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:10.118515 21391 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:10.144214 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 83982.2us
I20260709 13:10:10.169611 22560 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:10:10.177505 22571 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:10:10.225565 21316 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:10.245290 21393 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
W20260709 13:10:10.247964 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 216278us
I20260709 13:10:10.252821 21390 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.253728 21218 catalog_manager.cc:5697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.189147 21317 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.278842 21464 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:10.294387 21316 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:10.291847 22568 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:10:10.312186 21314 raft_consensus.cc:2955] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.373328 22561 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.375773 21470 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:10.389729 21466 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:10.397853 22042 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:10.400933 22453 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:10.398454 22537 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:10:10.425943 22575 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:10:10.440016 21314 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:10.442408 22515 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:10.445446 21393 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:10.448678 22515 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:10.502664 22040 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.513922 22515 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:10:10.525166 22512 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:10:10.569990 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 70641us
I20260709 13:10:10.582119 21216 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.586055 22575 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.615144 22042 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.621522 21466 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:10.623279 22453 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:10.641270 21214 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:10:10.675071 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 105631us
I20260709 13:10:10.690770 21391 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:10.718282 21395 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:10.724066 21393 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.725016 21390 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:10.733068 21219 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.733801 22487 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:10.736236 21206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff7ec37b4f0643d4b4d60d35243b93d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:10:10.751442 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 165676us
I20260709 13:10:10.751459 22559 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:10.775256 22561 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:10.781288 21464 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.809286 21393 raft_consensus.cc:2955] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.831895 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:10.897364 21214 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.899338 21214 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.902379 21214 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:10.930306 22566 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:10.930924 22566 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:10.935194 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:10.947145 21464 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:10.958570 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 06666c92a06645dc8a8977e923b51e37 with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:10:10.965452 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet ff7ec37b4f0643d4b4d60d35243b93d8 with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:10:10.973515 22613 tablet_replica.cc:333] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:10:10.978471 22566 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:10.979573 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:10.981246 21360 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:10.983577 22566 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:10.979573 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:10.985275 21393 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:10.988451 22595 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:10.992228 22042 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:10.994761 21312 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:11.000352 22601 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:11.006141 22042 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.005550 22487 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:11.008188 22575 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.011116 21393 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:11.022410 22613 raft_consensus.cc:2243] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.022039 22560 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:11.026840 21464 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.024655 22613 raft_consensus.cc:2272] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.034054 22508 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:11.086602 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57538.3us
I20260709 13:10:11.089171 22613 ts_tablet_manager.cc:1916] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.023684 22042 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:11.098229 21218 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:11.102741 22039 raft_consensus.cc:2955] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:11.105855 21312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:11.106539 21312 raft_consensus.cc:606] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:11.111510 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce267b84e93f48afa7ad5caa450b982a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.109159 21470 raft_consensus.cc:2955] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:11.130505 21393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:11.131174 21393 raft_consensus.cc:606] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:11.134992 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet ce267b84e93f48afa7ad5caa450b982a with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:10:11.137413 21312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "984d063a64ef47f7b0783e2181604515"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:11.196834 22612 tablet_replica.cc:333] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:10:11.198051 22612 raft_consensus.cc:2243] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.198948 22612 raft_consensus.cc:2272] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.248636 22614 tablet_replica.cc:333] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:10:11.249914 22614 raft_consensus.cc:2243] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.250775 22614 raft_consensus.cc:2272] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.260226 22614 ts_tablet_manager.cc:1916] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.263551 22612 ts_tablet_manager.cc:1916] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.289855 22613 ts_tablet_manager.cc:1929] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.290449 22613 log.cc:1199] T ff7ec37b4f0643d4b4d60d35243b93d8 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/ff7ec37b4f0643d4b4d60d35243b93d8
I20260709 13:10:11.309425 22614 ts_tablet_manager.cc:1929] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.310153 22614 log.cc:1199] T ce267b84e93f48afa7ad5caa450b982a P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/ce267b84e93f48afa7ad5caa450b982a
I20260709 13:10:11.319789 22612 ts_tablet_manager.cc:1929] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.326319 22612 log.cc:1199] T 06666c92a06645dc8a8977e923b51e37 P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/06666c92a06645dc8a8977e923b51e37
I20260709 13:10:11.292366 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet ff7ec37b4f0643d4b4d60d35243b93d8 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
W20260709 13:10:11.376879 21204 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 84539.7us
I20260709 13:10:11.378669 21219 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) evicted. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:11.450421 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 06666c92a06645dc8a8977e923b51e37 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:11.452209 21312 raft_consensus.cc:606] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:11.480118 22604 raft_consensus.cc:993] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:11.480754 22604 raft_consensus.cc:1081] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:11.489008 22039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42342
I20260709 13:10:11.489629 22039 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.489995 22039 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.529279 21206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 984d063a64ef47f7b0783e2181604515 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.530172 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet ce267b84e93f48afa7ad5caa450b982a (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:11.546788 22039 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:11.558674 21378 tablet_service.cc:1558] Processing DeleteTablet for tablet 984d063a64ef47f7b0783e2181604515 with delete_type TABLET_DATA_TOMBSTONED (TS d41c71e861344f0b90e8d44a8d0a3173 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52920
I20260709 13:10:11.561335 22612 tablet_replica.cc:333] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:10:11.570607 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:11.571471 21393 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.572160 21393 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:11.572865 21393 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:11.573892 21393 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.576195 22039 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:11.581727 21393 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:11.584535 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:11.585704 22512 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.586179 22512 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:11.586786 22612 raft_consensus.cc:2243] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.587005 22512 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:11.587574 22612 raft_consensus.cc:2272] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.593912 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:11.594605 21312 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.597123 22559 raft_consensus.cc:993] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:11.597649 22561 raft_consensus.cc:1081] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:11.598330 22612 ts_tablet_manager.cc:1916] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.601011 22039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "984d063a64ef47f7b0783e2181604515"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42344
I20260709 13:10:11.601843 22039 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.602213 22039 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.604547 21467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:11.605115 21467 raft_consensus.cc:606] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:11.607066 22575 raft_consensus.cc:993] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:11.607561 22575 raft_consensus.cc:1081] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:11.614960 22039 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:11.617800 21317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:11.618398 22039 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:11.618450 21317 raft_consensus.cc:606] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:11.619951 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:11.621670 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:11.622277 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:11.627125 21470 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.624269 21464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56756
I20260709 13:10:11.630832 21464 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.631484 21464 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.630823 21312 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:11.636376 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:11.637040 21317 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.637369 21317 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:11.638146 21317 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:11.638804 21464 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:11.639508 21317 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.641642 21464 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:11.642879 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:11.643577 21393 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.648388 21470 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:11.649214 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:11.649910 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:11.654266 22581 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.654764 22581 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:11.655166 22612 ts_tablet_manager.cc:1929] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.655625 22612 log.cc:1199] T 984d063a64ef47f7b0783e2181604515 P d41c71e861344f0b90e8d44a8d0a3173: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/wals/984d063a64ef47f7b0783e2181604515
I20260709 13:10:11.655625 22581 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:11.657765 21204 catalog_manager.cc:5028] TS d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): tablet 984d063a64ef47f7b0783e2181604515 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:11.659406 21312 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.659731 21312 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:11.660481 21312 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:11.663761 21317 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:11.666574 21393 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:11.661562 21312 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.675146 21218 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.676795 21312 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:11.677361 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:11.678217 22478 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.678736 22478 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:11.679630 22478 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:11.694629 21218 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.709309 21216 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.023303 22508 raft_consensus.cc:993] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:12.023810 22452 raft_consensus.cc:1081] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:12.025235 22039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42344
I20260709 13:10:12.025734 22039 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.026147 22039 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.031975 22039 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:12.034440 22039 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:12.034678 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:12.035326 21312 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:12.035611 21312 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:12.036300 21312 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:12.036953 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:12.037451 21312 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.037523 21392 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.042610 21392 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:12.042797 21312 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:12.043717 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:12.044545 22512 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:12.045066 22512 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:12.045837 22512 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:12.052780 21312 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:12.054214 22512 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:12.055140 21216 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.070848 21464 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:12.072443 22512 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:12.096354 22555 raft_consensus.cc:993] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:12.096863 22478 raft_consensus.cc:1081] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:12.098201 21312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:10:12.098658 21312 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.098908 21312 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.104812 21312 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:12.106599 21312 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:12.107653 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:12.108731 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:12.109248 21392 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.115407 21392 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:12.108281 21464 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:12.116315 21464 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:12.116797 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:12.117244 21464 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:12.120668 21464 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.120242 22508 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:12.125025 22508 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:12.127166 21393 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.127983 21464 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:12.129326 22555 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.125907 22508 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:12.142096 21312 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.143453 22555 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.147655 21218 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.157204 21317 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:12.162447 22512 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:12.178242 21393 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:12.179834 22581 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:12.391283 21417 debug-util.cc:398] Leaking SignalData structure 0x7b0800098a20 after lost signal to thread 20202
W20260709 13:10:12.392601 21417 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2660 after lost signal to thread 21253
W20260709 13:10:12.393703 21417 debug-util.cc:398] Leaking SignalData structure 0x7b08003494e0 after lost signal to thread 21345
W20260709 13:10:12.394688 21417 debug-util.cc:398] Leaking SignalData structure 0x7b0800345880 after lost signal to thread 21420
W20260709 13:10:12.395582 21417 debug-util.cc:398] Leaking SignalData structure 0x7b08001244a0 after lost signal to thread 21494
W20260709 13:10:12.396729 21417 debug-util.cc:398] Leaking SignalData structure 0x7b080031a7c0 after lost signal to thread 22066
I20260709 13:10:12.537494 21393 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:12.538972 22581 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:12.550885 21312 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:12.554991 22581 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:12.617146 21467 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.617499 21393 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.619095 22508 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.622035 22508 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.622519 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:12.770447 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:12.825435 21464 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:12.838857 21467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:12.839447 21467 raft_consensus.cc:606] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:12.843072 21393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:12.843632 21393 raft_consensus.cc:606] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:12.843644 21392 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:12.845950 22555 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:12.846935 21392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:12.847479 21392 raft_consensus.cc:606] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:12.845930 21433 consensus_peers.cc:597] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 077d2ef89a5347dc8b8e863085f1d4e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.852380 21312 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:12.854140 22601 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:12.860553 22555 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:12.870939 21392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:12.871954 21392 raft_consensus.cc:606] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:12.877229 21312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:12.877904 21312 raft_consensus.cc:606] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:12.879266 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:12.884948 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:12.884479 21392 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:12.889842 22633 raft_consensus.cc:993] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:12.890374 22500 raft_consensus.cc:1081] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:12.892000 21464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56746
I20260709 13:10:12.892565 21464 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.892911 21464 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.894380 21312 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:12.901279 21464 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:12.902421 21218 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 3, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:12.911981 21393 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:12.924201 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:12.925012 22039 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.955075 22039 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:12.918416 21464 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:12.917927 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:12.957388 21392 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:12.957711 21392 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:12.958372 21392 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:12.959380 21392 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.965698 22040 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:12.973361 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:12.974160 22636 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:12.974804 22636 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:12.975868 22636 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:12.987602 21392 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
W20260709 13:10:12.998564 21359 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f384b96e64eb4aa9a99fd8372643b01c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.999179 22452 raft_consensus.cc:993] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:12.999636 22452 raft_consensus.cc:1081] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:13.001341 21467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56756
I20260709 13:10:13.001947 21467 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.002085 21464 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.002375 21467 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.004372 22633 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:13.012643 21467 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:13.014310 21312 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.015996 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:13.016567 21312 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:13.016888 21312 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:13.017665 21312 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:13.018713 21312 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.019057 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:13.019622 21392 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.020215 22500 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:13.027010 21467 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:13.029801 21312 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:13.031215 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:13.032188 22636 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:13.032692 22636 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:13.033560 22636 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:13.039772 21392 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
W20260709 13:10:13.041594 22638 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:10:13.042819 22633 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.053043 21312 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.056921 21464 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.058917 21392 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:13.094381 21312 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:13.096509 21359 consensus_peers.cc:597] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91e50669ee6e496d9e5aaf0b2cc43c1c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.097541 21464 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.099551 22500 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:13.104719 22599 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.100373 21219 catalog_manager.cc:5697] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.116405 22599 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.117985 21216 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.119699 21216 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 3, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.123809 21464 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.143493 21321 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.170696 21219 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.177109 21312 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:10:13.196298 21284 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a81f5eab37044228b941f7eb2be5912. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.197345 21464 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.198870 22452 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.202561 21392 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.206938 22452 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:13.210379 22508 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.250603 21219 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.255282 22599 raft_consensus.cc:993] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:13.255824 22599 raft_consensus.cc:1081] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:13.259788 21393 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.269567 22040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42342
I20260709 13:10:13.270183 22040 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.270530 22040 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.220574 21464 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:13.278693 22040 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.290241 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:13.290948 21316 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.292893 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:13.293509 21392 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.293798 21392 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:13.295495 21392 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.300300 21392 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.302328 22040 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:13.306995 21316 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:13.313325 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:13.314123 22515 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.309836 22636 raft_consensus.cc:993] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:13.314694 22515 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:13.314926 22636 raft_consensus.cc:1081] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:13.315757 22515 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.317262 21316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:10:13.317826 21316 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.318207 21316 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.324890 21392 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:13.324923 21316 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.332866 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:13.333465 22040 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.339852 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:13.340520 21464 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.340821 21464 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:13.341490 21464 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.342504 21464 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.351024 22040 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:13.352176 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:13.352885 22508 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.353323 22508 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:13.348502 21219 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.354107 22508 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.355561 21316 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:13.387287 21464 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:13.404588 21219 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.454519 22654 ts_tablet_manager.cc:933] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:13.456908 22654 tablet_copy_client.cc:323] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:10:13.458475 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 077d2ef89a5347dc8b8e863085f1d4e2 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:10:13.459038 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 077d2ef89a5347dc8b8e863085f1d4e2 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-077d2ef89a5347dc8b8e863085f1d4e2
I20260709 13:10:13.460755 22599 raft_consensus.cc:993] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:13.461295 22599 raft_consensus.cc:1081] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:13.466614 21480 tablet_copy_source_session.cc:215] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.477253 21321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45126
I20260709 13:10:13.477838 21321 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.478183 21321 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.485507 22654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077d2ef89a5347dc8b8e863085f1d4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.488382 21321 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.491199 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:13.491330 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:13.491784 22042 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.503364 21393 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:13.506224 22555 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:13.507452 22040 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:13.491784 21392 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.508705 21392 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:13.509478 21392 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.510540 21392 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.516141 22636 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:13.522300 21392 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:13.523535 22042 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:13.506057 22654 tablet_copy_client.cc:806] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.526377 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:13.524430 21321 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:13.527657 22654 tablet_copy_client.cc:670] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:13.529080 22575 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.531028 22575 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:13.531872 22575 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:13.551733 22654 tablet_copy_client.cc:538] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:13.591543 21219 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.636109 22658 ts_tablet_manager.cc:933] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:13.640378 21391 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:13.644366 22636 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:13.649505 21321 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:13.654698 22654 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:13.658129 22664 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:10:13.680528 22658 tablet_copy_client.cc:323] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:10:13.682399 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet f384b96e64eb4aa9a99fd8372643b01c from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:10:13.682942 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet f384b96e64eb4aa9a99fd8372643b01c from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-f384b96e64eb4aa9a99fd8372643b01c
I20260709 13:10:13.699486 21391 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:13.701182 22512 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:13.719750 21406 tablet_copy_source_session.cc:215] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.721207 22667 ts_tablet_manager.cc:933] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:13.724332 22658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f384b96e64eb4aa9a99fd8372643b01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.725389 22667 tablet_copy_client.cc:323] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:10:13.740515 22658 tablet_copy_client.cc:806] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.741218 22658 tablet_copy_client.cc:670] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
W20260709 13:10:13.775015 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51976.7us
I20260709 13:10:13.780490 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:10:13.781724 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 91e50669ee6e496d9e5aaf0b2cc43c1c from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-91e50669ee6e496d9e5aaf0b2cc43c1c
I20260709 13:10:13.836460 21406 tablet_copy_source_session.cc:215] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.875007 22654 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:10:13.903322 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 53049.3us
I20260709 13:10:13.896325 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:13.910570 22654 tablet_bootstrap.cc:492] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:13.912905 21312 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:13.920532 22654 ts_tablet_manager.cc:1403] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.266s	user 0.029s	sys 0.005s
I20260709 13:10:13.932976 22515 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:13.971350 22654 raft_consensus.cc:359] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:13.972632 22654 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:13.973484 22654 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:13.975656 22654 ts_tablet_manager.cc:1434] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:10:13.990358 22667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.064319 22040 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:14.085027 22658 tablet_copy_client.cc:538] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:14.093253 22678 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:10:14.096168 21464 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:14.098799 21390 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:14.100108 22041 raft_consensus.cc:1217] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:14.122016 22686 ts_tablet_manager.cc:933] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
I20260709 13:10:14.147238 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-077d2ef89a5347dc8b8e863085f1d4e2 received from {username='slave'} at 127.0.0.1:59692
I20260709 13:10:14.147871 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-077d2ef89a5347dc8b8e863085f1d4e2 on tablet 077d2ef89a5347dc8b8e863085f1d4e2 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:14.175989 22682 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:10:14.202090 22658 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:14.224887 22039 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:14.229118 22679 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:14.229997 22508 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 13:10:14.257704 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 56756.2us
W20260709 13:10:14.293735 22690 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:14.304455 22686 tablet_copy_client.cc:323] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.193:45701
I20260709 13:10:14.313324 21331 tablet_copy_service.cc:140] P 058db415e9884ea0ba23f1e1ff59127a: Received BeginTabletCopySession request for tablet 4a81f5eab37044228b941f7eb2be5912 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:33484)
I20260709 13:10:14.313899 21331 tablet_copy_service.cc:161] P 058db415e9884ea0ba23f1e1ff59127a: Beginning new tablet copy session on tablet 4a81f5eab37044228b941f7eb2be5912 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:33484: session id = bfcd9560f8f44414b25f8069384c5a73-4a81f5eab37044228b941f7eb2be5912
I20260709 13:10:14.328263 22667 tablet_copy_client.cc:806] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:14.328971 22667 tablet_copy_client.cc:670] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:14.341740 22667 tablet_copy_client.cc:538] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:14.369014 21331 tablet_copy_source_session.cc:215] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:14.384855 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.430444 22686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a81f5eab37044228b941f7eb2be5912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.437110 22555 raft_consensus.cc:1064] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:14.446900 22555 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:14.473342 22658 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.474442 22658 tablet_bootstrap.cc:492] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:14.475193 22658 ts_tablet_manager.cc:1403] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.273s	user 0.029s	sys 0.018s
I20260709 13:10:14.497058 22042 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:14.497553 21470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904858d649144d589875f088692f104f"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:14.498245 21470 raft_consensus.cc:606] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:14.509023 21312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:14.509618 21312 raft_consensus.cc:606] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Received request to transfer leadership to TS d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:14.511411 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:14.513037 22662 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:14.514442 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:14.515389 21394 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:14.518165 22667 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:14.519408 22662 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.522678 22658 raft_consensus.cc:359] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:14.530771 22658 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:14.531599 22658 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:14.533567 21320 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:14.539178 22662 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:14.545822 22658 ts_tablet_manager.cc:1434] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 13:10:14.549971 22686 tablet_copy_client.cc:806] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:14.553170 22686 tablet_copy_client.cc:670] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:14.556850 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-f384b96e64eb4aa9a99fd8372643b01c received from {username='slave'} at 127.0.0.1:36486
I20260709 13:10:14.557382 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-f384b96e64eb4aa9a99fd8372643b01c on tablet f384b96e64eb4aa9a99fd8372643b01c with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:14.556978 22555 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:14.560004 22686 tablet_copy_client.cc:538] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:14.581108 22686 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:14.599238 21390 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:14.611461 21320 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:14.620872 21216 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 3 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.628826 22042 raft_consensus.cc:1217] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:14.608522 22039 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:14.644635 22662 raft_consensus.cc:993] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:14.645323 22662 raft_consensus.cc:1081] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:14.665107 21312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "904858d649144d589875f088692f104f"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:10:14.665882 21312 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.666731 21312 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.724877 22686 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.735464 22686 tablet_bootstrap.cc:492] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:14.736280 22686 ts_tablet_manager.cc:1403] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.155s	user 0.024s	sys 0.014s
I20260709 13:10:14.742726 22686 raft_consensus.cc:359] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:14.744879 22686 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:14.746706 22686 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:14.752936 21312 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:14.761839 22686 ts_tablet_manager.cc:1434] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:10:14.762718 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:14.763809 21331 tablet_copy_service.cc:342] P 058db415e9884ea0ba23f1e1ff59127a: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-4a81f5eab37044228b941f7eb2be5912 received from {username='slave'} at 127.0.0.1:33484
I20260709 13:10:14.764298 21331 tablet_copy_service.cc:434] P 058db415e9884ea0ba23f1e1ff59127a: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-4a81f5eab37044228b941f7eb2be5912 on tablet 4a81f5eab37044228b941f7eb2be5912 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:14.765645 21467 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.768512 21467 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:14.772666 21467 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:14.773610 21467 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.784507 21312 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:14.788956 21467 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:14.791093 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:14.791108 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:14.791697 22039 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.792307 22682 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.792814 22682 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:14.793696 22682 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:14.799386 22039 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:14.800403 22667 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.805240 22667 tablet_bootstrap.cc:492] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:14.806242 22667 ts_tablet_manager.cc:1403] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.288s	user 0.019s	sys 0.005s
I20260709 13:10:14.809803 22667 raft_consensus.cc:359] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:14.810737 22667 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:14.811472 22667 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:14.814471 22667 ts_tablet_manager.cc:1434] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:14.816169 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-91e50669ee6e496d9e5aaf0b2cc43c1c received from {username='slave'} at 127.0.0.1:36486
I20260709 13:10:14.816627 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-91e50669ee6e496d9e5aaf0b2cc43c1c on tablet 91e50669ee6e496d9e5aaf0b2cc43c1c with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:14.826668 21467 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:14.837437 22039 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:14.841288 22555 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:14.856463 22684 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:14.859040 21390 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:14.861977 22635 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:14.862015 22042 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:14.870524 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 077d2ef89a5347dc8b8e863085f1d4e2 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:14.882463 22676 raft_consensus.cc:993] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower d41c71e861344f0b90e8d44a8d0a3173 to start an election
I20260709 13:10:14.883013 22676 raft_consensus.cc:1081] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Signalling peer d41c71e861344f0b90e8d44a8d0a3173 to start an election
I20260709 13:10:14.885751 21390 raft_consensus.cc:2955] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:14.901578 21394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
 from {username='slave'} at 127.0.0.1:52946
I20260709 13:10:14.902189 21394 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.902503 21394 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.898293 21219 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.943627 21394 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:14.945248 21219 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 4 to 5, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.951812 21394 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:14.964546 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:14.965253 21312 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.965570 21312 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:14.966399 21312 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:14.969030 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet 077d2ef89a5347dc8b8e863085f1d4e2 with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45124
I20260709 13:10:14.985170 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:14.985836 22042 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.972433 21312 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.000624 22039 raft_consensus.cc:1217] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:15.010955 21312 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:15.017408 22042 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:15.019093 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:15.037976 22683 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.031518 22711 tablet_replica.cc:333] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:10:15.038540 22683 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:15.043589 22711 raft_consensus.cc:2243] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.043329 22683 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:15.044492 22711 raft_consensus.cc:2272] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.049767 22711 ts_tablet_manager.cc:1916] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:15.062515 21219 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 2 to 3, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.088214 22711 ts_tablet_manager.cc:1929] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:15.088795 22711 log.cc:1199] T 077d2ef89a5347dc8b8e863085f1d4e2 P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/077d2ef89a5347dc8b8e863085f1d4e2
I20260709 13:10:15.090902 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet 077d2ef89a5347dc8b8e863085f1d4e2 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:15.093008 22675 raft_consensus.cc:1064] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:15.095857 22675 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:15.115358 22042 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.117729 21467 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.117026 22675 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:15.119513 21314 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.121579 22675 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.122560 22683 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.161423 22692 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.165395 21467 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.176764 22042 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.186388 21312 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.194108 21215 catalog_manager.cc:5697] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.227087 21390 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:15.236064 22042 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.238294 22675 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:15.253681 22692 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.267498 21314 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.269368 22042 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.270005 22675 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.272594 22679 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.295962 21312 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.328351 22041 raft_consensus.cc:1217] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:15.328058 21219 catalog_manager.cc:5697] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.332629 22039 raft_consensus.cc:2955] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.347191 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet f384b96e64eb4aa9a99fd8372643b01c with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:10:15.359061 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f384b96e64eb4aa9a99fd8372643b01c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:15.362874 22723 tablet_replica.cc:333] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:10:15.367419 21466 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.369119 22682 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.370208 22723 raft_consensus.cc:2243] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.371134 22723 raft_consensus.cc:2272] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.375789 22723 ts_tablet_manager.cc:1916] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:15.418274 22723 ts_tablet_manager.cc:1929] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:15.418784 22723 log.cc:1199] T f384b96e64eb4aa9a99fd8372643b01c P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/f384b96e64eb4aa9a99fd8372643b01c
I20260709 13:10:15.421694 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet f384b96e64eb4aa9a99fd8372643b01c (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:15.490643 22039 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:15.492187 22692 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:15.511339 22508 raft_consensus.cc:1064] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:15.513736 22508 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:15.515455 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.535319 21466 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.540707 22039 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.545109 21392 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.564824 22508 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.568676 22676 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.569614 22679 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.599888 22729 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.616858 22039 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.619012 21312 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:15.629005 22720 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:15.634581 21218 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.649904 21395 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.654455 21314 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:15.661968 22039 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.666839 22679 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:15.673023 21395 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.681277 22682 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.684448 22039 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.692984 22679 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.696442 21206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a81f5eab37044228b941f7eb2be5912 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:15.706425 21218 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.731130 21455 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a81f5eab37044228b941f7eb2be5912 with delete_type TABLET_DATA_TOMBSTONED (TS 33be1cb5cfc143fc90e164888c96cc6f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56740
I20260709 13:10:15.749264 22716 raft_consensus.cc:1064] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:15.751869 22716 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:15.767611 21395 raft_consensus.cc:2955] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.774364 22042 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.776126 22675 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.778491 21312 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.780009 22718 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.799422 21463 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.807731 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.807689 22723 tablet_replica.cc:333] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:10:15.810101 22717 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.810698 22723 raft_consensus.cc:2243] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.811268 22723 pending_rounds.cc:70] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: Trying to abort 1 pending ops.
I20260709 13:10:15.811522 22723 pending_rounds.cc:77] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636313138860032 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "4a81f5eab37044228b941f7eb2be5912" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } } }
I20260709 13:10:15.847107 22723 raft_consensus.cc:2917] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:10:15.847613 22723 raft_consensus.cc:2889] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:15.848062 22723 raft_consensus.cc:2272] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.884348 22723 ts_tablet_manager.cc:1916] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:15.885645 22692 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.901351 22041 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.924522 21463 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.928414 21314 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:15.956892 21219 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 2 to 3, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.964735 21463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:15.965384 21463 raft_consensus.cc:606] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:15.968099 22723 ts_tablet_manager.cc:1929] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:15.968479 21317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904858d649144d589875f088692f104f"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:15.968525 22723 log.cc:1199] T 4a81f5eab37044228b941f7eb2be5912 P 33be1cb5cfc143fc90e164888c96cc6f: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/wals/4a81f5eab37044228b941f7eb2be5912
I20260709 13:10:15.969184 21317 raft_consensus.cc:606] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:15.970522 21204 catalog_manager.cc:5028] TS 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): tablet 4a81f5eab37044228b941f7eb2be5912 (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:15.973321 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:15.973862 21395 raft_consensus.cc:606] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:15.977162 21312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:15.978335 21312 raft_consensus.cc:606] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:15.979426 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:15.981003 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:15.981433 21395 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:15.999478 21464 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:16.005898 22717 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:16.009266 22039 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:16.016359 22692 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:16.025784 22720 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:16.031796 21463 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:16.033164 22041 raft_consensus.cc:2955] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:16.052261 21219 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 3 to 4, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New cstate: current_term: 1 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:16.063205 21306 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c with delete_type TABLET_DATA_TOMBSTONED (TS 058db415e9884ea0ba23f1e1ff59127a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45124
I20260709 13:10:16.064960 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 91e50669ee6e496d9e5aaf0b2cc43c1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:16.077775 22738 tablet_replica.cc:333] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:10:16.079043 22738 raft_consensus.cc:2243] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:16.080466 22738 raft_consensus.cc:2272] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:16.087852 22738 ts_tablet_manager.cc:1916] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:16.105983 22738 ts_tablet_manager.cc:1929] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:16.106459 22738 log.cc:1199] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 058db415e9884ea0ba23f1e1ff59127a: Deleting WAL directory at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/wals/91e50669ee6e496d9e5aaf0b2cc43c1c
I20260709 13:10:16.108561 21206 catalog_manager.cc:5028] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): tablet 91e50669ee6e496d9e5aaf0b2cc43c1c (table test-workload [id=e5d315cdd408479a84b8508fcc025e2e]) successfully deleted
I20260709 13:10:16.114952 22729 raft_consensus.cc:993] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower d41c71e861344f0b90e8d44a8d0a3173 to start an election
I20260709 13:10:16.115826 22682 raft_consensus.cc:1081] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer d41c71e861344f0b90e8d44a8d0a3173 to start an election
I20260709 13:10:16.117326 21395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
 from {username='slave'} at 127.0.0.1:52946
I20260709 13:10:16.117842 21395 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.118201 21395 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.123315 21395 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:16.125841 21395 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:16.126235 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:16.126713 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:16.127321 21463 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.126825 21314 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.128005 21314 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:16.128862 21314 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:16.129830 21314 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.134182 22508 raft_consensus.cc:993] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:16.134524 21463 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:16.134755 22508 raft_consensus.cc:1081] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:10:16.135879 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:16.136896 22720 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.137351 22720 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:16.138104 22720 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:16.138880 22041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "904858d649144d589875f088692f104f"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42344
I20260709 13:10:16.139448 22041 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.139791 22041 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.149295 22041 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:16.155809 21314 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:16.161594 21218 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.169220 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:16.169863 21464 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.174155 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:16.174758 21312 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:16.175073 21312 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:16.175261 22041 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:16.175779 21312 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:16.177016 21312 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.180354 21464 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:16.181620 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:16.182456 22689 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:16.182967 22689 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:16.183360 22555 raft_consensus.cc:993] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:16.183799 22555 raft_consensus.cc:1081] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:16.183944 22689 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:16.185559 21312 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:16.188148 21312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:10:16.188917 21312 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.189304 21312 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.196491 21219 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 2 to 3, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 3 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.205389 21312 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:16.209630 21312 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:16.209789 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:16.210439 22041 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.211272 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:16.211810 21464 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.212123 21464 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:16.212852 21464 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:16.215698 21464 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.216997 22041 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:16.218498 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:16.219759 22729 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.220291 22729 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:16.221196 22729 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:16.222693 21464 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:16.232474 21219 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.863587 22743 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:17.866890 22743 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:17.878207 22743 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:17.874408 22744 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:17.879261 22744 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:17.882442 22744 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:17.866930 22741 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:17.883570 22749 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:17.891448 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.894158 22751 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:17.957090 22753 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:17.957778 22753 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:17.960760 22753 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:17.966663 22741 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:17.966429 22751 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:17.978086 22751 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:17.963548 22749 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:17.982142 22746 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.004901 22745 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.041872 22751 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.050105 22751 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.055532 22756 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.056214 22756 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.043220 22742 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.007424 22746 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.099296 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.058588 22764 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.059284 22748 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.066910 22766 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.046396 22745 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.151528 22750 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.152333 22750 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.148649 22764 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.155089 22750 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.156383 22764 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.169109 22771 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.169122 22769 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.169857 22771 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.170071 22769 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.168093 22752 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.172675 22752 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.173425 22746 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.164780 22741 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.176643 22749 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.178180 22749 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.178735 22749 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.163386 22768 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.180727 22768 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.130578 22767 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.146946 22742 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.150543 22748 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.175133 22752 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.163316 22753 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.220839 22753 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.222126 22748 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.148967 22766 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.223317 22753 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.214536 22745 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.225301 22766 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.227054 22749 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.229357 22742 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.230314 22759 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.155767 22750 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.215969 22767 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.230965 22759 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.235054 22759 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.238070 22767 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.240419 22768 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.244959 22771 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.218400 22764 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.246083 22764 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.231384 22750 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.255899 22750 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.266297 22764 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.295014 22774 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.297778 22769 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.302358 22771 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.303192 22771 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.305866 22771 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.306565 22771 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.307229 22771 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.309929 22771 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.316524 22767 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.375275 22767 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.376308 22772 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.376822 22772 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.378165 22767 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.317342 22764 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.378865 22772 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.379552 22772 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.379256 22764 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.380023 22772 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.318063 22759 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.380986 22759 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.381927 22772 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.383093 22759 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.318918 22762 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.319746 22754 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.320495 22741 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.321115 22746 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.295722 22774 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.353092 22765 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.359979 22780 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.364164 22766 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.365477 22748 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.370846 22750 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.372509 22745 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.373113 22752 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.373827 22769 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.383853 22762 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.396718 22753 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.397529 22768 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.407243 21312 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:18.411116 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.400527 22759 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.420610 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.451190 21394 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:18.400709 22741 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.411970 22745 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.454321 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.454501 22776 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.412326 22767 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.410080 22771 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.400857 22746 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.393375 22754 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.403928 22765 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.459661 22774 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.462320 22760 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.412151 22752 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.410446 22750 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.455116 22776 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.415132 22769 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.454378 22763 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.482561 22751 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.416586 22748 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.487035 22770 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.462803 22745 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.418437 22768 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.406102 22780 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.416476 22753 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.412521 22766 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.471666 22774 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.485596 22749 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.485373 22742 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.462018 22759 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.461330 22767 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.503551 22745 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.505200 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.506033 22788 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.506102 22755 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.506150 22781 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.521975 22781 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:18.507783 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57154us
I20260709 13:10:18.508467 22790 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.508352 22787 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.468263 22771 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.487053 22775 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.497375 22761 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.496392 22764 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.539424 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:18.546492 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.547142 21394 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:18.535151 22781 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.538100 22795 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.521288 22774 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.524858 22745 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.549578 22762 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.524933 22786 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.513517 22749 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.528136 22742 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.547839 22779 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.494009 22760 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.560474 22777 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.497833 22763 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.545324 22755 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.588549 22753 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.594862 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.549721 22790 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.553579 22775 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.554021 22787 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.611964 22752 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.550691 22788 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.605587 22773 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.595136 22746 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.514984 22770 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.611037 22748 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.611159 22791 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:18.595948 22762 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.611903 22765 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.601882 22784 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.619580 21312 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.610584 22776 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.602828 22741 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.623531 22785 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.623879 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.572156 22795 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.616015 22768 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.624418 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.616394 22745 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.617195 22752 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.622959 22780 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.637943 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.554834 22761 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.614648 22778 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:18.616750 22750 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.615301 22792 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.677067 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.604477 22786 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.677932 22771 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.711583 22754 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.728073 21312 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:18.724571 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.635226 22766 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.710161 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.630874 22791 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.710716 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.688457 22752 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.773074 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.774156 22752 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.774647 22752 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.771202 21319 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:18.768313 21321 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
W20260709 13:10:18.776638 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 237263us
I20260709 13:10:18.629796 22762 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.706537 22747 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.613227 22777 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.633987 22793 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.715839 22767 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.781411 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.634060 22796 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.783216 21317 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:18.709278 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.785486 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.772289 22791 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:18.778780 22759 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.790346 21391 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:18.777395 22753 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.791983 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.781905 22744 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.799726 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.779085 22792 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.803956 22792 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.805382 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.786612 22745 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.810295 22745 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.810717 22783 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.625886 22773 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.788923 22776 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.788663 22749 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.605937 22779 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.795202 22742 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.779628 22752 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.800647 22774 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.822805 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.677488 22785 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.636138 22784 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.790776 22793 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.817521 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.812573 22744 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.831562 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.833406 21392 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:18.823387 22787 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:18.837311 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.816076 22753 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.787853 22747 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.844358 22787 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.845713 22801 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.845986 22802 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.778388 22778 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.818629 22776 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.796325 22796 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.864655 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.865259 21321 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:18.830093 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.836620 22780 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:18.811244 22783 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:18.846267 22786 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.826870 22798 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.874557 22745 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.866665 22770 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.876824 22761 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.866878 22763 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.877552 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.884614 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.885187 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.879865 22773 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.879880 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.880889 22779 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.887741 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:18.880950 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.888306 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.881860 22788 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.882632 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.883430 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.889317 21319 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:18.889348 21321 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:18.848212 22787 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.875118 22762 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.871260 22755 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.872056 22795 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.878451 22760 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.903578 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:18.898677 22790 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.871436 22780 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.895957 22741 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:10:18.896816 21313 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:18.896973 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.909274 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:18.846377 22801 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.904361 22795 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.908108 22775 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.912619 22762 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:18.912304 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.925613 21315 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:18.923338 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:18.930902 22785 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.926478 22753 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.846521 22802 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.936424 21313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40320a19af04e62afc637834ab759b2"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:18.933516 21362 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:18.919337 22777 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.926692 22754 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:18.926846 22752 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.925097 22762 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.942119 22797 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.933948 22774 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:18.954675 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:18.959646 22784 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.896390 22798 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.960435 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:18.937069 21313 raft_consensus.cc:606] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:18.940104 22759 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:18.935011 22793 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.932061 22795 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:18.958638 22762 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.977982 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:18.978953 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.943673 22754 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.968079 22774 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.985044 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:18.988467 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 128386us
I20260709 13:10:18.943411 22778 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:18.976490 22765 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:18.994390 22767 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:18.994837 22767 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:18.995002 22802 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.995187 22767 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:18.996999 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:18.977597 22776 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:18.976718 22759 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:18.983059 22754 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:18.970157 22804 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.989346 22774 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.041101 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:18.992789 22752 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:18.977751 22796 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:18.981098 22801 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.051970 22752 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.000293 22790 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.048768 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.002478 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:18.998468 22765 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:19.031248 22759 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.106959 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.103453 21464 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
W20260709 13:10:19.102810 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49159.7us
I20260709 13:10:18.975533 22797 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.108480 22801 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:19.051772 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.058423 22795 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.055353 22792 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.057086 22752 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.120352 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.121579 21463 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:19.107604 22753 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.107005 22765 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.052140 22804 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.111441 22803 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.111733 22780 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.128129 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.128523 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.112790 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.130360 22041 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:19.131400 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.104527 22790 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.135043 22776 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.138991 22039 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:19.140247 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.115097 22747 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.113225 22801 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.140770 22039 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:19.133697 22803 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:19.152395 22808 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.155891 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.156610 21463 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:19.127346 22753 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.127067 22792 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.164251 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.159442 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.166078 22040 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:19.155926 22803 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.169513 22790 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:19.169661 22804 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.140733 22776 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.160851 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.154901 22791 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.167590 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.155068 22808 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.200770 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.165411 22792 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:19.162264 22769 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:19.179935 21470 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:19.167829 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.180540 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.203915 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.209745 22040 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:19.205530 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.209005 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.202270 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.212334 21466 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:19.215622 22036 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:19.216111 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.220871 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.221451 22801 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:19.247377 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.259568 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.261158 21469 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:19.246619 21462 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.266728 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.235718 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.268762 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.253949 22776 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.213200 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.273944 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.275053 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.275635 21312 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:19.276473 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.279134 22798 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.279812 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.278831 22762 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.276974 21312 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:19.221957 22797 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.232198 22808 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:19.252606 22756 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.267566 22754 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.270678 22767 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.280819 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.293424 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.293810 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.291924 22791 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.295226 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.271657 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.296417 22753 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.296979 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.297797 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.298328 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.300474 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.301748 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.299835 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.298448 22034 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:19.304507 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:19.307729 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.013s	sys 0.011s
W20260709 13:10:19.308187 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.014s	sys 0.011s
I20260709 13:10:19.308342 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.309114 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.270053 22803 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.297829 22754 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.315116 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.321985 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.322595 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.318944 22042 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:19.324010 22039 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:19.308321 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.317579 22792 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.317704 22761 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.324787 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.334437 22792 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.318940 22808 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.336162 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.338135 22792 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.339504 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.340178 22783 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.341463 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.377305 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.378014 21313 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:19.378291 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.379204 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.379382 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.379819 21390 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:19.342298 22761 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.380707 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.381659 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:19.381821 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.382236 22761 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.344022 22803 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.323829 22767 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.344761 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.382777 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.382956 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.383265 21466 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:19.384097 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.384626 21466 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:19.384820 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.385414 21321 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.344907 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:19.387292 22811 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:10:19.387199 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.388011 21396 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 2: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:19.388804 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.320675 22776 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.389564 22776 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.319149 22800 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.390069 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.390560 22800 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.391144 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.348996 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.392416 22776 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:19.339645 22765 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.393656 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:19.351167 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.394712 22765 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.395386 22765 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.343899 22752 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.395696 22765 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:19.383882 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.396929 22765 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.397219 22752 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:19.397792 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:19.399740 22031 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:19.354902 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.355602 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.387212 22759 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.401659 21387 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:19.392920 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:19.402390 21388 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.356540 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.402907 22759 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.403092 21470 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:19.352766 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.357231 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.360855 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.363195 22744 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.363758 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.394771 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:19.409123 21464 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:19.409291 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.408463 21468 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:19.359555 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.374496 22787 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:19.375365 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.411440 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:19.411696 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.412278 21391 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:19.376936 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.385351 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.413620 22782 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.413789 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.414044 22782 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:19.414149 22788 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:19.414400 22782 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.414573 22788 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:19.388798 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.351004 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.345971 22762 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.392874 22800 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.352294 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.395704 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.396503 21320 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:19.353312 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.403679 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.357950 22774 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.410369 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.415318 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:19.416184 21390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:19.418613 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.424837 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.415030 22788 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.373859 22808 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.427400 21394 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.433045 21390 raft_consensus.cc:606] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:19.434222 22774 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.437139 21394 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:19.437425 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.446100 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.446774 21391 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.447875 22808 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.448173 22768 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.450487 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.450568 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:19.452864 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.454520 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:19.455566 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.459333 21321 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:19.461038 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.462064 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.462355 22786 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:19.462728 22786 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:19.463080 22786 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.463008 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.465332 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:19.467839 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.468317 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.468518 21321 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:19.464188 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.464203 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:19.472661 21387 raft_consensus.cc:606] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:19.474457 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:19.464335 22752 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:10:19.476011 22787 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:19.476392 22787 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:19.476653 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.477527 21313 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.477236 22787 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.477698 22786 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.478504 22787 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.464468 22808 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.482254 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.484122 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.485090 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.485306 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.480495 22754 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.482582 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.489221 21388 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:19.499377 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.510711 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:19.512127 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.512773 21462 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:19.512797 21465 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.513321 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.514111 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.501564 21314 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:19.502207 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.504858 22754 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:19.513676 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.525147 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.509979 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.499886 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.509210 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.507459 22782 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.530273 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.531283 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.531736 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.529107 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.529032 22754 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.529537 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.530269 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.527518 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:19.538996 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.539114 21464 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:19.538108 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.540371 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.542678 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.543933 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.545341 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.547398 22752 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.548182 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.510715 22786 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:19.548956 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.550105 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.558871 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.564595 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.566227 21396 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:19.566309 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.566622 21387 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:19.567595 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.567744 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.568425 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.556596 22752 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:19.569972 21395 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:19.572345 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.573770 21391 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:19.575222 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:19.575465 21389 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:19.546844 22782 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.526265 22765 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.576680 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.584128 21463 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:19.582613 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.582496 22752 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.587603 21436 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:19.589011 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.590926 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:19.583913 22803 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:19.592643 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:19.593694 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.594611 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.595430 21321 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:19.596287 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:19.597688 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.598608 22768 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.599648 22776 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.599972 22776 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:19.601701 21388 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:19.603905 21313 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:19.605116 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.615249 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.615423 21320 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:19.615636 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.590737 22786 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.590497 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.616285 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.616695 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:19.610865 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800307060 after lost signal to thread 20202
I20260709 13:10:19.616688 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.617389 22031 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
W20260709 13:10:19.618075 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800307740 after lost signal to thread 21253
I20260709 13:10:19.618448 22745 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.618861 22745 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.619186 22745 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:19.619292 22063 debug-util.cc:398] Leaking SignalData structure 0x7b080032ca00 after lost signal to thread 21345
I20260709 13:10:19.620973 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:19.621085 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.613790 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:19.619736 22801 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:10:19.626255 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.596653 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:19.626437 22798 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:19.629251 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.631258 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:19.630671 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:19.633894 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:19.616911 22786 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.632400 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.607133 22803 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:19.625339 22756 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.636013 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.636168 22741 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:19.634603 22786 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.642923 22798 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.643004 21388 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:19.643396 22798 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.643795 22798 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.634474 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.644562 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.645265 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:19.640506 22746 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.646363 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:19.646526 21362 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:19.647635 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:19.642038 22063 debug-util.cc:398] Leaking SignalData structure 0x7b080036dbc0 after lost signal to thread 21420
I20260709 13:10:19.628013 22809 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.639070 22772 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.652820 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.652276 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:19.655301 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.647274 22746 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.647933 22812 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.657733 22746 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.648856 21465 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:19.658219 22774 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:19.665242 21360 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:19.664736 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.666110 21470 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:19.661530 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.666793 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:19.646343 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:19.647315 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:19.656175 22791 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.669426 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.670128 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.655349 22801 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:19.672668 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:19.650669 22741 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:10:19.656817 22756 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:19.657060 22747 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.656635 22772 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.658978 22769 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:19.681314 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:19.683051 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.688972 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.674486 22755 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:19.675275 22801 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.679606 22762 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.673949 22791 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.711413 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:19.676116 22808 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.685070 22763 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:19.737113 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:19.688617 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800061e20 after lost signal to thread 21494
I20260709 13:10:19.739823 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.688457 22772 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.735746 22801 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.743659 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.692633 22761 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:19.748198 22761 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.748656 22761 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.691452 22765 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.750787 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:19.688601 22769 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.694628 22756 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:19.694932 22792 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.759258 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.761006 22777 raft_consensus.cc:993] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:19.796413 22777 raft_consensus.cc:1081] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:10:19.796415 22792 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.809333 22776 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.810179 21318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45126
I20260709 13:10:19.810796 22776 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.811961 21318 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.814275 21318 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.816713 21218 catalog_manager.cc:5697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.825057 22798 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.808023 22792 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:19.740155 22791 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.753922 22757 raft_consensus.cc:993] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:19.745148 22753 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.744676 22790 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:19.838340 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 149463us
W20260709 13:10:19.840853 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 167311us
I20260709 13:10:19.769405 22769 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.789263 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:19.848781 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.783707 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800340de0 after lost signal to thread 22066
I20260709 13:10:19.779892 22755 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:19.789211 22768 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:19.782665 22808 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:19.849985 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61404.1us
I20260709 13:10:19.850266 22822 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:19.850370 22808 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.850678 22822 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:19.741573 22763 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.851384 22763 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.851779 22822 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.853358 22822 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.686714 22793 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:10:19.680366 22803 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.841739 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:19.850917 22808 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.792424 22779 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.858585 21321 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:19.869102 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:19.802773 22788 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.876590 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.830178 22792 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.832448 22753 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.880295 22753 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.866674 22817 raft_consensus.cc:1081] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:19.891851 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:19.865154 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800354020 after lost signal to thread 22067
W20260709 13:10:19.899748 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 247192us
I20260709 13:10:19.899825 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:19.891600 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.902767 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:19.904690 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 116414us
I20260709 13:10:19.905383 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.877961 22759 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.908938 22042 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:19.889025 22798 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.891906 22790 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.909778 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.889393 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:19.856235 22745 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:19.880491 22756 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.918164 21318 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.901927 22778 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:19.903896 22741 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.912595 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:19.911506 21388 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:19.909114 22762 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:19.913187 22783 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:19.920379 22782 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.932420 22823 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.933126 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.913228 22790 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:19.937954 22790 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:19.940924 21318 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:19.922394 22778 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:19.946919 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.933192 22742 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:19.955227 22742 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:19.955636 22742 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.961236 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:19.962495 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:19.945955 22790 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.949266 22778 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.943750 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.949944 22825 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.969107 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:19.966682 22783 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:19.964727 22798 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:10:19.964886 22797 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:19.966696 22781 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:20.006809 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:20.002820 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.016433 22753 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:20.032661 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 65191.9us
I20260709 13:10:20.034652 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.035662 22745 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.035880 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.035697 22830 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.037315 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.037413 22830 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:19.969174 22820 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:10:20.012835 22783 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:20.046020 22783 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:20.043809 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.047948 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.021529 22781 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:20.049535 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.042500 22830 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.060344 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.056649 22781 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.040838 22788 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:20.072836 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 165888us
I20260709 13:10:20.057406 22753 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:20.111431 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 208718us
I20260709 13:10:20.112179 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.112583 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:20.113186 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 207860us
I20260709 13:10:20.015136 22824 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:10:20.118299 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.119704 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.119578 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.122951 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.124351 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.124788 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.126451 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.127504 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.119968 22788 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.176690 22793 raft_consensus.cc:993] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:20.177285 22793 raft_consensus.cc:1081] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:20.124007 22755 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.179924 22755 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.183066 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.125581 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.189528 22833 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:20.197154 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 71681.5us
W20260709 13:10:20.198690 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 71239.9us
I20260709 13:10:20.199318 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:10:20.200456 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 75726.3us
I20260709 13:10:20.201421 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.202796 22768 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.202773 22821 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:20.204353 22834 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.204581 22768 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.198432 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.205137 22768 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:20.206177 22833 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:20.206142 22768 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.207469 22768 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.208230 22820 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.210421 22820 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:20.211642 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.212278 22755 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:20.212145 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 87869.3us
I20260709 13:10:20.216585 22755 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:20.217032 21433 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.217458 22755 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.218652 22755 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.218791 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:20.221619 21284 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1adedb939e97489f9d96abf3bff7f1bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.222652 22833 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:20.223070 22768 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.223194 22820 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:20.235541 22820 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:20.233055 22777 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.234992 22833 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:20.234141 22778 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.236177 22820 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.236506 22833 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:20.246999 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.247570 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.248559 21393 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.235894 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.238972 22041 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:20.250408 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.117017 22763 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.183066 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.255929 22797 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:20.256402 22797 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:20.256760 22797 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:20.260979 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 133518us
W20260709 13:10:20.260979 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 61732.3us
I20260709 13:10:20.262861 21390 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.275665 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.275156 21390 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.266172 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.278302 22778 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.198360 22782 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.255404 22824 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:20.289997 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.290864 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.251837 22744 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.279171 22812 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:10:20.295204 22825 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.295179 22817 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.307003 22832 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:20.279073 22765 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:20.302407 21388 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.307672 22832 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.307770 22765 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:20.309443 22765 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.309916 22832 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.302618 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.316175 21388 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.316545 22834 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:10:20.322824 22791 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.325485 22791 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:20.325809 22772 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.006s
I20260709 13:10:20.322780 22765 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.326983 22753 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.327428 22753 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:20.328294 22753 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.329597 22753 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.330585 22765 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:20.331756 22761 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.000s
I20260709 13:10:20.333926 22781 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.303227 22829 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.272475 22777 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.336707 21389 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:20.325809 22746 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.003s
W20260709 13:10:20.338852 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 296572us
W20260709 13:10:20.341519 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 148148us
I20260709 13:10:20.348461 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:20.336944 22776 consensus_meta.cc:287] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.005s
I20260709 13:10:20.289391 22824 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:20.348495 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:20.351347 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 132649us
I20260709 13:10:20.352658 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.354022 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.354818 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:20.360205 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:20.361407 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46157.5us
I20260709 13:10:20.326313 22772 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.345516 22791 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:20.375955 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 86029.2us
I20260709 13:10:20.348930 22832 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.368485 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.370275 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:20.354264 22824 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.381646 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.383011 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.362618 22798 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:20.363144 22786 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.000s
I20260709 13:10:20.344790 22761 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.363073 22812 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:20.349581 22803 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:20.389727 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.390172 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.393478 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.378584 22793 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:20.351742 22746 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.374895 22823 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:20.393375 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 102596us
I20260709 13:10:20.396344 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.362957 22835 raft_consensus.cc:2764] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:20.423041 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.423447 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.381794 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.397559 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.368114 22842 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:20.424136 22757 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.431074 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:20.412945 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 57258us
I20260709 13:10:20.438205 21467 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.426225 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.388474 22798 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:20.395148 22776 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.427518 22744 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:20.439215 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.429603 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.395419 22755 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.391089 22812 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:20.428707 22741 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.446422 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:20.435866 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.395314 22793 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.447155 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:20.424151 22817 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.422132 22779 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.394680 22786 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.452956 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.453416 22781 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.454260 21315 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.454797 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.455329 21468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56746
W20260709 13:10:19.853168 22800 consensus_queue.cc:1175] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "058db415e9884ea0ba23f1e1ff59127a" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:20.458954 22761 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:20.539031 22745 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:20.539460 22745 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:20.540431 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.460672 21387 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.460780 22783 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.462466 22746 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.549161 22820 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.549726 22783 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:20.462641 22801 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.715s	user 0.007s	sys 0.007s
I20260709 13:10:20.395762 22756 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.466321 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.526234 22793 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.394529 22791 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:10:20.489852 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.468361 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.553841 22772 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.554548 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.554952 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:20.555192 21470 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:20.498191 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.486171 21317 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.556821 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.465257 22744 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:20.485193 22825 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:10:20.468200 22757 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.485865 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.447846 22752 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:20.523193 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.439049 22822 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.551602 22817 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:20.531622 22742 consensus_meta.cc:287] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.576s	user 0.004s	sys 0.005s
I20260709 13:10:20.491798 22833 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.467690 22835 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.467612 22837 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:20.583025 22837 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.583488 22837 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.583703 21468 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.452301 22798 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.518778 22812 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:20.551717 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 85468.9us
I20260709 13:10:20.562064 22772 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.587414 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.445639 21359 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.542047 22776 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:10:20.561175 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 120870us
I20260709 13:10:20.561710 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:20.531427 22792 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.001s
I20260709 13:10:20.563060 22752 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:20.555994 22801 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.566533 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.561371 22744 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.568445 22763 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:20.570640 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.571491 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.580399 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.584159 21468 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.584724 21470 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:20.544461 22840 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:20.603467 22769 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.006s
I20260709 13:10:20.598871 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.571990 22786 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:20.584599 22742 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.605679 22776 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.645761 22742 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.583989 22820 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.635892 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.646512 22776 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:20.635468 21388 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:20.614825 22787 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:20.602886 22817 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:20.606904 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 161410us
I20260709 13:10:20.615306 21464 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.634251 22797 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:20.590337 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 221950us
I20260709 13:10:20.618294 21469 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:20.654939 21317 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.637732 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:20.635082 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.639722 21319 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.657407 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.614600 22746 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.640218 21318 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.661163 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.664261 22800 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:20.664381 22752 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:20.637674 22808 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.003s
I20260709 13:10:20.670923 21470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a40320a19af04e62afc637834ab759b2"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56756
I20260709 13:10:20.607657 22756 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:10:20.673791 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.675376 21468 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.679896 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.681239 21470 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.685868 21470 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:20.687429 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 241458us
I20260709 13:10:20.692695 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:20.655382 22787 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:20.670922 22763 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:20.606329 22792 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:20.693135 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 94368.3us
I20260709 13:10:20.701975 22782 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.678826 22800 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.712267 21466 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.675253 22803 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.709025 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.709605 22818 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.710222 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.710793 22746 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:20.648208 22745 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.655903 22791 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:10:20.717777 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.699321 22822 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.674273 22769 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.708729 21462 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 3. Ops: []
I20260709 13:10:20.716956 22741 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:10:20.729781 21317 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:20.694218 22808 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.730028 21468 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.708768 22833 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.678169 22845 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.720788 22755 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:10:20.737908 22783 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.693761 22779 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:10:20.752735 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.734759 22803 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.742753 22754 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.722535 22767 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.744987 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.703100 22765 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:10:20.717880 22792 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.719435 22752 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:20.748872 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 71024.9us
I20260709 13:10:20.750528 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.712857 22763 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.742594 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.735005 22797 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.745217 22782 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.752370 22783 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:20.693423 22757 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:10:20.723982 22793 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.734457 22835 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:10:20.759013 21470 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.744691 22839 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:20.767467 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.767949 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.757793 21467 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:20.771983 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.770632 22782 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:20.791098 21464 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.787997 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:20.758332 22741 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:10:20.785015 22763 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:20.785141 22797 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.771164 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.788105 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:20.785683 22746 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:10:20.789260 22800 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:20.782191 22801 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.756999 22778 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:20.795059 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 121320us
I20260709 13:10:20.820921 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.821740 21316 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.795609 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.797859 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:20.810848 21470 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:20.777729 22791 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:20.789925 22793 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.773535 22837 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.828689 21466 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:20.775130 22824 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.794868 22842 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.790004 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:20.798440 22845 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.822171 21316 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:20.815145 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.830435 21463 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:20.800865 22797 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:20.832952 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:20.834474 21464 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.819814 22778 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:20.837378 21470 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.817202 22032 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.849361 21469 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:20.850327 21316 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.835620 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.858018 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:20.839622 22031 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:20.800637 22818 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:20.859416 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:20.859583 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:20.860117 22837 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.860239 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:20.863379 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.888005 22851 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:20.864102 21321 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.864284 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.836953 22772 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.866070 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:20.869529 21316 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.869668 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.894265 21317 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:20.871518 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:20.871716 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.897321 22797 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.848105 22782 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.899525 22797 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.899662 22782 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.902643 22824 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.906446 22798 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.906843 22782 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:20.908047 22782 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.908221 22041 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.908493 22782 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:20.909444 22782 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.872960 22778 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.910811 22798 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.873507 22808 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:20.876703 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.876363 22787 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.911607 22778 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.912147 22031 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:20.912511 22787 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.913252 22812 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.913686 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.914934 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:20.915230 22812 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.879730 22833 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.916486 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.916740 22833 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:20.917058 21396 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.917104 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.871645 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.917663 22833 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.918848 22833 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.917179 21392 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:20.908159 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.880537 22769 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:20.921337 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:20.922293 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.922765 21392 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.923120 21392 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:20.923228 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.923839 21392 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.924701 21392 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.924612 22762 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:20.928711 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:20.930402 22851 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:20.930855 22851 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:20.931757 22036 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.931643 22851 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.933000 21284 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.933117 21396 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:20.885432 22830 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.934388 22830 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:20.886838 22821 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:20.890242 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.936218 22821 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:20.895788 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:20.811861 22783 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:20.937085 21284 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.937307 22783 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.937207 22821 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.938633 22821 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.938786 22820 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.911394 22746 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.910811 22782 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.884665 21387 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:20.954394 21316 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:20.955098 21392 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:20.955461 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:20.939899 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.946938 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.950129 21318 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.960242 22040 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.960305 22841 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.962559 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:20.970263 22040 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.961494 21284 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.935462 22830 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:20.988276 22042 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.944819 22746 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:20.997915 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.952092 22745 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.944698 22824 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.951498 21387 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:21.024549 22039 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:20.958526 22755 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.020162 22822 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.996837 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:21.028898 22851 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.032351 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.965225 22808 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:20.958931 22792 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:10:20.956955 22781 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:10:21.039629 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:20.994865 22841 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:21.043696 22038 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:21.053755 21359 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:20.982041 22837 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:21.061640 21461 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.006s
I20260709 13:10:21.063036 22744 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.064505 22823 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:10:21.014192 22797 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:21.068239 22776 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:21.065246 22778 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:21.055017 22755 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:21.088665 22755 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.080470 21359 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:21.083163 22774 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:21.065984 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:20.980392 22817 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:10:21.113128 21314 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:21.079016 21461 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:21.094705 22778 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:21.124927 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:21.142995 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.120764 22774 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:21.166894 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:21.168962 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:21.175128 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:21.175354 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:21.177922 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:21.094009 22746 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.169034 22034 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 2: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:21.177023 22800 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.180876 21466 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:21.179862 22763 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.177281 22792 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.184696 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:21.184813 22759 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.188858 22759 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:21.189728 22759 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.175200 22762 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:10:21.193171 22762 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.193576 22762 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:21.195050 22783 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:21.195649 22783 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:21.186269 22756 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:10:21.196516 22783 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.200603 22779 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:21.200920 22757 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:21.201179 22779 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.202316 22757 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:21.202653 22757 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:21.203565 22779 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:21.204242 22744 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:21.205621 22833 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.197758 22783 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.206014 22833 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:21.213634 21387 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.206950 22833 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.225926 22824 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:21.226548 22824 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:21.226687 21388 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:21.229703 21466 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:21.214700 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.176666 22752 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:21.205644 22746 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.176276 22788 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:10:21.232420 22788 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.233144 22788 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.233440 22788 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:21.234262 22788 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.235575 22788 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.238190 22762 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.230716 22774 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.168674 22855 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.241132 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:21.251233 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:21.243075 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:21.259960 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.262426 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.248569 21468 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:21.266613 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:21.278314 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.036s	sys 0.031s
W20260709 13:10:21.320988 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.037s	sys 0.038s
W20260709 13:10:21.321435 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.323247 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56756.4us
I20260709 13:10:21.322487 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:21.326442 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:21.325356 22745 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:10:21.327544 22856 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:21.330618 22856 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:21.331100 22856 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:21.331574 21387 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.268659 22817 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:10:21.268599 22762 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.332017 22856 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.333321 22856 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:21.334692 22830 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.337294 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:21.338755 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:21.336115 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:21.340622 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:21.340713 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:21.227702 22824 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.339654 22793 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:21.336665 22745 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:21.355340 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:21.324848 22032 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:21.361016 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:21.363976 21314 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:21.337221 22834 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:21.339758 22783 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.365453 22041 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 3. Ops: []
I20260709 13:10:21.365387 22800 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:21.368227 22844 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:21.369009 22757 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.371793 22824 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.347755 22744 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:21.350402 22837 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:21.350735 22821 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.394495 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:21.396202 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:21.355810 22823 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:21.401619 21468 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:21.457602 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.468582 21463 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:21.478914 22861 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:10:21.480705 22793 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:21.481240 22793 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.483326 22837 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:21.485601 22821 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:21.486521 22821 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.486451 22841 raft_consensus.cc:2955] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:21.488513 21389 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:21.488653 22837 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.491294 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:21.502592 21462 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:21.483434 22793 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:21.374539 22852 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.146s
I20260709 13:10:21.508725 22777 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.509243 22777 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:21.510119 22777 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.477465 22761 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.512600 22757 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:21.512842 22844 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:21.492133 22823 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.524354 22797 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:21.550520 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:21.586752 22038 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:21.603648 22034 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
W20260709 13:10:21.610060 22863 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:21.615943 21466 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:21.552546 22797 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:21.620926 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.585469 22744 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:21.587345 22763 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.607842 22862 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:21.627717 22742 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:21.655436 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:21.660063 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 296193us
I20260709 13:10:21.661170 21467 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.664526 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:21.670205 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:21.676697 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.633572 22744 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.660827 22786 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.636090 22763 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:21.690577 22865 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:10:21.691016 22858 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.691494 22777 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:21.692871 22864 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:10:21.694130 22867 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:21.684343 22871 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.668883 22742 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.705184 22742 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:21.705708 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.658674 22797 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.709236 22797 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.709712 21218 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 283) took 2081 ms. Trace:
I20260709 13:10:21.639122 22844 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.712636 22786 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.714815 22786 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:21.691561 22858 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:21.710176 21218 rpcz_store.cc:276] 0709 13:10:19.628381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.628631 (+   250us) service_pool.cc:224] Handling call
0709 13:10:21.709624 (+2080993us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:20.055905 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:20.335358 (+279453us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:20.337891 (+  2533us) write_op.cc:435] Acquired schema lock
0709 13:10:20.339448 (+  1557us) tablet.cc:662] Decoding operations
0709 13:10:20.378236 (+ 38788us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:20.383123 (+  4887us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:20.387332 (+  4209us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:20.425755 (+ 38423us) tablet.cc:701] Row locks acquired
0709 13:10:20.429510 (+  3755us) write_op.cc:260] PREPARE: finished
0709 13:10:20.446711 (+ 17201us) write_op.cc:270] Start()
0709 13:10:20.465421 (+ 18710us) write_op.cc:276] Timestamp: P: 1783602620446670 usec, L: 0
0709 13:10:20.468108 (+  2687us) op_driver.cc:348] REPLICATION: starting
0709 13:10:20.555369 (+ 87261us) log.cc:844] Serialized 544 byte log entry
0709 13:10:20.729993 (+174624us) op_driver.cc:464] REPLICATION: finished
0709 13:10:21.278598 (+548605us) write_op.cc:301] APPLY: starting
0709 13:10:21.347631 (+ 69033us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:21.362303 (+ 14672us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:21.474607 (+112304us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:21.484209 (+  9602us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:21.484361 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:10:21.484413 (+    52us) write_op.cc:312] APPLY: finished
0709 13:10:21.484593 (+   180us) log.cc:844] Serialized 23 byte log entry
0709 13:10:21.484779 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:21.484872 (+    93us) write_op.cc:454] Released schema lock
0709 13:10:21.484908 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:21.485248 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:21.485281 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":184111,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":510032,"apply.run_cpu_time_us":10989,"apply.run_wall_time_us":236512,"num_ops":1,"prepare.queue_time_us":202433,"prepare.run_cpu_time_us":12533,"prepare.run_wall_time_us":570506,"raft.queue_time_us":96446,"raft.run_cpu_time_us":26069,"raft.run_wall_time_us":399733,"replication_time_us":261727,"thread_start_us":659493,"threads_started":4,"wal-append.queue_time_us":76216}]]}
I20260709 13:10:21.674324 22852 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:21.730749 22823 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:21.745289 21314 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.742964 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:21.764101 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:21.730856 22763 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:21.768669 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.770335 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.771832 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:21.772491 21393 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:21.775545 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:21.765023 21317 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:21.777089 21314 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:21.777701 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 107604us
I20260709 13:10:21.784541 21318 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:21.784791 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:21.786545 21318 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:21.787791 21319 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:21.789945 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:21.791173 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:21.791189 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:21.792491 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:21.792606 22858 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:21.796449 21467 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 2: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:10:21.791987 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.797147 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.798415 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:21.797147 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.799155 21312 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:21.780882 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:21.800202 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:21.800597 21390 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:21.801288 21317 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:21.783411 22822 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:21.801790 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:21.783533 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:21.806737 21316 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:21.779549 22800 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:10:21.797868 22781 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:21.806102 22822 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.809305 22879 ts_tablet_manager.cc:933] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
I20260709 13:10:21.809098 22781 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.809693 22822 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.813436 22820 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.814724 22820 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:21.815083 22820 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:21.816605 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.821861 21387 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:21.822526 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1220) took 1122 ms. Trace:
I20260709 13:10:21.824908 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:21.828676 22767 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:21.830849 21392 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:21.831962 22852 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:21.832445 22852 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:21.832861 22852 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.805760 22793 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:21.849637 21314 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.860009 21314 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.865239 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:21.867611 22849 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:21.874693 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:21.822849 21387 rpcz_store.cc:276] 0709 13:10:20.700582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.703433 (+  2851us) service_pool.cc:224] Handling call
0709 13:10:20.884534 (+181101us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b540030a0a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18fdc0 00007fc2bf21be18 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:21.213060 (+328526us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b540030a0a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf19606f 00007fc2bf20ef60 00007fc2bf2107de 00007fc2bf21c27c 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2
0709 13:10:21.330925 (+117865us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b58004502d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21c27c 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c
0709 13:10:21.822437 (+491512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506538112}
I20260709 13:10:21.877125 22787 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.946558 22879 tablet_copy_client.cc:323] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.193:45701
I20260709 13:10:21.891938 22757 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:10:21.869525 22820 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:21.900902 22841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33944 (request call id 6) took 3529 ms. Trace:
I20260709 13:10:21.949762 22752 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:21.956892 22830 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:10:21.943231 22787 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:10:21.965240 22833 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.832013 21461 raft_consensus.cc:2955] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:21.953923 22841 rpcz_store.cc:276] 0709 13:10:18.371797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.386276 (+ 14479us) service_pool.cc:224] Handling call
0709 13:10:18.456546 (+ 70270us) log.cc:844] Serialized 513 byte log entry
0709 13:10:21.900759 (+3444213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99513,"raft.run_cpu_time_us":2352,"raft.run_wall_time_us":50181,"thread_start_us":82762,"threads_started":3,"wal-append.queue_time_us":61550,"wal-append.run_cpu_time_us":1906,"wal-append.run_wall_time_us":1003864}
I20260709 13:10:21.964880 22781 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:22.032248 22872 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:10:22.046070 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 171477us
I20260709 13:10:22.052141 21388 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:22.063809 22787 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:22.073575 22822 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.078892 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:22.078979 22886 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.079625 21315 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.077190 22787 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:22.091377 22787 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.092394 22787 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.081275 21313 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:22.096400 22886 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.104856 22886 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:22.105484 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.106156 22744 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.108819 22820 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.118881 22822 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:22.129001 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:22.193519 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:22.143280 22842 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:22.147212 22871 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:22.225320 22850 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:22.225776 22850 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:22.211287 22754 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.228578 22754 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.234573 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.200742 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:22.244889 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:22.245852 21393 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:22.192823 22782 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:10:22.265673 21390 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.270021 21395 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.226612 22850 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.289304 22837 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:22.289122 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:22.324347 22837 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.325974 22787 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.326644 22837 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:22.326510 22787 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.327239 22757 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.327731 22757 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.328617 22787 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:22.297377 22034 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:10:22.306582 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.309340 21218 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.331668 21218 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 2 to 3, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 3 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.333285 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.242170 21315 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:22.238963 22774 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.292331 22808 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.336491 22808 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.315676 22777 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.294173 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:22.338410 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44295.3us
I20260709 13:10:22.338719 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:22.232941 22842 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:22.330025 22741 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.241544 22745 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.331820 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:22.362713 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:22.365337 21391 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
W20260709 13:10:22.359491 22870 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:10:22.271955 22871 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.365877 22754 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.373941 22844 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.375379 22842 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.345755 22849 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.337797 22777 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:22.344183 22759 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.393378 21314 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.363869 22800 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:22.382318 22852 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:10:22.360093 22756 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.351007 22788 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.371084 21387 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 2: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:22.391158 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:22.372779 22886 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:22.372714 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.359687 22822 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:22.396889 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.026s	sys 0.039s
W20260709 13:10:22.393507 22818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.010s	sys 0.104s
I20260709 13:10:22.360579 22774 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.389508 22850 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.406165 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:22.369352 22741 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.373072 22745 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.460621 22777 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.443923 22762 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.461320 22745 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.461491 22762 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.463099 22871 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.463467 22762 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.418764 22788 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.424679 21314 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:22.425143 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.026s	sys 0.039s
I20260709 13:10:22.416854 22756 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.425966 21313 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:22.431842 21464 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:22.391880 22844 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.423954 22886 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.441638 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:22.423535 22833 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.404477 22759 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.396401 22849 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.423480 22763 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.457496 22774 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:22.489156 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47748.1us
I20260709 13:10:22.459525 22741 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.416375 22800 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:22.411737 22852 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:22.470710 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 601007us
I20260709 13:10:22.480329 22762 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.444358 22818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.010s	sys 0.104s
I20260709 13:10:22.500442 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.503162 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.488188 22833 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:22.510478 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.483348 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.488907 22886 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.514295 21462 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.511325 22871 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:22.492799 22808 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:22.511109 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:22.527263 21396 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 2: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:22.528250 22759 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.526036 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:22.511273 22791 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:22.529003 22791 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.529392 22791 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.529938 22757 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.506451 22763 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.532472 22833 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:22.532760 22844 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:22.533071 22887 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:10:22.522651 22837 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:10:22.535629 22852 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:22.537650 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.537667 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1236) took 1132 ms. Trace:
I20260709 13:10:22.538389 21464 rpcz_store.cc:276] 0709 13:10:21.391221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.394148 (+  2927us) service_pool.cc:224] Handling call
0709 13:10:22.523712 (+1129564us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54003fa7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:22.523853 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107901184}
I20260709 13:10:22.547516 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:22.519598 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.511626 22762 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.536458 22871 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.569926 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:22.570463 21284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.017s	sys 0.039s
I20260709 13:10:22.576732 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.578456 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.579262 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.543926 22741 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.579937 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.542286 22823 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:22.583395 21284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.017s	sys 0.040s
I20260709 13:10:22.625000 21321 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:22.558485 22852 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:22.557137 22844 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:22.568531 22745 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.625052 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52643.6us
I20260709 13:10:22.664395 21321 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:22.665887 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.666558 21319 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:22.662495 21312 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
W20260709 13:10:22.683127 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 113272us
I20260709 13:10:22.686142 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:22.687011 22039 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:22.657755 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:22.657469 22765 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.696542 22763 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:22.696897 22788 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.660178 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:22.700829 22891 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:10:22.629107 21465 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
W20260709 13:10:22.703480 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 253964us
W20260709 13:10:22.884685 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.032s	sys 0.053s
I20260709 13:10:22.675648 22852 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:22.674257 22741 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.896725 22852 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.897774 22741 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.684602 22838 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.898702 22838 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.899433 22912 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.899830 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:22.899986 22912 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.900393 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.900583 21387 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:22.901167 22838 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:22.901618 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.901733 22838 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.767789 22901 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.902776 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.902696 22901 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.903591 21462 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:22.904704 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:22.905134 22901 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.768009 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 588) took 1062 ms. Trace:
W20260709 13:10:22.768998 22898 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:10:22.769449 22752 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:22.684506 21331 tablet_copy_service.cc:140] P 058db415e9884ea0ba23f1e1ff59127a: Received BeginTabletCopySession request for tablet 1adedb939e97489f9d96abf3bff7f1bd from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:33484)
I20260709 13:10:22.677973 22745 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.568737 22800 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.800426 22894 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:22.836576 22849 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:22.841490 22893 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
I20260709 13:10:22.781212 22823 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.861140 22896 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.861732 22906 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.873975 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:22.776329 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:22.885099 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.032s	sys 0.053s
I20260709 13:10:22.886320 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:22.932336 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58507us
W20260709 13:10:22.932690 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.932760 22039 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:22.933014 22909 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:22.887987 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.933526 22909 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.888840 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.889523 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.890108 22871 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:22.890391 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.934113 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:22.891304 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.907406 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.869009 22793 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.935209 22776 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:22.935381 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:22.935823 22776 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.935755 22793 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:22.936357 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 583618us
I20260709 13:10:22.869215 22765 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.937821 22793 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.921170 22752 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.557886 21389 raft_consensus.cc:2955] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:22.938558 22849 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:22.939077 22765 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.876677 22762 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:22.939327 22849 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.940438 22761 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.942155 22849 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:22.942479 22761 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.928506 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:22.945307 22765 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:22.945722 22765 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.946084 22765 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.944808 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:22.926836 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 231764us
I20260709 13:10:22.888159 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.933944 22909 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.934348 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.935150 21469 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:22.936436 22776 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.946950 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:22.960507 21360 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:22.928825 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 242829us
I20260709 13:10:22.963340 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:22.927031 21331 tablet_copy_service.cc:161] P 058db415e9884ea0ba23f1e1ff59127a: Beginning new tablet copy session on tablet 1adedb939e97489f9d96abf3bff7f1bd from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:33484: session id = bfcd9560f8f44414b25f8069384c5a73-1adedb939e97489f9d96abf3bff7f1bd
I20260709 13:10:22.956656 22906 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.964264 21461 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:22.966017 22906 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:22.966326 22762 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:22.966478 22906 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:22.966850 22762 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.966980 22906 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:22.968253 22778 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.968762 22782 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:22.968734 22778 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.963506 22788 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:22.969537 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.970193 21462 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:22.962028 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:22.970613 22912 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:22.971164 22912 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:22.972119 22917 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:22.972499 22906 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:22.972563 22917 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.973065 22917 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.905767 22038 rpcz_store.cc:276] 0709 13:10:21.705860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.731506 (+ 25646us) service_pool.cc:224] Handling call
0709 13:10:21.766559 (+ 35053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.230372 (+463813us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b180019ebe0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf210bfb 00007fc2bf21b64b 00007fc2bf217d8f
0709 13:10:22.692056 (+461684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.700151 (+  8095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.760343 (+ 60192us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:22.766960 (+  6617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.767774 (+   814us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.767921 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1317,"raft.queue_time_us":6522,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8568,"spinlock_wait_cycles":5590272,"thread_start_us":426999,"threads_started":1}
I20260709 13:10:22.974491 22034 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:22.975116 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:22.975759 21387 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:22.976783 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:22.977476 21393 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:22.973058 21468 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:22.951215 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:22.906742 22791 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:22.979667 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:22.980584 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:22.991058 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:22.991429 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:22.996387 21470 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
W20260709 13:10:22.991559 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 323827us
I20260709 13:10:23.014784 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:23.016315 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:23.001286 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:23.022742 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:22.902321 22838 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.027333 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:22.948560 22894 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:23.021123 22777 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:23.033535 21395 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:22.958177 22035 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:23.034456 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1393) took 1069 ms. Trace:
I20260709 13:10:23.014249 22856 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:23.028218 22849 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:22.978679 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:23.036064 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:23.053669 22886 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.517s	user 0.003s	sys 0.016s
I20260709 13:10:23.041858 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:23.013604 22906 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:23.047463 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:23.062832 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:23.063959 21391 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:23.037842 22820 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:23.046418 21316 rpcz_store.cc:276] 0709 13:10:21.960575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.960715 (+   140us) service_pool.cc:224] Handling call
0709 13:10:21.961791 (+  1076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.962101 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.962129 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.078114 (+115985us) spinlock_profiling.cc:243] Waited 884 us on lock 0x7b2c00014818. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:10:22.078620 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.404197 (+325577us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:22.404254 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.404711 (+   457us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.977979 (+573268us) raft_consensus.cc:1685] finished
0709 13:10:22.977997 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.029444 (+ 51447us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24511,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":13599,"spinlock_wait_cycles":2032896,"thread_start_us":309496,"threads_started":1,"wal-append.queue_time_us":424906}
I20260709 13:10:23.052740 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:23.053201 22745 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:22.998785 22761 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.020996 22793 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:23.057035 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 93782us
I20260709 13:10:23.026068 22871 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:23.041457 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:23.031595 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:23.111055 22911 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.112187 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:22.950426 22823 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.038085 22904 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:10:23.031636 22777 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.033229 22844 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:23.029870 22913 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:23.049463 22910 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:23.046566 22842 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.094485 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:23.061522 22783 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.057727 22856 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.949930 22896 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.063514 22886 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.053993 22902 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:23.057626 22849 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.100914 21396 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:23.166944 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:23.060914 21392 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:23.171120 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:23.062228 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:23.208585 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:23.182489 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 88125.8us
I20260709 13:10:23.210505 21394 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:23.187338 22856 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.066526 22852 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.065690 21465 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:23.111793 22911 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.102090 22761 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.113090 22820 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:23.192651 22916 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:23.066246 22906 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.182345 22777 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.113101 21391 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:23.219013 21394 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:23.219830 22918 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.220566 22890 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.221511 22039 raft_consensus.cc:2368] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:23.181356 22913 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.223686 22844 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.213197 22852 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.227927 22911 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.205215 22849 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.181166 22910 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:23.222007 22778 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:23.230460 22928 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.188877 22894 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.232084 22823 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:23.207849 22762 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.213491 22912 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:23.244798 22913 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.191166 22842 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.262774 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:23.287169 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 251583us
I20260709 13:10:23.297258 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:23.297968 21394 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.265457 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:23.268559 22911 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.268805 22910 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.188066 22783 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.286381 22895 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.229103 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:23.300714 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:23.265182 22844 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.310362 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:23.286137 22912 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:23.308251 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 79228.7us
I20260709 13:10:23.288450 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:23.286183 22791 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.267019 22890 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.319658 22921 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:23.305562 22838 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.204809 22902 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.315563 22912 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.264803 22918 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.313520 22034 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:23.309504 22911 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.321578 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:23.313889 22820 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.326854 22791 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.313076 22823 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.313727 22741 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:23.333139 22904 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.335249 22921 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.390705 22776 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.318625 22778 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.305440 22908 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.396353 21469 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:23.304479 22928 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.336345 22895 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.514532 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:23.515322 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:23.593269 22040 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
W20260709 13:10:23.535462 21359 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24db01a278af4a82a16f038fedabf4d3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.396394 21394 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:23.491815 21219 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 3 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:10:23.676960 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 141658us
I20260709 13:10:23.676116 21219 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 3, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 3 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.678367 21219 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 2 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.681245 21219 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 3, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:10:23.579845 21390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.015s	sys 0.042s
I20260709 13:10:23.404647 21313 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:10:23.684325 21390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.015s	sys 0.042s
W20260709 13:10:23.413636 22919 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:10:23.684980 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.028s	sys 0.029s
I20260709 13:10:23.722239 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:23.773015 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.028s	sys 0.031s
I20260709 13:10:23.779063 21219 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:10:23.780896 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:23.781703 21316 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:23.781015 21219 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:10:23.783577 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:23.517858 22909 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.006s
I20260709 13:10:23.785676 21321 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:23.516994 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:23.782958 21219 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: config changed from index -1 to 2, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 1 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:23.541067 22765 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.004s
I20260709 13:10:23.479633 22797 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:23.507092 22756 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:23.478574 22776 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:23.480365 22871 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:23.506827 22842 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.512518 22844 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.853806 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:23.522324 21331 tablet_copy_source_session.cc:215] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.401679 22777 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.413796 22908 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.472976 22890 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.577240 22856 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.531240 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:23.519889 22906 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.409098 22921 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.478214 22822 raft_consensus.cc:476] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:23.451462 22821 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:10:23.900460 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.018s
W20260709 13:10:24.004063 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.000s	sys 0.018s
I20260709 13:10:24.005285 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.005899 21469 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:23.411646 22904 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.007086 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:24.007642 21469 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.800872 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.008817 21468 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:23.906786 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.019s
W20260709 13:10:24.010010 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.000s	sys 0.020s
W20260709 13:10:23.833477 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 111363us
I20260709 13:10:23.548523 22752 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.531157 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:23.521353 22911 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.464848 22837 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:23.421754 22927 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:23.486824 22744 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.683588 22886 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.457206 22761 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.895721 22036 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:23.683352 22759 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:23.438598 22783 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.527994 22902 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.464937 22852 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.405951 22823 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.529593 22895 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:23.411182 22917 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.403019 22791 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.525525 22928 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.832899 22767 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.456138 22896 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.539546 22918 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:23.900132 22800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.010s	sys 0.006s
I20260709 13:10:23.413848 22778 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.786867 22858 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:23.777540 22850 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.942790 22793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.005s	sys 0.015s
I20260709 13:10:23.777913 22855 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.000821 22890 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:10:24.002197 22849 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.728s	user 0.005s	sys 0.006s
I20260709 13:10:23.959400 22842 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:23.578856 22910 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.994124 22838 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.908942 22797 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.952950 22871 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.866885 22909 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.022329 22822 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.010406 22821 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.041226 22924 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.965135 22914 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:10:24.119349 22916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.008s	sys 0.032s
W20260709 13:10:24.023792 22820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.011s	sys 0.005s
I20260709 13:10:24.233754 22778 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:24.135102 22800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.014s	sys 0.014s
W20260709 13:10:24.234578 22820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.012s	sys 0.006s
I20260709 13:10:24.235013 22797 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.236444 22791 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:23.946638 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:24.035974 22837 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:24.238277 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 291575us
W20260709 13:10:24.198773 21284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.008s	sys 0.007s
I20260709 13:10:23.961392 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:23.962677 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:24.240319 21284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.008s	sys 0.008s
I20260709 13:10:24.241250 21317 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:24.241914 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.242479 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.242743 22820 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:24.243217 22820 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.243467 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.037987 21387 raft_consensus.cc:2368] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:24.023845 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:24.203310 21287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.006s	sys 0.011s
I20260709 13:10:24.245287 21312 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
W20260709 13:10:24.245652 21287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.006s	sys 0.011s
I20260709 13:10:24.143129 22858 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.146697 22842 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.153594 22822 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:24.169545 22913 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.867s	user 0.011s	sys 0.000s
I20260709 13:10:24.014869 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:24.249411 22852 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.145445 22849 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.250464 22822 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.025193 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:24.165657 22931 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
W20260709 13:10:24.252007 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 226732us
I20260709 13:10:24.143838 22850 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:23.982435 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.002s	sys 0.012s
I20260709 13:10:24.253381 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:10:24.254226 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.003s	sys 0.012s
W20260709 13:10:24.024080 21360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.541s (SENT) [suppressed 2 similar messages]
I20260709 13:10:24.204212 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1387) took 1163 ms. Trace:
I20260709 13:10:24.255440 22932 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.202988 21388 raft_consensus.cc:2368] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:24.256759 22932 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.147636 22838 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.257808 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1390) took 1215 ms. Trace:
I20260709 13:10:23.959549 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:24.258616 22941 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.145644 22890 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.132975 22939 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.260515 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 300915us
I20260709 13:10:24.261066 22939 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.148497 22930 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:24.262871 21319 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:24.155022 22908 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.262805 22871 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.264003 22908 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.263638 22930 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.249445 22913 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:24.142338 22793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.005s	sys 0.015s
I20260709 13:10:24.265956 22793 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:23.940886 22765 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.229693 22777 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.267779 22793 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.268775 22777 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:24.269193 22777 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.269269 22910 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.019284 22774 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:24.041371 22911 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:10:24.270426 22856 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:23.896695 22746 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:24.270548 22774 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.272207 22911 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:24.272634 22940 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.273172 22821 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.273022 22911 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.273634 22774 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.273797 22821 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:24.273528 22940 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:23.877806 22757 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:24.200796 21331 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:33484 (request call id 175) took 1538 ms. Trace:
I20260709 13:10:24.275017 21331 rpcz_store.cc:276] 0709 13:10:22.662125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.674638 (+ 12513us) service_pool.cc:224] Handling call
0709 13:10:23.521983 (+847345us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b540035f0a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18fdc0 00007fc2bf2224a5 00007fc2bf2223ee 00007fc2c41b8036 00007fc2c41c1a3e 00007fc2bba8527b 00007fc2c41c19ba 00007fc2c41bcacc 00007fc2c41b7c7b 00007fc2c41ac8d1
0709 13:10:24.200375 (+678392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7034752}
I20260709 13:10:24.275583 22911 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.022017 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.275328 22757 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:23.494686 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.277109 21465 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:24.277254 21320 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:24.278344 22910 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.279069 21393 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:24.126233 22759 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.279188 22910 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.035817 22034 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 2: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:23.950099 21316 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.203140 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.258261 21392 rpcz_store.cc:276] 0709 13:10:23.042151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.206694 (+164543us) service_pool.cc:224] Handling call
0709 13:10:23.206995 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.211136 (+  4141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.211180 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.211745 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.333287 (+121542us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:23.333328 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.333416 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.257278 (+923862us) raft_consensus.cc:1685] finished
0709 13:10:24.257320 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.257608 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3687,"raft.queue_time_us":7848,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":8347,"thread_start_us":113317,"threads_started":1,"wal-append.queue_time_us":779789}
I20260709 13:10:24.155756 22924 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:24.170272 22920 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.045s	sys 0.104s
I20260709 13:10:24.107427 22927 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.312561 21316 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
W20260709 13:10:24.036134 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.047s	sys 0.091s
I20260709 13:10:24.256212 21390 rpcz_store.cc:276] 0709 13:10:23.040526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.040664 (+   138us) service_pool.cc:224] Handling call
0709 13:10:23.040968 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.041289 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.041314 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.053463 (+ 12149us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.771700 (+718237us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:23.953134 (+181434us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.953388 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.953475 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.203483 (+250008us) raft_consensus.cc:1685] finished
0709 13:10:24.203520 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.203896 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":169190,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"raft.queue_time_us":5693,"raft.run_cpu_time_us":781,"raft.run_wall_time_us":10478,"thread_start_us":717811,"threads_started":1,"wal-append.queue_time_us":1062672}
I20260709 13:10:24.021930 22035 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:24.316656 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1382) took 1283 ms. Trace:
I20260709 13:10:24.250283 22852 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.259618 22941 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.265221 22833 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:24.041100 22744 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.321995 21319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:24.322521 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:24.322934 21319 raft_consensus.cc:606] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:24.269586 22777 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.146107 22855 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.134528 22767 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.153321 22933 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.029745 21435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.000s	sys 0.015s
I20260709 13:10:24.337776 22918 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:10:24.339990 21435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.001s	sys 0.015s
I20260709 13:10:24.341140 22918 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:24.342005 22918 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:24.344511 21284 leader_election.cc:400] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:24.344916 21284 leader_election.cc:403] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.119343 22844 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.250345 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 235536us
I20260709 13:10:24.352758 22844 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.354610 21436 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:24.153280 22916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.008s	sys 0.032s
I20260709 13:10:24.243654 22820 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.367764 22849 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.244065 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.376658 21317 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:24.366228 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:24.245519 22837 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.379062 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.379321 22837 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:24.379837 22837 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.380477 22837 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.382925 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.246510 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.384511 21312 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:24.384865 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:24.227686 22038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.011s	sys 0.027s
W20260709 13:10:24.135670 22894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.026s
W20260709 13:10:24.219192 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.016s	sys 0.054s
I20260709 13:10:24.264511 22761 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:24.284579 22042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.011s	sys 0.034s
I20260709 13:10:24.283912 22800 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:10:24.293998 22912 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.907s	user 0.005s	sys 0.014s
I20260709 13:10:24.249348 22842 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.296276 22838 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.255640 22928 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.299486 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 276525us
I20260709 13:10:24.262856 22890 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.305657 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.306592 22910 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.291781 22940 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.274673 22821 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:24.304591 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59239.1us
I20260709 13:10:24.272225 22904 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:24.309891 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 54213.8us
I20260709 13:10:24.311738 22850 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.313778 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:24.311776 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.423233 21316 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.424249 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.424526 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.424934 22908 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:24.425247 22040 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:24.425608 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.425961 22034 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:24.426210 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.426884 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.315552 22927 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:24.316499 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.047s	sys 0.091s
W20260709 13:10:24.428117 21393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1244) took 1385 ms (client timeout 1628 ms). Trace:
W20260709 13:10:24.428609 21393 rpcz_store.cc:269] 0709 13:10:23.042480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.052500 (+ 10020us) service_pool.cc:224] Handling call
0709 13:10:24.427875 (+1375375us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540020eed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:24.428013 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2785348352}
I20260709 13:10:24.429867 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.430009 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.430632 21392 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:24.431452 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.321098 22909 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.321624 22930 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.325009 22744 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.331662 22855 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.432325 22820 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:24.332430 22920 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.045s	sys 0.106s
I20260709 13:10:24.245644 22797 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:10:24.324105 22858 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.320022 22833 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:24.337636 22933 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.351280 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.358724 22911 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:24.360281 22948 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:24.360751 22746 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:24.361132 22844 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.361599 22035 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.446992 22746 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.447448 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:24.363349 21319 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:24.448773 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.449023 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.449479 22746 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.367093 22778 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:24.367264 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.368263 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.369524 22852 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.454516 21389 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 2: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:24.369392 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.370877 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.372881 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:24.372944 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.379776 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.242053 22823 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.379928 22041 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:24.392453 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:24.451181 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.458917 21312 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.347894 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.317216 21387 rpcz_store.cc:276] 0709 13:10:23.033246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.034587 (+  1341us) service_pool.cc:224] Handling call
0709 13:10:24.316178 (+1281591us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54003f5054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:24.316427 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817537280}
I20260709 13:10:24.356846 22793 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:24.480468 21461 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:24.480695 22908 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:24.481388 22908 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.344916 22932 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.387980 22913 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:24.394892 22038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.011s	sys 0.028s
I20260709 13:10:24.399307 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.400610 22761 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.483973 22761 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.484663 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.485989 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.487181 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.488891 22757 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.407878 22939 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:24.408319 22042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.011s	sys 0.034s
I20260709 13:10:24.408085 22928 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:24.402107 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.017s	sys 0.054s
I20260709 13:10:24.411155 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:24.411353 22917 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.412607 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:24.412060 22774 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:24.449512 22031 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:24.493572 21463 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:24.493604 22774 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.441560 22924 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.494206 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:24.413570 22894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.012s	sys 0.027s
I20260709 13:10:24.416546 22800 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.495494 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.496078 22774 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.497014 22039 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 2: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:24.498005 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.331463 22941 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:24.408161 22942 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:10:24.498842 21390 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:24.499146 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.500164 22039 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:24.500509 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 460) took 1505 ms. Trace:
I20260709 13:10:24.433590 22765 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.436834 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.437881 21318 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:24.502696 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.438131 22820 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.503317 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:24.504006 22777 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.438304 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.444643 22910 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.505443 22910 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.505887 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.507486 22927 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.508137 22927 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.508497 22759 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.508656 22948 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.509363 22948 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.507222 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.431818 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.427371 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.453096 21395 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:24.440876 21469 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:24.440826 22833 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.461889 21317 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:24.433984 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:24.462147 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.463845 22821 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.464325 22912 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:24.417034 21388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1238) took 1913 ms (client timeout 1531 ms). Trace:
I20260709 13:10:24.489171 22908 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.465093 21396 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:24.465687 21391 raft_consensus.cc:2368] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:10:24.466406 22035 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:24.476435 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.487943 21321 raft_consensus.cc:2393] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:24.492817 22822 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:24.501382 22928 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.504456 22894 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.440023 21316 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:24.507797 22910 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.514462 21392 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:24.512259 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:24.450425 22778 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.511977 22948 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.517447 22767 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.520501 22933 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.520756 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.521255 22040 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:24.521287 22945 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.547276 21318 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:24.522030 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.522691 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.523954 21319 raft_consensus.cc:2368] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:10:24.500917 22038 rpcz_store.cc:276] 0709 13:10:22.994931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.025179 (+ 30248us) service_pool.cc:224] Handling call
0709 13:10:23.061870 (+ 36691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.188788 (+126918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.191375 (+  2587us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.265619 (+ 74244us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.483108 (+1217489us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:24.483214 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.483382 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.500282 (+ 16900us) raft_consensus.cc:1685] finished
0709 13:10:24.500308 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.500427 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18680,"raft.queue_time_us":114529,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":4831,"thread_start_us":1176863,"threads_started":1,"wal-append.queue_time_us":1008511}
I20260709 13:10:24.524570 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.524842 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.525204 21468 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:24.525204 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.508538 22911 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:24.498207 22879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1adedb939e97489f9d96abf3bff7f1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.540509 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.515874 22918 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.528816 22032 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.544620 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.533063 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.545181 22031 raft_consensus.cc:2368] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:10:24.550827 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.550076 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:24.549786 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:24.560740 21393 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:10:24.553025 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 180350us
I20260709 13:10:24.562985 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.567279 21312 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:24.566282 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.569597 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.569905 21218 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 181) took 2740 ms. Trace:
I20260709 13:10:24.570233 22040 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:24.714741 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:24.727231 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:24.715619 22928 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.573714 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:24.733724 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.734531 21467 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:24.734215 22928 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.734808 22933 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:24.735594 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.726967 22774 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:24.673995 22918 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:24.654157 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.737339 22918 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.737854 22918 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.738238 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.651805 21314 raft_consensus.cc:2368] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3.
I20260709 13:10:24.674155 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:24.532958 21388 rpcz_store.cc:269] 0709 13:10:22.504100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.507242 (+  3142us) service_pool.cc:224] Handling call
0709 13:10:23.262603 (+755361us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b5800124e98. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:24.416746 (+1154143us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54001c7354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:24.416957 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077277696}
I20260709 13:10:24.652328 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:24.672089 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 261023us
I20260709 13:10:24.568802 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 599) took 1054 ms. Trace:
I20260709 13:10:24.735314 22933 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:24.737061 22774 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.715831 21387 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:24.756819 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.756973 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.574193 21469 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:24.647097 22041 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:24.572223 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.745612 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:24.745841 22950 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:10:24.744331 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 212459us
I20260709 13:10:24.754295 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.565948 22765 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:24.763365 21316 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:24.764792 21467 raft_consensus.cc:2368] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:24.765362 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.682341 22759 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:24.646931 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.652988 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1250) took 1608 ms. Trace:
I20260709 13:10:24.768764 21319 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:24.553440 22894 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.769193 21393 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.779850 21466 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:24.727303 22927 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.771924 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.769932 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.576555 22820 raft_consensus.cc:2764] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:24.652230 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:24.770241 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 233811us
I20260709 13:10:24.811904 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:24.750859 22042 rpcz_store.cc:276] 0709 13:10:23.514690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.515485 (+   795us) service_pool.cc:224] Handling call
0709 13:10:23.515870 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.516177 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.516214 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.516741 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.497322 (+980581us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:24.549474 (+ 52152us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.553881 (+  4407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.563801 (+  9920us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.563838 (+    37us) raft_consensus.cc:1685] finished
0709 13:10:24.563847 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.568725 (+  4878us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4046,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":12599,"thread_start_us":1024333,"threads_started":2,"wal-append.queue_time_us":840908}
I20260709 13:10:24.564118 22822 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.747867 22928 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.788096 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.788360 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.788825 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:24.789986 22767 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:24.790354 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 177408us
I20260709 13:10:24.790789 21318 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:24.791345 22908 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:24.791040 22833 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.791828 22783 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.791805 21393 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
W20260709 13:10:24.793608 22961 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:10:24.795665 22757 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.796332 22917 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:24.796927 22778 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.748468 22941 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:24.755980 22933 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.797170 22913 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:24.807459 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:24.858652 21469 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:24.832226 22912 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.801510 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:24.861884 21321 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.574491 22911 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.867061 22894 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.869179 22911 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.768656 22765 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.774555 22759 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.869863 22765 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.869949 22759 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.872347 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:24.834476 21313 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
W20260709 13:10:24.873431 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 288538us
I20260709 13:10:24.839157 22036 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:24.839752 21320 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.839646 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:24.781261 21462 rpcz_store.cc:276] 0709 13:10:23.044217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.501574 (+457357us) service_pool.cc:224] Handling call
0709 13:10:23.502008 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.237917 (+735909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.238002 (+    85us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.238087 (+    85us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:24.238139 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.564383 (+326244us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b540025e254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:24.566557 (+  2174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.652806 (+ 86249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690996992}
I20260709 13:10:24.841355 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:24.570480 21218 rpcz_store.cc:276] 0709 13:10:21.829589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.829743 (+   154us) service_pool.cc:224] Handling call
0709 13:10:24.569641 (+2739898us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:22.773711 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:22.774482 (+   771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:22.774540 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:10:22.774577 (+    37us) tablet.cc:662] Decoding operations
0709 13:10:22.775099 (+   522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:22.775199 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:22.775242 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:22.775675 (+   433us) tablet.cc:701] Row locks acquired
0709 13:10:22.775697 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:10:22.775880 (+   183us) write_op.cc:270] Start()
0709 13:10:22.776010 (+   130us) write_op.cc:276] Timestamp: P: 1783602622775823 usec, L: 0
0709 13:10:22.780625 (+  4615us) op_driver.cc:348] REPLICATION: starting
0709 13:10:22.867250 (+ 86625us) log.cc:844] Serialized 925 byte log entry
0709 13:10:24.165737 (+1298487us) op_driver.cc:464] REPLICATION: finished
0709 13:10:24.395977 (+230240us) write_op.cc:301] APPLY: starting
0709 13:10:24.405221 (+  9244us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:24.415259 (+ 10038us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:24.416701 (+  1442us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:24.420442 (+  3741us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:24.420714 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:10:24.420785 (+    71us) write_op.cc:312] APPLY: finished
0709 13:10:24.421130 (+   345us) log.cc:844] Serialized 29 byte log entry
0709 13:10:24.421367 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:24.421552 (+   185us) write_op.cc:454] Released schema lock
0709 13:10:24.421626 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:24.422178 (+   552us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:24.422221 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":290041,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":227460,"apply.run_cpu_time_us":3575,"apply.run_wall_time_us":26195,"num_ops":2,"prepare.queue_time_us":354323,"prepare.run_cpu_time_us":16733,"prepare.run_wall_time_us":250984,"raft.queue_time_us":895632,"raft.run_cpu_time_us":8186,"raft.run_wall_time_us":151874,"replication_time_us":1384910,"thread_start_us":1674523,"threads_started":4,"wal-append.queue_time_us":195922}]]}
I20260709 13:10:24.852507 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.855441 21314 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:24.835422 22928 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:24.843436 22041 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:24.646675 22945 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.783322 21464 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:24.832932 22746 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:24.863538 22958 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.376s	user 0.002s	sys 0.000s
I20260709 13:10:24.858844 22035 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:24.865216 22032 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:24.821892 22761 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:24.874084 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 297049us
I20260709 13:10:24.874293 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:24.852330 22908 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:24.877924 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:24.879902 22912 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:24.842430 22932 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:24.882504 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:24.909708 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 120795us
W20260709 13:10:24.885946 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57358.3us
I20260709 13:10:24.896894 22746 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.882283 22928 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.856405 22777 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.902580 22894 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:24.908915 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:24.895124 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.906248 21395 raft_consensus.cc:606] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:24.843263 22783 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.867897 22913 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.910001 22912 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:24.915110 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.908468 22908 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.919497 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:24.918533 21468 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:24.894260 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:24.886150 22941 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:24.885367 22844 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:10:24.917317 22928 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.916175 22948 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.930440 21436 leader_election.cc:400] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:10:24.938539 22761 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.939677 22774 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.944391 21394 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:24.953217 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79324.6us
W20260709 13:10:24.946022 22837 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.004s
I20260709 13:10:24.947163 22833 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:24.948066 22913 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.950613 21436 leader_election.cc:403] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.880787 22917 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.928589 22912 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.920231 22894 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.879050 22757 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:24.955266 21393 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:24.956637 21433 leader_election.cc:400] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:10:24.961336 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.932732 22821 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:24.960363 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44524.9us
I20260709 13:10:24.974016 21433 leader_election.cc:403] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.943765 22941 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:24.949416 22778 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:24.986277 21393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:24.987454 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:24.989022 21393 raft_consensus.cc:606] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:24.977375 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:24.960320 21461 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:24.952827 22855 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:24.976145 22963 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:10:24.997170 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:24.963642 22894 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.971570 22917 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.954622 22910 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:24.977902 22945 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.009099 22783 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:24.985150 22821 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:25.004014 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:25.011025 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 100126us
I20260709 13:10:24.958707 22837 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.016187 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:25.017187 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:25.021922 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:25.022799 22041 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:25.019546 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.010457 21396 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.034231 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:25.035533 21391 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.036840 21470 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 2: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:25.014349 22821 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.042213 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.019254 22822 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.040184 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:25.024694 22932 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.049414 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:25.052371 21319 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.029279 22927 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:25.029631 22940 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:25.041182 22939 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:10:25.063814 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46746.6us
W20260709 13:10:25.056761 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 64491.1us
I20260709 13:10:25.050561 22941 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:25.067991 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.069130 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.024185 22855 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:25.074285 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74731.2us
I20260709 13:10:25.075922 21321 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:25.054415 22930 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:25.064419 22927 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.081439 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.070461 22941 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.067471 22932 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:25.078846 22924 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.075536 22945 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:25.090037 22041 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.083684 22913 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:25.084777 22927 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.079008 22940 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:25.101063 22913 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:25.107125 22913 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.091190 22941 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.086664 22906 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:10:25.096390 22945 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.111413 22894 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.118258 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:25.108732 22921 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.067s	user 0.013s	sys 0.001s
I20260709 13:10:25.119952 22932 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.123971 22945 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.126950 22778 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.124971 22921 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.128261 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:25.129930 22757 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.130203 22917 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:25.130715 21390 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:25.093734 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:25.132934 22041 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:25.133239 21319 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:25.130833 22746 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:25.084494 22930 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.138782 21396 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:25.139581 22930 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.165655 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:25.093924 22918 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.130199 22921 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.107968 21320 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:25.125566 22894 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:25.176333 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:25.180675 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:25.174741 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 96157.3us
I20260709 13:10:25.183483 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:25.184357 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:25.188642 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:25.197136 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.197487 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:25.206197 22041 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:25.210005 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 119320us
I20260709 13:10:25.189802 22906 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:25.216514 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.217254 21393 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:25.223016 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.194286 22917 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.187824 22833 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:25.225538 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:25.190423 22837 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.224117 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.210137 22911 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:25.229017 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.231047 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.224789 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:25.223063 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.257635 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.259311 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.261004 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.262316 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.262532 21362 leader_election.cc:400] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3.
I20260709 13:10:25.262861 21362 leader_election.cc:403] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:25.263566 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.264386 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:25.269030 22973 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:10:25.271777 22971 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:10:25.273442 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.312201 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.280157 22855 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:25.232966 22911 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.232000 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.230145 22822 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:25.320837 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.221181 22906 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.269398 22921 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:25.302785 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:25.225597 22833 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.334029 22833 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.334589 22921 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:25.303755 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.336711 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.336119 22921 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.337687 22774 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:25.338234 22774 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:25.338574 22838 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:25.327808 22906 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.339171 22838 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:25.340507 22838 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.343905 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.344396 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.345582 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.346143 22906 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.346652 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.346830 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:25.347640 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.230564 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.313247 21393 raft_consensus.cc:2410] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:25.258355 22928 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.355248 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:25.315891 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:25.315671 22821 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.339082 22774 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.358508 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.359452 22821 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.359688 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.360317 22918 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.361169 22837 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:25.361744 22837 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:25.362250 22837 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.364351 21394 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.304603 22757 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.326958 21396 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:25.329175 21320 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.327907 21391 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:25.306303 22913 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.348052 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.348210 22823 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:25.350335 21312 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:25.307542 22759 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:25.304116 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 77382.9us
I20260709 13:10:25.314064 22912 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.411159 21314 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:25.313817 22765 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.313745 22933 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.313701 22980 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:25.264744 22947 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:25.428668 22947 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.431358 22947 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:25.319415 22822 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.354573 22031 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.327593 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.375044 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:25.433543 21395 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:25.375136 21434 leader_election.cc:400] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
W20260709 13:10:25.434450 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 78113.2us
I20260709 13:10:25.225593 22940 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.313203 22911 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.414194 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.421881 21396 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.421983 22983 ts_tablet_manager.cc:933] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.422551 22945 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.422972 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.424705 22941 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.448179 21464 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.448941 22941 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.450654 22945 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.425411 22913 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.426642 22927 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.444883 21393 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:25.446707 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.445479 21461 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.457753 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.465808 21317 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.464295 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.467608 21470 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:25.476733 21396 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:10:25.308599 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 93327.2us
I20260709 13:10:25.464967 22822 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.454093 22906 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.461823 22927 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.490518 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.512598 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.514353 22822 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:25.516793 22822 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.497105 21464 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:25.463872 22823 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:25.462316 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.530898 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.531512 21464 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.519016 22822 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.576119 22823 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.579203 22917 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:25.581323 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.581478 22031 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:25.582149 21468 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:25.582973 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.511252 22924 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:25.588779 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.588855 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.589468 21470 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.564853 22034 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.596238 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.530189 22800 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.597386 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:25.583992 22948 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.001s
I20260709 13:10:25.600241 21464 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:25.601588 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.604933 22765 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.606096 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.606731 21466 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:25.610244 22978 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:25.611532 22823 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.611742 22928 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.612578 22912 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:25.612614 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:25.615020 21317 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:25.615854 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.616631 21468 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:25.588508 22980 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.628247 22930 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:25.628743 22930 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.629091 22930 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.630491 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.631062 21464 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:10:25.631131 21315 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:25.632944 21470 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:25.632548 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.613473 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.642627 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.648617 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.643302 22837 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.649976 21394 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:25.663548 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.664398 21317 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.642635 22034 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:25.666527 22833 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.667779 21464 raft_consensus.cc:2368] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:25.668217 22759 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:25.618804 22777 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:25.677807 22777 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.669127 22924 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.619050 22948 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:25.638137 22980 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:10:25.706136 22939 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260709 13:10:25.706568 22980 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.679212 22031 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.706588 22939 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:10:25.715569 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:25.718998 22777 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:25.722426 22879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42344 (request call id 188) took 4106 ms. Trace:
I20260709 13:10:25.727641 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.728323 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.716423 21461 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:25.761705 21468 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.755154 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:25.763130 21315 raft_consensus.cc:2368] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:25.763881 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.764696 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.768177 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:25.769731 21317 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:25.770658 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.765673 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:25.772347 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.726863 22930 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.772953 22039 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.772352 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.775403 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.775393 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.755064 22837 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.777477 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:25.763096 22933 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.753758 22757 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3.
I20260709 13:10:25.729236 22833 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:25.722921 21320 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:25.764900 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.776948 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:25.784740 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.783209 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:25.787468 22759 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:25.788420 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.789736 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:25.791929 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1551) took 1310 ms. Trace:
I20260709 13:10:25.772541 22928 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:25.796852 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.782507 22939 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:25.780414 22777 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:25.782337 22032 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:25.804731 21436 leader_election.cc:400] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:25.815981 21436 leader_election.cc:403] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:25.812309 21318 rpcz_store.cc:276] 0709 13:10:24.481697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.834830 (+353133us) service_pool.cc:224] Handling call
0709 13:10:24.859326 (+ 24496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.914132 (+ 54806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.914165 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.931127 (+ 16962us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.051792 (+120665us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:25.051815 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.051905 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.790295 (+738390us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b2400135cc8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc169fb0 00007fc2bede0488 00007fc2bede0be8 00007fc2bedb8398 00007fc2bedb376a 00007fc2bedb2bb6
0709 13:10:25.791607 (+  1312us) raft_consensus.cc:1685] finished
0709 13:10:25.791629 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.791854 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7162,"raft.queue_time_us":15291,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3147,"spinlock_wait_cycles":51207040,"thread_start_us":69578,"threads_started":1,"wal-append.queue_time_us":172232}
I20260709 13:10:25.818859 22947 raft_consensus.cc:2764] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:25.819289 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:25.820103 22947 raft_consensus.cc:2764] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:25.813894 22759 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:25.821280 22759 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.821869 22941 raft_consensus.cc:993] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:25.822319 22941 raft_consensus.cc:1081] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:25.824236 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.827745 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.828608 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:25.725765 22983 tablet_copy_client.cc:323] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:10:25.814594 22039 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:25.734320 22911 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.813078 21315 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:25.832612 21468 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:25.838028 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:25.841725 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:25.815291 22837 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.813437 22928 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:25.840378 22918 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:10:25.912477 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 74537.3us
I20260709 13:10:25.915084 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.915560 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:25.912612 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 85883.2us
I20260709 13:10:25.913666 21467 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:25.916580 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:25.825730 22035 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.917836 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:25.918946 22928 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.837651 22933 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.831265 22778 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:25.917433 21315 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:25.912324 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.831348 22031 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
W20260709 13:10:25.917941 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 76300.5us
I20260709 13:10:25.925244 22918 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:25.936088 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:25.936439 22774 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:25.842269 22939 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:25.936848 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:25.936689 22918 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.937536 21285 leader_election.cc:400] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:25.938315 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:25.938398 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:25.938732 22939 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.939042 22757 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:25.922250 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.925441 21470 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:25.925601 22837 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:25.923040 21319 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:25.941148 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:25.924523 22940 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.941561 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.943562 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.944802 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.940855 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.939494 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.945572 21315 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:25.925715 22911 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:25.946152 23002 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:25.946643 23002 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.946698 22774 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.946728 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.947120 23002 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.947410 22774 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:25.947499 22039 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.948583 22774 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.952431 22838 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:25.953071 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:25.953729 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:25.954594 22032 raft_consensus.cc:2368] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:25.727375 22879 rpcz_store.cc:276] 0709 13:10:21.616441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.618243 (+  1802us) service_pool.cc:224] Handling call
0709 13:10:21.809739 (+191496us) ts_tablet_manager.cc:934] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
0709 13:10:24.496160 (+2686421us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:25.350191 (+854031us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:25.365935 (+ 15744us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:25.721469 (+355534us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:25.721845 (+   376us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:25.722213 (+   368us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:25.722331 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":322,"tablet-copy.queue_time_us":154947,"thread_start_us":189656,"threads_started":2}
I20260709 13:10:25.955577 22879 tablet_copy_client.cc:806] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:25.956275 21433 leader_election.cc:400] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:25.956360 22879 tablet_copy_client.cc:670] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:25.956950 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.957381 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:25.958163 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.959273 21463 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:25.960296 21316 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:10:25.960609 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:25.961737 21317 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:25.958879 21466 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:25.917634 22910 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:25.968386 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.917429 22979 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:25.920696 22906 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:25.969295 21469 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:25.971194 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:25.972863 22039 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:25.931475 22930 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:25.976589 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:25.977365 21470 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:25.978487 23002 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:25.944403 22941 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:25.972532 22894 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:10:25.990154 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:25.969769 22777 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.970155 22910 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:26.000810 22910 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.980927 23002 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:26.004634 23002 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:26.004988 22917 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.005198 23002 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:26.005800 23002 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:26.008625 22837 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.010569 21466 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:25.973946 22778 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:26.017534 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:25.981411 22940 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:26.018268 21462 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:26.018677 22940 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:26.023017 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 82396.3us
I20260709 13:10:25.984261 22757 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:10:26.023211 22778 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:26.025050 22777 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:26.035461 22917 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:26.085217 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:26.073974 22778 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:26.105073 21316 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:26.079808 22838 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:10:26.104568 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 85681.9us
I20260709 13:10:26.124897 21466 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:26.108716 22917 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:26.126575 22917 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.128233 22777 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:26.112577 22838 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:26.140261 22838 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:26.115643 22912 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:10:26.113088 22941 raft_consensus.cc:2764] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:10:26.142076 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:26.144204 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.144968 21466 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:26.145769 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.146833 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.147562 21466 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:26.153195 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5937233440000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 13:10:26.159097 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.161741 22759 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:26.162994 23002 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:26.165225 23002 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:26.177757 22910 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.180100 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1252) took 1811 ms. Trace:
I20260709 13:10:26.180518 21389 rpcz_store.cc:276] 0709 13:10:24.368363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.455270 (+ 86907us) service_pool.cc:224] Handling call
0709 13:10:24.455681 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.746189 (+290508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.748102 (+  1913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.765826 (+ 17724us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:24.769920 (+  4094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.179796 (+1409876us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54003430d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:26.179846 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.180005 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252921088}
I20260709 13:10:26.194018 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:26.200529 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:26.203025 22933 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:26.204689 21313 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:26.204926 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:26.206197 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.206624 22894 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:26.207038 22894 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:26.207465 22894 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:26.208007 22924 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.207367 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:26.209643 22924 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:26.210134 22924 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:26.210346 22035 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:26.213868 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:26.211095 22924 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.214956 22823 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:26.215399 22988 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.219415 22823 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:26.221835 22823 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.224769 21466 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:26.188580 21462 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:26.231959 22759 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:26.236275 22910 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:26.191998 22778 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.215927 22988 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.265475 22988 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:26.265822 22778 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:26.275454 22894 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.278080 22894 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:26.282626 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:26.287349 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.292455 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.294036 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:26.296938 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:26.297497 21464 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:26.298156 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.299260 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:26.300104 21464 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:26.308969 21464 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:26.315382 21464 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:26.316421 21464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56756
I20260709 13:10:26.317160 21464 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.317528 21464 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.325992 21464 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:26.328418 21464 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:26.398362 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.399888 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.456526 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.460961 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1408) took 1243 ms. Trace:
I20260709 13:10:26.462236 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1401) took 1252 ms. Trace:
I20260709 13:10:26.464156 21395 rpcz_store.cc:276] 0709 13:10:25.218005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.459523 (+1241518us) service_pool.cc:224] Handling call
0709 13:10:26.459945 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.460588 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.460617 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.460664 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:26.460713 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.460776 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.460899 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.462512 23022 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.465927 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:26.466717 22924 raft_consensus.cc:2764] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:26.467103 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:26.467948 22924 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.468329 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:26.469246 22924 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:26.469622 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:26.463415 21387 rpcz_store.cc:276] 0709 13:10:25.209776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.212051 (+  2275us) service_pool.cc:224] Handling call
0709 13:10:26.455816 (+1243765us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b5800124e98. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:26.456090 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.456661 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.456702 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.457226 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.461732 (+  4506us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:26.461776 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.461857 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.461917 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:26.461934 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.462153 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":13758208,"thread_start_us":4148,"threads_started":1,"wal-append.queue_time_us":1193}
I20260709 13:10:26.470589 22924 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:26.477617 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.481889 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet 24db01a278af4a82a16f038fedabf4d3 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:10:26.482616 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.482656 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet 24db01a278af4a82a16f038fedabf4d3 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-24db01a278af4a82a16f038fedabf4d3
I20260709 13:10:26.483436 21388 raft_consensus.cc:2376] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4. Re-sending same reply.
I20260709 13:10:26.483798 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.484619 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.484680 21387 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:26.485337 21388 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:26.485515 21389 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:26.486068 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.486835 23024 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.487550 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.488163 23024 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:26.489024 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:26.490897 22930 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:26.490401 23024 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:26.492439 23024 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:26.492869 23024 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.493528 21395 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:26.500304 21406 tablet_copy_source_session.cc:215] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:26.500159 23024 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.501183 21388 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:26.502957 23024 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:26.503605 23024 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:26.504642 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:26.505523 23024 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:26.506106 23024 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:26.507177 23024 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.507718 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.508558 21392 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.509728 22983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24db01a278af4a82a16f038fedabf4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.516721 21392 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:26.517921 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:26.518780 22924 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.519286 22924 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:26.520406 22924 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.523061 21391 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:26.525144 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.526342 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.530202 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 172) took 1287 ms. Trace:
I20260709 13:10:26.530599 21467 rpcz_store.cc:276] 0709 13:10:25.243581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.257329 (+ 13748us) service_pool.cc:224] Handling call
0709 13:10:26.529989 (+1272660us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b540025a154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:26.530117 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505994112}
I20260709 13:10:26.531334 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.532447 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.533376 22036 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:26.534117 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 208) took 1529 ms. Trace:
I20260709 13:10:26.534276 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.534610 21392 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:26.534520 22036 rpcz_store.cc:276] 0709 13:10:25.004514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.016536 (+ 12022us) service_pool.cc:224] Handling call
0709 13:10:26.532956 (+1516420us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:26.533166 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.533845 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.534059 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303744}
I20260709 13:10:26.535472 22948 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.536528 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.537532 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:26.533685 21387 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
W20260709 13:10:26.538473 21321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1559) took 1449 ms (client timeout 1675 ms). Trace:
I20260709 13:10:26.539501 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:26.533370 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:26.538910 21321 rpcz_store.cc:269] 0709 13:10:25.088716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.094059 (+  5343us) service_pool.cc:224] Handling call
0709 13:10:26.537359 (+1443300us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5800181298. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:26.538319 (+   960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40360320}
I20260709 13:10:26.541756 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.542693 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.543005 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.543673 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.546353 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.547693 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.548518 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:26.550042 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.538899 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.550055 22948 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:26.585587 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.550042 22933 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.577139 22911 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:10:26.585364 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:26.551009 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.549953 22918 raft_consensus.cc:2764] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:26.591109 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.593263 21392 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:26.595252 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:26.588165 22833 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.607368 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:26.611070 21387 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:26.613612 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:26.614923 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:26.598848 22933 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:26.635649 22761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.546s	user 0.021s	sys 0.037s
W20260709 13:10:26.636068 22761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.552s	user 0.021s	sys 0.037s
I20260709 13:10:26.637059 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:26.639492 22778 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.640493 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:26.641791 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:26.642704 22917 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.643067 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:26.643365 22778 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.632134 22933 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:26.643996 22917 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.644757 22933 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:26.645663 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:26.646427 22778 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:26.646898 22778 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:26.647864 22778 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.652072 21359 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:26.652941 22917 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:26.653385 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:26.657903 22917 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.668669 21388 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:26.671015 23024 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:26.671465 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.672230 23022 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:26.673658 21462 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:26.672598 23022 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:26.675251 23022 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.677196 23022 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:26.679131 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:26.681501 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.682627 22778 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.684350 21388 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:26.685943 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.687616 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.689688 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.692068 21388 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:26.694058 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.687701 21219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 276) took 3640 ms. Trace:
I20260709 13:10:26.698086 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.704628 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.705648 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.708184 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.709625 21392 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:26.711091 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:26.703758 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.707314 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:26.719679 22032 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:26.718690 21388 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.725503 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:26.727005 22933 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:26.728425 22927 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.728760 22927 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:26.729146 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.729537 22927 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.730319 22933 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.730846 22927 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.733680 23002 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:26.734611 23002 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:26.734958 23002 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:26.732610 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.735754 23002 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.738071 23002 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:26.739723 21394 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:26.696847 21219 rpcz_store.cc:276] 0709 13:10:23.047671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.051740 (+  4069us) service_pool.cc:224] Handling call
0709 13:10:26.687517 (+3635777us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:24.155792 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:24.167149 (+ 11357us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:24.167214 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:10:24.167248 (+    34us) tablet.cc:662] Decoding operations
0709 13:10:24.309503 (+142255us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:24.310992 (+  1489us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:24.311049 (+    57us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:10:24.311839 (+   790us) tablet.cc:701] Row locks acquired
0709 13:10:24.311896 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:10:24.312196 (+   300us) write_op.cc:270] Start()
0709 13:10:24.312377 (+   181us) write_op.cc:276] Timestamp: P: 1783602624312117 usec, L: 0
0709 13:10:24.312448 (+    71us) op_driver.cc:348] REPLICATION: starting
0709 13:10:24.350403 (+ 37955us) log.cc:844] Serialized 2940 byte log entry
0709 13:10:24.461766 (+111363us) op_driver.cc:464] REPLICATION: finished
0709 13:10:24.468292 (+  6526us) write_op.cc:301] APPLY: starting
0709 13:10:24.468394 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:24.468631 (+   237us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:24.468745 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:24.469731 (+   986us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:24.469933 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:10:24.469980 (+    47us) write_op.cc:312] APPLY: finished
0709 13:10:24.506703 (+ 36723us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf213e28 00007fc2c2c4e581 00007fc2c2c4dd58 00007fc2c2c529f1 00007fc2c2c529a9 00007fc2c2c52939 00007fc2c2c52901 00007fc2c2c51b2d 000000000038f354 000000000038f199
0709 13:10:24.514584 (+  7881us) log.cc:844] Serialized 59 byte log entry
0709 13:10:24.525903 (+ 11319us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:24.534375 (+  8472us) write_op.cc:454] Released schema lock
0709 13:10:24.537332 (+  2957us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:24.561035 (+ 23703us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:24.564903 (+  3868us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":6238,"apply.run_cpu_time_us":2944,"apply.run_wall_time_us":79164,"num_ops":7,"prepare.queue_time_us":183338,"prepare.run_cpu_time_us":10174,"prepare.run_wall_time_us":360561,"replication_time_us":138072,"spinlock_wait_cycles":11549056,"thread_start_us":235699,"threads_started":1}]]}
I20260709 13:10:26.725502 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:26.746601 22930 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:10:26.750607 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1409) took 1532 ms. Trace:
I20260709 13:10:26.750859 23004 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:26.751113 21393 rpcz_store.cc:276] 0709 13:10:25.218283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.359452 (+141169us) service_pool.cc:224] Handling call
0709 13:10:26.750457 (+1391005us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b54000f1ed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:26.750553 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194366336}
I20260709 13:10:26.751534 23004 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:26.752529 23004 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.750703 22940 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:26.730125 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.003s
W20260709 13:10:26.754828 21314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 191) took 1713 ms (client timeout 1520 ms). Trace:
W20260709 13:10:26.756363 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.008s	sys 0.004s
W20260709 13:10:26.756460 21314 rpcz_store.cc:269] 0709 13:10:25.041729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.041897 (+   168us) service_pool.cc:224] Handling call
0709 13:10:26.754656 (+1712759us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54003aedd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:26.754774 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845647104}
I20260709 13:10:26.757826 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:26.747479 22908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.556s	user 0.010s	sys 0.019s
I20260709 13:10:26.747381 22837 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.760581 22940 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.768358 22940 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:26.769218 22940 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.770367 22940 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.761015 22917 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:26.755826 21388 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:26.755826 23016 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:10:26.781792 23016 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:26.782301 23016 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:26.763253 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.763826 22761 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.761219 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.784648 22761 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.765208 21394 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:26.785012 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:26.767720 22908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.582s	user 0.010s	sys 0.019s
I20260709 13:10:26.785604 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.786207 22761 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.773607 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:26.770918 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 168) took 1548 ms (client timeout 1631 ms). Trace:
I20260709 13:10:26.786100 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:26.789297 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.812505 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.783248 23016 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.787868 21215 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 3, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.828601 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:26.787763 21461 rpcz_store.cc:269] 0709 13:10:25.222210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.223673 (+  1463us) service_pool.cc:224] Handling call
0709 13:10:26.770641 (+1546968us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400249fd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:26.770807 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294860032}
I20260709 13:10:26.831640 21215 catalog_manager.cc:5697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.810554 22761 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:26.810480 22910 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.812194 22932 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.817461 22837 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:26.815064 22983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42342 (request call id 607) took 1690 ms. Trace:
W20260709 13:10:26.900913 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.816165 22933 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:26.863823 22948 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
W20260709 13:10:26.954046 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 166999us
W20260709 13:10:26.956967 23037 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:10:26.957726 22793 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.952422 23016 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:26.864485 22761 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:26.960249 22761 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:26.961689 21390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 184) took 2461 ms (client timeout 3030 ms). Trace:
W20260709 13:10:26.962057 21390 rpcz_store.cc:269] 0709 13:10:24.500551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.521749 (+ 21198us) service_pool.cc:224] Handling call
0709 13:10:26.961499 (+2439750us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540009f954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:26.961615 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303485184}
I20260709 13:10:26.945982 22918 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.965894 22918 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:26.966477 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:26.967131 21466 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:26.968211 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:26.945729 22983 rpcz_store.cc:276] 0709 13:10:25.117103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.118975 (+  1872us) service_pool.cc:224] Handling call
0709 13:10:25.452214 (+333239us) ts_tablet_manager.cc:934] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
0709 13:10:26.508436 (+1056222us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:26.650704 (+142268us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:26.650830 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:26.746299 (+ 95469us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:26.747053 (+   754us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:26.771702 (+ 24649us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:26.790163 (+ 18461us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":30566,"tablet-copy.queue_time_us":172660,"thread_start_us":197087,"threads_started":2}
I20260709 13:10:26.969767 21462 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:26.970288 22983 tablet_copy_client.cc:806] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:26.971107 22983 tablet_copy_client.cc:670] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:26.971470 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:26.976274 23002 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:26.976899 23002 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:26.971130 21469 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:26.958240 22793 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:26.983413 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:26.996938 21315 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:26.966909 22918 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:26.984650 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:26.998631 21317 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:26.982007 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.991456 21464 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:10:26.981325 22910 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.978820 23002 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:26.993323 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:26.995273 21321 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:26.995640 21312 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:27.000479 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:26.991914 21388 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:27.017208 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.980911 21461 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.013609 23002 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.007742 22910 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:27.015887 22983 tablet_copy_client.cc:538] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:27.006453 22823 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:27.020915 22793 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:27.022265 22910 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:27.020304 23002 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.021100 22823 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:27.016438 21313 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.029592 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.033260 21315 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:27.038630 21318 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:27.039181 21317 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:27.040076 21313 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:27.034405 22908 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:10:27.040920 21313 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:27.032600 22939 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:27.042586 21313 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.044917 23002 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:27.045054 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:27.045534 22823 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.046640 21468 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:27.048674 21462 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:27.050220 21463 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:27.051652 21466 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:27.053224 21394 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:27.054983 22930 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:27.056017 21321 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:10:27.056414 21321 pending_rounds.cc:85] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 4
I20260709 13:10:27.056634 21321 pending_rounds.cc:107] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:10:27.056911 21321 raft_consensus.cc:2889] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.058531 22823 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:27.059579 21470 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:27.045632 21469 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:27.063362 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:27.062721 22911 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:27.064263 22988 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:27.065096 23016 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:27.063601 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.071009 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:27.072060 21470 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:27.078047 21469 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:27.078204 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:27.079519 21470 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:27.080127 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:27.086593 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:27.080672 21317 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:10:27.087862 21317 pending_rounds.cc:85] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 4
I20260709 13:10:27.088155 21317 pending_rounds.cc:107] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:10:27.088433 21317 raft_consensus.cc:2889] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.089243 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.089519 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:27.093871 22039 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:27.094403 21360 leader_election.cc:400] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:27.059221 22917 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:10:27.096097 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:27.097445 22927 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:27.097891 22927 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:27.098311 22927 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:27.099088 22039 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:27.100225 22042 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:27.098918 22924 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:27.103096 22924 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:27.103518 22924 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:27.104862 22924 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.105640 22837 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:27.108320 22837 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:27.108484 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:27.108400 22948 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:27.108884 21395 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:27.107092 22927 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.111909 22927 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:27.112773 22822 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:27.114009 22837 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:27.114512 22822 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:27.115794 22822 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.113485 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.121270 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.118613 21469 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:27.106345 22924 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:27.122282 21469 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:27.081028 22983 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:27.123930 22040 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:27.125248 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:27.134801 21315 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:27.117990 22746 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:27.086309 23040 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:27.117843 23022 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:27.137074 22910 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:27.117573 21461 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
W20260709 13:10:27.150157 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51929.2us
I20260709 13:10:27.128904 22837 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:27.149636 22988 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:27.161285 22921 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.149673 22917 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:10:27.162514 22939 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.140224 23053 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:10:27.164613 23045 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:10:27.166877 23039 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.210s	user 0.001s	sys 0.001s
I20260709 13:10:27.142963 22746 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:27.142506 22948 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:27.129124 23002 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:10:27.230587 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 134598us
I20260709 13:10:27.230679 23002 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:27.231566 21315 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:27.170189 22921 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:27.229261 22746 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.233856 22948 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:27.173991 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:27.240134 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:27.154227 21469 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:27.233997 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 93604.9us
W20260709 13:10:27.298463 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 62007.1us
I20260709 13:10:27.233170 23002 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:27.300438 22948 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:27.300680 23050 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:27.368300 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:27.174306 22939 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:27.378839 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:27.380309 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 251504us
I20260709 13:10:27.381362 22759 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:27.381819 22759 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:27.382241 22759 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:27.384284 22778 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:27.385210 22778 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:27.386946 22778 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.302590 23022 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.176194 23040 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
I20260709 13:10:27.365736 22930 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.399988 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 232955us
W20260709 13:10:27.360298 21250 debug-util.cc:398] Leaking SignalData structure 0x7b08000369c0 after lost signal to thread 20202
W20260709 13:10:27.429005 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 70219.4us
W20260709 13:10:27.442135 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 269595us
W20260709 13:10:27.446427 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 65885.3us
W20260709 13:10:27.448942 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 277450us
I20260709 13:10:27.455986 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:27.399554 23022 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.470209 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.473908 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.419049 22930 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.487012 23064 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:10:27.487603 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.488819 23064 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:27.474447 22793 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:27.482447 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:27.501560 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.483327 22910 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:27.505952 21250 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9d80 after lost signal to thread 21253
I20260709 13:10:27.460878 23057 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:10:27.516199 21313 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:27.462397 23002 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:27.487082 22948 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:10:27.529466 21250 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d00 after lost signal to thread 21267
W20260709 13:10:27.535475 22761 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 13:10:27.521638 23016 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:27.446029 22921 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:27.563324 22921 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:27.564888 23059 consensus_queue.cc:1175] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33be1cb5cfc143fc90e164888c96cc6f" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: [1.2-1.2]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:10:27.566805 23062 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:10:27.569356 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:27.570271 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 615) took 1039 ms. Trace:
I20260709 13:10:27.570842 22930 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:27.570603 22031 rpcz_store.cc:276] 0709 13:10:26.530626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.569021 (+1038395us) service_pool.cc:224] Handling call
0709 13:10:27.570209 (+  1188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.588600 22939 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:27.592898 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 96006.4us
I20260709 13:10:27.620595 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:27.625922 23074 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.628712 23081 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:27.631212 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 151288us
I20260709 13:10:27.632498 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:27.573859 22761 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.611541 22948 consensus_queue.cc:1243] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:27.617370 23002 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:27.636202 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.637593 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:27.641526 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.644239 21396 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:27.644899 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1417) took 2340 ms. Trace:
I20260709 13:10:27.635900 23074 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.639446 23016 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:27.653636 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.645210 21396 rpcz_store.cc:276] 0709 13:10:25.304489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.643817 (+2339328us) service_pool.cc:224] Handling call
0709 13:10:27.644080 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.644686 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.644850 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.642454 23022 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:27.648803 23066 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:27.633230 23057 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:10:27.648010 23053 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:27.647953 22793 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:27.641803 23061 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:10:27.693305 21320 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:27.663486 23074 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:27.714577 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:27.673957 23079 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.728515 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:27.731618 23066 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:27.732797 23066 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:27.715839 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1255) took 3355 ms. Trace:
I20260709 13:10:27.723857 22939 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.687506 23053 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:27.756934 21250 debug-util.cc:398] Leaking SignalData structure 0x7b08001772e0 after lost signal to thread 21345
I20260709 13:10:27.776139 23092 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:27.782202 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.794622 22939 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.811640 22940 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:27.765439 22759 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.828200 23053 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:27.828260 22761 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:27.830751 21250 debug-util.cc:398] Leaking SignalData structure 0x7b0800390720 after lost signal to thread 21420
W20260709 13:10:27.831121 21250 debug-util.cc:398] Leaking SignalData structure 0x7b0800390780 after lost signal to thread 21421
W20260709 13:10:27.832185 21250 debug-util.cc:398] Leaking SignalData structure 0x7b080036c000 after lost signal to thread 21494
I20260709 13:10:27.764660 23087 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:10:27.808387 23092 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:27.738300 23079 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.842734 21393 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:27.832453 21250 debug-util.cc:398] Leaking SignalData structure 0x7b080036c100 after lost signal to thread 21495
I20260709 13:10:27.847184 23092 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:27.843647 22746 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.002s
I20260709 13:10:27.861613 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:27.862000 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:27.862347 21388 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:27.832767 22940 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.839376 23061 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:10:27.868059 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:27.806936 23074 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:27.868337 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:27.850906 22927 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.888389 23079 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:27.889326 22980 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:27.889667 22939 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:27.889801 22980 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.890201 22980 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:27.891314 22924 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.757s	user 0.005s	sys 0.006s
W20260709 13:10:27.883376 21250 debug-util.cc:398] Leaking SignalData structure 0x7b0800380500 after lost signal to thread 22066
I20260709 13:10:27.858019 22746 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:27.893602 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1431) took 1196 ms. Trace:
I20260709 13:10:27.903075 21387 rpcz_store.cc:276] 0709 13:10:26.697297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.701665 (+  4368us) service_pool.cc:224] Handling call
0709 13:10:27.489932 (+788267us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800124e98. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:27.490132 (+   200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.490474 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.490512 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.491014 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.504147 (+ 13133us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:27.504199 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.504295 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.893254 (+388959us) raft_consensus.cc:1685] finished
0709 13:10:27.893286 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.893539 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59869,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":24593,"spinlock_wait_cycles":4534016,"thread_start_us":12693,"threads_started":1,"wal-append.queue_time_us":376137}
I20260709 13:10:27.907253 22746 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:27.908816 22940 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:27.910622 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.911851 22823 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:27.913925 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:27.920008 21320 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:27.881487 22927 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:27.923719 22778 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:27.923976 22927 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:27.925273 22759 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:27.761027 21465 rpcz_store.cc:276] 0709 13:10:24.343065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.343231 (+   166us) service_pool.cc:224] Handling call
0709 13:10:24.343772 (+   541us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:24.446955 (+103183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.446992 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:24.447717 (+   725us) log.cc:844] Serialized 52 byte log entry
0709 13:10:24.549625 (+101908us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:24.842725 (+293100us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.884302 (+ 41577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.653011 (+2768709us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b54001a72d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:27.658785 (+  5774us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.659715 (+   930us) raft_consensus.cc:1685] finished
0709 13:10:27.685881 (+ 26166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.698560 (+ 12679us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21747,"prepare.queue_time_us":313999,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":40,"raft.queue_time_us":31134,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":3617,"spinlock_wait_cycles":226311552,"thread_start_us":202654,"threads_started":2,"wal-append.queue_time_us":333851,"wal-append.run_cpu_time_us":5819,"wal-append.run_wall_time_us":1293133}
W20260709 13:10:27.931118 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.939963 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:27.942970 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:27.943670 21393 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:27.947301 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:27.949827 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:27.952263 21394 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 13:10:27.952674 21394 pending_rounds.cc:85] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 1
I20260709 13:10:27.933913 21320 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:10:27.936596 23077 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:27.933166 22778 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:27.927829 23084 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:27.956300 21320 pending_rounds.cc:85] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 5
W20260709 13:10:27.934504 21250 debug-util.cc:398] Leaking SignalData structure 0x7b0800380400 after lost signal to thread 22884
I20260709 13:10:27.957597 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:27.964322 21320 pending_rounds.cc:107] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:27.964689 21320 raft_consensus.cc:2889] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.965302 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:27.952927 21394 pending_rounds.cc:107] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:10:27.967163 21394 raft_consensus.cc:2917] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:10:27.969978 21394 raft_consensus.cc:2889] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.976491 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:27.957592 21388 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:27.981298 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:27.958192 22921 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.001618 22823 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.002115 22911 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:28.002517 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36472 (request call id 14) took 5969 ms. Trace:
W20260709 13:10:28.006428 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.993582 23077 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:28.010162 23077 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:27.977190 22988 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:27.985246 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.010637 23077 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:28.007608 21394 rpcz_store.cc:276] 0709 13:10:22.033534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.033711 (+   177us) service_pool.cc:224] Handling call
0709 13:10:22.058580 (+ 24869us) log.cc:844] Serialized 513 byte log entry
0709 13:10:22.779535 (+720955us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b54003046a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf191142 00007fc2bf171eaa 00007fc2bf178d53 00007fc2bf178cd9 00007fc2bf178c69 00007fc2bf178c31 00007fc2bf177dfd 000000000038f354 000000000038f199 00007fc2bc12b475
0709 13:10:22.903955 (+124420us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b54003046a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf198b26 00007fc2bf19249a 00007fc2bf191714 00007fc2bf171eaa 00007fc2bf178d53 00007fc2bf178cd9 00007fc2bf178c69 00007fc2bf178c31 00007fc2bf177dfd 000000000038f354
0709 13:10:22.928853 (+ 24898us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b54003046a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf191142 00007fc2bf171eaa 00007fc2bf178d53 00007fc2bf178cd9 00007fc2bf178c69 00007fc2bf178c31 00007fc2bf177dfd 000000000038f354 000000000038f199 00007fc2bc12b475
0709 13:10:23.452585 (+523732us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb20a0a 00007fc2bdb20693 00007fc2bdb20631 00007fc2bf254b52 00007fc2bf254cf5 00007fc2bf191691 00007fc2bf171eaa 00007fc2bf178d53 00007fc2bf178cd9 00007fc2bf178c69
0709 13:10:23.540445 (+ 87860us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b1800205ec0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf254d01 00007fc2bf191691 00007fc2bf171eaa 00007fc2bf178d53 00007fc2bf178cd9 00007fc2bf178c69 00007fc2bf178c31 00007fc2bf177dfd 000000000038f354 000000000038f199
0709 13:10:27.997552 (+4457107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17767,"raft.run_cpu_time_us":32571,"raft.run_wall_time_us":2661759,"spinlock_wait_cycles":1259013120,"thread_start_us":330410,"threads_started":1,"wal-append.queue_time_us":458463,"wal-append.run_cpu_time_us":22850,"wal-append.run_wall_time_us":1584269}
I20260709 13:10:27.968963 23084 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.009047 22823 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.043242 23058 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:28.047973 22823 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:28.055547 21315 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:28.005816 22778 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.007853 22921 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.105778 21469 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:28.078462 22911 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.081043 22778 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:28.113169 23058 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:28.166785 23046 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:28.167306 23046 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:28.168331 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:28.168220 23046 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.168957 21465 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.169449 23046 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:28.079054 22980 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.163616 22906 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:28.177137 23098 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.178972 23098 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.180398 21469 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:10:28.181780 21267 auto_rebalancer.cc:629] Failed to schedule move for tablet 24db01a278af4a82a16f038fedabf4d3: Aborted: Op aborted by new leader
I20260709 13:10:28.184481 22921 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:28.192857 22980 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.176122 22906 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.199226 23098 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:28.125141 22911 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.281924 22911 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.202147 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:28.282961 22838 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:28.283174 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 81157us
I20260709 13:10:28.203665 23079 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.284942 23079 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.225344 23057 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.288401 23057 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.229722 23081 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.230054 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:28.296485 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 65526.4us
I20260709 13:10:28.297921 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.265384 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 194) took 1177 ms. Trace:
I20260709 13:10:28.293169 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.298552 21394 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:28.308216 23057 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:28.307986 23081 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.307978 22761 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:28.308997 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.309099 22761 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.309924 22906 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:28.310480 23081 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:28.311311 22761 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.287801 23079 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:28.311828 23084 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:28.315764 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.306373 21469 rpcz_store.cc:276] 0709 13:10:27.087937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.088184 (+   247us) service_pool.cc:224] Handling call
0709 13:10:27.088570 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.079968 (+991398us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b58001337d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4
0709 13:10:28.264831 (+184863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.265307 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145642880}
I20260709 13:10:28.318697 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:28.318811 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.319543 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.344617 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:28.345758 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.350275 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.351362 21469 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:28.353052 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:28.365832 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.367789 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.434125 21469 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:28.372562 23078 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.380229 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.010s	sys 0.018s
W20260709 13:10:28.434794 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.010s	sys 0.018s
W20260709 13:10:28.435257 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 691820us
W20260709 13:10:28.436934 21312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.018s	sys 0.037s
W20260709 13:10:28.437278 21312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.018s	sys 0.037s
W20260709 13:10:28.400378 22837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.010s	sys 0.019s
I20260709 13:10:28.315374 21465 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:28.367139 23079 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:28.374581 23067 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:28.316282 23077 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:28.398303 21287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.006s	sys 0.024s
W20260709 13:10:28.401307 21284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.011s	sys 0.028s
W20260709 13:10:28.447120 21284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.011s	sys 0.028s
W20260709 13:10:28.446733 21287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.006s	sys 0.024s
W20260709 13:10:28.447397 23004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.474s	user 0.010s	sys 0.021s
W20260709 13:10:28.450526 23004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.010s	sys 0.021s
I20260709 13:10:28.455507 21320 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:10:28.430097 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.017s	sys 0.015s
I20260709 13:10:28.371505 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:28.414750 21461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.017s	sys 0.016s
I20260709 13:10:28.455420 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.456215 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:28.456158 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.018s	sys 0.015s
W20260709 13:10:28.441715 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.008s	sys 0.020s
I20260709 13:10:28.452566 23098 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.446453 21466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.019s
W20260709 13:10:28.489164 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.010s	sys 0.021s
W20260709 13:10:28.493562 21466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.007s	sys 0.019s
I20260709 13:10:28.494431 21321 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
W20260709 13:10:28.489328 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 841582us
I20260709 13:10:28.491417 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.497109 21319 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:28.443352 23079 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.492628 21316 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:28.443987 23067 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:28.461906 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 90503.6us
W20260709 13:10:28.539052 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.545077 23100 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:10:28.544915 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:28.510018 23098 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.557945 21388 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:28.559087 23098 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:28.510629 23079 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.546427 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:28.548285 23102 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:10:28.462944 23064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.008s	sys 0.021s
W20260709 13:10:28.582913 23064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.008s	sys 0.021s
I20260709 13:10:28.585175 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.491582 22778 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:28.589018 23077 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.590250 23087 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:28.590899 23087 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.551318 23063 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.591998 23063 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.593267 23087 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.552332 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:28.552508 21387 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:28.594164 21468 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:28.594569 23063 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.594679 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:28.594998 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:28.595371 21387 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:28.552975 22918 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:28.596287 22918 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.598309 22918 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.553812 23081 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:28.598958 23081 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.599256 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.601231 23081 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:28.601436 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:28.553890 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.603937 21465 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 1.
I20260709 13:10:28.604892 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.513563 23067 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:28.605496 21465 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:28.509073 22911 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.612299 22911 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:28.494079 23022 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.000s	sys 0.028s
W20260709 13:10:28.614773 23022 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.000s	sys 0.029s
I20260709 13:10:28.577986 21392 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:28.616307 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.616814 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.617668 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:28.509977 22837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.010s	sys 0.019s
I20260709 13:10:28.621781 22031 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:28.627441 21392 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:28.579434 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.580379 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.607421 21468 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:28.610664 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.629077 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.642606 21392 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:28.644253 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.508978 23004 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:28.639057 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.639415 21320 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:28.646783 21320 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:28.640118 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:28.645049 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:28.509321 21461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.018s	sys 0.018s
I20260709 13:10:28.653591 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.649520 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.651973 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:28.614991 22911 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:28.654784 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:28.658479 21392 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:28.659495 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:28.660724 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:28.442339 23078 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.665091 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:28.670029 22040 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:28.672293 22040 pending_rounds.cc:85] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 5
W20260709 13:10:28.672508 21463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.010s	sys 0.026s
I20260709 13:10:28.672638 22040 pending_rounds.cc:107] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 13:10:28.673379 21463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.010s	sys 0.027s
I20260709 13:10:28.673400 22040 raft_consensus.cc:2889] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.671718 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:28.675905 22039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.016s	sys 0.021s
W20260709 13:10:28.676442 22039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.016s	sys 0.021s
I20260709 13:10:28.675907 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:28.678778 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:28.680269 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:28.661609 21320 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.721371 21320 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.689275 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.683144 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.724190 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.724946 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.726182 21314 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:28.670537 22778 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:28.728423 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:28.729380 22035 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:10:28.729902 21433 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.729969 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:28.730783 22041 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:28.730942 22980 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.731110 23101 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:28.731499 22980 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.731673 23101 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.733614 22980 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:28.733955 23101 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.648823 22793 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:28.665719 23084 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:28.690692 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:28.734727 22793 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.735615 21316 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:28.730814 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:28.736774 22793 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:28.685292 22947 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:28.728420 22778 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:28.737356 22947 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:28.685657 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:28.690440 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:28.672070 22837 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.664239 23004 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.738047 21317 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
W20260709 13:10:28.716396 23080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.016s	sys 0.039s
W20260709 13:10:28.752720 22002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.015s	sys 0.040s
W20260709 13:10:28.753038 22002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.015s	sys 0.040s
I20260709 13:10:28.737808 22947 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:28.696318 23091 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.004s	sys 0.029s
I20260709 13:10:28.734112 22980 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:28.691082 23022 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:28.690100 21464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.022s	sys 0.023s
I20260709 13:10:28.689616 22838 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:28.744024 21468 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:28.744151 21314 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:28.715030 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:28.735494 23079 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.713949 22911 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.671654 21469 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:28.715898 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53097.2us
I20260709 13:10:28.728499 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:28.745122 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:28.714762 23098 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:28.801756 23091 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.007s	sys 0.029s
W20260709 13:10:28.801095 21464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.025s	sys 0.023s
W20260709 13:10:28.792172 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.013s	sys 0.022s
W20260709 13:10:28.741449 21462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.019s	sys 0.042s
W20260709 13:10:28.806492 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 126324us
W20260709 13:10:28.754160 23080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.016s	sys 0.040s
I20260709 13:10:28.853345 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:28.849143 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.014s	sys 0.023s
I20260709 13:10:28.855036 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:28.837472 21469 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:28.746996 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:28.798043 23092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.002s	sys 0.044s
I20260709 13:10:28.753634 22034 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:28.850566 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:28.852515 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.750937 22917 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.754940 23088 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.023s	sys 0.025s
W20260709 13:10:28.809104 23059 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.023s	sys 0.039s
W20260709 13:10:28.858032 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 977590us
I20260709 13:10:28.752466 22918 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
W20260709 13:10:28.866120 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 119226us
I20260709 13:10:28.867513 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:28.802904 22838 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.803184 21387 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:28.750942 23058 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:10:28.805806 22980 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.876233 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:28.900913 22980 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:28.900964 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:28.753072 22778 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:28.886688 23082 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:28.903577 23082 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:28.904074 23082 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.863119 21468 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:28.842765 23074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.024s	sys 0.024s
I20260709 13:10:28.914268 21468 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:28.916414 21468 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:28.805949 23022 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.842588 23093 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:28.848090 22036 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:28.893190 23108 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:10:28.874548 22823 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:28.894146 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:28.894330 23109 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:28.894605 22838 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.874632 22906 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:28.869292 23092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.005s	sys 0.044s
W20260709 13:10:28.879010 23088 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.023s	sys 0.025s
I20260709 13:10:28.879083 22793 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.880730 23101 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.904903 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:28.842862 23064 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.875519 23111 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:10:28.892387 23059 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.024s	sys 0.039s
I20260709 13:10:28.895411 23115 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:28.937130 23093 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.909821 21392 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:28.936836 23098 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:28.843250 23056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.004s	sys 0.020s
I20260709 13:10:28.754020 22837 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:28.937143 21393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.014s	sys 0.030s
I20260709 13:10:28.938151 22042 raft_consensus.cc:2410] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:10:28.850430 23077 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:10:28.895483 22040 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:28.905187 22912 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:28.845611 22911 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:28.870132 23087 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 13:10:28.913265 23074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.024s	sys 0.024s
I20260709 13:10:28.919473 22980 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.031797 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:28.990792 21469 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:29.075307 21469 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:28.912814 22774 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:28.859048 21389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.012s	sys 0.013s
I20260709 13:10:28.886566 22917 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.038502 23078 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:28.924610 23107 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:28.910403 22761 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
W20260709 13:10:29.043267 21315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.016s	sys 0.021s
I20260709 13:10:29.001116 22906 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:10:28.856398 21462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.020s	sys 0.043s
W20260709 13:10:29.056905 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.031358 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.117919 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.059636 23113 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:29.062029 21393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.014s	sys 0.030s
I20260709 13:10:29.120378 23113 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.122584 23113 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:29.077701 21469 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:29.124138 21469 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:29.062964 23056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.004s	sys 0.020s
I20260709 13:10:29.059345 23093 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:29.126772 22035 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:29.059387 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:29.054725 23064 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.128607 21387 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:29.035434 23081 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:10:29.133033 23112 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:10:29.134174 23104 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:10:29.089262 21395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.001s	sys 0.062s
W20260709 13:10:29.135412 21395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.001s	sys 0.062s
W20260709 13:10:29.090416 21315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.016s	sys 0.021s
I20260709 13:10:29.030130 22793 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:29.034760 23101 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.100940 21396 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:29.078878 21389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.012s	sys 0.013s
I20260709 13:10:29.102819 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.104754 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.097414 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.106027 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.107216 22917 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:29.110661 23116 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:29.102063 22906 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:29.114341 23110 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.006s
I20260709 13:10:29.078274 22912 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.115880 23022 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:29.116523 23004 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:29.037345 21467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.015s	sys 0.028s
W20260709 13:10:29.189472 21467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.015s	sys 0.028s
W20260709 13:10:29.101141 22002 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.520s (SENT)
I20260709 13:10:29.078732 22774 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:10:29.155575 21470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.012s	sys 0.045s
W20260709 13:10:29.209254 21470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.013s	sys 0.045s
I20260709 13:10:29.104313 21465 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:29.149849 23107 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.089494 22980 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.222043 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 195) took 1577 ms. Trace:
I20260709 13:10:29.194291 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:29.185082 22983 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.017s	sys 0.027s
I20260709 13:10:29.123773 23113 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:10:29.148092 22988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.016s	sys 0.023s
I20260709 13:10:29.161101 23079 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:29.283996 21394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.029s	sys 0.039s
I20260709 13:10:29.156904 22034 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:29.210135 22774 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:29.289144 21284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.585s (SENT) [suppressed 16 similar messages]
I20260709 13:10:29.211212 22761 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:10:29.295855 21394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.030s	sys 0.039s
W20260709 13:10:29.314538 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 214515us
W20260709 13:10:29.315611 22002 leader_election.cc:336] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.713s (SENT)
I20260709 13:10:29.316488 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:29.240447 21467 rpcz_store.cc:276] 0709 13:10:27.644888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.645026 (+   138us) service_pool.cc:224] Handling call
0709 13:10:27.645336 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.653776 (+  8440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.653808 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.664697 (+ 10889us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.925457 (+260760us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b48001e0258. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:10:27.958780 (+ 33323us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:29.189884 (+1231104us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.209175 (+ 19291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.209284 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.209354 (+    70us) raft_consensus.cc:1685] finished
0709 13:10:29.221015 (+ 11661us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.221684 (+   669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26063,"prepare.queue_time_us":20656,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1449,"raft.queue_time_us":35988,"raft.run_cpu_time_us":1742,"raft.run_wall_time_us":269398,"spinlock_wait_cycles":78372224,"thread_start_us":1474631,"threads_started":2,"wal-append.queue_time_us":704347}
W20260709 13:10:29.327994 23066 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.572s	user 0.034s	sys 0.086s
W20260709 13:10:29.328500 23066 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.584s	user 0.035s	sys 0.086s
I20260709 13:10:29.329952 23064 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:29.332383 23064 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:29.332834 22912 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:29.333220 23064 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:29.333783 23064 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:29.334956 23064 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.336796 22793 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:29.338155 22837 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:29.295805 23107 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:29.341583 23107 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:29.296533 22983 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.266s	user 0.017s	sys 0.027s
W20260709 13:10:29.299018 22988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.017s	sys 0.023s
W20260709 13:10:29.356283 23073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.015s	sys 0.030s
I20260709 13:10:29.358206 22894 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:29.360977 23114 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:10:29.362421 21318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.012s	sys 0.037s
W20260709 13:10:29.426915 21318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.012s	sys 0.037s
I20260709 13:10:29.224565 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1424) took 1584 ms. Trace:
I20260709 13:10:29.222254 23082 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:29.321415 23102 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:10:29.409332 23073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.016s	sys 0.031s
I20260709 13:10:29.443794 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1469) took 1780 ms. Trace:
I20260709 13:10:29.434041 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1429) took 1608 ms. Trace:
I20260709 13:10:29.343834 22761 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:29.496930 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.444412 21312 rpcz_store.cc:276] 0709 13:10:27.662853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.663070 (+   217us) service_pool.cc:224] Handling call
0709 13:10:27.685058 (+ 21988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.685462 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.685499 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.698924 (+ 13425us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.437614 (+738690us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:28.437653 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.437731 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.113820 (+676089us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:29.433466 (+319646us) raft_consensus.cc:1685] finished
0709 13:10:29.433498 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.443591 (+ 10093us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114988,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":5320,"spinlock_wait_cycles":8246016,"thread_start_us":692686,"threads_started":1,"wal-append.queue_time_us":1155046}
I20260709 13:10:29.468164 21468 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:29.502681 23124 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:10:29.460737 23067 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.855s	user 0.006s	sys 0.006s
I20260709 13:10:29.494504 21464 rpcz_store.cc:276] 0709 13:10:27.825241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.825445 (+   204us) service_pool.cc:224] Handling call
0709 13:10:27.825884 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.836131 (+ 10247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.836174 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.836688 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.849183 (+1012495us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:28.886959 (+ 37776us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.893227 (+  6268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.893304 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.361252 (+467948us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:29.409980 (+ 48728us) raft_consensus.cc:1685] finished
0709 13:10:29.433815 (+ 23835us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.433965 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13942,"raft.queue_time_us":14467,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":6208,"spinlock_wait_cycles":30708096,"thread_start_us":1012048,"threads_started":1,"wal-append.queue_time_us":1320742}
I20260709 13:10:29.430410 22032 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:29.529420 23119 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:10:29.429864 23106 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:29.469736 22911 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:29.543864 21466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.005s	sys 0.031s
W20260709 13:10:29.544364 21466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.006s	sys 0.031s
I20260709 13:10:29.545110 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1427) took 1901 ms. Trace:
W20260709 13:10:29.546362 21321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.014s	sys 0.058s
W20260709 13:10:29.548110 21321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.015s	sys 0.058s
W20260709 13:10:29.561208 21391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.014s	sys 0.020s
W20260709 13:10:29.561602 21391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.014s	sys 0.020s
I20260709 13:10:29.446251 22774 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.546849 21463 rpcz_store.cc:276] 0709 13:10:27.643492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.643610 (+   118us) service_pool.cc:224] Handling call
0709 13:10:27.643953 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.649411 (+  5458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.649439 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.665955 (+ 16516us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.674188 (+1008233us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:28.674241 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.674342 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.544822 (+870480us) raft_consensus.cc:1685] finished
0709 13:10:29.544852 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.545034 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18484,"raft.queue_time_us":5371,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":1391360,"thread_start_us":974407,"threads_started":1,"wal-append.queue_time_us":1411449}
I20260709 13:10:29.546103 23063 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:29.527786 23067 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:29.585942 23129 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:29.592742 23082 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:29.537021 23093 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.595574 23093 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:29.596668 23131 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:29.609552 21469 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:29.602047 22980 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:29.614427 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 196) took 1969 ms. Trace:
W20260709 13:10:29.628830 21362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.005s	sys 0.029s
W20260709 13:10:29.639796 21362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.005s	sys 0.029s
W20260709 13:10:29.624254 23123 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:10:29.429132 21461 rpcz_store.cc:276] 0709 13:10:27.640015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.642666 (+  2651us) service_pool.cc:224] Handling call
0709 13:10:27.650669 (+  8003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.664594 (+ 13925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.668219 (+  3625us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.697170 (+ 28951us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.080211 (+383041us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b48001e0258. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:10:28.671026 (+590815us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:28.683560 (+ 12534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.688844 (+  5284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.160852 (+472008us) raft_consensus.cc:1685] finished
0709 13:10:29.161806 (+   954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.221165 (+ 59359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3156,"raft.queue_time_us":13526,"raft.run_cpu_time_us":2480,"raft.run_wall_time_us":412638,"spinlock_wait_cycles":47765760,"thread_start_us":955073,"threads_started":1,"wal-append.queue_time_us":1212679}
I20260709 13:10:29.651790 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1455) took 1695 ms. Trace:
I20260709 13:10:29.652009 23067 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:29.652315 21389 rpcz_store.cc:276] 0709 13:10:27.955932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.964961 (+  9029us) service_pool.cc:224] Handling call
0709 13:10:27.997392 (+ 32431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.009156 (+ 11764us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:29.160072 (+1150916us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.651389 (+491317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.651468 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:29.651511 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.651587 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.651729 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101886,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":10370,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1564766,"threads_started":2}
I20260709 13:10:29.657804 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1441) took 1344 ms. Trace:
I20260709 13:10:29.658264 21465 rpcz_store.cc:276] 0709 13:10:28.313475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.631873 (+318398us) service_pool.cc:224] Handling call
0709 13:10:29.657598 (+1025725us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54001a72d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:29.657723 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785572096}
I20260709 13:10:29.660415 22774 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:29.661046 23101 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:29.663774 21361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.013s	sys 0.020s
W20260709 13:10:29.664222 21361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.014s	sys 0.020s
I20260709 13:10:29.672925 23067 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.673595 23067 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:29.677975 22838 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.002s
I20260709 13:10:29.678524 22838 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:29.688328 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1291) took 1187 ms. Trace:
I20260709 13:10:29.688963 21468 rpcz_store.cc:276] 0709 13:10:28.500797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.917846 (+417049us) service_pool.cc:224] Handling call
0709 13:10:28.918303 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.499254 (+580951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.682703 (+183449us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540025e254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:29.688225 (+  5522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263964544}
I20260709 13:10:29.668232 23074 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.675833 23067 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:29.631340 22947 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.804s	user 0.007s	sys 0.004s
W20260709 13:10:29.630091 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.014s	sys 0.017s
W20260709 13:10:29.722092 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.014s	sys 0.017s
W20260709 13:10:29.722498 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 826242us
W20260709 13:10:29.641413 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 788128us
W20260709 13:10:29.631417 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.000s	sys 0.031s
W20260709 13:10:29.724357 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.000s	sys 0.031s
W20260709 13:10:29.724916 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 824008us
I20260709 13:10:29.725301 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:29.696738 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.019s	sys 0.013s
W20260709 13:10:29.726184 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.019s	sys 0.013s
I20260709 13:10:29.727651 21468 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:29.697538 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.013s	sys 0.017s
I20260709 13:10:29.694087 22912 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:10:29.731324 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.013s	sys 0.017s
W20260709 13:10:29.690853 22038 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.033s	sys 0.071s
W20260709 13:10:29.737090 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.009s	sys 0.015s
W20260709 13:10:29.737411 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.015s
I20260709 13:10:29.740761 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:29.697407 22778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.009s	sys 0.022s
I20260709 13:10:29.739501 22912 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.742678 21389 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:29.742822 23067 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:29.744323 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:29.770617 21393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.046s	sys 0.074s
W20260709 13:10:29.745275 23130 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:29.745680 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1291) took 1182 ms. Trace:
I20260709 13:10:29.745846 22918 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:29.746760 22911 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:29.748196 23082 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:29.749251 23135 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.212s	user 0.002s	sys 0.001s
W20260709 13:10:29.752085 23137 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:10:29.752506 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:29.736582 23079 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:29.626168 21462 rpcz_store.cc:276] 0709 13:10:27.645167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.645291 (+   124us) service_pool.cc:224] Handling call
0709 13:10:27.667371 (+ 22080us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.712420 (+ 45049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.715534 (+  3114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.792127 (+ 76593us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.918739 (+126612us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b48001e0258. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:10:29.151803 (+1233064us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:29.153644 (+  1841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.158087 (+  4443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.584137 (+426050us) raft_consensus.cc:1685] finished
0709 13:10:29.584167 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.612900 (+ 28733us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41278,"raft.queue_time_us":30112,"raft.run_cpu_time_us":3365,"raft.run_wall_time_us":219162,"spinlock_wait_cycles":83571072,"thread_start_us":1310019,"threads_started":1,"wal-append.queue_time_us":1421250}
W20260709 13:10:29.756973 23136 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
I20260709 13:10:29.757840 22761 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:29.759311 22838 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:29.692013 23074 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:29.769372 23092 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:10:29.736268 23080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.003s	sys 0.021s
I20260709 13:10:29.792133 22918 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:29.818213 23080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.003s	sys 0.021s
I20260709 13:10:29.692814 23073 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.766707 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.021s	sys 0.052s
I20260709 13:10:29.738204 22947 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:29.820487 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.022s	sys 0.052s
W20260709 13:10:29.820871 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 910707us
I20260709 13:10:29.767869 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:29.771080 21393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.046s	sys 0.074s
I20260709 13:10:29.772225 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1298) took 1138 ms. Trace:
I20260709 13:10:29.822444 21469 rpcz_store.cc:276] 0709 13:10:28.633565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.125926 (+492361us) service_pool.cc:224] Handling call
0709 13:10:29.126173 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.610163 (+483990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.771907 (+161744us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540025ab54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:29.772148 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110183808}
I20260709 13:10:29.694283 22988 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.774932 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:29.824770 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:29.777706 21391 rpcz_store.cc:276] 0709 13:10:28.563775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.646684 (+ 82909us) service_pool.cc:224] Handling call
0709 13:10:28.647104 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.647579 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.647620 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.648179 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.561990 (+913811us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.574174 (+ 12184us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.574414 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.574486 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.745470 (+170984us) raft_consensus.cc:1685] finished
0709 13:10:29.745491 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.745620 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28634,"prepare.queue_time_us":11534,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":1233,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":12464,"thread_start_us":873413,"threads_started":1,"wal-append.queue_time_us":1071678}
I20260709 13:10:29.825850 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:29.826419 21391 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:29.739609 22038 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.034s	sys 0.071s
I20260709 13:10:29.790349 21321 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:29.755592 23138 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:10:29.768844 22778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.009s	sys 0.022s
I20260709 13:10:29.739990 23107 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:29.832508 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:29.797390 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 481800us
W20260709 13:10:29.773851 22983 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:29.804144 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:29.762266 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1601) took 1308 ms. Trace:
I20260709 13:10:29.787202 22837 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.739336 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.843066 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 75375.9us
I20260709 13:10:29.844118 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:29.819689 23073 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.846872 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1482) took 1658 ms. Trace:
I20260709 13:10:29.848469 23073 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:29.850076 23073 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:29.850570 23073 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.852115 23107 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.829861 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:29.829994 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:29.835201 22002 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.804s (SENT)
W20260709 13:10:29.835541 21359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.000s	sys 0.026s
I20260709 13:10:29.835345 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:29.854897 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:29.840111 21318 rpcz_store.cc:276] 0709 13:10:28.453444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.453552 (+   108us) service_pool.cc:224] Handling call
0709 13:10:28.453909 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.454258 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.454293 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.492543 (+ 38250us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.427905 (+935362us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:29.427943 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.428022 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.762002 (+333980us) raft_consensus.cc:1685] finished
0709 13:10:29.762034 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.762198 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":38134,"thread_start_us":871112,"threads_started":1,"wal-append.queue_time_us":1125151}
I20260709 13:10:29.858438 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:29.854920 21313 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:29.861363 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:29.844856 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:29.866959 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:29.793120 22911 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:29.854955 21359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.000s	sys 0.026s
I20260709 13:10:29.876291 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:29.877810 21391 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:29.882594 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:10:29.884060 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54119.1us
I20260709 13:10:29.800871 23079 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:29.881680 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46505.5us
I20260709 13:10:29.888871 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:29.894789 22040 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:29.888932 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.895695 22042 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:29.847306 21315 rpcz_store.cc:276] 0709 13:10:28.188008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.188158 (+   150us) service_pool.cc:224] Handling call
0709 13:10:28.188481 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.188814 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.188842 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.189258 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.150017 (+960759us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:29.150055 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.150136 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.748546 (+598410us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:29.836311 (+ 87765us) raft_consensus.cc:1685] finished
0709 13:10:29.836353 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.846803 (+ 10450us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":916,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":2370304,"thread_start_us":946538,"threads_started":1,"wal-append.queue_time_us":1347590}
I20260709 13:10:29.909698 21390 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:29.843490 23139 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:10:29.920020 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.909785 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1457) took 1818 ms. Trace:
I20260709 13:10:29.852149 23080 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:29.828994 22988 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:29.863184 23149 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:29.830706 23092 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.926215 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1425) took 2285 ms. Trace:
I20260709 13:10:29.860886 23152 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:29.885280 21387 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:29.919613 22761 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:29.978577 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 203) took 1321 ms. Trace:
I20260709 13:10:29.863654 22837 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:29.873708 22778 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:29.921540 21395 rpcz_store.cc:276] 0709 13:10:28.091132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.093200 (+  2068us) service_pool.cc:224] Handling call
0709 13:10:28.093572 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.204884 (+111312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.204915 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.205494 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.148831 (+943337us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:29.148873 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.148934 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.907108 (+758174us) raft_consensus.cc:1685] finished
0709 13:10:29.907132 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.909591 (+  2459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107050,"raft.queue_time_us":107578,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":929943,"threads_started":1,"wal-append.queue_time_us":1370982}
I20260709 13:10:29.887912 23105 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:29.958971 21284 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.009s	sys 0.035s
I20260709 13:10:29.929544 22918 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:29.886195 22912 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:29.907325 23093 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:29.881619 22793 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:29.927459 23058 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.920555 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:29.968492 21470 rpcz_store.cc:276] 0709 13:10:27.640966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.641586 (+   620us) service_pool.cc:224] Handling call
0709 13:10:27.641949 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.642283 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.642310 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.994068 (+351758us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b2c0002f1a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:10:27.997742 (+  3674us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.209863 (+1212121us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:29.209918 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.210005 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.907993 (+697988us) raft_consensus.cc:1685] finished
0709 13:10:29.908017 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.926108 (+ 18091us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4223,"raft.queue_time_us":5496,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":29797,"spinlock_wait_cycles":4557184,"thread_start_us":1189509,"threads_started":1,"wal-append.queue_time_us":1622206}
I20260709 13:10:29.951234 23067 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.981793 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:29.986384 21284 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.010s	sys 0.035s
I20260709 13:10:29.989756 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:29.959252 23127 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.979007 21313 rpcz_store.cc:276] 0709 13:10:28.656862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.725047 (+ 68185us) service_pool.cc:224] Handling call
0709 13:10:28.725352 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.859531 (+1134179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.978292 (+118761us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540022cc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:29.978512 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2597295488}
I20260709 13:10:29.993022 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1464) took 1652 ms. Trace:
I20260709 13:10:29.996052 21315 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:29.982985 23084 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.245s	user 0.010s	sys 0.004s
I20260709 13:10:29.999070 21394 rpcz_store.cc:276] 0709 13:10:28.340961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.341117 (+   156us) service_pool.cc:224] Handling call
0709 13:10:28.341456 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.357018 (+ 15562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.357067 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.357678 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.315328 (+957650us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:29.315370 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.315437 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.992815 (+677378us) raft_consensus.cc:1685] finished
0709 13:10:29.992833 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.992960 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16215,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":3578,"spinlock_wait_cycles":747904,"thread_start_us":934513,"threads_started":1,"wal-append.queue_time_us":1265687}
I20260709 13:10:29.996702 21318 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
W20260709 13:10:29.996105 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 706988us
I20260709 13:10:29.997169 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.980966 23149 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:29.958294 23080 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:29.920418 23148 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:10:30.012914 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1285) took 1514 ms. Trace:
W20260709 13:10:30.016081 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.007s	sys 0.050s
W20260709 13:10:30.016407 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.007s	sys 0.050s
I20260709 13:10:30.015409 21390 rpcz_store.cc:276] 0709 13:10:28.498960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.499116 (+   156us) service_pool.cc:224] Handling call
0709 13:10:29.907414 (+1408298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.926694 (+ 19280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.012657 (+ 85963us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002e3bd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:30.012843 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3130806016}
W20260709 13:10:30.016664 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 1.09548e+06us
I20260709 13:10:29.991536 23152 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:29.988900 23073 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:29.990844 23058 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.991151 23107 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:30.009527 23118 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.852s	user 0.000s	sys 0.005s
I20260709 13:10:30.024313 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:29.995803 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:29.990783 22793 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:29.982996 22778 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.039047 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:30.059382 22042 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:30.061524 21315 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:30.018955 23084 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.058676 22793 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.063956 22947 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:30.064157 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:30.065968 22906 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.872s	user 0.004s	sys 0.008s
W20260709 13:10:30.067766 23155 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:10:30.069199 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.069969 23153 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:30.071525 22040 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:30.072495 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:30.035641 23058 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.003638 23067 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.045626 23152 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:10:30.111799 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.127321 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:30.010076 23127 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.136843 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:30.139091 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:30.131052 23122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.008s	sys 0.009s
I20260709 13:10:30.145910 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:30.058485 23105 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:10:30.157493 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:30.153016 22040 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:30.176184 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 498) took 3053 ms. Trace:
I20260709 13:10:30.128453 22906 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.090946 23160 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:10:30.145323 23153 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:30.193519 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:30.194205 21318 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
W20260709 13:10:30.157912 23143 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.315s	user 0.001s	sys 0.001s
I20260709 13:10:30.176637 22039 rpcz_store.cc:276] 0709 13:10:27.118954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.119369 (+   415us) service_pool.cc:224] Handling call
0709 13:10:27.135389 (+ 16020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.171091 (+ 35702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.171122 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.174892 (+  3770us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.848392 (+673500us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18003af420. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:10:28.676922 (+828530us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:28.676978 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.677068 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.799314 (+1122246us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:30.172518 (+373204us) raft_consensus.cc:1685] finished
0709 13:10:30.172543 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.172693 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63941,"raft.queue_time_us":85740,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7228,"spinlock_wait_cycles":147236352,"thread_start_us":828317,"threads_started":1,"wal-append.queue_time_us":1828435}
I20260709 13:10:30.160069 22983 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:30.158658 23064 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:30.175216 22911 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:30.196616 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:30.197265 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 321041us
I20260709 13:10:30.155197 23081 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:30.198094 21313 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.215010 21313 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:30.200342 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:30.152384 23122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.010s	sys 0.009s
I20260709 13:10:30.152691 21388 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:30.170665 23146 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:30.222599 23146 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.228353 21313 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.204487 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:30.179342 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 293899us
I20260709 13:10:30.210454 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:30.212201 21390 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:30.180212 23079 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:30.210345 23158 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 13:10:30.155449 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 333543us
I20260709 13:10:30.238754 21313 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.212337 23160 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:30.203605 23147 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.211421 22988 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:30.227272 23082 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:30.245810 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:30.245419 23150 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:10:30.245414 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1456) took 2276 ms. Trace:
I20260709 13:10:30.236721 21461 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:30.278807 21469 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:30.210898 23092 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:30.197979 23156 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:10:30.234963 22837 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:30.246819 23160 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:30.292409 21393 rpcz_store.cc:276] 0709 13:10:27.961224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.978620 (+ 17396us) service_pool.cc:224] Handling call
0709 13:10:27.978978 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.979202 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:29.120895 (+1141693us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.237239 (+1116344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.237309 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:30.237366 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.237452 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.237592 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10729,"prepare.queue_time_us":132805,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":235748,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4207,"thread_start_us":2228745,"threads_started":3,"wal-append.queue_time_us":859710}
I20260709 13:10:30.240857 23057 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:30.303086 21313 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.304232 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:30.268651 23149 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:30.302735 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.326884 22778 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:30.296792 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 429884us
I20260709 13:10:30.308765 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1428) took 2551 ms. Trace:
I20260709 13:10:30.335259 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:30.227746 23081 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.305238 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:30.269165 23147 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.335170 22983 tablet_bootstrap.cc:492] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:30.341964 21466 rpcz_store.cc:276] 0709 13:10:27.757568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.757824 (+   256us) service_pool.cc:224] Handling call
0709 13:10:27.773679 (+ 15855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.511827 (+738148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.511893 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.632248 (+120355us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.544815 (+912567us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:29.544865 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.544964 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.308445 (+763481us) raft_consensus.cc:1685] finished
0709 13:10:30.308473 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.308683 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25158,"raft.queue_time_us":32041,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":1563350,"threads_started":2,"wal-append.queue_time_us":1134968}
I20260709 13:10:30.335060 23080 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:30.352218 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 263257us
W20260709 13:10:30.361212 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.356841 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 270406us
I20260709 13:10:30.329912 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:30.424700 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 387477us
W20260709 13:10:30.416136 21392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.009s	sys 0.010s
I20260709 13:10:30.318519 23057 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:30.424947 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 60966.5us
I20260709 13:10:30.507249 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:30.508108 21396 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 2: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:30.465158 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:30.344470 23093 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:30.467389 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:30.298729 23082 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.519811 23093 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:30.472007 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.520756 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 220548us
W20260709 13:10:30.473304 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 267796us
W20260709 13:10:30.473363 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 168237us
W20260709 13:10:30.477772 21392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.013s	sys 0.011s
I20260709 13:10:30.269850 23152 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.360106 23151 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:30.332270 22793 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.360152 23106 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:30.501987 23127 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:30.521979 23093 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:30.558364 22983 ts_tablet_manager.cc:1403] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 3.496s	user 0.041s	sys 0.059s
I20260709 13:10:30.559355 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:30.560487 21395 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:10:30.562013 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 51639.3us
I20260709 13:10:30.561666 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:30.479672 23164 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:10:30.479184 23067 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:30.571599 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:30.572615 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1296) took 1978 ms. Trace:
I20260709 13:10:30.573061 21387 rpcz_store.cc:276] 0709 13:10:28.602187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.156423 (+554236us) service_pool.cc:224] Handling call
0709 13:10:29.220173 (+ 63750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.981538 (+761365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.572338 (+590800us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400388e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:30.572551 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451637632}
I20260709 13:10:30.573668 23081 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:30.574380 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:30.575201 21387 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:30.577091 23175 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:30.577661 23175 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:30.578516 23175 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.579108 23058 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:30.580679 23163 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:10:30.321609 23153 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.585906 23156 consensus_queue.cc:1243] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:30.581148 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:30.471575 23146 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:30.590001 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 245984us
I20260709 13:10:30.593216 21395 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:10:30.586341 23167 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:10:30.508021 22918 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:30.600514 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:30.601529 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79401.5us
I20260709 13:10:30.613893 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:30.559232 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:30.626890 21389 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:30.621897 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 144584us
I20260709 13:10:30.605386 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:30.579941 23057 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:30.528376 23063 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:30.500329 23173 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:30.563431 23151 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:30.630995 23151 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:30.630893 23173 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.633184 23081 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:30.633848 23173 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:30.634536 23173 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:30.635090 23173 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.636260 23063 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.638837 23063 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:30.562954 23183 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:30.587141 22906 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:30.587533 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:30.595038 23161 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:10:30.601908 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:30.661182 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:30.612497 22918 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.670315 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:30.685365 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.675635 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 73808.4us
I20260709 13:10:30.686484 21359 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:30.364800 23160 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.611516 23176 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:30.646689 23162 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:30.615392 22980 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:30.706316 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:30.708058 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:30.708830 21313 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:30.660506 23082 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:30.658613 23156 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:30.726200 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 132996us
I20260709 13:10:30.689818 22918 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:30.706553 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.691188 23079 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:30.689013 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 501) took 2194 ms. Trace:
I20260709 13:10:30.712148 23057 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:30.689379 21387 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:30.590968 23074 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.705921 23186 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:10:30.644740 23106 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:30.786042 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51443.5us
W20260709 13:10:30.787585 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 101216us
I20260709 13:10:30.595752 23149 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.826386 21394 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:10:30.841787 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 52619.5us
I20260709 13:10:30.842609 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:30.850214 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:30.660737 23183 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.727897 22980 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.848703 22793 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:30.874421 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49586.3us
I20260709 13:10:30.861626 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1294) took 2295 ms. Trace:
I20260709 13:10:30.773661 23195 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:30.713933 23176 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.883917 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:30.832890 23074 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.738659 23156 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:30.906961 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 56826.5us
I20260709 13:10:30.911906 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:30.882447 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 518) took 1021 ms. Trace:
W20260709 13:10:30.903330 23165 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 13:10:30.896010 23195 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.910614 23147 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:30.906095 23199 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:30.913987 23058 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:30.957485 23168 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:30.957296 23199 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:30.957954 23168 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.958333 23168 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.958673 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 201) took 1231 ms. Trace:
W20260709 13:10:30.961387 23064 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.747s	user 0.011s	sys 0.000s
I20260709 13:10:30.962759 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 514) took 1119 ms. Trace:
I20260709 13:10:30.906590 23181 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:30.883630 22983 raft_consensus.cc:359] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.919778 23189 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:30.923673 23195 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:30.959187 21461 rpcz_store.cc:276] 0709 13:10:29.727484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.740544 (+ 13060us) service_pool.cc:224] Handling call
0709 13:10:29.745801 (+  5257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.304272 (+558471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.958325 (+654053us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54000b8954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:30.958591 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073391872}
W20260709 13:10:30.971563 23174 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
W20260709 13:10:30.980233 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62379.2us
W20260709 13:10:30.982373 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.000061 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:31.003268 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:30.959852 23199 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.005023 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1620) took 1243 ms. Trace:
I20260709 13:10:30.927734 23173 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:30.897820 21388 rpcz_store.cc:276] 0709 13:10:28.565865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.745582 (+179717us) service_pool.cc:224] Handling call
0709 13:10:28.832689 (+ 87107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.224258 (+1391569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.861275 (+637017us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002e2cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:30.861542 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2981856640}
I20260709 13:10:30.995880 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 240) took 1260 ms. Trace:
I20260709 13:10:31.003818 21317 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:30.932247 23073 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 13:10:30.995575 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 83772us
I20260709 13:10:31.011657 21318 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:31.005517 21314 rpcz_store.cc:276] 0709 13:10:29.762035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.762174 (+   139us) service_pool.cc:224] Handling call
0709 13:10:29.762473 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.762774 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.762817 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.763254 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.161782 (+398528us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:30.161835 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.161920 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.004743 (+842823us) raft_consensus.cc:1685] finished
0709 13:10:31.004778 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.004953 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":934,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":19795,"thread_start_us":398150,"threads_started":1,"wal-append.queue_time_us":563350}
I20260709 13:10:31.013610 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:30.978749 23189 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.037001 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:31.039237 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:31.039844 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:31.041517 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.043630 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:31.044692 21319 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:31.024384 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:31.024819 21321 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:31.004326 23081 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:30.917574 22036 rpcz_store.cc:276] 0709 13:10:29.861325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.872578 (+ 11253us) service_pool.cc:224] Handling call
0709 13:10:29.961970 (+ 89392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.998188 (+ 36218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.002464 (+  4276us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.003024 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.349650 (+346626us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:30.349712 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.349822 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.863998 (+514176us) raft_consensus.cc:1685] finished
0709 13:10:30.864052 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.874030 (+  9978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20431,"raft.queue_time_us":185,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":40425,"thread_start_us":346125,"threads_started":1,"wal-append.queue_time_us":859156}
I20260709 13:10:31.026386 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:31.027031 23106 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.015305 21392 rpcz_store.cc:276] 0709 13:10:29.735544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.735684 (+   140us) service_pool.cc:224] Handling call
0709 13:10:29.735982 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.736217 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:29.767377 (+ 31160us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.995330 (+1227953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.995402 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:30.995474 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.995587 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.995776 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47682,"prepare.queue_time_us":31313,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3945,"raft.queue_time_us":76584,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":14100,"thread_start_us":1188040,"threads_started":2,"wal-append.queue_time_us":1095408}
I20260709 13:10:31.028798 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:31.064352 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:31.065785 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:31.029923 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:31.001025 22980 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.032748 23111 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:30.998313 23079 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:31.007776 22988 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:31.071292 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:31.051358 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:31.002753 23181 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:31.042990 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:31.046216 23082 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:31.043097 23057 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.044369 23187 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.069131 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:31.073294 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:31.073115 21321 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:31.044612 23189 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:31.063860 22911 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:30.963259 22032 rpcz_store.cc:276] 0709 13:10:29.843652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.852225 (+  8573us) service_pool.cc:224] Handling call
0709 13:10:29.852593 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.852942 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.852975 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.853497 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.307089 (+453592us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:30.333729 (+ 26640us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.603782 (+270053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.623290 (+ 19508us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.962525 (+339235us) raft_consensus.cc:1685] finished
0709 13:10:30.962555 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.962698 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1054,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":241245,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":34113,"thread_start_us":683397,"threads_started":2,"wal-append.queue_time_us":1009423}
I20260709 13:10:31.052345 23176 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:31.080583 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.063071 22774 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:31.071794 22906 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:31.032017 22918 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.068518 23146 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:31.118796 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 457665us
I20260709 13:10:31.071832 23201 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:31.082050 23063 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:31.087378 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:31.083148 23147 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:31.076504 23151 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.084405 23082 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.074857 23079 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:31.152391 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61809.8us
I20260709 13:10:31.162731 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:31.144639 23208 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:10:31.090358 22983 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:31.117616 23057 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.209625 21393 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:31.144375 23213 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:31.146968 23073 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:31.158568 23183 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:31.194983 23163 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:31.191712 23082 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:31.129522 22774 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:30.752496 22038 rpcz_store.cc:276] 0709 13:10:28.494285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.496433 (+  2148us) service_pool.cc:224] Handling call
0709 13:10:28.613279 (+116846us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:28.613571 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.613881 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:29.842445 (+1228564us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.611839 (+769394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.615386 (+  3547us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:30.640705 (+ 25319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.654505 (+ 13800us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.683329 (+ 28824us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1232968,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":232752,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4283,"spinlock_wait_cycles":12629760,"thread_start_us":1905611,"threads_started":3,"wal-append.queue_time_us":723534}
I20260709 13:10:31.233853 21462 raft_consensus.cc:2393] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:31.239085 23179 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:10:31.255793 23079 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.258472 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 206) took 1003 ms. Trace:
I20260709 13:10:31.259298 22918 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:31.259672 23214 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:31.083611 23111 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.145711 23146 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.118206 23187 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.329149 23187 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.331022 22983 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:31.216748 23181 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.332384 22042 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:31.295078 21470 rpcz_store.cc:276] 0709 13:10:30.255544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.255708 (+   164us) service_pool.cc:224] Handling call
0709 13:10:30.256172 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.287331 (+ 31159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.287367 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.287970 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.582002 (+294032us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b18003c1cc0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:10:31.044313 (+462311us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:31.051433 (+  7120us) log.cc:844] Serialized 14 byte log entry
0709 13:10:31.051675 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.051748 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.258121 (+206373us) raft_consensus.cc:1685] finished
0709 13:10:31.258236 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.258402 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47003,"prepare.queue_time_us":7222,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":54205,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":21915,"spinlock_wait_cycles":22324224,"thread_start_us":462127,"threads_started":1,"wal-append.queue_time_us":816436}
I20260709 13:10:31.220103 23063 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:31.319988 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:31.321295 21389 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.694s	user 0.013s	sys 0.000s
W20260709 13:10:31.349951 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 284218us
I20260709 13:10:31.351226 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:31.334852 23151 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.354286 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:31.354602 22036 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:31.354985 22036 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:31.355417 22774 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.355635 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:31.355840 22036 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.356914 22036 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:31.357381 23057 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.313103 22906 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:31.358086 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:31.358321 22906 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.358696 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:31.359368 22035 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:31.348587 22918 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:31.360591 22918 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.358690 22039 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:31.335430 23167 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:31.333278 22983 ts_tablet_manager.cc:1434] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.774s	user 0.015s	sys 0.005s
I20260709 13:10:31.348587 23063 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.235749 23073 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.331985 23111 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:31.403915 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.417047 21469 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:31.395955 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:31.418733 21470 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.408771 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.420434 21464 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:31.410161 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.349855 21389 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
W20260709 13:10:31.393083 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.407953 21468 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:31.379045 23192 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:31.231874 23213 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.447893 23192 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:31.448385 23192 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:31.449658 23213 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:31.453640 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.455999 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.455669 23192 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.456507 23168 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.456804 21463 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:31.494781 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:31.495704 21461 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 2: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:31.496019 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 207) took 1225 ms (client timeout 1539 ms). Trace:
W20260709 13:10:31.496544 21462 rpcz_store.cc:269] 0709 13:10:30.271414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.276774 (+  5360us) service_pool.cc:224] Handling call
0709 13:10:31.495818 (+1219044us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540025b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:31.495962 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634240256}
I20260709 13:10:31.497726 23073 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:31.498826 23192 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:31.470330 21470 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:31.504230 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.504395 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1479) took 1036 ms. Trace:
I20260709 13:10:31.504904 21389 rpcz_store.cc:276] 0709 13:10:30.465984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.470514 (+  4530us) service_pool.cc:224] Handling call
0709 13:10:31.502051 (+1031537us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:31.507530 23074 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.001s
I20260709 13:10:31.508410 23073 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.460732 21466 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:31.521101 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:31.521777 21390 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:31.518391 22039 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:31.516099 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.380615 23147 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:31.545912 21391 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:31.415138 23063 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:31.502475 22912 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:31.390304 22983 ts_tablet_manager.cc:1467] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Tablet startup took 831ms
I20260709 13:10:31.568475 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:31.522586 22774 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:31.581207 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 67729us
I20260709 13:10:31.583264 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:31.566159 23224 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:31.557310 23147 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.547195 23073 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.586283 23169 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:31.587004 23151 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:31.613207 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.571220 22912 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.622570 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.592239 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.603345 22906 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:31.634429 21469 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:31.583387 22774 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:31.605806 23169 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:31.617847 23151 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:31.589234 23224 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:31.650401 22036 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:31.694355 23224 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:31.644447 23151 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:31.700466 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:31.701305 21461 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:31.639988 23169 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:31.709304 22918 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:31.718827 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.719521 21469 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:31.720350 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:31.721427 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.722396 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.723598 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:31.665655 23073 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.671396 22035 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:10:31.673852 23219 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.295s	user 0.002s	sys 0.000s
W20260709 13:10:31.674777 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.686023 23168 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.689998 22774 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:31.728309 21390 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:31.750669 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1480) took 1284 ms. Trace:
I20260709 13:10:31.751128 21390 rpcz_store.cc:276] 0709 13:10:30.466460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.466592 (+   132us) service_pool.cc:224] Handling call
0709 13:10:31.520962 (+1054370us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b5800124e98. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:31.750604 (+229642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16660224}
I20260709 13:10:31.829770 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1477) took 1414 ms. Trace:
I20260709 13:10:31.956991 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1481) took 1490 ms. Trace:
W20260709 13:10:31.974646 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 243920us
W20260709 13:10:31.989423 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.998672 21391 rpcz_store.cc:276] 0709 13:10:30.466924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.467058 (+   134us) service_pool.cc:224] Handling call
0709 13:10:31.956779 (+1489721us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540039e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:31.956903 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359553280}
I20260709 13:10:31.911499 21215 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 273) took 8597 ms. Trace:
W20260709 13:10:31.993086 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.004980 21360 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:32.005936 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:32.007239 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:31.750581 23057 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.846422 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.008198 21390 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:31.998206 21393 rpcz_store.cc:276] 0709 13:10:30.415861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.424449 (+  8588us) service_pool.cc:224] Handling call
0709 13:10:31.829485 (+1405036us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b540020f3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:31.829688 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420148608}
I20260709 13:10:32.012432 21396 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:10:32.014212 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 120148us
W20260709 13:10:31.924979 23189 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.000s
W20260709 13:10:31.834463 23220 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.584s	user 0.000s	sys 0.009s
I20260709 13:10:32.015100 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:31.880508 23092 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:31.920723 23201 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.759s	user 0.012s	sys 0.000s
W20260709 13:10:31.843520 23195 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.841s	user 0.008s	sys 0.001s
W20260709 13:10:31.863880 23084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.384s	user 0.007s	sys 0.019s
W20260709 13:10:31.840570 23216 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:10:31.944988 23203 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.770437 22912 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.045887 22988 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:10:32.048398 23196 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.048918 23196 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:32.049667 23230 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:10:32.015412 23063 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.050884 23081 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:32.051309 23196 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:32.052317 23180 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:32.052747 21467 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:32.025239 23092 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.028331 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:32.030583 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 1.15533e+06us
I20260709 13:10:32.012859 23073 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:32.031934 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:32.021423 23080 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.015199 23168 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:31.999436 21461 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:32.048174 23209 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:32.051363 23081 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.015987 23057 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.003975 21215 rpcz_store.cc:276] 0709 13:10:23.313949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.314106 (+   157us) service_pool.cc:224] Handling call
0709 13:10:31.911416 (+8597310us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:27.172252 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:27.235036 (+ 62784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:27.235086 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:10:27.235107 (+    21us) tablet.cc:662] Decoding operations
0709 13:10:27.235516 (+   409us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:27.235572 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:27.235597 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:27.237657 (+  2060us) tablet.cc:701] Row locks acquired
0709 13:10:27.237675 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:27.237809 (+   134us) write_op.cc:270] Start()
0709 13:10:27.237917 (+   108us) write_op.cc:276] Timestamp: P: 1783602627237771 usec, L: 0
0709 13:10:27.237938 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:10:27.298643 (+ 60705us) log.cc:844] Serialized 930 byte log entry
0709 13:10:27.857144 (+558501us) op_driver.cc:464] REPLICATION: finished
0709 13:10:29.301006 (+1443862us) write_op.cc:301] APPLY: starting
0709 13:10:29.321489 (+ 20483us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:29.362142 (+ 40653us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:29.406657 (+ 44515us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:29.407143 (+   486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:29.407364 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:10:29.407434 (+    70us) write_op.cc:312] APPLY: finished
0709 13:10:29.407681 (+   247us) log.cc:844] Serialized 29 byte log entry
0709 13:10:29.743267 (+335586us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bc10e0ac 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b
0709 13:10:30.239510 (+496243us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:30.245231 (+  5721us) write_op.cc:454] Released schema lock
0709 13:10:30.250523 (+  5292us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:30.317784 (+ 67261us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:30.321308 (+  3524us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":1330438,"apply.run_cpu_time_us":36202,"apply.run_wall_time_us":1078456,"num_ops":2,"prepare.queue_time_us":161339,"prepare.run_cpu_time_us":26944,"prepare.run_wall_time_us":336464,"raft.queue_time_us":275085,"raft.run_cpu_time_us":37240,"raft.run_wall_time_us":1001619,"replication_time_us":619048,"spinlock_wait_cycles":9573248,"thread_start_us":2101150,"threads_started":5,"wal-append.queue_time_us":1042154,"wal-append.run_cpu_time_us":22676,"wal-append.run_wall_time_us":2594103}]]}
I20260709 13:10:32.052342 23063 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:32.014277 23147 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:32.032671 23084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.557s	user 0.015s	sys 0.021s
I20260709 13:10:32.013063 23157 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:32.030824 23197 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:32.036688 23195 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:31.800876 23082 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.059180 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:32.023430 23229 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.024564 23181 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:32.032399 23201 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:32.036159 22793 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.045892 23186 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:32.015906 23169 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.020233 23171 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:10:32.069736 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 939966us
I20260709 13:10:31.910717 23151 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.073896 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1635) took 1068 ms. Trace:
I20260709 13:10:32.103591 21320 rpcz_store.cc:276] 0709 13:10:31.005283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.005738 (+   455us) service_pool.cc:224] Handling call
0709 13:10:31.005992 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.006183 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:31.026164 (+ 19981us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.073431 (+1047267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.073506 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:32.073568 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.073660 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.073826 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":922466,"prepare.queue_time_us":31655,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":914146,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":4212,"thread_start_us":133876,"threads_started":1,"wal-append.queue_time_us":606971}
I20260709 13:10:32.022348 23189 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.058213 23073 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:32.061691 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:32.061962 23111 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:32.063810 23156 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.086225 23172 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:31.570060 22983 ts_tablet_manager.cc:1469] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Trace:
0709 13:10:25.117103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.118975 (+  1872us) service_pool.cc:224] Handling call
0709 13:10:25.452214 (+333239us) ts_tablet_manager.cc:934] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
0709 13:10:26.508436 (+1056222us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:26.650704 (+142268us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:26.650830 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:26.746299 (+ 95469us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:26.747053 (+   754us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:26.771702 (+ 24649us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:26.790163 (+ 18461us) inbound_call.cc:177] Queueing success response
0709 13:10:27.055955 (+265792us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:10:30.558805 (+3502850us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:10:30.566389 (+  7584us) tablet_replica.cc:261] Starting instrumentation
0709 13:10:30.567016 (+   627us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":30566,"raft.queue_time_us":6294,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":16646,"tablet-copy.queue_time_us":172660,"tablet-download-pool.queue_time_us":338,"tablet-download-pool.run_cpu_time_us":1295,"tablet-download-pool.run_wall_time_us":35671,"thread_start_us":197087,"threads_started":2}
I20260709 13:10:32.086820 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:32.123549 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.087616 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1644) took 1012 ms. Trace:
I20260709 13:10:32.057171 23203 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.124390 21314 rpcz_store.cc:276] 0709 13:10:31.074930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.075103 (+   173us) service_pool.cc:224] Handling call
0709 13:10:31.088359 (+ 13256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.088587 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:31.236100 (+147513us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.087265 (+851165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.087325 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:32.087371 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.087453 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.087560 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":887916,"prepare.queue_time_us":68801,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":4019,"raft.queue_time_us":849739,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9264,"thread_start_us":107383,"threads_started":1}
I20260709 13:10:32.125988 23183 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.126681 23203 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.126541 23183 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.127303 23200 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:32.127660 23200 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:32.128196 23201 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:32.091061 23229 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:32.095784 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.096357 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.066128 23080 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.100456 22879 tablet_copy_client.cc:538] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:32.101154 23197 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.135393 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.135982 21321 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:32.136229 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.101347 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:32.136798 21315 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:32.101681 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.102228 21464 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.106706 21320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:32.089538 23157 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:10:32.110951 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.092171 22793 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:32.113755 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.113963 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.114234 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.114500 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.142400 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.142704 21470 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:32.143136 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.143334 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.144345 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.116868 23202 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.148259 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:32.148082 23202 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.097599 23186 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.149413 23186 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.150794 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.150717 22793 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:32.122255 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.123961 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.135053 23156 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 13:10:32.152530 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.152837 22040 raft_consensus.cc:2410] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:32.152992 23156 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:32.083297 23149 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:10:32.153375 23156 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:32.154203 23156 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.155335 23156 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:32.156221 23236 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:32.139775 23245 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:10:32.157486 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.132242 21396 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:32.092804 23147 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:10:32.158589 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.095898 23180 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:10:32.159385 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:32.109651 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.160951 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.162125 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.162360 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.138171 21320 raft_consensus.cc:606] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:32.163012 21318 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:32.163360 21320 raft_consensus.cc:614] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:32.163300 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.164288 23022 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:32.164470 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.164631 23084 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.164690 23022 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:32.165592 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.165886 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.165694 23022 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.128188 23172 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:32.169732 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:32.140087 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.140085 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.170572 21468 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:32.170725 21321 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:32.171566 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.144639 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.105969 22034 raft_consensus.cc:2368] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:32.132866 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.143441 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:32.178247 21390 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.170809 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:32.145768 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.180480 21315 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:32.146648 23201 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:32.151998 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.131304 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:32.128255 21387 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.189973 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.166849 23022 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.163882 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.167660 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.116362 23073 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.168897 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.159754 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.201268 21312 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.169442 22042 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:32.201609 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.203645 23106 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.173342 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.135197 23197 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:32.180546 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:32.146597 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.179415 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:32.211740 21359 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:32.214047 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.214758 21319 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:32.214593 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:32.166808 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.192651 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:32.192845 21391 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:32.122215 23170 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:32.152004 22793 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.217813 21318 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:10:32.197093 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 65908.6us
I20260709 13:10:32.173998 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:32.198311 23228 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:32.198633 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.221534 22040 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
W20260709 13:10:32.200374 21285 connection.cc:256] RPC call timeout handler was delayed by -2.1288808689999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:10:32.222600 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0577808689999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:10:32.223073 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0487808689999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:10:32.223498 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8111808689999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:10:32.223904 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5141808690000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2311s for a response
I20260709 13:10:32.223754 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:32.226118 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.204356 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.227715 21466 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:32.205752 23092 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.206161 23207 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:32.206737 23237 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:32.248298 23084 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:32.248482 23197 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.249843 23197 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.250381 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.128544 23200 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.252373 23146 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.253417 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:32.215755 23106 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.254622 21467 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:32.255436 21461 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.175413 22947 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:32.255754 21467 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.264731 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:32.178316 23181 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:32.177487 22774 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:32.209283 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.211275 21395 raft_consensus.cc:2376] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3. Re-sending same reply.
I20260709 13:10:32.196090 21390 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:32.230285 23229 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.204875 23074 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:32.234408 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.283154 21391 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:32.235062 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.235684 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:32.236986 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63106.6us
I20260709 13:10:32.289791 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:32.291018 23240 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:10:32.277797 23168 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:32.292488 23168 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:32.292850 23168 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.241070 21312 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:32.242184 23189 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.242748 23202 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.227041 23170 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.294503 23202 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:32.244539 23195 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.244251 23172 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.296510 23170 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.245443 23080 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.298050 23081 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.230957 23157 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.231498 23209 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:32.256191 22947 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.257055 23169 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.257558 23171 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:32.283656 22774 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.231837 23147 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:32.301687 22947 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.301725 23147 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.302304 23147 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.302773 22774 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.255599 23106 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.259320 22906 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:32.303495 22906 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.303987 22906 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.208586 23151 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.259781 23207 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:32.206943 21314 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.260356 23246 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:32.306488 23207 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.307881 23207 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.259079 22879 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
W20260709 13:10:32.267616 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.275177 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:32.311600 21466 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.267251 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:32.312314 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:32.312717 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 45542us
I20260709 13:10:32.296648 21396 raft_consensus.cc:2410] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:32.261147 23201 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.315713 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.221289 23183 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.329854 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:32.333984 21359 consensus_peers.cc:597] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7cc0b64eb784638b78409562870a2db. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.269853 23228 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.338084 23228 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.271353 23181 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:32.282703 23074 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.315459 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.354439 23081 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.318692 21465 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
W20260709 13:10:32.363642 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 141700us
I20260709 13:10:32.333657 23151 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:32.335074 23195 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:32.380482 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:32.277983 23218 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:10:32.353180 23181 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.343659 23082 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:32.381517 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:32.359104 23074 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.331393 23107 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:10:32.354606 23196 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:32.400429 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:32.380425 23127 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 13:10:32.406423 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 170856us
W20260709 13:10:32.407902 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 101467us
I20260709 13:10:32.409044 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:32.385582 23195 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.413391 23106 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:32.374351 23080 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:10:32.402436 23196 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.403656 23151 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.423103 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.405967 23218 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.453420 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.410959 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:32.419641 23195 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.454485 21390 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:32.417441 23127 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:32.467998 21321 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:32.505208 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:32.521020 21395 raft_consensus.cc:2376] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4. Re-sending same reply.
I20260709 13:10:32.522290 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.459498 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 641) took 1417 ms. Trace:
I20260709 13:10:32.523734 22031 rpcz_store.cc:276] 0709 13:10:31.038414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.045238 (+  6824us) service_pool.cc:224] Handling call
0709 13:10:32.422920 (+1377682us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:32.452023 (+ 29103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5204352}
W20260709 13:10:32.471338 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.481302 23186 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.526899 21319 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:32.529713 23186 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.446858 23196 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.458770 23218 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:32.530725 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:32.531721 23218 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.532670 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:32.533120 23218 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.486761 23168 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.533752 23146 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:32.534274 23146 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:32.534690 23146 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.535956 23168 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.537039 23168 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.518204 23180 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:32.537648 23180 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:32.538426 23180 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.543391 23180 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.544747 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:32.503279 23194 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:32.592271 23194 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:32.499873 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 523) took 1184 ms. Trace:
I20260709 13:10:32.594957 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.551278 23057 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.552881 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:32.604624 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.555625 21466 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:32.504411 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.577584 21388 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:32.555377 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:32.583439 23244 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.525s	user 0.004s	sys 0.000s
I20260709 13:10:32.511799 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.585961 23160 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.587199 21394 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.587894 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.590363 23074 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.590680 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:32.591176 21320 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:32.489595 23073 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.594933 23194 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:32.593923 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49254.6us
I20260709 13:10:32.638414 23194 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.638473 23074 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.639133 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:32.639981 21393 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:32.546105 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:32.640713 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.595830 22034 rpcz_store.cc:276] 0709 13:10:31.315221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.319645 (+  4424us) service_pool.cc:224] Handling call
0709 13:10:32.499612 (+1179967us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54006c5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:32.499804 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733006720}
I20260709 13:10:32.600555 21389 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:32.641237 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:32.605335 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 176319us
I20260709 13:10:32.575796 22906 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.576256 23147 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.605346 21392 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:32.604744 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:32.649415 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.649526 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:32.454138 23246 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.625612 21219 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 2 to 3, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 3 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.653118 21219 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.657446 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:32.607566 22911 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:32.579280 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.665604 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.668206 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:32.668866 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:32.669162 21390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
W20260709 13:10:32.605581 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 431697us
I20260709 13:10:32.676460 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.677874 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.679083 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.681380 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.682067 21321 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.684410 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.685084 21312 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.640583 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:32.660543 23152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.539s	user 0.034s	sys 0.047s
I20260709 13:10:32.683753 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.667799 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:32.690740 21393 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:32.645025 23107 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.698850 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.722913 21319 raft_consensus.cc:2410] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:32.692175 21360 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:32.647321 23186 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:32.724524 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.663097 23081 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:32.727921 22002 leader_election.cc:336] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.668s (SENT)
I20260709 13:10:32.735563 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:32.655454 21219 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.728960 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.729772 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.664505 23168 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:32.652096 23176 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:32.669006 23203 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.739161 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.730809 23107 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:32.692762 23152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.571s	user 0.035s	sys 0.047s
I20260709 13:10:32.664652 23067 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:32.651826 23246 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:32.667433 22911 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.752450 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.784511 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.746374 23168 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.761219 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.770103 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.733788 23169 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:32.731055 21462 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:32.667416 22774 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:10:32.785307 21313 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:32.753221 21391 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:32.786170 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.788472 21319 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:32.789160 21317 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:32.795411 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:32.796566 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 396197us
I20260709 13:10:32.836216 21216 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 284) took 8401 ms. Trace:
I20260709 13:10:32.788174 22911 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.839402 21312 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:32.741760 23186 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:32.852982 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 207215us
I20260709 13:10:32.844271 21318 raft_consensus.cc:2410] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:32.845952 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:32.793068 23168 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.773409 23176 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.771657 23181 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.862799 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:32.858237 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.863574 21314 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:32.863631 21319 raft_consensus.cc:2410] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:32.843932 21216 rpcz_store.cc:276] 0709 13:10:24.214092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.214361 (+   269us) service_pool.cc:224] Handling call
0709 13:10:24.408768 (+194407us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf182090 00007fc2bf220f3a 00007fc2c4fd71cc 00007fc2c50d537e 00007fc2c35962a4 00007fc2c3596232 00007fc2c3596161 00007fc2c35960dc 00007fc2c3595392 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:32.615318 (+8206550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274483,"reported_tablets":6,"spinlock_wait_cycles":196679552}
W20260709 13:10:32.827071 23172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.008s
I20260709 13:10:32.775856 23228 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:32.773034 23203 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.859241 21315 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:10:32.859622 23259 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 13:10:32.860319 21388 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:32.797739 23196 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:32.868575 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.869623 23022 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:32.877470 23073 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.877975 23181 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.784941 23057 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:10:32.881747 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1473) took 1162 ms. Trace:
I20260709 13:10:32.883455 23200 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.960603 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:32.887348 21395 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:10:32.888253 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.964s (SENT)
I20260709 13:10:32.953905 23166 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.976312 23107 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:32.982326 22906 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:32.987140 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 98899.4us
I20260709 13:10:32.989002 23185 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:32.989379 23185 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:32.989756 23185 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.944363 21320 raft_consensus.cc:2410] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:32.946467 21321 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:32.950330 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.875638 23176 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:32.890007 23172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.008s	sys 0.009s
I20260709 13:10:32.957525 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:32.959532 23022 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:32.890239 23186 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:32.839748 23169 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:32.990974 22042 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:32.941502 23074 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.964634 21390 raft_consensus.cc:606] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.006420 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:33.024744 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.888885 23187 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:10:33.025486 21390 raft_consensus.cc:614] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:32.976886 23257 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:10:32.957376 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.994351 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-24db01a278af4a82a16f038fedabf4d3 received from {username='slave'} at 127.0.0.1:36486
I20260709 13:10:33.020742 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:33.022517 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:33.026165 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:33.038347 21393 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:33.007746 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 259916us
I20260709 13:10:33.027375 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:33.017782 23157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.009s	sys 0.014s
I20260709 13:10:33.049985 21392 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.050513 22040 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:33.044080 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-24db01a278af4a82a16f038fedabf4d3 on tablet 24db01a278af4a82a16f038fedabf4d3 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.014878 23022 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:33.054136 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 362080us
I20260709 13:10:32.889716 23246 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.065004 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.085589 21470 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:33.065171 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:32.972846 23080 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:10:33.068545 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.015290 23082 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:33.011220 23081 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:32.987293 23195 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.105898 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.073323 21467 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:33.107472 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.108260 21467 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:33.031083 23074 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:10:33.055028 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 415955us
I20260709 13:10:33.081634 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:33.088727 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.053277 23180 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.002s
I20260709 13:10:33.091140 21396 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:33.090786 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:33.071168 23157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.010s	sys 0.015s
W20260709 13:10:33.117780 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.116876 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.120857 21466 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:33.117996 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.051244 23153 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:10:33.084597 23147 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:33.123020 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.090785 23084 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.113503 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.078601 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.089695 23111 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:32.986159 21462 rpcz_store.cc:276] 0709 13:10:31.719009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.724551 (+  5542us) service_pool.cc:224] Handling call
0709 13:10:32.582723 (+858172us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:32.582978 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.839461 (+256483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.881484 (+ 42023us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540025dd54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:32.881680 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266800768}
I20260709 13:10:33.123010 23268 ts_tablet_manager.cc:933] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:33.099315 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.143244 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.100943 23092 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:33.144397 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.145813 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.148986 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:33.150714 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.113044 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.160288 23081 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.161273 21315 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:33.161520 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.161823 21315 pending_rounds.cc:85] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 5
I20260709 13:10:33.162199 21315 pending_rounds.cc:107] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:33.095271 23156 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:10:33.155987 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.156291 23073 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.162395 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.162513 21315 raft_consensus.cc:2889] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:33.152438 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53263.8us
I20260709 13:10:33.130669 22906 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.168150 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.168850 21469 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
W20260709 13:10:33.149034 23146 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260709 13:10:33.107185 23082 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.177047 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.194456 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.147940 23210 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.199157 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:33.202631 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:33.203397 22002 leader_election.cc:336] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.141s (SENT)
I20260709 13:10:33.203735 21393 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:33.203922 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.125758 23176 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:10:33.206851 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.211712 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.163517 21465 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.191452 22036 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:33.163187 23157 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:33.219264 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43514.7us
I20260709 13:10:33.162967 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:33.206632 23146 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.151394 23084 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.240835 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:33.241519 21314 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.241798 21315 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:33.234355 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.163265 23111 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.192001 23229 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.169922 23269 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.240502 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1497) took 1121 ms. Trace:
I20260709 13:10:33.244165 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.239462 23154 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.248301 21394 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:33.222226 23147 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:33.249878 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.231964 23261 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:33.166816 23092 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.251148 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.253661 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.191854 22988 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:10:33.261354 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.254897 23157 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:33.262039 23275 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:33.262790 23146 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:33.262952 23111 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:33.264496 23084 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:33.264822 23271 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:10:33.264520 23265 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:10:33.265364 23262 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:10:33.265340 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:33.309764 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 157451us
I20260709 13:10:33.196794 23196 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:33.153661 23169 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.242249 23063 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:33.243398 23228 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:33.311607 23107 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.264514 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.259104 21389 rpcz_store.cc:276] 0709 13:10:32.119587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.748260 (+628673us) service_pool.cc:224] Handling call
0709 13:10:32.791675 (+ 43415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.837093 (+ 45418us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:32.860831 (+ 23738us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.168555 (+307724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.171123 (+  2568us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:33.205874 (+ 34751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.218617 (+ 12743us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.236758 (+ 18141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22725,"prepare.queue_time_us":27618,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":6132,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":24912,"thread_start_us":291081,"threads_started":1,"wal-append.queue_time_us":399353}
I20260709 13:10:33.247577 23186 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:33.282015 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:33.226329 22837 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:33.285754 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:33.191509 23074 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:33.268966 23267 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:10:33.291277 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:33.337356 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46196.1us
I20260709 13:10:33.338112 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.339567 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.271310 23176 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:33.278645 23187 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:33.310967 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45717.8us
I20260709 13:10:33.344681 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.266183 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.293414 23147 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:33.297159 23274 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:33.313701 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.273154 21314 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:33.303349 23203 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:33.357265 23277 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:33.334632 23063 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:33.322691 23154 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.323434 23195 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:33.346233 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.347096 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.344707 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 646) took 2299 ms. Trace:
I20260709 13:10:33.347843 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.366465 21390 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:33.367165 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:33.367470 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53868us
I20260709 13:10:33.349282 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.337780 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.344005 23187 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:33.352283 22988 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.348371 23084 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.348563 23146 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.340379 23176 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.374917 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.376884 23176 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:33.353902 23022 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:33.350234 23263 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:10:33.245126 23151 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:33.358417 23274 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:33.332367 23186 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:33.409142 23186 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.410422 23186 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:33.358180 23147 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.368842 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.366354 22041 rpcz_store.cc:276] 0709 13:10:31.045166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.045294 (+   128us) service_pool.cc:224] Handling call
0709 13:10:31.045600 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.045932 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.045966 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.046402 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.455715 (+1409313us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b180035c4a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:10:32.840333 (+384618us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:33.145112 (+304779us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.146443 (+  1331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.146518 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.324724 (+178206us) raft_consensus.cc:1685] finished
0709 13:10:33.342021 (+ 17297us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.344646 (+  2625us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1077,"prepare.queue_time_us":463341,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":29648,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":31718,"spinlock_wait_cycles":5186944,"thread_start_us":670706,"threads_started":2,"wal-append.queue_time_us":2070561}
W20260709 13:10:33.417066 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48303.5us
I20260709 13:10:33.378456 23180 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.351960 23107 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.325199 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:33.378607 23181 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:33.363063 23283 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.390843 23022 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:33.396627 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1500) took 1276 ms. Trace:
W20260709 13:10:33.416174 23278 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:33.403126 23246 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.403286 23168 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.408145 23274 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.417919 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:33.420454 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 159145us
I20260709 13:10:33.420583 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.472944 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.414796 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.422173 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1495) took 1303 ms. Trace:
I20260709 13:10:33.486284 21394 rpcz_store.cc:276] 0709 13:10:32.119021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.708795 (+589774us) service_pool.cc:224] Handling call
0709 13:10:32.709102 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.271160 (+562058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.422003 (+150843us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54000ac8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:33.422127 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239594240}
I20260709 13:10:33.485600 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.487681 21394 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:33.423002 21320 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.424465 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:10:33.488641 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 64253.6us
I20260709 13:10:33.426265 22039 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:33.426911 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.377450 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.377660 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.378211 23203 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:33.433626 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.379498 23196 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.382154 23082 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:33.468894 23181 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:33.435513 21395 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.434943 23146 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:10:33.348285 23157 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.464447 21392 rpcz_store.cc:276] 0709 13:10:32.120488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.750705 (+630217us) service_pool.cc:224] Handling call
0709 13:10:33.049748 (+299043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.071328 (+ 21580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.396416 (+325088us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540017e3d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:33.396562 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686942976}
I20260709 13:10:33.401216 23057 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:33.493445 23166 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:33.466979 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:33.540647 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 73741.6us
I20260709 13:10:33.431334 22988 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.442504 23160 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.003s
W20260709 13:10:33.474047 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56256.3us
I20260709 13:10:33.546399 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.547851 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.384835 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:33.549247 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.476063 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.470636 23187 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.473366 23063 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.479423 22879 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:33.555387 21462 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:33.555891 22879 tablet_bootstrap.cc:492] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:33.551820 23247 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.556910 22879 ts_tablet_manager.cc:1403] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 1.298s	user 0.024s	sys 0.024s
I20260709 13:10:33.556634 23247 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.481618 23281 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:10:33.482350 23107 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.463430 22035 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:33.484205 23283 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.432614 23200 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.492241 21394 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:33.492012 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.494052 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:33.504983 23286 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.494963 21396 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:10:33.485538 22911 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.001s
I20260709 13:10:33.442535 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:33.465709 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.518272 23092 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:33.517998 23057 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:33.497203 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:33.515316 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 81795us
I20260709 13:10:33.521744 23181 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.524794 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.525625 23022 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:33.526821 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.551964 23180 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:10:33.529613 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.591308 21312 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:33.533021 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.593689 21468 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.595429 21468 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:33.535701 21463 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:33.538996 23185 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.005s
I20260709 13:10:33.550482 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.552580 22988 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.545121 23166 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.600327 21391 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:33.566284 21390 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:33.613380 21468 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:33.381338 23272 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:10:33.547045 22906 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.568707 21466 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:33.571095 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79148.1us
I20260709 13:10:33.618923 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.589344 21462 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:33.546060 23268 tablet_copy_client.cc:323] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
W20260709 13:10:33.598893 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48512.1us
I20260709 13:10:33.584614 22031 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:33.585393 23281 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.587298 23200 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:33.620362 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.551704 23176 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.589970 23022 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:33.625269 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 77524.7us
I20260709 13:10:33.611442 23166 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:33.582651 22911 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.621380 23180 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:33.638150 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.640455 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:33.646378 21312 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.630115 22034 raft_consensus.cc:2368] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:33.624464 23286 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.628324 23228 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.649041 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.631829 23154 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.649495 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet e7cc0b64eb784638b78409562870a2db from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:10:33.651827 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet e7cc0b64eb784638b78409562870a2db from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-e7cc0b64eb784638b78409562870a2db
I20260709 13:10:33.632014 23196 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.656558 21470 raft_consensus.cc:2368] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
I20260709 13:10:33.657021 23200 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.656920 23196 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.659308 23170 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.659731 23170 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:33.660707 22911 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:33.660679 23170 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.661814 23293 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.639596 23022 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.626968 23203 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:33.665966 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:33.666080 21466 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:33.609598 23185 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.667377 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.668397 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:33.673717 21395 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:33.675016 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 185437us
I20260709 13:10:33.678615 21312 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:33.645954 23180 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:33.679783 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:33.682503 23081 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:33.683019 23081 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:33.683884 23081 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.684263 23274 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.685187 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.686039 23092 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.686443 23154 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:33.687067 23154 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.687358 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.688283 23111 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.689960 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.651613 23176 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.654986 23168 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:33.696362 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.697252 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:33.698532 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.699313 21312 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:33.628108 23057 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.701092 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:33.702534 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.702474 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.704573 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.655712 23228 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.707248 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.708079 21314 pending_rounds.cc:85] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 4
W20260709 13:10:33.708263 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.686407 23274 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:33.675017 23200 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:10:33.695255 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.771304 21314 pending_rounds.cc:107] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:10:33.771888 21314 raft_consensus.cc:2889] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.752107 23180 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.709190 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.772889 23180 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.701011 22918 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.777180 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 86218.2us
I20260709 13:10:33.778676 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:33.781456 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 72329.5us
W20260709 13:10:33.786543 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.786862 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.739554 22837 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.709681 23176 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.705777 23283 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:33.705581 23092 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.729187 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:33.705430 23293 consensus_queue.cc:1175] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfcd9560f8f44414b25f8069384c5a73" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:10:33.776283 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:33.701879 23160 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:10:33.703580 23297 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:10:33.815089 23160 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.815543 23160 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:33.815564 23297 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.815970 23160 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:33.799748 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.740145 23281 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:10:33.804483 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.776930 23152 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:10:33.783895 23175 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:33.816936 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:33.817564 23175 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.819993 23175 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:33.820807 23289 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:10:33.820662 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.821359 23170 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.821583 22042 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
W20260709 13:10:33.822532 23288 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:10:33.822496 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.825644 21359 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:33.827332 23154 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:33.828883 21393 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:33.832659 23292 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:33.837373 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:33.792711 23201 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.843083 23283 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:33.844050 21393 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:33.799144 22911 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.846230 23301 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:33.849804 23301 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.850183 23301 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:33.850068 23160 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.847842 23296 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.854569 23260 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.812842 23176 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:33.790752 22918 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:33.856678 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 149534us
I20260709 13:10:33.862540 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.780069 23203 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:33.848574 23294 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:10:33.855176 23291 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:10:33.873594 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.856144 22038 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:33.881693 21395 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:33.848249 23200 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:33.857160 23260 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:33.860203 23185 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:33.885910 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.889688 23309 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.890537 22918 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:33.893581 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 106783us
I20260709 13:10:33.897245 23151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36472 (request call id 15) took 3724 ms. Trace:
I20260709 13:10:33.884759 23306 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.912313 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59440.6us
I20260709 13:10:33.865274 23176 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.913058 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:33.913398 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.913806 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:33.917591 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:33.891760 23170 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:10:33.893826 23200 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.921257 23308 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.921686 23176 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:33.921823 23308 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.922382 23176 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.904924 23160 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:33.926949 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.913540 23309 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.921844 23200 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:33.911150 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 240) took 1166 ms. Trace:
I20260709 13:10:33.946590 22038 rpcz_store.cc:276] 0709 13:10:32.742046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.885367 (+143321us) service_pool.cc:224] Handling call
0709 13:10:33.815816 (+930449us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:33.838367 (+ 22551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.888373 (+ 50006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.908810 (+ 20437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10836224}
I20260709 13:10:33.948385 21469 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:33.918973 23315 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.951072 23107 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.952670 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.953593 23166 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.953707 23260 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.954854 23301 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.955300 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:33.956449 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.955883 21466 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:33.931684 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.958855 21464 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.932654 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:33.929759 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:33.944356 21395 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:10:33.946205 23200 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.964830 23260 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.927619 23308 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:33.955837 23166 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:33.982010 21317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:53496
W20260709 13:10:33.982369 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.970289 21465 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
W20260709 13:10:33.973465 23186 consensus_meta.cc:287] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 13:10:33.974550 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 660) took 1415 ms. Trace:
I20260709 13:10:33.910041 23151 rpcz_store.cc:276] 0709 13:10:30.172514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.172836 (+   322us) service_pool.cc:224] Handling call
0709 13:10:30.789569 (+616733us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54003037a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18da1d 00007fc2bf1741a4 00007fc2bf1f6447 00007fc2bf21370a 00007fc2bf21476a 00007fc2bf21391b 00007fc2bf21f03c 00007fc2bf21e6b3 00007fc2c41ded29 00007fc2bd75d1d4
0709 13:10:30.910554 (+120985us) log.cc:844] Serialized 513 byte log entry
0709 13:10:33.897151 (+2986597us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47932,"raft.queue_time_us":68814,"raft.run_cpu_time_us":2457,"raft.run_wall_time_us":180877,"spinlock_wait_cycles":61940608,"thread_start_us":248510,"threads_started":2,"wal-append.queue_time_us":229432,"wal-append.run_cpu_time_us":2229,"wal-append.run_wall_time_us":1074881}
I20260709 13:10:33.929170 22918 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.906531 23283 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:33.982666 21317 raft_consensus.cc:606] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:34.025004 21317 raft_consensus.cc:614] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:33.970443 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52913.6us
I20260709 13:10:33.990999 21464 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:34.030220 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:34.030808 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:33.980439 23299 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:10:33.925879 23081 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:10:33.964943 23200 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:33.909482 22879 raft_consensus.cc:359] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:34.033701 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:33.983119 23111 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.995018 22906 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.035481 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:33.912767 23306 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:33.994586 22031 rpcz_store.cc:276] 0709 13:10:32.559541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.564996 (+  5455us) service_pool.cc:224] Handling call
0709 13:10:32.576416 (+ 11420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.629139 (+1052723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.974263 (+345124us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54004cac54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:33.974481 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256400640}
I20260709 13:10:33.966914 23107 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:34.067028 23107 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:34.039309 23246 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:33.994347 23160 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.992901 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:34.061474 21463 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.075431 23160 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.077250 21392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:34.038838 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:34.079242 21464 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.040019 23200 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.068848 23203 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:34.067378 23107 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:34.070259 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 539) took 1479 ms. Trace:
I20260709 13:10:34.072135 23301 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:34.075706 23201 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.060316 22879 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:34.073809 23246 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.081384 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.087456 23285 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:34.088378 21464 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:34.088757 23306 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.088982 21318 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:34.113746 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:34.114634 23283 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.115101 23283 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:34.089479 23057 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.115940 23283 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.118978 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.091606 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.120438 21395 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:34.092536 22988 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:34.073256 23127 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:34.123168 21319 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:34.124207 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:34.098104 23107 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.125499 23107 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.100354 21406 tablet_copy_source_session.cc:215] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:34.100831 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.082985 23022 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.109138 23319 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:34.145659 21319 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:34.146379 21319 pending_rounds.cc:85] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 5
I20260709 13:10:34.146760 21319 pending_rounds.cc:107] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:34.147145 21319 raft_consensus.cc:2889] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.141723 23306 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:34.156891 23306 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.159265 23306 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.160710 23074 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.160409 22879 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:34.163388 22879 ts_tablet_manager.cc:1434] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.606s	user 0.008s	sys 0.001s
I20260709 13:10:34.107317 23246 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.165175 23319 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.167332 23247 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:34.108253 23285 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:34.111534 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 544) took 1233 ms. Trace:
I20260709 13:10:34.168401 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.170776 23228 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:34.142800 23082 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.174817 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.177928 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.179615 22040 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:10:34.163736 22879 ts_tablet_manager.cc:1467] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Tablet startup took 606ms
I20260709 13:10:34.188931 21312 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:34.193270 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:34.216952 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.217653 21321 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:34.236896 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1297) took 2053 ms. Trace:
I20260709 13:10:34.230520 23285 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.239147 21391 rpcz_store.cc:276] 0709 13:10:32.183475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.854153 (+670678us) service_pool.cc:224] Handling call
0709 13:10:32.854497 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.610455 (+755958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.232229 (+621774us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540020f3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:34.236808 (+  4579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714813824}
I20260709 13:10:34.238133 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.182075 22906 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:10:34.212505 23153 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:34.246228 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:34.249707 23022 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.238615 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.251086 21389 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:34.246246 23176 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.252851 21320 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.097399 22032 rpcz_store.cc:276] 0709 13:10:32.590610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.595050 (+  4440us) service_pool.cc:224] Handling call
0709 13:10:32.603770 (+  8720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.603970 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:33.100158 (+496188us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.972802 (+872644us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b18003295c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:10:34.035947 (+ 63145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.038424 (+  2477us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.063881 (+ 25457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.067659 (+  3778us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.070211 (+  2552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30954,"prepare.queue_time_us":650028,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":63,"raft.queue_time_us":59766,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3004,"spinlock_wait_cycles":34666880,"thread_start_us":684181,"threads_started":3,"wal-append.queue_time_us":237052}
I20260709 13:10:34.182451 22035 rpcz_store.cc:276] 0709 13:10:32.874824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.161025 (+286201us) service_pool.cc:224] Handling call
0709 13:10:33.249068 (+ 88043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.562413 (+313345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.096652 (+534239us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54004696d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:34.108428 (+ 11776us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373632256}
I20260709 13:10:34.238941 23180 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:34.262593 23180 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.266153 23180 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:34.190671 22879 ts_tablet_manager.cc:1469] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Trace:
0709 13:10:21.616441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.618243 (+  1802us) service_pool.cc:224] Handling call
0709 13:10:21.809739 (+191496us) ts_tablet_manager.cc:934] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701)
0709 13:10:24.496160 (+2686421us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:25.350191 (+854031us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:25.365935 (+ 15744us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:25.721469 (+355534us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:25.721845 (+   376us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:25.722213 (+   368us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:25.722331 (+   118us) inbound_call.cc:177] Queueing success response
0709 13:10:32.258730 (+6536399us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:10:33.557322 (+1298592us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:10:33.688400 (+131078us) tablet_replica.cc:261] Starting instrumentation
0709 13:10:33.688984 (+   584us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":322,"mutex_wait_us":6308,"raft.queue_time_us":16205,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":4754,"tablet-copy.queue_time_us":154947,"tablet-download-pool.queue_time_us":192,"tablet-download-pool.run_cpu_time_us":1572,"tablet-download-pool.run_wall_time_us":6143207,"thread_start_us":189656,"threads_started":2}
I20260709 13:10:34.193769 23082 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.267174 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.222373 23160 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.268532 23153 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.269064 23153 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:34.242340 23152 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:10:34.269569 23082 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:34.271925 21331 tablet_copy_service.cc:342] P 058db415e9884ea0ba23f1e1ff59127a: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-1adedb939e97489f9d96abf3bff7f1bd received from {username='slave'} at 127.0.0.1:33484
I20260709 13:10:34.272046 23200 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.272637 21331 tablet_copy_service.cc:434] P 058db415e9884ea0ba23f1e1ff59127a: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-1adedb939e97489f9d96abf3bff7f1bd on tablet 1adedb939e97489f9d96abf3bff7f1bd with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:34.272991 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.273774 21388 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:34.275588 21392 raft_consensus.cc:606] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:34.276005 21392 raft_consensus.cc:614] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:34.277484 23172 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:34.281466 23172 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.281978 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:34.283926 23318 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:34.284358 23318 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:34.285166 23318 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.286335 23318 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:34.290343 23319 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.281905 23172 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.293236 21464 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.294445 21315 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.247959 21461 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:34.303311 21315 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:34.313030 21464 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:34.316253 21468 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:34.321177 21467 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:34.322574 21395 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
W20260709 13:10:34.322824 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.341033 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:34.341982 21389 raft_consensus.cc:2368] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
W20260709 13:10:34.343478 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.346163 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:34.347245 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7cc0b64eb784638b78409562870a2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:34.355818 23200 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.358075 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.358776 21313 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
W20260709 13:10:34.354112 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.368242 23196 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.368848 23247 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:34.369432 23247 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:34.370391 23247 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.372589 23187 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:34.375680 23246 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.382614 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1317) took 1130 ms. Trace:
I20260709 13:10:34.383121 21470 rpcz_store.cc:276] 0709 13:10:33.251984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.345972 (+ 93988us) service_pool.cc:224] Handling call
0709 13:10:34.382397 (+1036425us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b540024a4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:34.382549 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667040640}
I20260709 13:10:34.383833 23246 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.385317 21433 leader_election.cc:400] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:34.385653 21433 leader_election.cc:403] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.386183 23312 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:34.386698 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.387387 23297 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.387528 23312 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:34.387831 23297 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:34.388708 23111 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:34.388809 23297 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.389647 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.389930 23297 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.391311 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.392556 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:34.393208 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.394306 21316 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.404768 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:34.389637 23111 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:34.419212 21393 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:34.421561 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.399451 23153 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.428776 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 224) took 1002 ms. Trace:
I20260709 13:10:34.429257 21461 rpcz_store.cc:276] 0709 13:10:33.426489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.484083 (+ 57594us) service_pool.cc:224] Handling call
0709 13:10:34.428574 (+944491us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540029aed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:34.428701 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108446464}
I20260709 13:10:34.431412 21462 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:34.419325 23111 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:34.423249 21465 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:34.432222 23330 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:10:34.433508 23285 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.434569 23111 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.435770 23111 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:34.436619 23210 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:34.437021 23210 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:34.437424 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.437796 23210 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.438742 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.439141 23210 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:34.439342 21466 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:34.440527 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.439792 23146 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:34.441186 23146 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:34.442003 23146 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.442960 23146 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.441303 21464 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:34.432130 21396 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:34.439378 23284 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:34.446363 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.447541 21463 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:34.448587 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.448688 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.449491 21468 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:34.450994 23172 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.452666 21470 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:34.453584 21461 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:34.448712 23332 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:10:34.447019 23284 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:34.455722 23172 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:34.455432 23284 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.456844 23284 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.459025 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:34.459930 21461 raft_consensus.cc:2368] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
W20260709 13:10:34.432977 23298 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.663s	user 0.003s	sys 0.006s
I20260709 13:10:34.463430 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:34.433293 23153 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:34.518100 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:34.524405 21219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 182) took 7563 ms. Trace:
W20260709 13:10:34.534441 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:34.537109 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.545507 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:34.545269 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:34.554061 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:34.556087 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.556540 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.557909 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:34.557992 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.561767 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:34.565606 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:34.568634 23057 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:34.571456 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.578346 21285 leader_election.cc:400] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
I20260709 13:10:34.591074 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.594180 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:34.596472 23111 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:34.601171 23319 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:34.603873 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:34.604092 23285 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:34.604777 23297 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:34.605080 23285 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.605594 23297 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:34.608170 21319 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:34.611562 21320 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:34.616775 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.575755 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.620270 23057 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:34.621296 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 46066.2us
I20260709 13:10:34.610268 21319 pending_rounds.cc:85] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 1
I20260709 13:10:34.628924 21319 pending_rounds.cc:107] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:34.629422 21319 raft_consensus.cc:2889] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.631937 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.633463 21315 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:34.524976 21219 rpcz_store.cc:276] 0709 13:10:26.960513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.961052 (+   539us) service_pool.cc:224] Handling call
0709 13:10:34.524149 (+7563097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:33.266756 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:33.356348 (+ 89592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:33.356385 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:10:33.356402 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:33.356996 (+   594us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:33.357048 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:33.357078 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:33.357420 (+   342us) tablet.cc:701] Row locks acquired
0709 13:10:33.357433 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:10:33.357559 (+   126us) write_op.cc:270] Start()
0709 13:10:33.357666 (+   107us) write_op.cc:276] Timestamp: P: 1783602633357521 usec, L: 0
0709 13:10:33.357690 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:10:33.432426 (+ 74736us) log.cc:844] Serialized 1311 byte log entry
0709 13:10:33.946848 (+514422us) op_driver.cc:464] REPLICATION: finished
0709 13:10:34.061510 (+114662us) write_op.cc:301] APPLY: starting
0709 13:10:34.061577 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:34.061680 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:34.061775 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:34.062115 (+   340us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:34.062237 (+   122us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:10:34.062264 (+    27us) write_op.cc:312] APPLY: finished
0709 13:10:34.062413 (+   149us) log.cc:844] Serialized 35 byte log entry
0709 13:10:34.062544 (+   131us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:34.062609 (+    65us) write_op.cc:454] Released schema lock
0709 13:10:34.062635 (+    26us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:34.062896 (+   261us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:34.062912 (+    16us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":90369,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":114423,"apply.run_cpu_time_us":1387,"apply.run_wall_time_us":1393,"num_ops":3,"prepare.queue_time_us":475420,"prepare.run_cpu_time_us":32402,"prepare.run_wall_time_us":356564,"raft.queue_time_us":109673,"raft.run_cpu_time_us":15697,"raft.run_wall_time_us":87732,"replication_time_us":589007,"thread_start_us":629293,"threads_started":4,"wal-append.queue_time_us":223109}]]}
I20260709 13:10:34.640370 21392 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:34.641736 23151 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:34.647771 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.642554 23151 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.654088 21467 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:34.653378 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49799.6us
I20260709 13:10:34.656833 21388 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:34.659770 21316 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:34.665210 23247 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.661621 23297 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.667025 23200 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:34.675148 23200 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.677263 23200 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:34.673463 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49574.7us
I20260709 13:10:34.681268 23153 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.676637 22040 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Advancing to term 2
I20260709 13:10:34.686111 23057 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.692716 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:34.693979 22035 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:34.698282 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.700006 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:34.700778 21285 leader_election.cc:400] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
I20260709 13:10:34.700467 23312 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:34.701083 23151 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.701385 23063 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.701933 23111 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.703258 23111 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:34.704591 23111 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.706156 23111 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.701897 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.709108 23063 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.689014 23285 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.710875 21285 leader_election.cc:403] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.711529 23297 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
I20260709 13:10:34.712494 22034 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:34.716620 23107 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.716763 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:34.717345 23107 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.718078 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 662) took 1088 ms. Trace:
I20260709 13:10:34.718539 22034 rpcz_store.cc:276] 0709 13:10:33.630386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.816643 (+186257us) service_pool.cc:224] Handling call
0709 13:10:34.717839 (+901196us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400622854. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:34.718000 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464906624}
I20260709 13:10:34.721132 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.724766 23285 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:34.687304 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:34.726238 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53418.3us
I20260709 13:10:34.727344 23312 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:34.727538 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:34.727856 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:34.727815 23312 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.729355 23312 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.725067 23107 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.728086 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.733139 21314 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:34.734557 21320 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:34.735903 21315 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:34.738463 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.738663 21321 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:34.736653 21316 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:34.739349 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:34.746435 23285 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:34.748361 23151 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:34.764492 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 64589.1us
I20260709 13:10:34.766901 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.760335 23176 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:34.773156 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.762317 23285 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:34.777948 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:34.780516 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:34.785518 21267 auto_rebalancer.cc:629] Failed to schedule move for tablet c4e9f5b52ad74d0d8f492da1f7ef4721: Illegal state: Replica 058db415e9884ea0ba23f1e1ff59127a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:10:34.743667 21312 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:10:34.786798 23275 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.779027 23151 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.789875 23151 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.795053 23187 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:34.795634 23151 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:34.795864 23187 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.798880 23187 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.766471 23146 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:10:34.801267 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:34.802448 23275 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:34.803735 23063 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.804770 23063 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:34.805966 23063 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:34.808943 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 81096.7us
I20260709 13:10:34.809980 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.810894 23176 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:34.811631 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.813043 23146 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.813828 23275 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:34.814702 23284 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:34.826359 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:34.827214 21315 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
W20260709 13:10:34.828598 23341 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:10:34.831012 22906 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:34.815253 23312 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.831457 23285 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:34.834224 23312 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:34.836668 23210 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.836815 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:34.837632 22039 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:34.839710 23338 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:10:34.841346 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:34.844214 22035 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:34.846777 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:34.847707 23176 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:34.848395 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 78604.6us
I20260709 13:10:34.851080 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.857431 22039 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:34.858647 23268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42342 (request call id 661) took 2254 ms. Trace:
I20260709 13:10:34.860247 23200 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:34.836762 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 65205.2us
I20260709 13:10:34.900095 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:34.900645 21388 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:34.908540 23297 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.909580 23297 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:34.910316 23297 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.912642 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.913770 23063 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:34.914984 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.916002 23172 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.926174 21318 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:34.929141 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:34.931950 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 81059.9us
I20260709 13:10:34.948438 23319 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:34.949527 23176 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:34.949884 23297 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:34.949966 23176 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:34.951157 23176 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:34.952512 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:34.961691 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.963505 23111 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.963886 23176 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:34.966935 21391 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:34.967640 21219 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:34.968924 23074 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.967144 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.963660 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.972594 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.969193 21219 catalog_manager.cc:5697] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:10:34.975873 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.886647 23268 rpcz_store.cc:276] 0709 13:10:32.603702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.603828 (+   126us) service_pool.cc:224] Handling call
0709 13:10:33.163218 (+559390us) ts_tablet_manager.cc:934] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
0709 13:10:34.346020 (+1182802us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:34.597825 (+251805us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:34.598128 (+   303us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:34.757219 (+159091us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:34.857944 (+100725us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:34.858337 (+   393us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:34.858435 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":76409,"tablet-copy.queue_time_us":447655,"thread_start_us":382140,"threads_started":2}
I20260709 13:10:34.979197 23297 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:34.980491 23297 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.978624 21219 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 4, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 4 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:34.941512 23275 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:34.978456 23268 tablet_copy_client.cc:806] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:34.984328 21219 catalog_manager.cc:5697] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 4, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:10:34.991974 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 67532.9us
I20260709 13:10:34.934945 22906 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:10:34.933081 23153 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:10:34.978868 23063 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:34.997586 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:34.997697 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:34.974180 23057 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:34.998311 21219 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 3, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:10:35.010897 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47342.8us
I20260709 13:10:35.008917 23319 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:35.015451 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:35.023269 23319 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:35.006803 23057 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.024056 21219 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:10:35.016937 23275 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:35.068457 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 53114.5us
I20260709 13:10:35.032554 23268 tablet_copy_client.cc:670] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:34.995244 23074 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.057458 23057 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:35.070726 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57809.7us
I20260709 13:10:35.004333 23285 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:10:35.076906 21285 leader_election.cc:400] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
I20260709 13:10:35.030833 23284 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:10:35.081871 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:35.073484 23151 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:35.072268 23275 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:35.075433 21219 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 4, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 4 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:35.079530 23200 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:35.096305 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:35.098771 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 146349us
I20260709 13:10:35.097900 22039 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:35.089962 23107 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:35.118686 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 126269us
I20260709 13:10:35.118021 21219 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 3 to 4, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 4 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.117611 23297 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:35.142208 23284 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:35.148831 23172 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:35.107788 23166 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:10:35.157613 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 65811us
I20260709 13:10:35.113371 23151 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.122848 23107 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.151161 23200 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:35.162379 21219 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 4, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 4 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:35.178056 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:35.178436 21219 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:10:35.184079 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44785.6us
I20260709 13:10:35.148902 23356 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:10:35.189281 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:35.189388 21219 catalog_manager.cc:5697] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:10:35.182379 23200 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:35.196890 21219 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 3 to 5, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 5 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:35.133668 23275 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:35.221283 23342 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:10:35.221575 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.222538 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 61797.3us
I20260709 13:10:35.226846 23319 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:35.222553 23355 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:35.202405 23200 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.212947 21219 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
W20260709 13:10:35.259755 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 143315us
I20260709 13:10:35.221300 23074 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:35.267635 21219 catalog_manager.cc:5697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 3, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 3 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.260807 23063 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:35.281034 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 129867us
I20260709 13:10:35.282275 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.269496 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.266695 23319 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.264880 23297 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:35.283939 21219 catalog_manager.cc:5697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 3, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:10:35.294374 23343 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:10:35.295991 23319 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.295261 23166 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:35.298552 23319 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:35.299554 21313 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:35.304785 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:35.305606 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.306389 21470 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:35.308651 23107 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:35.313208 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:35.313489 23063 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:35.316867 23063 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:35.320281 22032 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:35.321084 23063 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:35.322335 23351 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:10:35.322430 23063 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:35.321707 23353 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:35.321496 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.325850 21312 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:35.289408 23297 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:35.333235 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53541.3us
I20260709 13:10:35.344347 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:35.354557 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 96936.2us
I20260709 13:10:35.332469 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.284883 23355 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:35.319630 23107 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:35.341048 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:35.335047 23297 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:35.364787 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44550.3us
I20260709 13:10:35.349817 23319 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.363993 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:35.366276 21470 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:35.376173 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:35.376940 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:35.377748 21392 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:35.377156 21461 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:35.375849 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:35.364956 23107 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.373732 23153 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:35.375820 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 74014.3us
I20260709 13:10:35.390609 23312 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:35.379822 23362 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:35.391067 23312 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:35.391232 23362 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:35.392339 23362 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:35.393752 23350 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:35.374696 23151 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:35.388221 23364 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:35.382771 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:35.382872 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:35.396473 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:35.392860 22041 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:35.395691 23312 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.390061 23107 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:35.402329 23312 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:35.396586 21394 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:35.417922 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45731.2us
I20260709 13:10:35.393769 23362 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:35.443048 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46829.4us
W20260709 13:10:35.444226 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 53384.6us
I20260709 13:10:35.444320 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:35.443014 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.445868 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:35.446031 21314 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:35.447383 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:35.460403 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:35.466739 23275 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:35.469791 23367 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:35.472111 23268 tablet_copy_client.cc:538] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:10:35.482116 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 123271us
I20260709 13:10:35.458063 23176 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:35.458490 23151 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:35.506553 23275 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:35.507575 23275 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.508395 23364 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:35.509006 23364 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.511307 23364 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:35.467373 23057 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.443141 23166 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:10:35.514551 23153 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:35.515461 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:35.518216 23323 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.492020 23348 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:10:35.520568 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.459815 23319 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.526135 21394 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:35.559830 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:35.499621 23200 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.489560 23176 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:35.567667 21314 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:10:35.566658 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 118951us
I20260709 13:10:35.571857 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.580400 23111 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:35.581017 23111 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:35.583213 23111 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:35.584830 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.584987 22911 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.567987 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 150437us
I20260709 13:10:35.585692 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.614779 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:35.615688 21467 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:35.572284 23057 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:35.577005 23176 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.619979 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.621272 21315 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:35.623934 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.632341 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:35.628458 22041 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:35.623042 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:35.625077 23146 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:35.641783 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52824.6us
I20260709 13:10:35.645452 21461 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:35.645800 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:35.646569 21396 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:35.615850 23355 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.655471 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:35.660466 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.641026 23146 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.567337 23323 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.664072 21315 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:35.666688 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:35.667232 21315 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:35.620195 23107 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:35.680564 23381 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:10:35.682395 23151 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.682924 23151 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.685326 23151 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:35.686879 23151 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.687654 23180 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:35.688138 23151 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.688644 23180 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:35.689340 23375 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:35.689898 23375 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:35.689287 23180 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.690244 23375 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:35.616321 22911 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.696172 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:35.665526 23146 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:35.698083 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:35.699234 22036 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:10:35.715672 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 57814.1us
I20260709 13:10:35.658795 23364 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:10:35.683902 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.662322 23355 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.755561 22039 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:35.676087 23166 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:10:35.757301 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.719812 23275 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.793035 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 72728.2us
W20260709 13:10:35.794739 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 98695.5us
I20260709 13:10:35.803992 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.762363 22906 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.820746 21320 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:35.824321 23360 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:10:35.798177 23151 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:35.829489 23385 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:35.831053 23369 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.841883 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43799.1us
I20260709 13:10:35.825604 23355 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:35.801869 23319 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:35.848079 21463 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:35.805011 23362 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.851666 23369 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.851824 22906 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.801761 23172 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.865381 23372 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.152s
I20260709 13:10:35.866418 21320 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:35.866192 23172 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.867743 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:35.868413 23172 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:35.868956 23368 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:10:35.870729 23393 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:35.802271 23275 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.871819 23057 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:35.854823 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:35.844841 21315 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:35.819656 23200 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:35.876093 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46083.4us
I20260709 13:10:35.876941 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:35.863046 23362 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.882863 23057 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:35.902390 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:35.900167 21469 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:35.910214 23362 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:35.923663 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:35.924738 22035 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:35.934057 23153 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.934964 23153 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:35.938170 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:35.939293 23355 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:35.952790 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.955514 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.959364 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:35.960610 21320 raft_consensus.cc:2410] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:35.961071 21318 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:35.973477 23153 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:35.975351 23355 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:35.977201 23355 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:35.978983 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:35.991854 23285 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:36.001679 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 146967us
I20260709 13:10:36.002561 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:36.009821 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 214311us
W20260709 13:10:36.050968 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 168851us
W20260709 13:10:36.006173 23297 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.633s	user 0.001s	sys 0.009s
W20260709 13:10:36.059012 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56557us
I20260709 13:10:35.999606 21465 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:36.052543 23355 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.009060 23200 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.056072 23319 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:36.065423 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.068315 21470 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:36.062477 23107 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:36.114993 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55018.8us
I20260709 13:10:36.062857 23297 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.069576 22911 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:36.079500 23348 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:36.079464 23074 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.079603 23180 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:36.081859 23357 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.154920 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 252586us
I20260709 13:10:36.160992 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:36.163102 21314 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:36.166841 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 114894us
I20260709 13:10:36.128365 23323 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:36.122500 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:36.141129 23107 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.171769 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56031us
I20260709 13:10:36.144310 23348 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:36.125056 23200 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.120725 23387 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.315s
I20260709 13:10:36.168857 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:36.154476 23384 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.275s
I20260709 13:10:36.167320 23390 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.169859 23275 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.192119 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.158282 23074 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.175633 23180 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:36.167255 23357 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:36.256274 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51878.8us
I20260709 13:10:36.258674 23151 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.260138 23402 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:36.260246 22035 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:36.209671 22906 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:36.186410 23411 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:36.261266 23405 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:36.255079 23180 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:36.261049 23146 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.005s
I20260709 13:10:36.192476 23107 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.209888 22036 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:36.212641 23369 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:36.213655 23057 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:36.260175 23394 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.306s	user 0.001s	sys 0.001s
I20260709 13:10:36.302316 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.263530 23323 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.311985 23427 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.312680 23427 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.315398 23427 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.301633 23355 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.332020 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.334609 23107 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.337688 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.338661 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.340893 23107 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.341601 23268 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:10:36.341459 23107 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.339680 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:36.345306 23176 consensus_meta.cc:287] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.000s
I20260709 13:10:36.345966 23176 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.326793 23427 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.348320 23421 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.348489 23427 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.348923 23421 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.349087 23176 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.350560 23427 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.343602 23107 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.351050 23421 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:36.351514 23396 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:10:36.355738 23409 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:10:36.356266 23412 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.356912 23412 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.359215 23412 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:36.359764 23403 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:10:36.360579 23297 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.362473 23180 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.363165 23370 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.363780 23370 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.366694 23370 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.369738 23422 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.370347 23422 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.296169 23151 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.307492 23411 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:36.384357 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52429.3us
I20260709 13:10:36.318099 23415 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.301350 23146 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.376114 23385 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:36.295634 23348 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.317348 23323 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.447485 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:36.410796 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.455531 21317 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:36.410981 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.413204 23367 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.456995 23367 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:36.457787 23395 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.407s	user 0.004s	sys 0.000s
I20260709 13:10:36.413767 23210 raft_consensus.cc:1064] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:36.459244 23367 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:36.413839 23415 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:36.414918 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 458151us
I20260709 13:10:36.456244 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:36.461874 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.462517 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.463160 21314 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:36.419497 23146 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.421452 23426 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.422253 23373 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.392728 23372 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:36.426573 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:36.427645 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.428486 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:36.490545 21468 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:36.428661 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.429472 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.430949 23411 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.388484 23166 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:36.494832 23166 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:36.495707 23166 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.496392 21464 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:36.443208 23357 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.445601 23151 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.448298 23323 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.448851 23428 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.499074 23428 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.491778 21463 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:36.500631 23373 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.501435 23428 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.371245 23355 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.502883 23373 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:36.503968 23355 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.504770 21316 raft_consensus.cc:2410] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:36.402905 23385 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.427673 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.506160 23385 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.506485 21466 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:36.380790 23180 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.507704 23180 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.510717 23180 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:36.451886 23375 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.000s
I20260709 13:10:36.511541 23375 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.512264 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.454617 23319 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:36.454751 23399 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.392s	user 0.000s	sys 0.007s
I20260709 13:10:36.463498 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.466557 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:36.415530 23074 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.514400 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:36.515226 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48738.3us
I20260709 13:10:36.467283 23422 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:36.468922 23172 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.516613 23172 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.469532 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:36.517874 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48417us
I20260709 13:10:36.472332 23415 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:36.473352 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.520853 21391 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:36.522349 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.473489 23153 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:36.475044 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:36.523401 21392 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.475330 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.524065 21394 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:36.476331 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.476536 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.476889 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.477149 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:36.477790 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:36.530758 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:36.531320 21316 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:36.531450 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.532109 21318 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:36.533130 23372 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:36.478319 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.475762 23348 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.533962 21390 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:36.534823 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.536098 21388 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:36.533154 21318 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:36.479583 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.482429 23421 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.482949 23408 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.484129 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.487246 23200 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:36.487815 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.488530 23426 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.493803 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.454386 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.507769 21468 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:36.515908 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:36.528522 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.579011 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.540185 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.580061 21314 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:36.527402 23180 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:36.579329 21391 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:36.527222 23074 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.526556 23367 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:36.573477 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.574474 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:36.529184 23355 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:36.583024 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.593071 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.586671 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:36.581238 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.594046 21314 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:36.589327 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:36.586591 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70747us
I20260709 13:10:36.596398 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.597077 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:36.598088 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:36.610935 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.602531 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.612475 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:36.618381 21395 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:10:36.612807 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 241926us
I20260709 13:10:36.623342 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.625037 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.592935 23428 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:36.626331 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.538563 23153 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.590987 23367 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.627374 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.593012 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.625808 21462 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:36.628752 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.586031 23180 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.626425 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.593273 23355 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.599253 22906 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:36.631204 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.602581 23319 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:36.635689 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:36.603283 23410 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:36.620263 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.604096 23398 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:36.631179 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:36.616115 23422 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.583577 23408 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.639904 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:36.691341 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:36.618903 23425 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:36.618942 23297 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:36.592103 23421 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.629979 23428 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.710278 21393 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:36.710284 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.661584 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:36.640794 21316 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:36.688808 23176 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:36.600673 23074 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.697577 23180 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.620682 23323 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.700487 21390 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:36.636264 23367 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.684127 22911 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:36.686010 23398 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:36.717727 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56242.4us
I20260709 13:10:36.904439 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.711683 23371 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.227s
I20260709 13:10:36.660302 23285 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:36.721047 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 94687.5us
I20260709 13:10:36.694015 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:36.698943 23410 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.695219 21318 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:10:36.830490 23430 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.198s	user 0.000s	sys 0.002s
I20260709 13:10:36.790738 23384 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:36.928814 23384 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.929376 23384 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.857671 23153 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:36.708478 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.845806 23323 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.709761 23377 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:36.933099 23433 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.831750 21394 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:36.714437 23428 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.934672 23323 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.936157 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1734) took 1035 ms. Trace:
I20260709 13:10:36.936483 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:36.937302 22032 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:36.936543 21315 rpcz_store.cc:276] 0709 13:10:35.900566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.903401 (+  2835us) service_pool.cc:224] Handling call
0709 13:10:35.903738 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.296357 (+392619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.296429 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.309311 (+ 12882us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.590227 (+280916us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:36.590284 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.590392 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.935918 (+345526us) raft_consensus.cc:1685] finished
0709 13:10:36.935936 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.936084 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":172270,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":40560,"thread_start_us":663959,"threads_started":2,"wal-append.queue_time_us":613695}
I20260709 13:10:36.721990 23176 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.940253 23176 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:36.878089 23385 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:36.942803 21389 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:36.711783 23389 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.369s
I20260709 13:10:36.850325 23427 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.659970 21465 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:36.701802 23297 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.858062 23408 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.828752 23386 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.800429 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66437us
I20260709 13:10:36.722193 23319 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:36.899045 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:36.699687 23422 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:36.861972 21392 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:36.628155 23247 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:10:36.970118 21388 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:36.701139 23355 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:36.906497 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.723531 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:36.830271 23172 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:36.927911 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.928690 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:36.933693 23433 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.831250 21466 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:10:36.709230 23063 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:36.931576 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:36.907161 23425 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.955746 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:36.944648 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.897535 23426 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.907226 23398 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:36.964053 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.944235 22036 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:36.965149 21318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:10:36.966312 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:36.976665 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 87253.7us
W20260709 13:10:36.976781 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49000.3us
I20260709 13:10:36.945431 22911 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:36.978717 21464 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:37.000941 21318 raft_consensus.cc:606] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:37.005211 21318 raft_consensus.cc:614] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:36.981228 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.985940 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:37.009541 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 286076us
I20260709 13:10:37.010371 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:36.969027 23297 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.012079 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:36.947203 23410 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:37.014230 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 58558.6us
W20260709 13:10:37.019006 21320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.025s
W20260709 13:10:37.019797 21320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.008s	sys 0.026s
I20260709 13:10:36.971575 23422 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:37.021464 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 66053us
I20260709 13:10:37.026425 22042 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:36.982897 23390 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:36.976086 23323 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.981019 23319 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:36.980090 23408 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.049279 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.039915 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.040115 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:37.052522 21467 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:37.053715 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:36.982698 23425 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.950832 23285 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.048967 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:36.981612 23418 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:37.056166 21313 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:36.968690 23427 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.061058 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:37.019879 23400 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:37.073062 21469 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:36.984413 23364 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:10:37.023262 23412 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:37.065013 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.079906 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:36.943598 23210 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.083590 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:37.013319 23063 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:37.091941 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.041251 23390 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:37.057153 23418 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.062987 23389 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:37.111866 21467 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:37.085991 23153 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:37.118556 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.132115 21469 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:37.133437 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.058117 23323 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.112555 23418 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:37.061519 23408 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.105010 23361 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:37.142709 21392 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:37.102342 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.148965 23323 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:37.149528 23153 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:37.143394 23373 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.143458 22032 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:37.117081 23389 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.130704 23247 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:37.116703 23421 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:36.975778 23386 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:37.150997 21387 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
W20260709 13:10:37.184890 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 167922us
I20260709 13:10:37.159472 23153 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:37.190563 21312 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:37.142480 23390 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:37.193985 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 208122us
I20260709 13:10:37.166015 23389 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.161983 23323 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.210191 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:37.165495 23373 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.181926 23385 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:37.190039 23107 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.233040 23107 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.235554 23107 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:37.180349 21387 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:37.235858 23153 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.237370 23153 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:37.205907 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 193936us
I20260709 13:10:37.239256 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:37.207505 23172 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.232293 23385 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:37.201849 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:37.252451 21313 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:37.270752 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:37.273664 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:37.274398 22032 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:37.252082 23385 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.275131 23385 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.277685 23447 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:37.268504 23445 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:37.280608 23445 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.181703 23319 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.211457 23428 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.283061 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:37.245105 23357 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:37.275596 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:37.255008 23247 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.286556 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:37.286290 23373 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:37.294152 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 278514us
I20260709 13:10:37.256948 23433 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:37.304973 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:37.292325 23361 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:37.261874 23200 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.289273 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.253990 23323 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.263077 23172 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:37.358058 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53217.1us
I20260709 13:10:37.355628 21313 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:37.359484 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:37.315081 23063 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:37.316108 23107 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.308393 23285 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:37.318513 23400 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:37.358206 23440 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:10:37.290155 23176 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.383383 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:37.383885 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 99106.1us
I20260709 13:10:37.390203 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:37.308310 23247 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.393131 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:37.368372 23450 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:37.389206 23151 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:37.417657 23432 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.586s	user 0.003s	sys 0.000s
I20260709 13:10:37.383553 23107 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.469928 23357 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.470588 23357 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:37.470801 23107 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:37.471578 23107 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:37.510663 23435 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.711s	user 0.004s	sys 0.000s
I20260709 13:10:37.511000 23107 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.423841 23412 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:37.512434 23412 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.515163 23412 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:37.460222 23375 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:37.414150 23362 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.516539 23362 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:37.421483 23370 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:37.517792 23370 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:37.518997 23370 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.483616 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 685) took 1405 ms. Trace:
I20260709 13:10:37.520319 22031 rpcz_store.cc:276] 0709 13:10:36.078581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.079786 (+  1205us) service_pool.cc:224] Handling call
0709 13:10:36.151252 (+ 71466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.301259 (+150007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.307175 (+  5916us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.344543 (+ 37368us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.588788 (+244245us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:36.724295 (+135507us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.831259 (+106964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.850105 (+ 18846us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.416892 (+566787us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:37.483165 (+ 66273us) raft_consensus.cc:1685] finished
0709 13:10:37.483299 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.483497 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33569,"prepare.queue_time_us":429961,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":29763,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":43041,"spinlock_wait_cycles":44747008,"thread_start_us":426053,"threads_started":3,"wal-append.queue_time_us":343891}
I20260709 13:10:37.526000 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:37.531244 23408 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:37.494390 22911 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:37.536865 23427 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:37.500419 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:37.538839 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:37.539960 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.503211 23153 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:37.541210 23153 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.544246 23411 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.504288 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1552) took 1016 ms. Trace:
I20260709 13:10:37.545305 21394 rpcz_store.cc:276] 0709 13:10:36.487609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.578730 (+ 91121us) service_pool.cc:224] Handling call
0709 13:10:37.504075 (+925345us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54000ac8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:37.504210 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579222912}
I20260709 13:10:37.505368 23364 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:37.548714 22906 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.549198 23364 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.549502 22906 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.505972 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:37.463783 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.563844 21461 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:37.543845 23153 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:37.509079 23074 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:37.568809 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.569893 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.575189 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:37.577837 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.576951 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:37.327548 23384 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.384833 23400 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.625355 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48491.1us
I20260709 13:10:37.358340 23200 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.745098 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:37.754693 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.756553 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.551860 23364 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:37.757994 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.407289 23426 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:37.783347 21467 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:37.624497 23412 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:37.785754 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 392726us
I20260709 13:10:37.407596 23457 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:37.743687 23400 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.805150 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.809814 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.815882 21463 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:37.810000 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:37.800496 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:37.779701 23372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.010s	sys 0.004s
I20260709 13:10:37.823592 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.831017 23426 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.570406 23459 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.416s
I20260709 13:10:37.854084 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.803648 23411 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:37.861733 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:37.834988 23372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.011s	sys 0.005s
W20260709 13:10:37.845271 23432 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:10:37.877418 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 127931us
I20260709 13:10:37.883612 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:37.875116 21467 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
W20260709 13:10:37.888223 23449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.017s	sys 0.109s
I20260709 13:10:37.889391 23478 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:37.889894 23478 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.890401 23478 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:37.890969 23323 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:37.892184 23465 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.892748 23465 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:37.895011 23465 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:37.895588 23180 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.058s	user 0.010s	sys 0.001s
W20260709 13:10:37.896912 23441 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.576s	user 0.001s	sys 0.000s
I20260709 13:10:37.897985 23446 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:37.898432 23446 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.898758 23446 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:37.899531 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1622) took 1425 ms. Trace:
I20260709 13:10:37.899927 21320 rpcz_store.cc:276] 0709 13:10:36.474402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.480218 (+  5816us) service_pool.cc:224] Handling call
0709 13:10:36.516085 (+ 35867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.516479 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.516515 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.516943 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.022028 (+505085us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:37.022068 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.022139 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.899275 (+877136us) raft_consensus.cc:1685] finished
0709 13:10:37.899298 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.899447 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4411,"raft.queue_time_us":4519,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":13936,"thread_start_us":504671,"threads_started":1,"wal-append.queue_time_us":638559}
I20260709 13:10:37.902493 23426 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:37.846570 23428 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:37.908607 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 494175us
I20260709 13:10:37.845957 23457 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:37.922680 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.932376 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:37.933080 21467 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:37.878018 23386 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:37.949756 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:37.950668 21388 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:37.873034 23364 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:37.921727 23385 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:10:37.930789 23449 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.783771 23361 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.954499 23454 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.889835 23456 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:37.921231 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:37.975045 23449 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:37.988190 23463 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:37.987725 23454 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.988423 23411 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.988818 22906 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:37.988648 23456 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.996865 23449 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:37.997728 23480 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:37.951934 23475 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:37.895991 23180 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:38.020201 21469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.016s	sys 0.014s
W20260709 13:10:38.078276 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:37.994648 23348 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.461s	user 0.012s	sys 0.001s
I20260709 13:10:38.108882 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:38.082639 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 88109.1us
I20260709 13:10:38.110642 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:38.083930 22002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.020s	sys 0.031s
I20260709 13:10:38.092991 23449 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:38.098268 21469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.019s	sys 0.015s
I20260709 13:10:37.982656 23445 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:37.991110 23428 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:10:38.072674 23440 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:10:38.111346 22002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.020s	sys 0.031s
I20260709 13:10:38.119382 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 242) took 1329 ms. Trace:
I20260709 13:10:38.073014 23172 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:37.968330 23385 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:37.973555 23364 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.089846 23176 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.097160 23415 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:38.140270 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 893068us
I20260709 13:10:38.181653 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:38.183406 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:38.112844 23421 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.176561 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:38.098214 23427 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.142776 21468 rpcz_store.cc:276] 0709 13:10:36.790102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.830475 (+ 40373us) service_pool.cc:224] Handling call
0709 13:10:36.830817 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.897258 (+ 66441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.898506 (+  1248us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.925739 (+ 27233us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.439979 (+514240us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b180031fde0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:10:37.781532 (+341553us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:37.781815 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.782343 (+   528us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.118871 (+336528us) raft_consensus.cc:1685] finished
0709 13:10:38.118904 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.119258 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29808,"raft.queue_time_us":46792,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":18216,"spinlock_wait_cycles":47801216,"thread_start_us":301776,"threads_started":1,"wal-append.queue_time_us":1190433}
I20260709 13:10:38.132822 21313 raft_consensus.cc:2410] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:38.115350 23449 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.219270 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:38.127933 23367 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.171s	user 0.010s	sys 0.000s
I20260709 13:10:38.113024 23476 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.148470 23247 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:38.138499 23479 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:38.151091 23348 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:38.119957 23445 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:38.133570 23180 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.208945 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 583) took 1028 ms. Trace:
I20260709 13:10:38.214123 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:38.105911 22906 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.234966 21433 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.538s (SENT) [suppressed 18 similar messages]
I20260709 13:10:38.115504 23480 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.190809 23384 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:38.299243 23422 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.249s	user 0.011s	sys 0.001s
I20260709 13:10:38.247637 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:38.191155 23285 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:38.193260 23200 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.120500 23372 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:10:38.240557 23489 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:38.254770 21467 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:38.120394 23428 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.260584 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:38.278146 23476 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.327559 23476 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:38.224978 23398 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.202s	user 0.008s	sys 0.003s
I20260709 13:10:38.269009 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:38.213865 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:38.217860 23488 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:38.107339 23457 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:38.264717 23389 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.015s	user 0.010s	sys 0.002s
I20260709 13:10:38.111748 23475 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:38.299283 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 154901us
I20260709 13:10:38.185976 23465 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:10:38.120779 23470 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 13:10:38.258982 23323 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.292172 23357 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.821s	user 0.006s	sys 0.008s
I20260709 13:10:38.262153 23107 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:38.291694 23486 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:38.307070 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:38.214412 23415 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.259326 23487 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:38.243698 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:38.250519 23421 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.250010 23427 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.270601 23367 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.345302 21319 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:38.355861 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 136708us
I20260709 13:10:38.321292 23445 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:38.396957 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 140365us
I20260709 13:10:38.353143 23200 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.309599 23479 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:38.388481 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:38.412791 21316 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:10:38.389322 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 63545.2us
I20260709 13:10:38.318873 22906 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.390758 23458 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:38.315274 23456 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:38.361956 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:38.419829 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57964.5us
I20260709 13:10:38.419955 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:38.420921 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:38.402864 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 167928us
I20260709 13:10:38.321951 23422 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.344986 23489 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.363090 23488 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.432343 21314 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.435269 21463 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:38.436334 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:38.413268 21465 raft_consensus.cc:2410] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:10:38.413429 23355 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.404s	user 0.010s	sys 0.003s
I20260709 13:10:38.402355 21387 raft_consensus.cc:606] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:38.357904 23398 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:38.455868 23425 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.377s	user 0.009s	sys 0.004s
I20260709 13:10:38.456512 21395 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:38.457660 23398 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.458355 23398 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:38.458446 23465 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:38.458989 23398 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:38.382709 23357 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.461647 23357 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:38.462684 23466 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:10:38.462795 23355 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.436671 23364 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:38.456008 23490 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:10:38.303364 22031 rpcz_store.cc:276] 0709 13:10:37.180107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.523525 (+343418us) service_pool.cc:224] Handling call
0709 13:10:37.523938 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.786916 (+262978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.817462 (+ 30546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.836091 (+ 18629us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:37.846202 (+ 10111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.208658 (+362456us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b5400319554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:38.208711 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.208875 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147828608}
I20260709 13:10:38.455968 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:38.462976 21317 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:38.464474 23493 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:10:38.467439 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 129218us
I20260709 13:10:38.454285 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:38.468966 22041 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:38.427510 23458 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.375674 23389 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.440424 23476 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.473905 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:38.440177 23485 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.475263 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:38.412925 23200 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.486811 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 249) took 1297 ms. Trace:
I20260709 13:10:38.487576 21469 rpcz_store.cc:276] 0709 13:10:37.189188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.189351 (+   163us) service_pool.cc:224] Handling call
0709 13:10:37.205826 (+ 16475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.208815 (+  2989us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:37.327509 (+118694us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.171263 (+843754us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.191303 (+ 20040us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.191493 (+   190us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:38.191524 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.191578 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.486608 (+295030us) raft_consensus.cc:1685] finished
0709 13:10:38.486637 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.486757 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106567,"prepare.queue_time_us":169867,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2837,"raft.queue_time_us":125262,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":9397,"thread_start_us":848602,"threads_started":2,"wal-append.queue_time_us":773705}
I20260709 13:10:38.489856 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:38.490586 23180 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:38.488875 23107 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:38.476882 23458 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:38.501398 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:38.504243 23398 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.477617 23411 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.505723 21316 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:38.518404 23488 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:38.526232 23474 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:10:38.526813 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:38.531308 21284 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:38.529284 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 693) took 1559 ms. Trace:
I20260709 13:10:38.520846 21465 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:38.522270 23446 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.001s
I20260709 13:10:38.516922 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:38.534965 23488 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.546849 23489 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.532531 22042 rpcz_store.cc:276] 0709 13:10:36.970393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.435520 (+465127us) service_pool.cc:224] Handling call
0709 13:10:37.435908 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.480980 (+ 45072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.481022 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.481745 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.835875 (+354130us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:37.943907 (+108032us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.952814 (+  8907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.953004 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.529100 (+576096us) raft_consensus.cc:1685] finished
0709 13:10:38.529120 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.529230 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286993,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":2550,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":11073,"thread_start_us":435947,"threads_started":2,"wal-append.queue_time_us":660303}
I20260709 13:10:38.456521 23425 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.524257 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:38.523089 23411 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.617385 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:38.553942 23297 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.522s	user 0.013s	sys 0.001s
I20260709 13:10:38.537578 23398 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.628110 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 212220us
I20260709 13:10:38.612457 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:38.553941 23107 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:38.611897 23489 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.541102 23446 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.618934 22031 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:38.554216 23355 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.612510 23488 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:38.638979 23400 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.003s
I20260709 13:10:38.639389 23428 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.632295 23501 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.658227 23510 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:38.650564 23489 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:38.620695 21269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 58789.5us
I20260709 13:10:38.664592 22040 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:38.647609 23415 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.666787 23510 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.648547 23398 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.660219 23480 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.635355 23297 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.660395 23427 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:38.661883 23467 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:38.658279 23389 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:38.686168 23489 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:38.674511 23503 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:10:38.665364 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:38.805269 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 168541us
I20260709 13:10:38.649315 23107 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.654117 23180 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:38.759370 23479 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.760321 23445 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.645098 23507 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:10:38.661222 23488 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.658231 23390 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.694522 22032 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:38.691675 23422 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.667786 23428 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:38.808265 23489 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:38.808597 21321 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:38.664793 23400 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.765353 23480 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.824604 23410 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.776s	user 0.012s	sys 0.002s
I20260709 13:10:38.805537 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
W20260709 13:10:38.807758 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 139045us
W20260709 13:10:38.828557 23512 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:10:38.814579 21465 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.811496 23200 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.834141 23398 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.801951 23467 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:38.813858 23475 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.860463 23411 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.846369 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 688) took 2046 ms. Trace:
W20260709 13:10:38.847399 23418 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.681s	user 0.014s	sys 0.001s
I20260709 13:10:38.848610 23446 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.830209 22906 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.853578 23297 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.854048 21461 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:38.871937 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:38.872738 22036 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:38.848968 23480 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.873389 23297 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:38.873914 23297 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.875032 23480 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.835103 23489 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.872941 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:38.855809 23488 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.824875 23510 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.853570 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:38.831223 23428 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:38.858767 23478 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.968s	user 0.006s	sys 0.008s
I20260709 13:10:38.859925 23467 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.848222 23410 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.818142 23180 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:38.697043 23501 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.868239 23418 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.871258 23107 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.872907 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:38.904233 21318 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:38.875912 23297 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.863656 22038 rpcz_store.cc:276] 0709 13:10:36.801181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.148635 (+347454us) service_pool.cc:224] Handling call
0709 13:10:37.148999 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.176394 (+ 27395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.179379 (+  2985us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.252057 (+ 72678us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.752829 (+500772us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.752878 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.845885 (+1093007us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b54006c5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:38.845958 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.846050 (+    92us) raft_consensus.cc:1685] finished
0709 13:10:38.846067 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.846301 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28927,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":13252,"spinlock_wait_cycles":3155840,"thread_start_us":433010,"threads_started":1,"wal-append.queue_time_us":807150}
I20260709 13:10:38.883111 23489 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.862399 21387 raft_consensus.cc:606] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:38.885253 23464 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.000s	user 0.005s	sys 0.002s
I20260709 13:10:38.856685 23400 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.915354 23180 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.896023 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:38.917135 21394 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:38.897580 23428 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:38.898068 23478 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.875937 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:38.880646 22906 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:38.880887 23389 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:38.911691 21470 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:38.919564 21319 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.918663 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1544) took 1143 ms. Trace:
I20260709 13:10:38.922821 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:38.925840 22042 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.933513 21312 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:38.933182 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:38.935276 23468 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:38.925334 21462 rpcz_store.cc:276] 0709 13:10:37.767423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.787917 (+ 20494us) service_pool.cc:224] Handling call
0709 13:10:38.872775 (+1084858us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:38.911032 (+ 38257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23833344}
I20260709 13:10:38.921310 23400 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:38.945633 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:38.946156 23410 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:38.949563 23501 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:38.951113 21319 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:38.952535 23425 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.959830 23418 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.965039 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:38.969753 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:38.969888 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:38.971029 23385 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:38.971158 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:38.972421 23479 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:38.976203 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:38.984840 23412 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.015s	sys 0.020s
W20260709 13:10:38.985471 23412 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.015s	sys 0.020s
I20260709 13:10:38.985877 23412 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:38.986832 23412 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:38.985232 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 178786us
I20260709 13:10:38.940299 23400 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.925886 23389 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.926097 22906 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.971865 23385 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:38.994026 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:38.971889 21462 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.010243 23513 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:38.936185 23468 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:38.930126 23458 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:38.995752 23400 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.028513 23146 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:39.028610 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:39.029490 21388 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:39.029187 23146 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.030983 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.031298 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:39.031934 21387 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.032402 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.032609 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.033878 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.022022 22906 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.025772 23446 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:39.035431 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.035280 23446 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.036077 21392 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:39.035923 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.036731 21390 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:39.026039 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:39.026467 21468 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:39.027060 23418 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:39.027434 23458 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.044601 23478 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:39.048710 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.053444 21466 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.052800 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.047829 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:39.037516 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.054893 21392 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:39.047528 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:39.055962 21316 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:39.040753 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:39.056854 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:39.057492 21316 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:39.064802 23418 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.065552 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.066176 21316 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:39.066547 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1754) took 1783 ms. Trace:
I20260709 13:10:39.064843 23449 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.067240 23418 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:39.052265 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:39.041980 23389 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.061396 23268 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.049901 23468 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:39.091289 22031 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:39.063225 22042 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:39.063449 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:39.059021 23513 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:39.066901 21321 rpcz_store.cc:276] 0709 13:10:37.283015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.291475 (+  8460us) service_pool.cc:224] Handling call
0709 13:10:37.310837 (+ 19362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.831719 (+1520882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.066337 (+234618us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540015c2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:39.066497 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3444120320}
I20260709 13:10:39.070432 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:39.070842 23449 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:39.071197 23421 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:39.074651 22041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 573) took 2452 ms (client timeout 2086 ms). Trace:
I20260709 13:10:39.076337 21388 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:39.076596 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.081488 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:39.040304 23446 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:39.083225 23146 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:39.084728 21465 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:39.082254 21316 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:39.039880 23385 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.092741 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:39.094050 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:39.123100 22042 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:39.094659 23268 tablet_bootstrap.cc:492] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:10:39.095227 22038 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:39.128602 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:39.129325 21321 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.110682 21466 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:39.112538 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:39.111920 22041 rpcz_store.cc:269] 0709 13:10:36.622183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.622303 (+   120us) service_pool.cc:224] Handling call
0709 13:10:39.074392 (+2452089us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54004696d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.074548 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4086723840}
I20260709 13:10:39.116722 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1550) took 1140 ms. Trace:
I20260709 13:10:39.138792 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:39.115321 23389 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:39.123730 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.114485 23449 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.121456 23513 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.140441 21392 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:39.147599 23360 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.131420 23510 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:10:39.147706 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 575) took 2520 ms. Trace:
I20260709 13:10:39.137763 23386 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:39.138665 21467 rpcz_store.cc:276] 0709 13:10:37.976671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.417400 (+440729us) service_pool.cc:224] Handling call
0709 13:10:38.417692 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.417902 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:38.465320 (+ 47418us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.972518 (+507198us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18000e3860. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:10:39.116248 (+143730us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.116320 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:39.116389 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.116481 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.116649 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14332,"prepare.queue_time_us":47403,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":14552,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7561,"spinlock_wait_cycles":5703040,"thread_start_us":129071,"threads_started":1}
I20260709 13:10:39.141743 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:39.163208 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.164572 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:39.150997 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.150197 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.162096 21321 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:39.164710 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.129303 23421 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.129976 23522 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.167109 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:39.168510 23268 ts_tablet_manager.cc:1403] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 2.827s	user 0.036s	sys 0.024s
I20260709 13:10:39.160977 22034 rpcz_store.cc:276] 0709 13:10:36.627332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.631944 (+  4612us) service_pool.cc:224] Handling call
0709 13:10:37.586511 (+954567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.751589 (+165078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.757537 (+  5948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.783253 (+ 25716us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.787651 (+  4398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.811663 (+ 24012us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.140933 (+1329270us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b540046a350. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.147603 (+  6670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955588864}
I20260709 13:10:39.123196 23458 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:10:39.170311 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.148900 23449 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.148777 23074 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:39.174355 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.174789 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:39.164371 23360 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.176358 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.176811 23348 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:39.189601 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.190968 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.191478 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1639) took 2142 ms. Trace:
I20260709 13:10:39.192167 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.191972 21315 rpcz_store.cc:276] 0709 13:10:37.049246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.049452 (+   206us) service_pool.cc:224] Handling call
0709 13:10:37.515390 (+465938us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5800181298. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:37.515609 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.789783 (+274174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.789828 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.789891 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:37.789946 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.191237 (+1401291us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400228b54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:39.191284 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.191404 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660728576}
I20260709 13:10:39.192902 21396 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:39.193462 23360 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:39.193531 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.194134 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1548) took 2707 ms. Trace:
I20260709 13:10:39.194199 21315 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:39.194572 21395 rpcz_store.cc:276] 0709 13:10:36.486351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.795050 (+308699us) service_pool.cc:224] Handling call
0709 13:10:36.795343 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.456940 (+1661597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.193892 (+736952us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54001c3754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:39.194045 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3820038400}
I20260709 13:10:39.195134 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.194135 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1552) took 1212 ms. Trace:
I20260709 13:10:39.177484 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:39.196341 21468 rpcz_store.cc:276] 0709 13:10:37.982227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.268661 (+286434us) service_pool.cc:224] Handling call
0709 13:10:39.193960 (+925299us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54001a77d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.194061 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561801088}
I20260709 13:10:39.196846 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.197160 21318 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:39.197207 21392 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.143337 23389 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.178905 21467 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.155871 23476 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:39.142844 23425 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.179904 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:39.130214 23385 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.181653 21321 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:39.182224 23074 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.182586 23518 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:39.172262 23386 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:39.179579 23166 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:39.184508 21316 raft_consensus.cc:2410] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:39.191558 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1757) took 1040 ms. Trace:
I20260709 13:10:39.201494 23348 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:39.196231 23458 consensus_queue.cc:1243] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:39.178203 23421 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.200426 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.170980 23146 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:39.202215 23476 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:39.206285 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.238319 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.208925 21362 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.211428 21467 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:39.143091 21387 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:39.214097 21312 rpcz_store.cc:276] 0709 13:10:38.151215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.151371 (+   156us) service_pool.cc:224] Handling call
0709 13:10:39.191406 (+1040035us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b540032b4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.191506 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650256256}
I20260709 13:10:39.192445 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:39.183970 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.218195 21321 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:39.221743 23074 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.202538 23389 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.204330 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:39.177567 23522 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.239605 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.248245 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:39.240453 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:39.243366 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.244951 21389 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:39.245857 23360 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.246537 23449 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.215940 23371 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:39.249217 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:39.236994 23057 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.743s	user 0.019s	sys 0.012s
I20260709 13:10:39.251784 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.212954 23425 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.259013 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.240917 23476 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.257352 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:39.256232 23057 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.762s	user 0.019s	sys 0.012s
I20260709 13:10:39.240056 23412 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.259557 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.253505 23510 raft_consensus.cc:2764] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:10:39.242853 23166 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.260619 21390 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:39.244232 23146 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:39.262748 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.262941 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.233340 23400 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.254278 23074 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:39.265200 21467 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:39.265759 23386 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.268882 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.269781 21468 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:39.270969 23074 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.272281 23074 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:39.271761 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.273778 21389 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:39.273949 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.274782 23454 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:39.274731 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.275033 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.276134 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.277282 23362 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.278558 23362 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.277268 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.280391 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.281347 21468 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:39.282178 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.282256 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:39.261818 23371 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:39.285676 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.267619 23412 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.280402 23418 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:39.287213 21465 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:39.287556 21391 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:39.269833 23390 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.287819 23348 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.288537 23385 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.291100 23449 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:39.287794 23522 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.302265 21464 raft_consensus.cc:2368] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5.
I20260709 13:10:39.302098 23166 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.302785 23166 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:10:39.302912 21313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 1648) took 1913 ms (client timeout 1772 ms). Trace:
I20260709 13:10:39.303223 23166 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.302078 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:39.292770 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.305225 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.299427 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.306556 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.307425 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1539) took 2279 ms. Trace:
I20260709 13:10:39.307576 23412 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.307864 21470 rpcz_store.cc:276] 0709 13:10:37.027685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.064227 (+ 36542us) service_pool.cc:224] Handling call
0709 13:10:37.505782 (+441555us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:39.307248 (+1801466us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002490d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.307348 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3127679616}
I20260709 13:10:39.309341 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.310945 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.294682 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:39.303434 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1554) took 1320 ms. Trace:
I20260709 13:10:39.311975 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:39.303385 21313 rpcz_store.cc:269] 0709 13:10:37.389109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.389914 (+   805us) service_pool.cc:224] Handling call
0709 13:10:39.302671 (+1912757us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54003c87d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.302820 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705248512}
W20260709 13:10:39.313402 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44510.1us
I20260709 13:10:39.315682 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1548) took 1543 ms. Trace:
I20260709 13:10:39.313352 21464 rpcz_store.cc:276] 0709 13:10:37.982837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.147754 (+164917us) service_pool.cc:224] Handling call
0709 13:10:39.052664 (+904910us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3e9c 00007fc2bc0f3a5b 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:39.303248 (+250584us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400249ad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.303376 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574422912}
I20260709 13:10:39.316897 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.319289 21467 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:39.319521 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.313385 21316 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.317492 21463 rpcz_store.cc:276] 0709 13:10:37.772357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.858490 (+ 86133us) service_pool.cc:224] Handling call
0709 13:10:39.315430 (+1456940us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b5400217354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.315606 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223960448}
I20260709 13:10:39.323426 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.324123 21387 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:10:39.324731 23460 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 1.569s	user 0.009s	sys 0.006s
I20260709 13:10:39.325981 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 580) took 2435 ms. Trace:
I20260709 13:10:39.325466 23522 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:39.326722 23522 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.326359 22039 rpcz_store.cc:276] 0709 13:10:36.890428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.150461 (+260033us) service_pool.cc:224] Handling call
0709 13:10:37.169626 (+ 19165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.176215 (+  6589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.176259 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.194063 (+ 17804us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.313882 (+119819us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:37.314005 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.314144 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.297134 (+1982990us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:39.325716 (+ 28582us) raft_consensus.cc:1685] finished
0709 13:10:39.325737 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.325925 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7758,"raft.queue_time_us":42849,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4868,"spinlock_wait_cycles":385104256,"thread_start_us":90217,"threads_started":1,"wal-append.queue_time_us":171843}
I20260709 13:10:39.329067 23522 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:39.331466 21360 leader_election.cc:400] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5.
I20260709 13:10:39.331846 21360 leader_election.cc:403] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:39.262494 23467 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.334546 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.333686 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.336511 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.340739 21464 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:39.337762 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.341754 21467 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:39.348098 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:39.349922 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.352164 21316 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:39.295684 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.357973 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.358759 21464 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:39.356642 23511 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:39.363052 23511 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.363579 23511 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.356791 23516 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.356897 23385 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.369527 21465 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:39.373435 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.377411 21465 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:39.354650 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:39.389590 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.380219 23400 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.291987 23268 raft_consensus.cc:359] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:39.403203 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:39.398852 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:39.374475 23446 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.353276 23421 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:39.406810 23523 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:10:39.407303 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.407717 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.407985 21320 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:39.409049 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.406473 23485 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:39.400677 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.410014 23365 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:39.396171 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.411391 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:39.411664 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.412165 23412 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:39.412508 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:39.395409 23386 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:10:39.413581 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.407336 23510 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.414276 23386 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:39.414566 23510 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:39.414975 23510 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.417924 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.419080 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:39.406702 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:39.419696 21394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1341) took 1852 ms (client timeout 2284 ms). Trace:
I20260709 13:10:39.420153 21312 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:39.421257 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.422525 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.423161 21312 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
W20260709 13:10:39.420156 21394 rpcz_store.cc:269] 0709 13:10:37.567789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.568535 (+   746us) service_pool.cc:224] Handling call
0709 13:10:39.419455 (+1850920us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001c4654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.419586 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3098926464}
I20260709 13:10:39.412613 23365 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.424860 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:39.419106 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:39.426366 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.427443 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.429137 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.298099 23371 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.435238 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:39.435678 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.436260 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:39.438400 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:39.308461 23146 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.440683 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:39.381317 21462 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:39.441810 22040 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:39.430701 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.422722 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:39.451921 21312 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:39.453254 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.454162 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.454672 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:39.397352 23437 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:39.461253 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.462203 21391 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:39.463246 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.380740 23357 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:10:39.465016 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.472918 21318 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:39.400585 23425 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:39.470945 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70345.7us
I20260709 13:10:39.406558 23446 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.403770 23390 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:39.403599 23268 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:10:39.484448 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.498509 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.498071 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:39.465862 23375 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.501391 21320 raft_consensus.cc:2410] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:39.501514 23375 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.502261 22041 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:39.503186 23360 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:39.503558 23375 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.441767 23521 raft_consensus.cc:2764] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:39.450785 23478 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:39.450449 23176 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:39.515414 21390 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:39.412674 23412 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.478235 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:39.481663 23496 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.483946 23437 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:39.504930 23425 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:39.506827 23479 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:39.548902 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:39.551970 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:39.552851 21319 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.528481 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.535039 21469 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:39.532955 21392 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:39.525691 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1751) took 2263 ms. Trace:
W20260709 13:10:39.534801 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 251) took 1780 ms (client timeout 1811 ms). Trace:
I20260709 13:10:39.564231 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.568499 21317 rpcz_store.cc:276] 0709 13:10:37.262809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.262983 (+   174us) service_pool.cc:224] Handling call
0709 13:10:37.263396 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.470210 (+1206814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.525371 (+1055161us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540022d8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:39.525616 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2758403456}
I20260709 13:10:39.567761 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1559) took 1132 ms. Trace:
I20260709 13:10:39.529371 23176 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:39.548959 23390 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:39.599445 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 71036.4us
I20260709 13:10:39.602209 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.573469 21463 rpcz_store.cc:276] 0709 13:10:38.435286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.323225 (+887939us) service_pool.cc:224] Handling call
0709 13:10:39.323491 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.323716 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:39.397234 (+ 73518us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.567156 (+169922us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.567391 (+   235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.567456 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:39.567517 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.567582 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.567698 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175357,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":2599,"raft.queue_time_us":4793,"thread_start_us":237626,"threads_started":2}
W20260709 13:10:39.629225 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45313.6us
I20260709 13:10:39.601123 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:39.523607 23478 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:39.649209 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 274360us
I20260709 13:10:39.563320 23375 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 13:10:39.658053 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 219725us
I20260709 13:10:39.680943 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:39.583250 23390 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.635834 23357 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.686630 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:39.536163 23268 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:39.688279 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.689800 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.644390 23520 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:39.713960 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:39.722788 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 121784us
I20260709 13:10:39.723901 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:39.570535 21461 rpcz_store.cc:269] 0709 13:10:37.754203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.754416 (+   213us) service_pool.cc:224] Handling call
0709 13:10:39.534552 (+1780136us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400025dd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:39.534728 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483376512}
I20260709 13:10:39.686292 23479 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:39.688560 23390 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.641314 23210 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:10:39.688010 23467 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:39.733451 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.706797 23521 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:39.710160 21319 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
W20260709 13:10:39.728459 23528 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:10:39.728067 23370 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:39.678808 23437 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.730280 23479 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:39.764081 23518 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.781535 23367 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:39.786289 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 237443us
I20260709 13:10:39.768204 23446 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:39.788391 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.790947 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.769189 23370 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.773368 23479 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.808254 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.810220 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.812637 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:39.763754 23074 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.811594 23425 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:10:39.756698 23176 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.816468 23531 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:39.764834 23478 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:39.818650 23476 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.001s
I20260709 13:10:39.819145 23476 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.821466 23476 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.794067 23412 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:39.824463 23412 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:39.828509 23527 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:10:39.830245 23530 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:39.833065 23539 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:39.833674 23539 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.834249 23425 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:39.834658 23425 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:39.785109 23518 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.841410 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.785902 23535 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:39.835848 23539 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:39.850495 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 177116us
I20260709 13:10:39.809927 23370 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.835479 23425 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:39.854391 23425 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.842418 23373 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:39.857270 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.860839 23074 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:39.843617 23210 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.843833 23518 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.865255 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:39.869519 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 155644us
I20260709 13:10:39.873251 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.877272 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:39.874774 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 141435us
I20260709 13:10:39.881038 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:39.882313 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.880081 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.904418 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:39.906208 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:39.906404 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.907586 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.914911 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:39.863444 23510 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:39.869359 23210 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:39.920629 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.908010 23535 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.912230 23539 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.909858 23443 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:39.952508 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45073.8us
I20260709 13:10:39.954118 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.955377 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.908175 23547 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:39.921128 23412 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.916332 23521 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:39.929726 23210 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.951297 23176 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:39.952373 23437 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:39.949991 23535 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:39.954933 23478 raft_consensus.cc:2764] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:10:39.955544 23443 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.957962 23549 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:39.972471 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:39.959448 23412 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:39.959393 23550 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.990818 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.966301 23176 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:39.969369 23443 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.997375 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:39.966641 23535 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:40.022004 23536 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:10:40.022384 23510 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:39.988782 23412 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:39.997349 23166 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.004s
I20260709 13:10:39.975154 23546 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:40.043182 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1565) took 1547 ms. Trace:
I20260709 13:10:39.997387 23542 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:39.997500 23516 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
W20260709 13:10:40.047926 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 127421us
I20260709 13:10:40.050711 22042 raft_consensus.cc:1217] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:10:40.016964 23531 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:40.002905 23389 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.001s
I20260709 13:10:39.992547 23547 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:40.015720 23385 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.001s
W20260709 13:10:39.999008 23534 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:10:40.003964 23176 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.004006 23323 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.055313 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:40.043835 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 137709us
I20260709 13:10:40.056152 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:40.054198 23516 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:40.047029 21470 rpcz_store.cc:276] 0709 13:10:38.496068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.354430 (+858362us) service_pool.cc:224] Handling call
0709 13:10:39.354836 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.379447 (+ 24611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.379474 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.384293 (+  4819us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.754037 (+369744us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:39.754076 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.754151 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.023424 (+269273us) raft_consensus.cc:1685] finished
0709 13:10:40.023445 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.043111 (+ 19666us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8568,"raft.queue_time_us":9226,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4552,"thread_start_us":299852,"threads_started":1,"wal-append.queue_time_us":430221}
I20260709 13:10:40.048717 23546 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.045601 23550 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:40.047284 23362 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.002s
I20260709 13:10:40.059307 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.094029 21468 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:40.085783 23559 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:10:40.085000 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.096421 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1557) took 1661 ms. Trace:
I20260709 13:10:40.118927 21469 rpcz_store.cc:276] 0709 13:10:38.434738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.491959 (+ 57221us) service_pool.cc:224] Handling call
0709 13:10:39.534709 (+1042750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.554483 (+ 19774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.096128 (+541645us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400025dd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:40.096336 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397440768}
I20260709 13:10:40.046381 23166 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.068334 23385 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5.
I20260709 13:10:40.105412 23469 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.131695 21395 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:40.131564 23469 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.110234 23400 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:40.113317 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:40.132655 23400 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:40.133601 23400 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.134800 23400 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.091646 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 700) took 1066 ms. Trace:
W20260709 13:10:40.136833 23552 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:40.136740 22038 rpcz_store.cc:276] 0709 13:10:39.025265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.057675 (+ 32410us) service_pool.cc:224] Handling call
0709 13:10:39.094945 (+ 37270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.132128 (+ 37183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.091272 (+959144us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5400647650. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:40.091565 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78832384}
W20260709 13:10:40.113807 23557 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:10:40.064110 23531 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.152303 23323 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:40.153072 23323 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.154258 23531 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.155380 23323 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.045019 23521 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.130117 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.131033 23275 raft_consensus.cc:993] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:40.131808 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:40.107998 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.086678 23268 ts_tablet_manager.cc:1434] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.904s	user 0.011s	sys 0.014s
W20260709 13:10:40.144536 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59572.2us
I20260709 13:10:40.088845 23481 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.167449 23481 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:40.163278 23268 ts_tablet_manager.cc:1467] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Tablet startup took 992ms
I20260709 13:10:40.167870 23481 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.092439 23548 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:10:40.149271 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1366) took 1034 ms. Trace:
I20260709 13:10:40.172725 21467 rpcz_store.cc:276] 0709 13:10:39.114794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.377554 (+262760us) service_pool.cc:224] Handling call
0709 13:10:39.377919 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.378235 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.378280 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.386271 (+  7991us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.582558 (+196287us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:39.582612 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.582709 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.149032 (+566323us) raft_consensus.cc:1685] finished
0709 13:10:40.149052 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.149201 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":134137,"threads_started":1,"wal-append.queue_time_us":321971}
I20260709 13:10:40.150174 21396 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:40.150820 23477 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.150923 23166 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.151674 23562 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:40.066581 23389 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:40.088884 23553 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:10:40.092837 23546 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.117731 23550 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.164858 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.205518 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:40.165287 21394 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:40.166908 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.174245 23275 raft_consensus.cc:1081] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:40.212133 23428 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.212263 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.212652 23428 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:40.213079 23428 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.213553 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.214730 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.216902 23550 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:40.174494 23547 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:40.177228 23323 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:40.207180 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.220822 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:40.225031 22042 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.217522 23492 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.235929 23492 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:40.215786 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.226359 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:40.227721 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:40.168156 23268 ts_tablet_manager.cc:1469] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Trace:
0709 13:10:32.603702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.603828 (+   126us) service_pool.cc:224] Handling call
0709 13:10:33.163218 (+559390us) ts_tablet_manager.cc:934] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
0709 13:10:34.346020 (+1182802us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:34.597825 (+251805us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:34.598128 (+   303us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:34.757219 (+159091us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:34.857944 (+100725us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:34.858337 (+   393us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:34.858435 (+    98us) inbound_call.cc:177] Queueing success response
0709 13:10:36.341135 (+1482700us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:10:39.181697 (+2840562us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:10:39.289270 (+107573us) tablet_replica.cc:261] Starting instrumentation
0709 13:10:39.289967 (+   697us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":76409,"raft.queue_time_us":102410,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":103,"tablet-copy.queue_time_us":447655,"tablet-download-pool.queue_time_us":46119,"tablet-download-pool.run_cpu_time_us":2094,"tablet-download-pool.run_wall_time_us":346146,"thread_start_us":532982,"threads_started":3}
W20260709 13:10:40.228312 23551 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.143s	user 0.002s	sys 0.001s
I20260709 13:10:40.228844 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:40.229946 23511 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.848s	user 0.009s	sys 0.003s
I20260709 13:10:40.255195 21466 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:40.232714 23481 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.251081 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.251783 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.255156 23384 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.255542 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1350) took 1222 ms. Trace:
I20260709 13:10:40.254040 23323 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:40.260192 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.222702 23547 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.254158 23548 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:40.185345 23390 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.183542 23518 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.263002 23511 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.266971 23371 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:40.261739 21388 rpcz_store.cc:276] 0709 13:10:39.033553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.033660 (+   107us) service_pool.cc:224] Handling call
0709 13:10:40.255384 (+1221724us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54002cd154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:40.255488 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96402816}
I20260709 13:10:40.269213 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:40.184612 23370 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.185001 23477 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.274775 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.278666 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.290449 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1573) took 1235 ms. Trace:
I20260709 13:10:40.291721 21391 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:40.284976 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.290867 21465 rpcz_store.cc:276] 0709 13:10:39.055009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.371209 (+316200us) service_pool.cc:224] Handling call
0709 13:10:39.371458 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.377865 (+  6407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.290231 (+912366us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b5400070154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:40.290391 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13292800}
I20260709 13:10:40.295220 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:40.296487 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.297281 23548 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:40.316253 23548 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:40.316841 23548 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.302213 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.303053 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-e7cc0b64eb784638b78409562870a2db received from {username='slave'} at 127.0.0.1:36486
I20260709 13:10:40.306509 23063 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:40.307883 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.312999 22042 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:40.314863 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.321986 21313 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:40.322764 23410 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.323004 21317 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:40.322053 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.336627 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.324586 23511 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:40.286046 23468 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:40.325398 23562 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.326365 23418 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:40.327028 23481 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.336318 21317 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:40.344991 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.340799 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.337832 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-e7cc0b64eb784638b78409562870a2db on tablet e7cc0b64eb784638b78409562870a2db with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:40.346092 22040 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:40.341641 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:40.346957 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:40.347549 21465 raft_consensus.cc:2368] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
W20260709 13:10:40.327952 23537 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.513s	user 0.000s	sys 0.003s
I20260709 13:10:40.345052 21317 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.353616 21317 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.351763 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.354750 22040 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:40.355608 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:40.365998 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.367192 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.367846 22040 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:40.370384 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.339200 23468 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:40.373476 21320 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:40.361354 23425 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.006s
I20260709 13:10:40.383474 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.383980 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:40.369607 22032 raft_consensus.cc:2368] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7.
I20260709 13:10:40.386108 21392 raft_consensus.cc:2410] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:40.387662 21390 raft_consensus.cc:2368] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:40.339689 23166 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:10:40.352293 23562 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.344653 23555 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:10:40.345386 23410 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.394994 23496 raft_consensus.cc:993] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:40.393898 23166 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:40.369271 23367 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.402500 23166 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:40.403515 23166 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.397337 23562 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.388221 21320 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.397960 21317 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:10:40.390316 23449 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:40.390379 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.342474 23063 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.414901 21390 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:40.371472 23418 consensus_queue.cc:1243] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:40.384467 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 705) took 1006 ms. Trace:
I20260709 13:10:40.401991 23151 raft_consensus.cc:1081] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:10:40.389608 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:40.406706 21317 pending_rounds.cc:85] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 2
I20260709 13:10:40.422536 21317 pending_rounds.cc:107] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:10:40.422861 21317 raft_consensus.cc:2889] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.423267 22039 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:40.400906 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1368) took 1259 ms. Trace:
I20260709 13:10:40.423666 22039 pending_rounds.cc:85] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 5
I20260709 13:10:40.423930 22039 pending_rounds.cc:107] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:40.424368 22039 raft_consensus.cc:2889] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.423843 21468 rpcz_store.cc:276] 0709 13:10:39.141941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.380820 (+238879us) service_pool.cc:224] Handling call
0709 13:10:39.396634 (+ 15814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.094721 (+698087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.400687 (+305966us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b540029a4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:40.400851 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602776832}
I20260709 13:10:40.413293 21434 leader_election.cc:400] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:40.425968 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.415645 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 319) took 1071 ms. Trace:
I20260709 13:10:40.404711 23166 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.359736 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.420497 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:40.426306 21434 leader_election.cc:403] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:40.426725 21390 rpcz_store.cc:276] 0709 13:10:39.344641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.390124 (+1045483us) service_pool.cc:224] Handling call
0709 13:10:40.415548 (+ 25424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.401291 23410 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:40.433974 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.434705 21468 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:40.438089 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.438227 23319 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.438344 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.438799 21390 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:40.439152 23063 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:40.439669 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.440313 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1577) took 1110 ms. Trace:
I20260709 13:10:40.440488 21389 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:40.440850 21390 rpcz_store.cc:276] 0709 13:10:39.330210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.439523 (+1109313us) service_pool.cc:224] Handling call
0709 13:10:40.439833 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.440001 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.440043 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.440085 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:40.440121 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.440172 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.440259 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.445636 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.431775 23510 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:40.445356 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.450285 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.412562 23449 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.465261 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1579) took 1134 ms. Trace:
I20260709 13:10:40.440605 23437 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.359520 23323 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.541078 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:40.489114 21389 rpcz_store.cc:276] 0709 13:10:39.330754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.439381 (+1108627us) service_pool.cc:224] Handling call
0709 13:10:40.465167 (+ 25786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.548293 21390 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:40.548444 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.549093 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1578) took 1218 ms. Trace:
I20260709 13:10:40.549432 21390 rpcz_store.cc:276] 0709 13:10:39.330469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.442273 (+1111804us) service_pool.cc:224] Handling call
0709 13:10:40.548136 (+105863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.548761 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.549033 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.549876 23469 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:40.550549 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1580) took 1211 ms. Trace:
I20260709 13:10:40.551054 21389 rpcz_store.cc:276] 0709 13:10:39.338894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.549708 (+1210814us) service_pool.cc:224] Handling call
0709 13:10:40.550028 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.550215 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.550241 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.550289 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:40.550343 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.550397 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.550495 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.550719 21390 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:40.552687 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 320) took 1205 ms. Trace:
I20260709 13:10:40.552989 21390 rpcz_store.cc:276] 0709 13:10:39.347395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.550224 (+1202829us) service_pool.cc:224] Handling call
0709 13:10:40.550559 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.552472 (+  1913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.552641 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.553332 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 321) took 1199 ms. Trace:
W20260709 13:10:40.553261 21393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 314) took 3025 ms (client timeout 1889 ms). Trace:
I20260709 13:10:40.555415 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1589) took 1183 ms. Trace:
I20260709 13:10:40.554903 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1582) took 1185 ms. Trace:
I20260709 13:10:40.554900 21389 rpcz_store.cc:276] 0709 13:10:39.354305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.552530 (+1198225us) service_pool.cc:224] Handling call
0709 13:10:40.552826 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.552991 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.553021 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.553069 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:40.553103 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.553162 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.553282 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.556195 21390 rpcz_store.cc:276] 0709 13:10:39.369679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.554090 (+1184411us) service_pool.cc:224] Handling call
0709 13:10:40.554421 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.554621 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.554646 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.554688 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:40.554715 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.554765 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.554855 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.557698 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1588) took 1186 ms. Trace:
I20260709 13:10:40.558177 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 324) took 1153 ms. Trace:
I20260709 13:10:40.558133 21391 rpcz_store.cc:276] 0709 13:10:39.371290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.462947 (+ 91657us) service_pool.cc:224] Handling call
0709 13:10:40.557465 (+1094518us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54000f14d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:40.557633 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903326464}
I20260709 13:10:40.557755 21389 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:40.558871 21390 rpcz_store.cc:276] 0709 13:10:39.404417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.557346 (+1152929us) service_pool.cc:224] Handling call
0709 13:10:40.557568 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.557757 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.557792 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.557851 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:40.557895 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.557968 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.558112 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.559695 21391 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:40.563222 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 326) took 1125 ms. Trace:
I20260709 13:10:40.563735 21391 rpcz_store.cc:276] 0709 13:10:39.437418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.559182 (+1121764us) service_pool.cc:224] Handling call
0709 13:10:40.559481 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.562892 (+  3411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.563150 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.545356 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.556008 21395 rpcz_store.cc:276] 0709 13:10:39.371529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.905919 (+534390us) service_pool.cc:224] Handling call
0709 13:10:40.555220 (+649301us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54003f4b54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:40.555357 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490414464}
I20260709 13:10:40.567821 21469 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:40.544196 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:40.555150 21393 rpcz_store.cc:269] 0709 13:10:37.527580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.539619 (+ 12039us) service_pool.cc:224] Handling call
0709 13:10:40.553019 (+3013400us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54002e27d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:40.553156 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6029242624}
I20260709 13:10:40.434221 23389 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:40.572137 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:40.575933 21391 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:40.478821 23449 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.437283 23539 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:40.582199 21391 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:10:40.583264 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 249842us
I20260709 13:10:40.595151 21463 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:40.583757 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:40.577363 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.599020 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.604113 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.539343 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:40.578784 23564 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.314s	user 0.001s	sys 0.003s
I20260709 13:10:40.606060 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.597383 23531 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.607613 23319 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:40.610996 23367 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:40.563277 23468 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:40.621481 21466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1360) took 1626 ms (client timeout 1661 ms). Trace:
I20260709 13:10:40.422747 22034 rpcz_store.cc:276] 0709 13:10:39.377922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.380521 (+  2599us) service_pool.cc:224] Handling call
0709 13:10:40.314687 (+934166us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:40.379228 (+ 64541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16052608}
I20260709 13:10:40.580880 23517 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:40.580009 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 323) took 1173 ms. Trace:
I20260709 13:10:40.581142 23492 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.569870 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.628329 23547 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:40.635519 23535 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
W20260709 13:10:40.639622 23479 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.826s	user 0.010s	sys 0.005s
I20260709 13:10:40.640406 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1575) took 1315 ms. Trace:
I20260709 13:10:40.669797 23319 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:40.643034 23443 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
I20260709 13:10:40.647014 23428 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.479722 23412 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.651651 23555 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:40.635567 23176 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.003s
I20260709 13:10:40.654011 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:10:40.739588 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 85670.7us
I20260709 13:10:40.740581 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.740875 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.654518 23550 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:40.655061 23390 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:40.655267 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51285.4us
I20260709 13:10:40.746532 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:40.655745 23458 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.656500 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:40.627696 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:40.750707 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 123110us
I20260709 13:10:40.662883 21320 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:40.663657 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:40.597821 23562 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:40.680692 21466 rpcz_store.cc:269] 0709 13:10:38.994750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.180227 (+185477us) service_pool.cc:224] Handling call
0709 13:10:40.621280 (+1441053us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000b8954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:40.621418 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447733632}
I20260709 13:10:40.619472 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:40.641903 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.718006 23535 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.715996 21387 rpcz_store.cc:276] 0709 13:10:39.329575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.333910 (+  4335us) service_pool.cc:224] Handling call
0709 13:10:39.353569 (+ 19659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.381254 (+ 27685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.381294 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.385834 (+  4540us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.687483 (+301649us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:39.752415 (+ 64932us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.787342 (+ 34927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.787473 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.292486 (+505013us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b24002859c8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc16a09d 00007fc2bed9c10e 00007fc2bedb388c 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221
0709 13:10:40.604596 (+312110us) raft_consensus.cc:1685] finished
0709 13:10:40.640142 (+ 35546us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.640313 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117180,"prepare.queue_time_us":65823,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":68701,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":28215,"spinlock_wait_cycles":27019008,"thread_start_us":218580,"threads_started":1,"wal-append.queue_time_us":384039}
I20260709 13:10:40.758929 21395 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:40.722620 23548 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.728281 23492 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.729039 23468 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.729689 23479 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.679733 23477 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:40.714444 23210 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.003s
I20260709 13:10:40.742043 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.742355 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:40.758456 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1581) took 1411 ms. Trace:
I20260709 13:10:40.736526 23555 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:40.736016 23400 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
I20260709 13:10:40.716914 23517 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:40.767087 21285 leader_election.cc:400] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:10:40.799199 21285 leader_election.cc:403] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:40.733896 23319 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.767652 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.776504 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:40.771598 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:40.766278 23367 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:40.813819 21318 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:40.813959 23367 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.814505 23367 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.815295 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:40.815457 23492 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.786670 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:40.787103 23565 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:10:40.788950 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:40.789635 23479 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:40.791632 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49389.1us
I20260709 13:10:40.783571 21396 rpcz_store.cc:276] 0709 13:10:39.346749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.677001 (+330252us) service_pool.cc:224] Handling call
0709 13:10:40.758294 (+1081293us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400405454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:40.758398 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015589248}
I20260709 13:10:40.792348 21319 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:40.794396 23521 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:10:40.756565 23531 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:40.794863 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.831410 21313 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:40.761837 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:40.773372 23563 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.514s	user 0.000s	sys 0.005s
I20260709 13:10:40.758188 23562 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:40.765574 23507 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:40.819703 23546 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.595s	user 0.004s	sys 0.004s
I20260709 13:10:40.820189 23566 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:10:40.785769 21387 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:40.685417 21389 rpcz_store.cc:276] 0709 13:10:39.399957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.557175 (+1157218us) service_pool.cc:224] Handling call
0709 13:10:40.557588 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.560169 (+  2581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.573269 (+ 13100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172928}
I20260709 13:10:40.822728 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:40.736663 23443 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.759712 23547 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:40.744248 23176 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.787708 23210 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.824962 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:40.802544 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.858551 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:40.799437 23446 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:40.767055 23550 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.864210 21313 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:40.834427 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 72683.7us
I20260709 13:10:40.865612 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.796319 23555 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.837967 21320 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:40.779294 23284 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:10:40.861037 21314 raft_consensus.cc:2368] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:40.870996 21312 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.839098 23562 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.869910 22040 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:40.869735 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 263756us
I20260709 13:10:40.872448 21320 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:40.872989 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.857630 23547 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.881274 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:40.885299 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:40.904174 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 79307.6us
I20260709 13:10:40.867498 23531 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:40.905328 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 46297.9us
I20260709 13:10:40.908622 21317 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:40.857611 23511 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:10:40.871991 23456 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:40.906149 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.865698 23457 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:10:40.896771 23521 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.875965 21284 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.874341 23469 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.921952 23566 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.925225 23412 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.925320 23566 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.926981 23550 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.928493 23548 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.931072 23449 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.932005 23384 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:40.932476 23384 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:40.933547 23449 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:40.917047 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.920140 21317 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:40.933363 23384 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.897868 23547 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.901990 23515 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:10:40.937953 23384 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.938534 23515 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:40.938841 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.939095 23515 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:40.872393 23517 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.920554 23074 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:10:40.847766 23546 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:40.942191 23456 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.944022 23428 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:40.944355 23546 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:40.897787 23437 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:40.928014 23566 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:40.907541 22032 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:40.947258 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:40.948868 22042 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:40.950035 23492 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:40.922441 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.950407 23492 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:40.952370 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.953105 21470 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:40.953943 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:40.954504 21470 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:40.963500 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:40.965371 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:40.966828 23210 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:40.969805 23469 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.972241 23535 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:40.973127 23535 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:40.973407 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 97539us
I20260709 13:10:40.976624 23518 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:40.981097 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.982548 21284 leader_election.cc:400] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7.
I20260709 13:10:40.982811 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.983053 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:40.983623 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:40.987462 23546 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:40.974404 23456 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:40.951268 23492 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.993076 23492 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.992743 23515 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:40.994170 23539 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:40.990233 21463 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:40.994660 23074 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:40.952412 23569 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:10:40.990178 23566 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:10:41.007440 23574 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:41.008006 23574 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.009052 23074 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:41.009544 23074 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:41.010136 23574 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:41.010555 23074 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.012420 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.013334 22036 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:41.013726 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.014518 22040 raft_consensus.cc:2368] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7.
I20260709 13:10:41.015669 21284 leader_election.cc:400] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7.
I20260709 13:10:41.015964 21284 leader_election.cc:403] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:10:41.006922 21465 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:41.019435 21465 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:41.015249 23562 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.002522 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:40.998564 21466 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:41.039774 21394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1590) took 1668 ms (client timeout 1677 ms). Trace:
W20260709 13:10:41.052569 21394 rpcz_store.cc:269] 0709 13:10:39.371816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.424656 (+ 52840us) service_pool.cc:224] Handling call
0709 13:10:41.039536 (+1614880us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b540017e8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:41.039699 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539430144}
I20260709 13:10:41.054776 21312 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:41.042090 21464 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:41.015303 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:41.061345 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 113161us
I20260709 13:10:41.066459 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:41.015200 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.011929 23074 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.003499 23550 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:40.990262 23578 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.017758 23176 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:41.076648 21315 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:41.080993 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:41.056757 21464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56746
I20260709 13:10:41.091102 21464 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.091565 21464 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.054131 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56746
I20260709 13:10:41.092705 21465 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.093139 21465 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.080245 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:41.102155 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 216961us
I20260709 13:10:41.057857 23574 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7.
I20260709 13:10:41.109763 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:41.111115 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:41.116171 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:41.118238 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.076294 23478 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:41.084699 23550 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:41.119370 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:41.121855 21313 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:41.110687 23521 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:41.076404 23456 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:41.155795 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.115374 23434 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:41.165254 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62064.4us
I20260709 13:10:41.115252 23418 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.156633 23521 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:41.168709 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1598) took 1055 ms. Trace:
I20260709 13:10:41.126770 23425 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:41.176729 21392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 328) took 1699 ms (client timeout 2151 ms). Trace:
I20260709 13:10:41.153509 22035 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:41.177708 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:41.117578 23546 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:10:41.186084 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.152235 23550 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:41.175045 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 179051us
I20260709 13:10:41.127079 23443 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:41.186022 21392 rpcz_store.cc:269] 0709 13:10:39.477426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.129824 (+652398us) service_pool.cc:224] Handling call
0709 13:10:41.176511 (+1046687us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54002cdb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:41.176667 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526104320}
I20260709 13:10:41.182950 21393 rpcz_store.cc:276] 0709 13:10:40.113390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.571015 (+457625us) service_pool.cc:224] Handling call
0709 13:10:40.598649 (+ 27634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.614035 (+ 15386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.614062 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.790949 (+176887us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:10:40.798933 (+  7984us) log.cc:844] Serialized 572 byte log entry
0709 13:10:41.073132 (+274199us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:41.073188 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.073288 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.159232 (+ 85944us) raft_consensus.cc:1685] finished
0709 13:10:41.159253 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.168639 (+  9386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76840832,"thread_start_us":256655,"threads_started":1,"wal-append.queue_time_us":306206}
I20260709 13:10:41.202135 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:41.136211 21465 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.210103 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:41.216317 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:41.216945 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.217749 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:41.218573 21466 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:41.218619 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.221391 21468 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:41.225867 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.228055 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:41.228866 21468 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:41.170730 23572 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:41.231223 21468 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:41.231899 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 51383.8us
I20260709 13:10:41.234200 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.235478 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:41.239010 21465 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:41.240868 21465 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:41.244294 23370 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:41.246263 21467 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:41.247511 21467 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:41.246982 23389 raft_consensus.cc:2955] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:10:41.249949 23580 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:10:41.252696 23548 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:41.252705 23531 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:10:41.257741 23531 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:41.258862 23531 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:41.259315 23531 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:41.265342 23446 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:41.265834 23446 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:41.266768 23446 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.269490 23531 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.276118 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 716) took 1231 ms. Trace:
I20260709 13:10:41.276613 22035 rpcz_store.cc:276] 0709 13:10:40.044562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.067561 (+ 22999us) service_pool.cc:224] Handling call
0709 13:10:40.972700 (+905139us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:41.112252 (+139552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.203181 (+ 90929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.275862 (+ 72681us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540053cfd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:41.276019 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321728512}
I20260709 13:10:41.278038 23531 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:41.278621 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 612) took 1171 ms. Trace:
I20260709 13:10:41.279066 22036 rpcz_store.cc:276] 0709 13:10:40.107328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.113004 (+  5676us) service_pool.cc:224] Handling call
0709 13:10:41.278406 (+1165402us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:41.278532 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220608384}
I20260709 13:10:41.284487 21469 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:41.291113 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:41.153851 23478 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.206837 23063 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:41.316408 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.317137 22034 raft_consensus.cc:2376] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5. Re-sending same reply.
I20260709 13:10:41.317008 23510 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:41.166796 23176 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 13:10:41.298926 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 66357.8us
I20260709 13:10:41.324638 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.325171 21392 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:41.326802 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.293987 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.203163 23521 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:41.185743 23425 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:41.280948 23517 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:41.170945 23275 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:10:41.346503 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.347084 21396 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.348863 21393 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:41.308209 23371 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:41.309105 23453 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:41.309712 23548 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.310724 23518 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:41.311789 23478 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:41.172922 23457 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:10:41.170166 23367 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.326258 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.332069 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.358913 21394 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:41.360109 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.361686 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:41.282202 23151 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.304175 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.335278 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:41.366241 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 72356.8us
I20260709 13:10:41.345566 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.351917 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.369675 21436 leader_election.cc:400] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4.
I20260709 13:10:41.363950 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.370855 21393 raft_consensus.cc:2376] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6. Re-sending same reply.
I20260709 13:10:41.347240 23425 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.347899 23535 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:41.374991 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 43647.4us
I20260709 13:10:41.386030 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:41.386740 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:10:41.376598 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 72545.2us
I20260709 13:10:41.387790 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.388526 21284 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.377490 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:41.380599 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43491.6us
I20260709 13:10:41.390972 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.391366 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.378470 23562 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:41.365271 23515 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:41.330032 23172 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:10:41.322957 23479 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:10:41.390314 21392 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.328290 23319 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:41.402287 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 176498us
I20260709 13:10:41.347661 23574 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:10:41.400002 21392 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:41.380738 23478 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.368934 23456 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.389892 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.425797 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.400321 23579 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:10:41.460146 23362 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:41.461032 23362 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:41.461381 23362 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:41.462073 23367 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:41.462285 23362 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.399576 23472 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.422871 21461 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:41.433454 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.434536 23357 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:41.434839 23583 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:41.434769 21393 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:41.400229 23481 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.438767 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:41.441900 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.431924 23539 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:41.397086 23428 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.445627 23550 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.455340 23063 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.450798 23360 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.385401 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:41.463886 21316 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:41.476248 23384 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.007s
I20260709 13:10:41.477361 23357 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:41.454028 21392 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.436455 22031 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:41.455533 23515 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:41.464004 23468 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.473942 23425 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.455130 23592 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:10:41.385133 23496 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:10:41.454592 23469 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.493116 23550 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:41.493461 23360 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.568540 21464 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:10:41.494019 23492 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.501s	user 0.000s	sys 0.009s
I20260709 13:10:41.495095 22042 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:41.497079 21391 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:10:41.586241 21391 pending_rounds.cc:85] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 5
I20260709 13:10:41.586570 21391 pending_rounds.cc:107] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:10:41.586862 21391 raft_consensus.cc:2889] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.493866 23398 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:41.490633 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:41.501924 23515 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.503391 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.500161 23357 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:41.496325 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62945.4us
I20260709 13:10:41.500854 22035 raft_consensus.cc:2955] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:41.503839 21396 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:41.496765 23458 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.456220 23548 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:41.539906 21394 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:41.550037 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.569934 23400 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:41.604825 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 43487.4us
I20260709 13:10:41.553996 23446 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:41.562631 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 105953us
I20260709 13:10:41.570013 23469 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:41.584465 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.557082 23521 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.590020 23479 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.587364 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66212.8us
I20260709 13:10:41.500298 23319 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:41.590569 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 100026us
I20260709 13:10:41.591338 21464 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:41.488300 23472 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.591342 23428 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:10:41.584556 23362 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.671903 21466 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:41.602458 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:41.561762 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:41.607533 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:41.606679 23496 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:41.663053 21313 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:41.664975 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52311.9us
I20260709 13:10:41.666209 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:41.681175 21321 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.681622 21312 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:10:41.670333 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 85946.3us
I20260709 13:10:41.683466 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.597566 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:41.589910 23398 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:41.666313 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56746 (request call id 1598) took 1036 ms. Trace:
I20260709 13:10:41.695137 21464 rpcz_store.cc:276] 0709 13:10:40.625781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.056641 (+430860us) service_pool.cc:224] Handling call
0709 13:10:41.662076 (+605435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:41.674522 21316 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:41.662744 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 159453us
I20260709 13:10:41.589866 23176 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:10:41.683568 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:41.703663 21388 raft_consensus.cc:2955] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:41.685325 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.671103 23275 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.706722 21316 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:41.707460 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.709069 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.703066 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.704349 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:41.660010 23539 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:41.709733 21393 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:41.635177 23555 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.005s
I20260709 13:10:41.671558 23492 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.713785 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.716181 23555 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.717274 23492 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:41.717289 21319 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:41.719260 23555 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:41.689689 23586 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.336s	user 0.004s	sys 0.000s
I20260709 13:10:41.723016 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:41.596835 23531 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:41.679323 23496 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:41.750474 21393 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:41.671720 23510 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:10:41.768101 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 70784.8us
I20260709 13:10:41.694630 23319 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:41.712831 23562 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.721583 23412 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:41.772329 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:41.604929 23548 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:41.722134 23572 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.803473 21390 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.810353 21313 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:41.735451 23518 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.817662 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 84246.7us
I20260709 13:10:41.613986 23210 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.202s
W20260709 13:10:41.817499 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 100927us
I20260709 13:10:41.683166 23587 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:10:41.730547 23539 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.817122 23492 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:41.822872 21321 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:41.834246 21313 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:41.752526 23531 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:41.774538 23360 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:41.841370 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 118714us
I20260709 13:10:41.842267 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.819906 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:41.725903 23479 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.769878 23477 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:10:41.857951 21312 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:41.851452 23547 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.915s	user 0.020s	sys 0.009s
I20260709 13:10:41.847724 23566 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:10:41.817515 23550 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:41.869457 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.865103 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:41.865283 23360 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:41.871063 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:41.849732 21389 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:10:41.953846 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 82876.3us
W20260709 13:10:41.872995 23598 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:10:41.957002 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:41.957247 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:41.877533 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:41.879746 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:41.959955 23384 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:41.883343 23614 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:41.960870 23614 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:10:41.961445 23596 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.357s	user 0.003s	sys 0.000s
I20260709 13:10:41.961789 23614 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.962653 23589 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:41.963048 23589 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:41.885121 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:41.963680 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 78624.3us
I20260709 13:10:41.963853 23612 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:41.886272 23578 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:41.859144 23531 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.888396 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:41.891942 23572 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.767117 23469 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:41.840499 23398 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.898977 21396 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:41.936256 23412 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:41.908628 21392 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.914531 23425 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:41.920250 23595 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:41.921495 21395 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:41.923813 21319 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:41.930145 23472 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:41.933439 21312 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:41.882484 23319 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.960484 23384 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.886315 23617 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:41.968863 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:41.998236 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.846117 23518 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:42.003577 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46403.9us
W20260709 13:10:41.979035 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 109662us
I20260709 13:10:42.045887 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:41.907217 23492 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.047266 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:41.966979 23284 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.953161 23535 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:41.964512 23612 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:41.999256 23574 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:42.032410 23437 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.031522 21395 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:42.033987 21392 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:42.035962 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:42.032648 23398 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.971500 23578 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:41.946699 23547 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.978385 23587 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:10:42.054315 21395 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:41.936434 23548 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:42.058954 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.058890 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:42.070894 21463 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.031957 23515 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:42.035704 23521 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.037398 23384 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:42.066948 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.071962 21395 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.053272 23535 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.057626 23284 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.078572 23481 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:42.069697 23478 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.610s	user 0.005s	sys 0.005s
I20260709 13:10:42.082317 22040 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:42.027580 23412 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:42.083492 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47613.4us
I20260709 13:10:42.063812 23609 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:42.016688 23608 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:10:42.005417 23434 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:10:42.084916 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:42.099852 21463 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:42.118144 23625 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.118631 23515 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:42.118850 23625 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.119585 23515 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:42.120561 23621 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:10:42.121462 23606 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:42.123297 21395 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:10:42.132629 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.133406 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:42.133781 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:42.124529 23518 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.081944 23548 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.093923 23210 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:42.081163 23574 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:10:42.128746 23578 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:41.963925 23589 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.060626 23437 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.091758 23478 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:42.101611 23609 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:42.152870 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:42.170611 21395 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:42.170897 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:42.145514 23428 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:42.170625 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:42.164675 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79865.6us
I20260709 13:10:42.173060 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:42.166646 21315 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:42.168226 21463 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:42.171602 21387 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:42.025298 23572 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.176419 21392 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:42.177726 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:42.168100 23284 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.178064 23210 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:10:42.178309 23446 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 13:10:42.178587 23389 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:42.192797 23389 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:42.193652 23389 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.172343 23612 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.196341 23361 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:42.181187 23172 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:42.196806 23361 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:42.197127 23172 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:42.197567 23172 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.197732 23361 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.198781 23361 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.184895 23481 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:10:42.145619 23400 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:42.190977 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.184442 23428 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:42.171756 23521 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.172827 23360 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:42.214536 22042 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:42.218350 23531 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.259480 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:42.272799 22041 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:42.174867 23453 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:42.185158 21462 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:42.268108 23384 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.171976 23539 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.269770 23412 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.201994 23578 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:42.274909 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 69744.6us
I20260709 13:10:42.207176 23479 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.288821 23428 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.223929 23521 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:42.292917 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:42.300858 22041 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:42.204887 23608 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:10:42.295167 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:42.297647 23572 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.276507 23360 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:42.216195 23400 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:42.313436 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 100299us
I20260709 13:10:42.189088 23210 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:42.315616 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:42.321451 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:42.316985 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:42.322492 21396 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:42.322151 21391 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:42.326972 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:42.327594 21391 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:42.306366 23613 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.330143 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:42.331184 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:42.332700 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.332784 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:42.334110 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:42.335556 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.315725 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:42.301028 23453 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.328569 22036 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:42.359704 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.340612 23572 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.344547 23412 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:42.303249 23609 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.364348 23574 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:42.372100 23574 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:42.372480 23574 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:42.372996 23631 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:42.364713 23518 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:10:42.366498 23425 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:42.374683 23425 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:42.374202 23481 consensus_queue.cc:1175] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33be1cb5cfc143fc90e164888c96cc6f" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:42.375080 23425 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:42.377671 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.379739 23437 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.394513 23357 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.398932 23472 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.399439 23472 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:42.400595 23472 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.433557 23483 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:42.436131 23531 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.437016 23400 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:42.361873 23360 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.438391 23453 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.442440 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.369514 23412 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:42.341382 23521 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.458276 23425 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:42.448263 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.460167 23384 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.463136 23629 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:42.465077 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.466044 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:42.469853 21320 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:42.447407 23472 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.455327 23412 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.488598 23629 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.493363 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.496394 23425 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.497161 23521 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.498317 23535 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.500483 21316 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:42.506588 23614 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.511370 23469 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.512935 23535 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.418969 23370 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.518282 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:42.518824 22032 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:42.519001 22036 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.519132 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1708) took 1013 ms. Trace:
I20260709 13:10:42.519606 21315 rpcz_store.cc:276] 0709 13:10:41.505400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.505547 (+   147us) service_pool.cc:224] Handling call
0709 13:10:41.505943 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.173804 (+667861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.518888 (+345084us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54003c8cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:42.519067 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519042432}
I20260709 13:10:42.520287 23172 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.521153 23496 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.522228 23496 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.522523 23172 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:42.523578 23370 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.525744 23370 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.527098 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 272) took 1516 ms. Trace:
I20260709 13:10:42.527503 22040 rpcz_store.cc:276] 0709 13:10:41.010496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.077018 (+ 66522us) service_pool.cc:224] Handling call
0709 13:10:41.077328 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.089155 (+1011827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.526781 (+437626us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54004655d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:42.526964 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310727040}
I20260709 13:10:42.529305 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:42.537140 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.531018 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:42.540987 23063 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.541234 23476 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.541568 23063 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.541783 23476 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.544327 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:42.545115 21315 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:42.483520 23176 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:42.539819 23400 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:42.546686 23400 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.547394 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:42.543926 23476 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:42.548822 23400 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:42.550271 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.560297 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:42.561151 21470 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.543823 23063 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.578047 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.584836 23574 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.587020 23574 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.588754 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:42.589610 21396 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.591012 22036 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:42.592905 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.563066 23578 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.594964 23578 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.550805 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:42.552330 23535 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:10:42.604743 23535 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:42.605108 23535 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:42.605751 21396 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:42.605836 23535 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.607347 23535 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.557314 23172 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.612738 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.613385 21470 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:42.607355 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:42.616371 23574 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:42.598925 23357 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:42.620857 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:42.619503 23629 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.627139 23578 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.628185 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:42.629081 21462 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:42.630263 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:42.630949 21462 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.645040 23176 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:42.645789 23176 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:42.646425 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.649869 23547 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.653368 23412 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.616947 23574 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:42.615720 23172 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.658103 21215 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 3 to 4, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.125259 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:42.663223 23458 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:42.664634 21461 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:42.665313 23546 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.669103 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:42.672950 23357 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:42.682607 21396 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:42.657471 21470 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:42.683794 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.686496 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:42.691396 23357 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.691985 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:42.692663 21461 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:42.693661 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:42.694133 23574 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:42.695992 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.695890 23492 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.696540 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.684787 23546 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:42.682050 23458 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:42.689141 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:42.688390 23539 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:42.696586 23492 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.694257 21461 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:42.706141 21320 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:42.686960 23476 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:10:42.717088 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:42.722609 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:42.723274 21321 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.727895 23469 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:42.728407 23469 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.728751 23469 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.730150 23412 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.731717 23172 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:42.733340 23400 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.733817 23400 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.734210 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:42.737222 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:42.737957 21391 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:42.744364 23588 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:42.742848 23400 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:42.744984 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:42.746039 23635 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.479s	user 0.005s	sys 0.000s
I20260709 13:10:42.745015 23588 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.748234 23492 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.748461 23588 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.704733 23539 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.768384 23539 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.743036 23458 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.773087 21463 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:42.760318 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.761008 23609 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.776644 23458 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:42.769541 23063 consensus_queue.cc:1175] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfcd9560f8f44414b25f8069384c5a73" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 5 } }
I20260709 13:10:42.782007 23176 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.783201 21319 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:42.761121 21321 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:42.765173 21462 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:42.764873 23546 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.767912 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:42.794286 23468 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:42.795113 23468 consensus_queue.cc:1243] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:42.796783 21467 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:42.803690 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:42.804699 21396 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.773104 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.752414 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:42.808697 21392 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:42.789526 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.790917 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.811100 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.867731 21317 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:42.897877 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 108444us
I20260709 13:10:42.911473 23385 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:42.912226 23425 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.912138 23385 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:42.816282 23492 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.917663 23492 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:42.918882 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 107926us
I20260709 13:10:42.922966 21396 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:42.912806 23425 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:42.931403 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.932134 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:42.797150 23483 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 13:10:42.913908 23611 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:42.918385 23457 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:42.953501 21315 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:42.925864 23574 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:42.960917 23611 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:42.962028 23611 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:42.963812 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.970872 22036 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:42.972878 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:42.977141 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:42.948770 23566 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:42.983585 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:42.957607 23574 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.981329 23535 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:42.991988 23535 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:42.993167 23425 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:42.994699 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:42.989639 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:42.997920 23578 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:42.989637 23574 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.985718 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:43.002477 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:43.003201 23483 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.003609 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:43.003897 23483 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:42.965574 23457 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.004516 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:42.988319 22036 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:43.007066 21396 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:43.012173 23566 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:43.022444 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.032143 23398 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.037506 23492 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.042436 23385 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.049000 23361 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:43.174149 23361 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:43.174594 21469 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:43.049785 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:43.177582 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 127911us
I20260709 13:10:43.059062 23425 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:43.181100 23425 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.181550 23425 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.182548 23600 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:43.183007 23600 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.183322 23600 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.060261 23457 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.184425 22039 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEARNER]: Advancing to term 5
W20260709 13:10:43.060923 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56551.7us
I20260709 13:10:43.185626 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:43.187057 23592 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.187547 23592 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:43.187800 21469 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:43.062181 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.188498 23592 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.070613 23589 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.189401 23555 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:43.191313 22039 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:43.192207 21319 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.183712 23425 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.193042 23531 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:43.193634 21316 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:10:43.080826 23210 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:43.194471 23210 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:43.194911 22032 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:43.195365 23210 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.088793 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:43.197283 21315 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:43.183449 22036 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:43.117853 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.117116 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.108440 21396 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:43.234145 21468 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:43.119415 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.235198 21468 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:43.142403 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.236088 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:43.128682 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.158730 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.237480 21463 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:43.158456 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:43.113376 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1826) took 1453 ms. Trace:
W20260709 13:10:43.058887 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55348.9us
I20260709 13:10:43.240504 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:43.194047 21316 pending_rounds.cc:85] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 3
I20260709 13:10:43.241185 21316 pending_rounds.cc:107] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:10:43.241436 21316 raft_consensus.cc:2889] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:43.244093 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:43.102684 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 767472us
I20260709 13:10:43.164974 21392 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:10:43.158838 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.204852 21319 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:10:43.250231 21319 pending_rounds.cc:85] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 2
I20260709 13:10:43.250566 21319 pending_rounds.cc:107] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:10:43.250808 21319 raft_consensus.cc:2889] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:43.122213 21215 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 2 to 5, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 5 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.162086 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.229628 23210 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.252825 21215 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.253391 21219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 277) took 8556 ms. Trace:
I20260709 13:10:43.111377 23547 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.157665 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:43.058516 23483 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:43.076617 23360 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.160251 23389 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.058145 23539 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.244164 23457 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:43.253453 21470 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:43.273959 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.274822 21318 raft_consensus.cc:1217] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Deduplicated request from leader. Original: 5.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:10:43.345093 21318 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:10:43.239928 21314 rpcz_store.cc:276] 0709 13:10:41.659884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.660530 (+   646us) service_pool.cc:224] Handling call
0709 13:10:41.660955 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.053868 (+392913us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:10:42.053897 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.054330 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.378862 (+324532us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b1800337180. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:10:42.477649 (+ 98787us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.477707 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.111865 (+634158us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540015c7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:43.111938 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.112002 (+    64us) raft_consensus.cc:1685] finished
0709 13:10:43.112024 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.113276 (+  1252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91055,"raft.queue_time_us":86821,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":5466,"spinlock_wait_cycles":710488704,"thread_start_us":98582,"threads_started":1,"wal-append.queue_time_us":422349}
I20260709 13:10:43.075023 23472 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:43.107138 23492 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.170s
I20260709 13:10:43.086711 23546 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.280606 23611 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:43.159147 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:43.286268 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:43.330771 23483 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.260052 23437 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:10:43.073776 23176 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.233124 23425 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.295926 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.295537 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.272919 21215 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 5, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.092176 23319 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.081523 23566 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.260123 23550 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.271370 23323 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.085014 23398 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.271955 23578 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.280019 23412 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.347261 21388 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:43.342654 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.282341 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:43.416473 21319 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:43.055457 23469 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.314424 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.324635 23370 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.293783 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.361508 21396 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:43.042791 23574 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.259734 23555 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:10:43.275596 23400 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:10:43.175266 23361 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.439177 21395 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:43.439738 21468 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:43.282122 23478 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:10:43.193660 23531 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:42.993243 23535 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.349264 23476 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.318914 21219 rpcz_store.cc:276] 0709 13:10:34.654442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.664564 (+ 10122us) service_pool.cc:224] Handling call
0709 13:10:43.210024 (+8545460us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:36.050116 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:36.266653 (+216537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:36.266721 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:10:36.266746 (+    25us) tablet.cc:662] Decoding operations
0709 13:10:36.311799 (+ 45053us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:36.311905 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:36.311944 (+    39us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:10:36.313391 (+  1447us) tablet.cc:701] Row locks acquired
0709 13:10:36.313448 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:10:36.313621 (+   173us) write_op.cc:270] Start()
0709 13:10:36.313784 (+   163us) write_op.cc:276] Timestamp: P: 1783602636313557 usec, L: 0
0709 13:10:36.313824 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:10:36.314675 (+   851us) log.cc:844] Serialized 6048 byte log entry
0709 13:10:37.274618 (+959943us) op_driver.cc:464] REPLICATION: finished
0709 13:10:38.214895 (+940277us) write_op.cc:301] APPLY: starting
0709 13:10:38.227407 (+ 12512us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:38.354711 (+127304us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:38.378309 (+ 23598us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:38.527576 (+149267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:38.527908 (+   332us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:10:38.527956 (+    48us) write_op.cc:312] APPLY: finished
0709 13:10:38.528361 (+   405us) log.cc:844] Serialized 107 byte log entry
0709 13:10:38.711161 (+182800us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.711324 (+   163us) write_op.cc:454] Released schema lock
0709 13:10:38.711409 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:38.711866 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.711898 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":29,"spinlock_wait_cycles":3968,"child_traces":[["op",{"apply.queue_time_us":824122,"apply.run_cpu_time_us":55734,"apply.run_wall_time_us":526129,"num_ops":15,"prepare.queue_time_us":173820,"prepare.run_cpu_time_us":13989,"prepare.run_wall_time_us":624966,"raft.queue_time_us":293470,"raft.run_cpu_time_us":42273,"raft.run_wall_time_us":181756,"replication_time_us":947308,"thread_start_us":615809,"threads_started":5,"wal-append.queue_time_us":379533,"wal-append.run_cpu_time_us":63007,"wal-append.run_wall_time_us":2777344}]]}
I20260709 13:10:43.386474 21393 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:43.386590 21215 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 2 to 4, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.349413 23472 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:43.358525 23611 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:43.357440 23457 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.383633 23385 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.343703 23389 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:43.434953 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 104707us
I20260709 13:10:43.382988 23609 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 13:10:43.431867 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 146172us
I20260709 13:10:43.388573 23618 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:10:43.444654 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.450587 21215 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 5, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 5 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.390607 23425 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.389940 23319 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.483093 21314 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:43.392946 23550 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.434849 22032 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:43.458951 23611 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.425606 23412 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.480238 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:43.486601 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.487334 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.493302 21466 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:43.489557 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.466403 23361 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:43.476145 21215 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 2 to 5, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 5 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.436376 23370 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.513150 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:43.523231 21314 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:43.523339 21215 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:43.524506 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:43.524711 21215 catalog_manager.cc:5697] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 2 to 4, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.484498 23587 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:43.504185 23660 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:10:43.468104 23385 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.559832 23385 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.528257 21215 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 2 to 3, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 3 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:43.564772 21215 catalog_manager.cc:5697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 1 to 2, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.566669 21215 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 2 to 3, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.538566 23492 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.568300 23492 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.456627 23476 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.489567 23063 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.507433 23616 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.572413 21387 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:43.573334 21215 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:43.522444 23555 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.501983 23515 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 13:10:43.585834 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 120239us
I20260709 13:10:43.501261 23457 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:43.608647 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 149803us
I20260709 13:10:43.613003 21470 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:43.542271 23367 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:10:43.583666 23385 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:43.615324 23663 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:10:43.609723 23539 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:43.636986 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 127189us
I20260709 13:10:43.570444 23587 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:43.640460 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.521881 23472 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.626701 23664 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.585486 23063 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.648415 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:43.649660 21314 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:43.612166 23555 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.625989 23458 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:10:43.628166 23398 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.657111 23398 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:43.659796 23662 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:10:43.661175 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 748) took 1189 ms. Trace:
I20260709 13:10:43.661813 23063 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.661653 22038 rpcz_store.cc:276] 0709 13:10:42.472088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.474100 (+  2012us) service_pool.cc:224] Handling call
0709 13:10:43.087466 (+613366us) spinlock_profiling.cc:243] Waited 983 us on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:43.087744 (+   278us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:43.088340 (+   596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.088389 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:43.089207 (+   818us) log.cc:844] Serialized 52 byte log entry
0709 13:10:43.277614 (+188407us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:43.279365 (+  1751us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.319666 (+ 40301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.330629 (+ 10963us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.660756 (+330127us) raft_consensus.cc:1685] finished
0709 13:10:43.660898 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.661091 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":600,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":9974,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":10591,"spinlock_wait_cycles":2261248,"thread_start_us":156379,"threads_started":1,"wal-append.queue_time_us":259843}
I20260709 13:10:43.665011 23472 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.665854 23412 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.651974 21319 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:43.642967 23385 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.627269 23669 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:43.610282 23616 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.641963 23469 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.640798 23675 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.674737 23550 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.675077 23675 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.675669 23675 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.683094 23611 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.684396 23492 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.686115 23425 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.687781 23555 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:43.654287 23661 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:10:43.689705 23587 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.689941 23676 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.690487 23676 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.692179 23669 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.693082 23319 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:43.694149 23672 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:43.695621 23616 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.689754 23531 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.697713 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.689589 23675 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.673708 23385 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.655019 23574 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:43.737895 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 213626us
I20260709 13:10:43.738716 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:43.743458 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:43.731164 23531 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.745316 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:43.746697 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:43.753161 21465 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:43.735718 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.651257 23664 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.748363 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.755064 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:43.750516 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.739423 23389 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.736230 22035 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:43.751250 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.763288 22042 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:43.764245 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.764838 22042 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:43.765751 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.766259 22042 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:43.766569 23676 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.768343 23664 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.768996 23483 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.756352 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.742712 23574 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:43.760870 21468 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:43.751811 23437 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:43.770542 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:43.772322 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:43.753662 23476 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:43.756735 23063 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:43.770100 21469 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:43.762552 23616 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.771188 23566 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.791529 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.787748 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:43.772136 23370 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.784512 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.794866 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:43.783033 21465 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
W20260709 13:10:43.791074 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.772521 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.793965 21395 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.774011 23389 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.794920 21466 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:43.788986 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:43.815218 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.815874 21393 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:10:43.756554 23531 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.822808 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:43.823046 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:43.800475 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.785799 23361 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.788383 23515 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.801367 23574 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.786800 23210 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 13:10:43.790100 23615 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:43.807844 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.784257 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:43.818914 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:43.816763 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.834444 21320 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:43.834800 21393 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
W20260709 13:10:43.834444 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50265.7us
I20260709 13:10:43.803216 23566 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.838430 23566 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.840225 21389 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [4.2-6.3]
W20260709 13:10:43.840626 23600 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.657s	user 0.010s	sys 0.000s
I20260709 13:10:43.816859 23437 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:43.841233 23600 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.842032 23483 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.831982 23370 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:10:43.843585 23600 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.789124 23400 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:10:43.816020 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:43.823544 21388 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:43.828594 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:43.848747 21319 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:43.790267 23671 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.856315 23323 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.848450 23574 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.856577 23671 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.856911 23323 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.805823 22034 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:43.858403 23574 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.858673 23671 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.858961 23574 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.859124 23323 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.859429 23574 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.851135 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:43.852944 23437 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:43.832370 23063 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:43.853680 23555 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.852954 23389 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:43.833570 23361 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.854688 23535 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:43.829509 23476 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:10:43.834254 21395 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:43.860219 21318 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:43.862080 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:43.908767 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 92812.2us
W20260709 13:10:43.908234 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44717.4us
I20260709 13:10:43.882112 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:43.794974 23616 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.921811 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:43.919853 21388 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
W20260709 13:10:43.928620 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 107091us
I20260709 13:10:43.934894 23478 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:43.935389 23478 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.935873 23478 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:43.937279 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.937623 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:43.938413 23412 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:43.938795 23412 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.939137 23412 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.939222 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:43.940069 21465 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.935158 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:43.942955 21466 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:43.884045 23063 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.928403 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:43.946131 23063 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.921288 23566 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:43.948422 23566 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.948853 23566 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.949898 23385 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:43.950874 21387 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:43.943631 21467 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:43.954684 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:43.956122 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:43.957293 21388 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:43.958669 23531 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:43.960705 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:43.961661 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:43.962380 21465 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:43.962128 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:43.907784 23535 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.885226 22038 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:43.926808 23370 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.924589 23319 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:43.971275 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:43.930548 23681 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.976624 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:43.977599 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:43.981262 21315 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.870278 23615 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:43.984619 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:43.965112 23611 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:43.965569 23664 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:43.984396 21317 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:43.968168 23535 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.969082 23675 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:44.015573 21315 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:43.967160 23685 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.975589 23458 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:43.964594 23400 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:10:43.984972 23676 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.932440 23555 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:43.973649 23472 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:44.005553 23664 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:44.035149 23691 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:44.036201 23611 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.022588 23685 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.023818 23458 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.061277 23592 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:44.115166 23616 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:44.036834 23611 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:43.981493 23681 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.029760 23676 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:44.132268 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:44.135243 22040 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:43.986229 23437 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.041987 23664 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.115366 23458 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:44.042786 23319 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:44.060814 23679 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:44.117116 23477 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:44.043084 23389 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.100s
W20260709 13:10:44.152668 23686 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:10:44.117290 23685 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.138141 23676 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.160691 21470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:44.165603 21470 raft_consensus.cc:606] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:44.165961 21470 raft_consensus.cc:614] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:44.115594 23592 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:44.173702 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 189205us
I20260709 13:10:44.154173 23574 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.175482 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.187302 21390 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:44.178289 21395 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:44.193583 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3784e213304c30beba718dd813ab39"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:44.194197 21395 raft_consensus.cc:606] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:44.193729 23319 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.185093 21392 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:44.170975 23412 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.196404 23385 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:44.197436 23412 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.199106 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:44.199756 22036 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.164988 23361 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.179177 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:44.201138 23592 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.207507 23472 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:44.163564 23477 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.208186 23472 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.172926 23389 consensus_queue.cc:1243] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:44.209839 23389 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:44.210094 23477 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:44.210350 23472 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:44.214573 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:44.215492 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.217130 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.223712 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.225116 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:44.230897 21436 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:44.219038 23679 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:44.225986 23385 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:44.252373 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.254271 21359 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.222003 23515 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:44.272434 23515 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:44.273353 23515 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.276898 23681 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.277544 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.277788 23681 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:44.278053 23614 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:44.278264 21392 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:44.278460 23681 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.279198 23681 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.279745 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:44.280414 21388 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.255257 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:44.286558 21321 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:44.255405 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:44.256109 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:44.256258 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:44.257169 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:44.229912 23670 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:44.262331 23698 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:10:44.263293 23702 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:10:44.245468 23367 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:44.264011 23697 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 13:10:44.264863 23701 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:10:44.265353 23360 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:44.266912 23478 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.253001 23592 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.240746 23472 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:44.306857 23706 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.311271 23472 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.278503 23614 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:44.311777 23706 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.312757 23614 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.254944 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:44.314024 23706 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.234400 23616 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.209846 23063 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.318554 23708 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.296846 21388 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:44.319132 23708 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.319645 23063 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:44.210407 23389 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:44.320454 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 63356us
I20260709 13:10:44.320567 23611 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.321448 23478 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.321617 23389 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:44.321769 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.240232 23477 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:44.322084 23478 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.322382 23477 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.322652 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.280414 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:44.258872 23385 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.323450 23675 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:44.323535 23385 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:44.295670 23670 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.324209 23670 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:44.324244 23703 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:44.326182 23703 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:44.327430 23669 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:44.327622 23412 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:44.311784 23472 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.328226 23412 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:44.329197 23412 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.330297 21388 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:44.331055 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:44.331310 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:44.349560 22040 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:44.346697 21388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:44.351244 21388 raft_consensus.cc:606] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:44.341733 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.331710 22031 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:44.352555 21395 raft_consensus.cc:2410] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:44.352025 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:44.342097 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.296983 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:44.322822 23477 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.318199 23685 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.354090 21314 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:44.319350 23679 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.246419 23615 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.410712 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.323911 23675 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:44.418018 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:44.418161 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.418164 21388 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 1.
I20260709 13:10:44.411221 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.302388 23367 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.417037 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.331918 21392 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.419682 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.420712 21388 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:44.355005 23695 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.421593 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:44.339363 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:44.426558 21393 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:44.427580 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:44.420507 21394 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:44.422253 23675 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.432463 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:44.433138 21395 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:44.434274 23677 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:44.434978 23063 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:44.436431 22035 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:44.340260 23589 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:10:44.340229 23592 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.344167 23385 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.322680 23478 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.337394 23535 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.448905 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.455070 21392 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:44.344312 23472 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.437233 23708 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:44.468818 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:44.416169 23706 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:44.420239 22036 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
W20260709 13:10:44.473037 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1402) took 1315 ms (client timeout 1722 ms). Trace:
W20260709 13:10:44.473590 21467 rpcz_store.cc:269] 0709 13:10:43.158037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.158187 (+   150us) service_pool.cc:224] Handling call
0709 13:10:44.472837 (+1314650us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400070154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:44.472958 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429453184}
I20260709 13:10:44.356357 23566 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.480309 21465 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:44.489041 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:44.449059 23677 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:44.491932 21319 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:44.502192 21285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.722s (SENT) [suppressed 10 similar messages]
I20260709 13:10:44.510380 21315 raft_consensus.cc:2368] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4.
I20260709 13:10:44.438195 23695 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.467438 23664 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.535916 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:44.536696 21468 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:44.501313 23708 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:44.501078 23687 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:44.497458 22032 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:44.504662 23319 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:44.514909 23616 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:44.530966 23703 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:44.572751 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:44.573720 22041 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:44.575237 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:44.598444 21390 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:44.504961 23677 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:44.602360 23657 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.169s	user 0.002s	sys 0.003s
I20260709 13:10:44.561673 23687 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:44.722390 23712 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:10:44.725481 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1605) took 2172 ms. Trace:
I20260709 13:10:44.725925 21464 rpcz_store.cc:276] 0709 13:10:42.553119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.553221 (+   102us) service_pool.cc:224] Handling call
0709 13:10:43.043280 (+490059us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:43.043541 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.043843 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.043880 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.044446 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.271566 (+227120us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:43.271608 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.271672 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.461398 (+1189726us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:44.725269 (+263871us) raft_consensus.cc:1685] finished
0709 13:10:44.725292 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.725418 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58162432,"thread_start_us":209878,"threads_started":1,"wal-append.queue_time_us":332020}
I20260709 13:10:44.726763 23675 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.733464 23670 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.763767 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:44.558250 23708 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.781011 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:44.776584 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:44.569154 23319 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:44.849009 21314 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:44.722157 23592 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:44.875578 21396 raft_consensus.cc:606] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:44.848379 23176 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:44.771420 23618 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:44.876111 21396 raft_consensus.cc:614] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:44.886653 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 311493us
I20260709 13:10:44.966820 21468 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:44.875895 23492 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:44.962114 23592 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:45.204510 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54991.8us
I20260709 13:10:44.885776 23707 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:45.223220 21319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1867) took 1361 ms (client timeout 1774 ms). Trace:
I20260709 13:10:44.886471 23574 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:45.030043 23711 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.548s	user 0.000s	sys 0.001s
I20260709 13:10:44.968524 23609 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:44.886358 23685 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.103600 23589 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:44.556802 23458 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.043681 23706 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:44.886673 23618 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:44.886160 23176 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.673790 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:45.228523 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:45.668854 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:45.665783 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:45.683749 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 455232us
I20260709 13:10:45.683650 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:45.685745 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1657) took 1244 ms. Trace:
I20260709 13:10:45.692180 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1647) took 1344 ms. Trace:
I20260709 13:10:45.692293 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1646) took 1345 ms. Trace:
W20260709 13:10:45.304143 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.004s	sys 0.047s
I20260709 13:10:45.693493 23609 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:45.694013 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.007s	sys 0.064s
I20260709 13:10:45.694331 23609 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:45.694751 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.22594e+06us
I20260709 13:10:45.690917 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:45.661839 21287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.000s	sys 0.011s
I20260709 13:10:45.708101 23737 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:45.709250 23737 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.712990 23737 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:45.696352 22041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.042s
W20260709 13:10:45.718640 21435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.007s	sys 0.040s
W20260709 13:10:45.716238 21287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.000s	sys 0.018s
W20260709 13:10:45.721025 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.015s	sys 0.016s
W20260709 13:10:45.777186 22041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.012s	sys 0.042s
W20260709 13:10:45.690378 21319 rpcz_store.cc:269] 0709 13:10:43.861629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.861849 (+   220us) service_pool.cc:224] Handling call
0709 13:10:45.222968 (+1361119us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b540022cc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:45.223136 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335415552}
W20260709 13:10:45.721066 21435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.008s	sys 0.040s
I20260709 13:10:45.718991 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1429) took 1190 ms. Trace:
I20260709 13:10:45.209115 23535 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.215181 23592 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:45.521302 23724 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:10:45.235445 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1421) took 1048 ms. Trace:
W20260709 13:10:45.410060 23689 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:45.789119 23483 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.693068 21388 rpcz_store.cc:276] 0709 13:10:44.347088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.426299 (+ 79211us) service_pool.cc:224] Handling call
0709 13:10:44.426566 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.449676 (+ 23110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.449725 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.450620 (+   895us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.781508 (+330888us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:44.781562 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.781662 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.691578 (+909916us) raft_consensus.cc:1685] finished
0709 13:10:45.691648 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.692056 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9417,"raft.queue_time_us":9792,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":277642,"threads_started":1,"wal-append.queue_time_us":915914}
I20260709 13:10:45.793560 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1764) took 1017 ms. Trace:
W20260709 13:10:45.411259 23681 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.131s	user 0.012s	sys 0.000s
I20260709 13:10:45.795408 23176 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.796387 21314 raft_consensus.cc:2368] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5.
I20260709 13:10:45.183534 23671 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:45.523707 23566 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.812695 23671 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.813614 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:45.227316 23367 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:45.814664 21314 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:45.412505 23695 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.445590 23708 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.523140 23675 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.816211 21465 rpcz_store.cc:276] 0709 13:10:44.187516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.187707 (+   191us) service_pool.cc:224] Handling call
0709 13:10:44.474835 (+287128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.484368 (+  9533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.235137 (+750769us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400070150. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:45.235345 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659337088}
I20260709 13:10:45.818727 23681 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.804747 21316 rpcz_store.cc:276] 0709 13:10:44.776023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.779253 (+  3230us) service_pool.cc:224] Handling call
0709 13:10:44.779610 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.876910 (+ 97300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.876957 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.877012 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:44.877056 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.792961 (+915905us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b54003f5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:45.793028 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.793335 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223201664}
I20260709 13:10:45.820369 23483 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:45.821363 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:45.822306 21316 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.823329 23483 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.816010 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:45.824929 23681 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.825762 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:45.826043 23458 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.209765 23492 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:45.797142 23706 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:45.798468 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.015s	sys 0.018s
I20260709 13:10:45.798588 23592 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.799059 23688 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.832173 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 780) took 1555 ms. Trace:
I20260709 13:10:45.161453 23704 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:45.832835 23706 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.832703 22032 rpcz_store.cc:276] 0709 13:10:44.277097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.280138 (+  3041us) service_pool.cc:224] Handling call
0709 13:10:45.831707 (+1551569us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540057dd54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:45.831933 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375344384}
I20260709 13:10:45.833410 23704 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:45.834336 22038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 281) took 2166 ms (client timeout 2556 ms). Trace:
I20260709 13:10:45.825809 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:45.834949 22038 rpcz_store.cc:269] 0709 13:10:43.668179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.672224 (+  4045us) service_pool.cc:224] Handling call
0709 13:10:45.833949 (+2161725us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003d18d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:45.834159 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236283776}
W20260709 13:10:45.835569 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1412) took 2085 ms (client timeout 1998 ms). Trace:
I20260709 13:10:45.692759 21393 rpcz_store.cc:276] 0709 13:10:44.347369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.427430 (+ 80061us) service_pool.cc:224] Handling call
0709 13:10:44.427781 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.436455 (+  8674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.436484 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.436952 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.598424 (+161472us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:44.598481 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.598592 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.691579 (+1092987us) raft_consensus.cc:1685] finished
0709 13:10:45.691630 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.691962 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8222,"raft.queue_time_us":8655,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":160985,"threads_started":1,"wal-append.queue_time_us":951228}
W20260709 13:10:45.836054 21462 rpcz_store.cc:269] 0709 13:10:43.749912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.751651 (+  1739us) service_pool.cc:224] Handling call
0709 13:10:45.825348 (+2073697us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3e9c 00007fc2bc0f3a5b 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:45.835498 (+ 10150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3745536}
I20260709 13:10:45.837009 21315 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
W20260709 13:10:45.824961 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1413) took 2073 ms (client timeout 1705 ms). Trace:
I20260709 13:10:45.837843 23385 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.800253 23616 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.840729 23616 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.779637 23319 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.801126 23574 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:45.361572 23716 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.801793 23744 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:45.782913 21469 rpcz_store.cc:276] 0709 13:10:44.528825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.528951 (+   126us) service_pool.cc:224] Handling call
0709 13:10:44.529288 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:44.535582 (+  6294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.535629 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:44.544978 (+  9349us) log.cc:844] Serialized 52 byte log entry
0709 13:10:45.029217 (+484239us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:45.029265 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.029345 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.696264 (+666919us) raft_consensus.cc:1685] finished
0709 13:10:45.696305 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.718672 (+ 22367us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":334989,"threads_started":1,"wal-append.queue_time_us":1019664}
I20260709 13:10:45.488265 23721 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.692003 21387 rpcz_store.cc:276] 0709 13:10:44.441048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.467129 (+ 26081us) service_pool.cc:224] Handling call
0709 13:10:44.467430 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.468253 (+   823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.468279 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.468701 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.716516 (+247815us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:44.716573 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.716666 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.685025 (+968359us) raft_consensus.cc:1685] finished
0709 13:10:45.685074 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.685459 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11222,"thread_start_us":216336,"threads_started":1,"wal-append.queue_time_us":894055}
W20260709 13:10:45.556254 23705 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.013s	sys 0.007s
I20260709 13:10:45.795140 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1765) took 1015 ms. Trace:
I20260709 13:10:45.810148 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:45.810554 21390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 351) took 1469 ms (client timeout 1761 ms). Trace:
I20260709 13:10:45.827198 21314 raft_consensus.cc:2410] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:10:45.519117 23676 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.344s	user 0.005s	sys 0.005s
I20260709 13:10:45.797113 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1868) took 1916 ms. Trace:
W20260709 13:10:45.497462 23477 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.133s	user 0.011s	sys 0.002s
I20260709 13:10:45.831151 23492 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.617367 23726 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:45.801796 23743 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:10:45.837843 21461 rpcz_store.cc:269] 0709 13:10:43.751831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.753221 (+  1390us) service_pool.cc:224] Handling call
0709 13:10:45.824439 (+2071218us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54001a72d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:45.824695 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161809664}
W20260709 13:10:45.863722 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 190365us
I20260709 13:10:45.227777 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:45.849411 23695 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:45.850340 23589 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:10:45.847954 21390 rpcz_store.cc:269] 0709 13:10:44.341037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.341873 (+   836us) service_pool.cc:224] Handling call
0709 13:10:45.810026 (+1468153us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002e3bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:45.810307 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560629120}
I20260709 13:10:45.849126 21319 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.872242 23425 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:45.850898 23721 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.418895 23670 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.847744 21321 rpcz_store.cc:276] 0709 13:10:44.780156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.783013 (+  2857us) service_pool.cc:224] Handling call
0709 13:10:44.783381 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.970574 (+187193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.970618 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.970675 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:44.970727 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.794667 (+823940us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400089154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:45.794738 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.794965 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429910784}
I20260709 13:10:45.876448 23676 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:45.877967 23726 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.879196 23743 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:45.880303 23737 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.882228 22035 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:45.882880 23555 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.611784 23717 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:45.345126 23664 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:45.916115 21284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.007s	sys 0.005s
W20260709 13:10:45.849306 23693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.169s	user 0.016s	sys 0.024s
W20260709 13:10:45.938254 21284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.008s	sys 0.006s
I20260709 13:10:45.927888 23385 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:45.832718 23688 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:45.942765 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.944388 23737 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:45.948156 23705 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.023s	sys 0.021s
I20260709 13:10:45.949186 23695 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.950546 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:45.951311 22041 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.950881 23717 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.952307 23716 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.952950 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:45.953570 23717 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:45.954272 23717 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.954790 23716 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:45.955094 23717 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.958276 21393 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:45.955495 23716 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:45.959941 21285 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.283s	user 0.008s	sys 0.018s
I20260709 13:10:45.982645 23618 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:45.962299 23477 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.984563 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1762) took 1209 ms. Trace:
I20260709 13:10:45.985112 23704 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:45.960955 23693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.412s	user 0.016s	sys 0.025s
I20260709 13:10:45.986173 23477 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.965560 23731 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:45.987336 23731 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:45.988777 23743 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.989933 23688 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.990162 23716 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.990556 23555 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.991165 23555 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.992349 23716 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:45.961880 23589 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.993817 23664 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.994649 23664 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:45.977106 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:45.996272 23555 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:45.942344 23385 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:45.980271 21285 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.477s	user 0.009s	sys 0.018s
I20260709 13:10:45.997574 23717 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.997792 23744 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.997154 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:45.947877 23737 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:46.016400 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 88142.7us
I20260709 13:10:46.016373 23574 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:45.228394 23707 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:45.985108 21313 rpcz_store.cc:276] 0709 13:10:44.775360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.777168 (+  1808us) service_pool.cc:224] Handling call
0709 13:10:44.777544 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.182950 (+405406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.182993 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.236580 (+ 53587us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.880076 (+643496us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:45.880172 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.880279 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.984114 (+103835us) raft_consensus.cc:1685] finished
0709 13:10:45.984143 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.984379 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108865,"raft.queue_time_us":109166,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":130026,"thread_start_us":420711,"threads_started":2,"wal-append.queue_time_us":275337}
I20260709 13:10:45.854260 21320 rpcz_store.cc:276] 0709 13:10:43.880361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.880524 (+   163us) service_pool.cc:224] Handling call
0709 13:10:43.880880 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.933915 (+ 53035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.933947 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.934396 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.018252 (+ 83856us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:44.018294 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.796235 (+1777941us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b5400228654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:45.796343 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.796406 (+    63us) raft_consensus.cc:1685] finished
0709 13:10:45.796423 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.796824 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5455,"raft.queue_time_us":7651,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":145,"spinlock_wait_cycles":108342528,"thread_start_us":83560,"threads_started":1,"wal-append.queue_time_us":183336,"wal-append.run_cpu_time_us":2736,"wal-append.run_wall_time_us":1198182}
I20260709 13:10:45.984613 23736 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.978230 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 288) took 1012 ms. Trace:
I20260709 13:10:46.020021 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.026712 23744 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:46.027676 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 1.52542e+06us
I20260709 13:10:46.027855 23717 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.028631 23745 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.028800 23737 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.012696 23385 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.015407 23492 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:45.999068 23671 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.046897 21316 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:45.989970 23726 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.059626 23609 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.062083 23677 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.029304 22035 rpcz_store.cc:276] 0709 13:10:44.960048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.967286 (+  7238us) service_pool.cc:224] Handling call
0709 13:10:45.939683 (+972397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:46.064266 23736 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.065101 23731 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.058293 23745 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.066110 23687 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.075403 21321 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:46.076349 21319 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:46.027704 23747 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.078653 23745 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.095003 23676 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.096241 21390 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:46.082664 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.067148 23736 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.112247 23730 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.112820 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.113306 23730 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.096292 23744 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.115128 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:46.116714 21313 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:46.118047 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.120223 23609 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.120518 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:46.121398 21393 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.112274 23737 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.127816 21313 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:46.141696 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:46.149287 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 92471.1us
I20260709 13:10:46.153303 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.154170 22035 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.092494 23721 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.090452 23477 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:46.123705 23707 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.156368 23677 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.156395 23726 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.168063 23737 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.170047 23744 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.175776 23719 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.443s	user 0.006s	sys 0.008s
W20260709 13:10:46.171875 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 55451.9us
I20260709 13:10:46.172611 23477 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:46.173200 23748 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.190761 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:46.173671 23714 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.457s	user 0.009s	sys 0.005s
I20260709 13:10:46.175873 23753 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:46.176487 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.096268 23671 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.170133 23703 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.176416 23492 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.199440 22041 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:46.186916 23731 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.145658 23717 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.190459 23676 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.193710 23616 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.191672 23615 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.203929 23703 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.213609 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.218506 21387 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:46.219005 23668 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.219349 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1648) took 1799 ms. Trace:
I20260709 13:10:46.220144 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 781) took 1648 ms. Trace:
I20260709 13:10:46.220664 23753 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:46.221843 23713 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.361s	user 0.017s	sys 0.022s
I20260709 13:10:46.222035 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.224139 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:46.224742 23574 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.225323 23555 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.225739 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.206642 23748 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.225885 23736 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:46.226544 23700 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 2.042s	user 0.008s	sys 0.011s
I20260709 13:10:46.207307 23726 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.228140 21316 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:46.228047 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.230459 21393 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:46.233289 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.206439 23744 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.224200 23609 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.261116 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.272135 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.241806 23664 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.232779 21395 rpcz_store.cc:276] 0709 13:10:44.347634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.433699 (+ 86065us) service_pool.cc:224] Handling call
0709 13:10:44.434016 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.437610 (+  3594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.437646 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.438081 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.791853 (+1353772us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b18004191a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:10:45.871560 (+ 79707us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:45.871642 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.872823 (+  1181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.072367 (+199544us) raft_consensus.cc:1685] finished
0709 13:10:46.072389 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.146557 (+ 74168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3240,"raft.queue_time_us":3536,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11684,"spinlock_wait_cycles":18148224,"thread_start_us":79074,"threads_started":1,"wal-append.queue_time_us":1558004}
I20260709 13:10:46.280951 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.271448 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:46.276479 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 71408.6us
I20260709 13:10:46.285449 22034 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:46.285730 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.264925 23319 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:46.286890 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73144.2us
I20260709 13:10:46.287508 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.288379 23492 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.288664 23758 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.289891 23684 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.292006 23757 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.292361 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:46.292537 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51028.5us
I20260709 13:10:46.292691 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.285657 22032 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.294902 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.286029 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.255594 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:46.307850 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 70779.3us
I20260709 13:10:46.308600 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:46.247303 23676 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.314440 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:46.264367 23671 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.240850 23677 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.315310 21313 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:46.212374 23747 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.293211 23555 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.318442 22041 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.307109 23319 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.313318 22039 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.320205 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:46.278055 23592 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.331390 23684 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.313403 22031 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.321630 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.324278 21392 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:46.325663 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.270558 23615 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.309430 23589 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:10:46.330116 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.347863 21462 raft_consensus.cc:2368] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:10:46.347740 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.330714 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1404) took 2532 ms. Trace:
I20260709 13:10:46.331679 23763 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.332333 23757 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.332935 23592 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.334455 23753 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.335052 21362 leader_election.cc:400] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5.
I20260709 13:10:46.362803 21362 leader_election.cc:403] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:10:46.319984 23609 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.263761 23574 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.340130 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.340555 21461 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.343382 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.343873 23717 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.344388 21316 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.345947 23555 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.318692 23477 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.277925 23668 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.294742 23731 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.353196 22041 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:46.355623 23676 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.348935 21391 rpcz_store.cc:276] 0709 13:10:43.798222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.798332 (+   110us) service_pool.cc:224] Handling call
0709 13:10:43.798611 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.911742 (+113131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.911789 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.914199 (+  2410us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.982738 (+ 68539us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:43.982780 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.234135 (+1251355us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b54000ac3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:45.234208 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.167498 (+933290us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:46.320694 (+153196us) raft_consensus.cc:1685] finished
0709 13:10:46.320714 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.330509 (+  9795us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50306,"raft.queue_time_us":52122,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8626,"spinlock_wait_cycles":150558208,"thread_start_us":68216,"threads_started":1,"wal-append.queue_time_us":221843}
I20260709 13:10:46.357188 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49116 (request call id 17) took 1868 ms. Trace:
I20260709 13:10:46.338601 23385 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.338340 23319 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.321628 23616 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:46.383607 23616 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.359431 23763 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.235353 22036 rpcz_store.cc:276] 0709 13:10:44.571872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.585204 (+ 13332us) service_pool.cc:224] Handling call
0709 13:10:45.335496 (+750292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:45.915155 (+579659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.915230 (+    75us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:45.916465 (+  1235us) log.cc:844] Serialized 52 byte log entry
0709 13:10:46.096354 (+179889us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:46.096407 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.096536 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.219747 (+123211us) raft_consensus.cc:1685] finished
0709 13:10:46.219769 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.219917 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":295058,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":342,"thread_start_us":319703,"threads_started":2,"wal-append.queue_time_us":282603}
I20260709 13:10:46.361217 23747 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.372370 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.379531 23574 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.380416 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.380626 23478 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.388298 22038 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:46.389000 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:46.401554 23756 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 13:10:46.401968 22034 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.374938 21396 rpcz_store.cc:276] 0709 13:10:44.488699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.488870 (+   171us) service_pool.cc:224] Handling call
0709 13:10:46.356780 (+1867910us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540017ded4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf212853 00007fc2c41e060a 00007fc2bd7667d4 00007fc2bd766762 00007fc2bd766691 00007fc2bd76660c 00007fc2bd7658c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:46.356935 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886982400}
I20260709 13:10:46.389449 23668 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.393208 21316 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:46.357861 23758 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.396697 23677 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.400098 21465 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:46.411361 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.391677 21395 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:46.412276 21468 raft_consensus.cc:2368] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
I20260709 13:10:46.412722 23726 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.413371 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.414955 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.415196 21470 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:46.416333 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:46.416913 23615 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.418094 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.418895 21470 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:46.420450 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.421502 23684 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.422065 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.422287 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.422781 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:46.422782 21314 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:46.424336 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:46.425246 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:46.425457 23472 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.426225 23685 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:46.426786 23685 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:46.427858 23685 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.372179 23743 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5.
I20260709 13:10:46.403506 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.401592 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.406141 21469 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:46.406415 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.373368 23757 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.407433 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.410295 22039 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:46.410765 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.418951 21313 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:46.425642 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.404219 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.424427 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.431931 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:46.432282 22038 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:46.432555 23478 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:46.389449 23385 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.434980 22041 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:46.433049 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.428764 23730 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.436628 23574 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:46.452605 23757 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:46.453510 23757 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.452605 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:46.456339 23718 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.976s	user 0.004s	sys 0.000s
I20260709 13:10:46.456413 22038 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:46.457068 22038 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:46.458420 22038 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.461951 21463 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:46.464864 23695 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.465718 23758 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.465790 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.468266 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:46.436802 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.455880 23757 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.473909 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.472549 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1879) took 2120 ms. Trace:
I20260709 13:10:46.441084 23616 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.486074 22041 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:46.486994 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:46.489347 21470 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.446286 21462 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:46.482944 21317 rpcz_store.cc:276] 0709 13:10:44.351738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.353134 (+  1396us) service_pool.cc:224] Handling call
0709 13:10:44.353475 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.357484 (+  4009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.357512 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.357917 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.701835 (+343918us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:44.701874 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.701945 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.455307 (+1753362us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:46.467470 (+ 12163us) raft_consensus.cc:1685] finished
0709 13:10:46.467493 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.472333 (+  4840us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7207,"raft.queue_time_us":18677,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":6753,"spinlock_wait_cycles":16895360,"thread_start_us":271698,"threads_started":1,"wal-append.queue_time_us":950051}
I20260709 13:10:46.498597 21315 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:46.486302 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:46.528954 21470 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
W20260709 13:10:46.522149 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 147102us
I20260709 13:10:46.522684 21461 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:46.531352 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:46.493290 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.520208 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1767) took 1737 ms. Trace:
W20260709 13:10:46.546238 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 96891.9us
I20260709 13:10:46.511060 21463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:46.548421 21463 raft_consensus.cc:606] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:46.548962 21463 raft_consensus.cc:614] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:46.459976 22038 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.546947 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:46.492444 23765 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:46.555253 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.554752 21467 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:46.535712 21312 rpcz_store.cc:276] 0709 13:10:44.782867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.219343 (+436476us) service_pool.cc:224] Handling call
0709 13:10:45.219774 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.926324 (+706550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.926395 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.926460 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:45.926520 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.519729 (+593209us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b5400088754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:46.519786 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.520016 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607213440}
I20260709 13:10:46.520145 23609 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.557453 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.533522 22036 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.563273 23210 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:46.563853 23210 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:46.564380 22035 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:46.564796 23210 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.565974 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.566747 22035 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.573012 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.573750 22040 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:46.574726 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.575350 22040 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.575721 23748 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.577335 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:46.580725 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.521584 23671 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.561108 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:46.491878 23744 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:46.583784 21314 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:46.548382 23743 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:46.595938 23531 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:46.579928 23614 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.600586 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.536645 23731 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.538256 23763 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.605556 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.606385 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.548748 23757 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:10:46.608193 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47185.8us
I20260709 13:10:46.606822 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.560650 22032 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
W20260709 13:10:46.616475 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.612203 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:46.619764 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.622047 23762 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:46.622501 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:46.623859 21315 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:46.625923 22034 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:10:46.626142 23319 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.639835 21319 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:46.604064 23743 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:46.628440 21465 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:46.631211 21316 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:46.641645 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:46.605118 23531 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:46.644335 23319 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.647439 22031 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:46.640188 23762 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.653923 23425 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.655318 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.656451 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:46.679507 21467 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:46.661720 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 107057us
I20260709 13:10:46.663236 23210 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:46.663470 23515 raft_consensus.cc:1064] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
W20260709 13:10:46.682976 23515 raft_consensus.cc:1068] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Unable to promote non-voter bfcd9560f8f44414b25f8069384c5a73: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:46.684770 23425 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.685873 21466 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:46.688221 23763 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:46.666370 23754 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.356s	user 0.002s	sys 0.000s
I20260709 13:10:46.666568 22040 raft_consensus.cc:2410] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:10:46.666873 23743 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:46.667559 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 55431us
I20260709 13:10:46.669135 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:46.676154 23671 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:46.681027 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 43777.9us
I20260709 13:10:46.681206 23744 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:46.679909 23762 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.688422 21470 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:46.663771 23703 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:46.691370 22039 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:46.689375 23210 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.707641 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:46.714042 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:46.718235 23688 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:46.718832 23688 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.719276 23688 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.707715 23744 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:10:46.722882 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 416254us
I20260709 13:10:46.723248 23744 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.728138 23721 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:46.728654 23721 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.729067 23721 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:46.732441 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 63432.6us
I20260709 13:10:46.742487 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:46.743199 22039 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:46.693578 23671 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.744329 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:46.746799 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.748632 21284 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:46.747898 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1426) took 2226 ms. Trace:
I20260709 13:10:46.766987 21467 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:46.769260 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:46.776444 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:46.707479 23210 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.706151 23319 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:46.763968 21466 rpcz_store.cc:276] 0709 13:10:44.505840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.506070 (+   230us) service_pool.cc:224] Handling call
0709 13:10:44.506441 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.686227 (+2179786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.731721 (+ 45494us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b540025ab54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:46.732012 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5011031936}
I20260709 13:10:46.780300 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.783419 21390 raft_consensus.cc:2368] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:10:46.784248 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:46.787016 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:46.747618 23747 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:46.790400 23715 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 2.018s	user 0.018s	sys 0.021s
I20260709 13:10:46.791870 22038 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:10:46.801883 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.793710 23425 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.747804 23671 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.804667 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.781162 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.801014 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.763478 23574 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:46.768630 23758 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.776911 23705 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:46.809970 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 95989.3us
I20260709 13:10:46.808126 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:46.751374 23609 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.801800 22038 pending_rounds.cc:85] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 4
I20260709 13:10:46.812520 21313 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:46.776247 22036 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:46.799546 23747 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.879503 21320 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:46.817803 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:46.820829 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:46.816713 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.887972 21466 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:46.809512 23704 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:46.807709 23574 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:46.895744 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 109215us
I20260709 13:10:46.816752 22038 pending_rounds.cc:107] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 13:10:46.896752 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 87164.4us
I20260709 13:10:46.886610 23747 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.898068 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:46.909247 22038 raft_consensus.cc:2889] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.911275 23210 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.905400 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1872) took 2660 ms. Trace:
I20260709 13:10:46.905478 23425 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:46.905515 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:46.891353 23664 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:46.932142 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 129702us
I20260709 13:10:46.912124 23707 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:46.912338 23478 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:46.939389 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.901798 23574 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:46.913650 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 92953us
I20260709 13:10:46.813033 23705 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:46.944564 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:46.943289 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54055.2us
I20260709 13:10:46.922688 21318 rpcz_store.cc:276] 0709 13:10:44.242422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.242878 (+   456us) service_pool.cc:224] Handling call
0709 13:10:44.243308 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.316876 (+ 73568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.316908 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.317532 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.518685 (+201153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:44.518713 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.518805 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.747495 (+2228690us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:46.898371 (+150876us) raft_consensus.cc:1685] finished
0709 13:10:46.898393 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.902359 (+  3966us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73124,"raft.queue_time_us":75032,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":148911360,"thread_start_us":200793,"threads_started":1,"wal-append.queue_time_us":368699}
I20260709 13:10:46.945753 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.904582 23704 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:46.928766 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:46.929657 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.936841 23747 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.913487 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:46.953789 21467 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:46.954210 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:46.931862 23676 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:46.951086 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.896275 23609 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:46.925941 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 162902us
I20260709 13:10:46.811237 23319 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.955672 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:46.973366 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:46.973433 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44783.4us
I20260709 13:10:46.814517 23758 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:46.944268 23705 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.978951 21315 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:46.979316 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:46.980262 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:46.983703 21467 raft_consensus.cc:2376] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7. Re-sending same reply.
I20260709 13:10:46.885885 23531 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:46.974984 23676 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:46.997822 23758 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:46.972777 23618 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:47.006867 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 103881us
I20260709 13:10:47.023738 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:46.959966 23664 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:10:47.022125 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:47.005560 23425 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:47.039283 23425 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.039883 23425 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.047070 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:47.048822 23726 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.049441 23726 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.052205 23755 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.008836 23703 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:47.057240 23703 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:47.057647 23703 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:47.058573 23703 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.059646 23703 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.061657 23744 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:47.006351 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:47.051790 23726 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:47.077704 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 91127.4us
W20260709 13:10:47.201116 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.125587 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:47.111840 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:47.133870 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:47.104681 21466 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:47.118651 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:47.218905 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 519370us
W20260709 13:10:47.203879 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 181844us
I20260709 13:10:47.079628 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:47.203576 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:47.245596 21314 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:47.271380 21466 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:47.192408 23707 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:47.356818 23707 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.359187 21466 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:47.104905 23780 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:47.360364 21466 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.360488 23780 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:47.360922 23780 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.133206 23319 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:47.028446 23615 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:47.365459 21467 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:47.113953 23555 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:47.366111 23555 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:47.366299 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:47.366503 23555 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.352639 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:47.376058 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 172558us
W20260709 13:10:47.376943 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 353295us
I20260709 13:10:47.377507 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:47.379671 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:47.382185 21466 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:10:47.385068 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:47.406276 23748 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:47.407195 22039 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:47.408898 23618 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:47.409382 23618 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.409749 23618 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.128733 23676 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:47.412357 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:47.413213 22038 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:47.247584 23704 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.200804 23385 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.426759 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.392294 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:47.382633 21466 pending_rounds.cc:85] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 4
I20260709 13:10:47.439148 21466 pending_rounds.cc:107] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:10:47.439597 21466 raft_consensus.cc:2889] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:47.417620 23385 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:47.464185 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 71955.6us
I20260709 13:10:47.468099 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:47.445057 23721 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.715s	user 0.014s	sys 0.000s
W20260709 13:10:47.475055 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 53234.9us
I20260709 13:10:47.474444 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:47.496814 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.500167 23319 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:47.500717 23319 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.502961 23319 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:47.504313 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:47.505357 23755 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:47.505796 23755 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:47.506181 23755 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.507578 23609 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:47.466946 23478 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:10:47.508535 22035 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.941s	user 0.013s	sys 0.001s
I20260709 13:10:47.508889 22035 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:47.407222 23730 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:47.482802 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 209903us
I20260709 13:10:47.389849 23726 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.488973 21997 leader_election.cc:400] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:10:47.517740 21997 leader_election.cc:403] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:10:47.519950 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 167375us
I20260709 13:10:47.523224 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:47.532260 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.053s
W20260709 13:10:47.532719 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.008s	sys 0.053s
I20260709 13:10:47.484807 23748 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:47.475170 23210 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:47.481405 23753 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:47.554306 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:47.558804 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:47.496833 21462 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
W20260709 13:10:47.574823 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58484.1us
I20260709 13:10:47.547709 23748 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:47.517052 23721 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:47.585175 23477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.020s	sys 0.049s
I20260709 13:10:47.619091 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:47.625218 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:47.597544 23726 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:10:47.605060 23748 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:47.641254 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 151388us
W20260709 13:10:47.616171 23477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.021s	sys 0.049s
W20260709 13:10:47.650020 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 161234us
I20260709 13:10:47.641408 23730 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.671211 23730 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:47.660486 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:47.674809 23730 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:47.674407 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 82015.7us
I20260709 13:10:47.632247 23615 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:47.644763 23609 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:47.667079 23574 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.000s
I20260709 13:10:47.651144 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:47.646450 23786 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:47.662252 23425 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:10:47.692281 23425 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:47.694664 23425 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:47.696976 23615 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.661921 23801 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.704348 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:47.690678 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:47.688083 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:47.705581 21394 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:47.673997 23477 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:47.708907 23801 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.709731 23477 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:47.712252 23786 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:47.715018 23786 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:47.713030 23721 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:47.719003 23531 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.705080 21387 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
W20260709 13:10:47.707471 23705 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.704s	user 0.002s	sys 0.009s
I20260709 13:10:47.659992 23752 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 13:10:47.666777 23555 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:47.726467 23688 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.006s	user 0.010s	sys 0.001s
I20260709 13:10:47.708209 23574 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.720971 23458 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:47.741372 23385 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:47.742027 23671 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.002s
I20260709 13:10:47.740331 23705 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.753261 23671 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:47.755206 23705 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:47.689216 23609 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:47.752370 23743 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.060s	user 0.005s	sys 0.006s
I20260709 13:10:48.189541 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:48.021664 21317 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:48.021245 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:48.191529 21315 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.767062 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:48.056757 22002 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.761s (SENT)
W20260709 13:10:47.776459 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 88567.7us
I20260709 13:10:48.170512 23730 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:48.271067 23809 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.407s
W20260709 13:10:47.937109 23618 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.001s
W20260709 13:10:47.928278 23779 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.025s	user 0.005s	sys 0.009s
I20260709 13:10:48.026165 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:48.636777 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 447705us
I20260709 13:10:47.929302 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:47.897202 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:48.503739 22040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.017s	sys 0.017s
W20260709 13:10:47.912515 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 318862us
I20260709 13:10:47.711625 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:48.187093 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:47.768883 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:47.885465 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:48.639339 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 582607us
W20260709 13:10:47.811774 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.196583 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:48.187556 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:48.235687 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:48.229817 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:48.188570 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:47.852696 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.055919 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:47.761554 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:48.642848 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 872742us
I20260709 13:10:47.934345 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:47.732019 23721 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:48.653702 21360 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.014s	sys 0.005s
W20260709 13:10:48.476693 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 168649us
I20260709 13:10:48.665586 21321 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.666220 21318 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:48.666996 22040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.019s	sys 0.017s
W20260709 13:10:47.938812 23773 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.130s	user 0.000s	sys 0.015s
I20260709 13:10:47.741559 23731 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:48.665628 21465 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:48.734148 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:48.174355 23753 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
W20260709 13:10:48.175237 23755 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.003s
I20260709 13:10:47.752247 23574 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:48.541988 23792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.000s	sys 0.015s
I20260709 13:10:47.755466 23671 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:47.760499 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:48.158159 23703 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.088s	user 0.010s	sys 0.000s
I20260709 13:10:47.786250 23752 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:48.304648 21389 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:48.740229 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:48.832325 21360 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.014s	sys 0.014s
I20260709 13:10:48.738754 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:48.849247 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 948942us
I20260709 13:10:48.849525 21466 raft_consensus.cc:2368] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:48.739159 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:48.744243 23813 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:10:48.835057 21316 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:48.740753 21320 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:48.739032 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.737721 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.665136 21395 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.795720 23688 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:48.217265 23555 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:48.672096 22042 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.857048 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:47.757988 23762 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.007s	user 0.007s	sys 0.004s
I20260709 13:10:47.996309 23744 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:48.839869 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.839222 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.668752 23531 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.770694 23801 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:48.838702 23695 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.847467 23478 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:47.929782 23477 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:48.231648 23800 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:47.900723 23385 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:48.848779 21467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.005s	sys 0.031s
I20260709 13:10:48.832337 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1456) took 1070 ms. Trace:
I20260709 13:10:48.850026 21314 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
W20260709 13:10:48.834599 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.850320 21470 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:48.893302 21465 rpcz_store.cc:276] 0709 13:10:47.761909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.764509 (+  2600us) service_pool.cc:224] Handling call
0709 13:10:48.832261 (+1067752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.740226 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:48.893114 21467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.005s	sys 0.031s
W20260709 13:10:48.837428 23792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.006s	sys 0.015s
I20260709 13:10:48.851754 21391 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
W20260709 13:10:48.737988 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 66208.9us
I20260709 13:10:48.861629 23574 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.738438 23609 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:47.937304 23748 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:47.775664 23780 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:48.857758 21320 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:48.901219 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.858467 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.664008 23618 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:48.663393 23786 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.187s
I20260709 13:10:48.901824 21391 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:48.861939 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:48.849972 23753 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:48.844760 23752 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:48.862615 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:48.868552 21394 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:48.913751 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:48.882999 23801 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:48.873606 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.873775 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:48.874619 23791 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:48.809418 23721 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:48.840898 23755 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:48.920930 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.869676 22035 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:48.887408 23478 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:48.862145 23795 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:48.893757 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1455) took 1132 ms. Trace:
I20260709 13:10:48.833861 23687 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.951714 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:48.950436 21470 rpcz_store.cc:276] 0709 13:10:47.761586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.764141 (+  2555us) service_pool.cc:224] Handling call
0709 13:10:47.936704 (+172563us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:48.739036 (+802332us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3e9c 00007fc2bc0f3a5b 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:48.893699 (+154663us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26731136}
I20260709 13:10:48.854133 21388 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:48.860867 23731 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:48.903792 21390 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:48.940202 23809 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.881598 23800 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.908622 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:48.911547 23780 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:48.919291 23791 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:48.870262 23762 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:48.879859 23531 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:48.921015 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 47331.3us
I20260709 13:10:48.880388 21321 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:48.931974 21312 raft_consensus.cc:2368] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4.
I20260709 13:10:48.881052 23744 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:48.970856 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.971530 21388 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:48.972591 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.973387 21388 raft_consensus.cc:2393] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:48.974252 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.975329 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.976892 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:48.882200 23695 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:48.921034 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.922032 21468 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:48.980459 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1805) took 1018 ms. Trace:
I20260709 13:10:48.937207 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.833575 23472 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.899967 23385 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:48.892120 23477 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.959162 23800 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:48.663765 23743 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:48.966142 23688 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:48.953958 23795 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:48.968205 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 1808) took 1004 ms. Trace:
I20260709 13:10:49.037127 21321 rpcz_store.cc:276] 0709 13:10:47.963580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.025740 (+ 62160us) service_pool.cc:224] Handling call
0709 13:10:48.968148 (+942408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.968752 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:48.956651 22035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 305) took 1193 ms (client timeout 1579 ms). Trace:
I20260709 13:10:49.038444 21470 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:48.969372 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.935783 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:48.922530 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.042225 21394 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:48.981576 21312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 306) took 2040 ms (client timeout 1761 ms). Trace:
W20260709 13:10:49.043033 21312 rpcz_store.cc:269] 0709 13:10:46.938432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.945464 (+  7032us) service_pool.cc:224] Handling call
0709 13:10:48.862486 (+1917022us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5800181298. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:48.978669 (+116183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34217728}
I20260709 13:10:48.980334 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.044740 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:49.045385 21388 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:48.983534 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:48.900215 23574 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.002205 21393 raft_consensus.cc:1217] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[4.2-6.3]   Dedup: 6.3->[]
I20260709 13:10:49.048908 21393 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:10:49.003641 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.003806 22042 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:48.936218 23801 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.050076 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 306) took 1289 ms. Trace:
I20260709 13:10:49.006157 23531 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.006376 23721 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:49.008271 21392 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:10:49.053772 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70343.5us
I20260709 13:10:48.956277 23687 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.057674 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.051548 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.059202 21468 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:49.060910 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.061592 21461 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
W20260709 13:10:49.062036 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1458) took 1299 ms (client timeout 1674 ms). Trace:
W20260709 13:10:49.062393 21461 rpcz_store.cc:269] 0709 13:10:47.762584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.762709 (+   125us) service_pool.cc:224] Handling call
0709 13:10:49.060744 (+1298035us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:49.061978 (+  1234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7566208}
I20260709 13:10:49.063475 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:48.982692 23786 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:10:49.010078 21463 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:48.967670 23730 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:49.007329 23472 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:48.969885 23791 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:48.979574 23618 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.003212 23609 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:49.050454 22042 rpcz_store.cc:276] 0709 13:10:47.761088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.761278 (+   190us) service_pool.cc:224] Handling call
0709 13:10:49.050017 (+1288739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.105070 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.054198 21396 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.000948 21313 rpcz_store.cc:276] 0709 13:10:47.962459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.962588 (+   129us) service_pool.cc:224] Handling call
0709 13:10:48.026749 (+ 64161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.747072 (+720323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.747102 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.747142 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:48.747169 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.980073 (+232904us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540021a7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:48.980214 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.980383 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656114944}
I20260709 13:10:48.992431 23748 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:49.063934 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1666) took 1008 ms. Trace:
I20260709 13:10:49.065361 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.066484 21387 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:49.067203 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:49.107757 21393 rpcz_store.cc:276] 0709 13:10:48.055790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.055902 (+   112us) service_pool.cc:224] Handling call
0709 13:10:48.234375 (+178473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:49.049509 (+815134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.063711 (+ 14202us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540017e8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:49.063870 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765504896}
I20260709 13:10:49.068648 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.109035 21466 raft_consensus.cc:2368] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5.
I20260709 13:10:49.068548 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1457) took 1306 ms. Trace:
I20260709 13:10:49.070137 21388 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:49.072098 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:48.979344 23555 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:49.071638 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 228924us
I20260709 13:10:49.115955 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.073112 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:49.029261 21315 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.001s
I20260709 13:10:49.117107 21315 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:49.117683 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 1806) took 1155 ms. Trace:
W20260709 13:10:49.067343 23812 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:10:48.960695 23809 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:49.106415 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51696us
I20260709 13:10:49.064523 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.011173 23477 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.109424 21463 rpcz_store.cc:276] 0709 13:10:47.762264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.764581 (+  2317us) service_pool.cc:224] Handling call
0709 13:10:47.937195 (+172614us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:49.006594 (+1069399us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3e9c 00007fc2bc0f3a5b 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:10:49.006794 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.068312 (+ 61518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.068496 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21481088}
I20260709 13:10:49.068696 23704 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:49.145299 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1668) took 1088 ms. Trace:
I20260709 13:10:49.146189 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.155870 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:49.153391 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 269499us
I20260709 13:10:49.156636 21388 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:49.117961 21315 rpcz_store.cc:276] 0709 13:10:47.962742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.962855 (+   113us) service_pool.cc:224] Handling call
0709 13:10:49.117629 (+1154774us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.145144 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.157744 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1671) took 1100 ms. Trace:
I20260709 13:10:49.158245 21393 rpcz_store.cc:276] 0709 13:10:48.057501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.144848 (+1087347us) service_pool.cc:224] Handling call
0709 13:10:49.157690 (+ 12842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.147817 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:49.042300 22035 rpcz_store.cc:269] 0709 13:10:47.760061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.760197 (+   136us) service_pool.cc:224] Handling call
0709 13:10:48.953619 (+1193422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.149917 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:49.151260 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.151654 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.152771 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:48.962456 23752 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.155061 21391 rpcz_store.cc:276] 0709 13:10:48.056505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.052178 (+995673us) service_pool.cc:224] Handling call
0709 13:10:49.145235 (+ 93057us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:49.218057 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 54883.3us
I20260709 13:10:49.221392 21470 raft_consensus.cc:2368] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5.
I20260709 13:10:49.159523 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:49.172168 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.222685 21468 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:49.218997 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:49.226296 21387 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.226517 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1673) took 1168 ms. Trace:
I20260709 13:10:49.227056 21388 rpcz_store.cc:276] 0709 13:10:48.058149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.171806 (+1113657us) service_pool.cc:224] Handling call
0709 13:10:49.226435 (+ 54629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.218394 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.228968 21466 raft_consensus.cc:2368] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3.
I20260709 13:10:49.224357 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:49.114508 23609 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:49.224743 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.228216 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:49.232246 22041 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:49.149348 23676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.049s	sys 0.015s
I20260709 13:10:49.151037 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.237428 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.238121 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.238248 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.115646 23492 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.182199 21360 leader_election.cc:336] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.530s (SENT)
I20260709 13:10:49.249778 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:49.246860 21393 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:49.158058 23704 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:49.251574 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 101693us
I20260709 13:10:49.218029 23478 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.273962 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.274300 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.275156 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.276206 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.239792 23609 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.245326 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1426) took 1071 ms. Trace:
I20260709 13:10:49.252388 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.274403 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1678) took 1214 ms. Trace:
I20260709 13:10:49.154807 23780 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:10:49.301846 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1424) took 1128 ms. Trace:
I20260709 13:10:49.228773 23748 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:49.152258 23555 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:49.241107 21462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.010s	sys 0.010s
I20260709 13:10:49.252830 21463 raft_consensus.cc:2368] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:49.307209 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:49.239871 23676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.049s	sys 0.016s
I20260709 13:10:49.307641 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:49.310719 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.323390 21468 raft_consensus.cc:2410] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:10:49.309065 21997 leader_election.cc:336] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.631s (SENT)
I20260709 13:10:49.305001 21393 rpcz_store.cc:276] 0709 13:10:48.173654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.275952 (+1102298us) service_pool.cc:224] Handling call
0709 13:10:49.301780 (+ 25828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.304430 21391 rpcz_store.cc:276] 0709 13:10:48.059810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.221402 (+1161592us) service_pool.cc:224] Handling call
0709 13:10:49.274343 (+ 52941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.303750 21390 rpcz_store.cc:276] 0709 13:10:48.174373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.152569 (+978196us) service_pool.cc:224] Handling call
0709 13:10:49.245284 (+ 92715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.312681 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 304) took 1688 ms. Trace:
I20260709 13:10:49.251919 23752 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.364481 22040 rpcz_store.cc:276] 0709 13:10:47.623979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.624157 (+   178us) service_pool.cc:224] Handling call
0709 13:10:47.645405 (+ 21248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:47.653229 (+  7824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.653256 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:47.653811 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:10:48.832589 (+1178778us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:48.832632 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.832705 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.312464 (+479759us) raft_consensus.cc:1685] finished
0709 13:10:49.312484 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.312604 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16420,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":1141025,"threads_started":1,"wal-append.queue_time_us":1164329}
W20260709 13:10:49.378629 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 216433us
I20260709 13:10:49.380972 21463 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:49.302029 23704 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:49.321137 21462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.016s	sys 0.028s
I20260709 13:10:49.383968 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:49.390057 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:49.328655 22032 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:49.389864 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.392174 21466 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:49.306195 23786 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:49.155061 23731 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:49.395433 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 213262us
I20260709 13:10:49.396386 21393 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:49.396518 21360 leader_election.cc:336] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.573s (SENT)
I20260709 13:10:49.394368 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:49.396938 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:49.397862 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 90279.7us
I20260709 13:10:49.398468 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:49.273900 23707 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.400969 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.401684 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.402271 21463 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.410138 23705 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:49.410673 23687 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.410662 23705 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:49.395872 23744 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.412185 23705 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.411813 23786 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:49.412866 21314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 310) took 1722 ms (client timeout 2131 ms). Trace:
W20260709 13:10:49.413283 21314 rpcz_store.cc:269] 0709 13:10:47.690138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.690303 (+   165us) service_pool.cc:224] Handling call
0709 13:10:49.412713 (+1722410us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003becd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:49.412816 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631945472}
I20260709 13:10:49.401317 23695 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:49.414063 23786 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.324594 23688 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.416061 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1675) took 1357 ms. Trace:
I20260709 13:10:49.416467 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1674) took 1338 ms. Trace:
I20260709 13:10:49.418813 21391 rpcz_store.cc:276] 0709 13:10:48.058785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.384526 (+1325741us) service_pool.cc:224] Handling call
0709 13:10:49.415985 (+ 31459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.419483 21393 rpcz_store.cc:276] 0709 13:10:48.058458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.395884 (+1337426us) service_pool.cc:224] Handling call
0709 13:10:49.396219 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.396789 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.396976 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:49.398857 23818 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:10:49.397569 23819 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 13:10:49.328428 23703 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:10:49.426666 23472 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.419664 23707 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.276526 23492 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.429565 21463 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:49.435505 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 126450us
W20260709 13:10:49.442130 21997 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.645s (SENT)
I20260709 13:10:49.326151 23748 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.396097 23762 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:49.441036 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46742.2us
W20260709 13:10:49.438483 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.447359 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50867.7us
I20260709 13:10:49.408236 23385 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:49.447988 21360 leader_election.cc:336] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.611s (SENT)
I20260709 13:10:49.419835 23786 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:49.302111 23821 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:49.396581 23837 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.418443 22034 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:10:49.440243 21395 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.002s
I20260709 13:10:49.461757 21395 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:49.462118 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:49.462281 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1661) took 1577 ms. Trace:
I20260709 13:10:49.462656 21395 rpcz_store.cc:276] 0709 13:10:47.885803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.898111 (+ 12308us) service_pool.cc:224] Handling call
0709 13:10:49.462224 (+1564113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.463809 21395 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:49.423544 23744 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:49.467968 21360 leader_election.cc:336] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.782s (SENT)
I20260709 13:10:49.470968 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1684) took 1318 ms. Trace:
I20260709 13:10:49.434116 23743 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.473053 21395 rpcz_store.cc:276] 0709 13:10:48.146077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.463391 (+1317314us) service_pool.cc:224] Handling call
0709 13:10:49.463656 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.464166 (+   510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.464345 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.477775 21314 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:49.498780 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:49.447046 23827 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:49.503443 21320 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:49.505497 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63406.8us
I20260709 13:10:49.459231 23792 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:49.462040 23821 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:49.516445 21997 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.761s (SENT)
I20260709 13:10:49.517069 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:49.518289 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:49.521386 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:49.521701 21314 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:49.524712 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:49.465201 23795 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.494587 23574 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.534723 23792 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.542837 23792 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.515741 23821 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.543603 23477 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.549867 21394 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
W20260709 13:10:49.550172 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 82238.3us
W20260709 13:10:49.551117 21360 leader_election.cc:336] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.782s (SENT)
I20260709 13:10:49.400563 23555 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.511827 23744 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:49.507493 23837 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:49.553347 21396 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:49.532718 22041 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:49.525202 23721 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.562830 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 46444.9us
I20260709 13:10:49.564422 23721 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:49.560060 21285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.652s (SENT) [suppressed 57 similar messages]
I20260709 13:10:49.570125 23827 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:49.571189 23721 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:49.571609 23827 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:49.574086 23492 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.574322 23809 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:49.575603 23707 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.578507 21463 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:49.579612 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.560127 23743 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:49.580762 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:49.561872 21360 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.784s (SENT)
I20260709 13:10:49.581073 23748 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.581465 21463 raft_consensus.cc:2368] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:49.582213 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.583175 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.584227 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.580543 23743 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.549016 23730 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.599740 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:49.582424 21360 leader_election.cc:336] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.871s (SENT)
I20260709 13:10:49.600672 21463 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:49.599959 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1682) took 1440 ms. Trace:
I20260709 13:10:49.600695 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:49.602188 21390 rpcz_store.cc:276] 0709 13:10:48.145345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.428142 (+1282797us) service_pool.cc:224] Handling call
0709 13:10:49.439864 (+ 11722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.440165 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:49.488691 (+ 48526us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.568128 (+ 79437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.568204 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:49.568280 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.585275 (+ 16995us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.585377 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17141,"prepare.queue_time_us":48507,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":17305,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":78713,"threads_started":2,"wal-append.queue_time_us":75392}
I20260709 13:10:49.604419 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.609635 23744 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:49.610909 21360 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.936s (SENT)
W20260709 13:10:49.611814 21360 leader_election.cc:336] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.959s (SENT)
I20260709 13:10:49.612207 23836 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.612807 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.613870 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.614863 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.615406 21463 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:49.612203 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:49.618835 21360 leader_election.cc:336] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.100s (SENT)
I20260709 13:10:49.619441 23836 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:49.598667 23824 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:10:49.607290 23705 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.622577 21387 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:49.619366 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:49.623293 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.634174 21284 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:49.631048 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.638589 22041 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.641386 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.640605 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1427) took 1465 ms. Trace:
I20260709 13:10:49.643468 21387 rpcz_store.cc:276] 0709 13:10:48.174713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.148318 (+973605us) service_pool.cc:224] Handling call
0709 13:10:49.640544 (+492226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.644634 21387 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:49.645236 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1688) took 1472 ms. Trace:
I20260709 13:10:49.645586 21387 rpcz_store.cc:276] 0709 13:10:48.173230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.644165 (+1470935us) service_pool.cc:224] Handling call
0709 13:10:49.644475 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.645027 (+   552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.645188 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.642797 21463 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:49.657948 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:49.660058 22041 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:49.659970 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:49.655501 21997 leader_election.cc:336] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.881s (SENT)
I20260709 13:10:49.663965 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1687) took 1516 ms. Trace:
I20260709 13:10:49.664494 21390 rpcz_store.cc:276] 0709 13:10:48.147122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.633348 (+1486226us) service_pool.cc:224] Handling call
0709 13:10:49.657890 (+ 24542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.663520 (+  5630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.663562 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.663623 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:49.663667 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.663751 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.663883 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.609675 23743 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:49.666889 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48094.3us
I20260709 13:10:49.661732 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:49.669025 21360 leader_election.cc:336] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.155s (SENT)
I20260709 13:10:49.666899 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.670274 22041 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:49.674832 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.655182 23707 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.676537 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1428) took 1501 ms. Trace:
I20260709 13:10:49.677129 21463 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:49.676921 21387 rpcz_store.cc:276] 0709 13:10:48.175068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.646300 (+1471232us) service_pool.cc:224] Handling call
0709 13:10:49.662913 (+ 16613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.676150 (+ 13237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.676197 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.676260 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:49.676305 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.676360 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.676480 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.658316 23836 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:49.682009 21360 leader_election.cc:336] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.312s (SENT)
I20260709 13:10:49.685086 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:49.683300 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.688556 21390 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:49.688935 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1913) took 1015 ms. Trace:
I20260709 13:10:49.672097 23730 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.672520 23748 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:49.689970 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.690439 21387 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:49.692481 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1441) took 1143 ms. Trace:
I20260709 13:10:49.692813 21387 rpcz_store.cc:276] 0709 13:10:48.549501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.678189 (+1128688us) service_pool.cc:224] Handling call
0709 13:10:49.688663 (+ 10474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.692228 (+  3565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.692407 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.690577 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1440) took 1141 ms. Trace:
I20260709 13:10:49.691732 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:49.694214 21390 rpcz_store.cc:276] 0709 13:10:48.549170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.665888 (+1116718us) service_pool.cc:224] Handling call
0709 13:10:49.678957 (+ 13069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.690319 (+ 11362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.690522 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.684202 23809 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.697136 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 60672.7us
I20260709 13:10:49.701524 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:49.694206 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.689318 21318 rpcz_store.cc:276] 0709 13:10:48.674010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.838960 (+164950us) service_pool.cc:224] Handling call
0709 13:10:48.846427 (+  7467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.846698 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:49.241400 (+394702us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.688606 (+447206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.688664 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:49.688705 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.688767 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.688868 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27682,"prepare.queue_time_us":463343,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":43639,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11952,"thread_start_us":773138,"threads_started":3,"wal-append.queue_time_us":288317}
W20260709 13:10:49.704901 21319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 304) took 2763 ms (client timeout 2066 ms). Trace:
W20260709 13:10:49.705348 21319 rpcz_store.cc:269] 0709 13:10:46.937895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.939407 (+  1512us) service_pool.cc:224] Handling call
0709 13:10:49.700801 (+2761394us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54000fcb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:49.700931 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4946707840}
I20260709 13:10:49.676018 23827 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:49.702965 21390 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:49.707216 21313 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:49.707582 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1444) took 1120 ms. Trace:
I20260709 13:10:49.707927 21387 rpcz_store.cc:276] 0709 13:10:48.587045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.693556 (+1106511us) service_pool.cc:224] Handling call
0709 13:10:49.704116 (+ 10560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.707277 (+  3161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.707305 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.707349 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.707381 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.707437 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.707535 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.691881 23707 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:49.709364 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1446) took 1073 ms. Trace:
I20260709 13:10:49.710475 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.713192 21390 rpcz_store.cc:276] 0709 13:10:48.633420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.695965 (+1062545us) service_pool.cc:224] Handling call
0709 13:10:49.697057 (+  1092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.706315 (+  9258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.706512 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.714102 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.716531 23747 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.703511 22031 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:49.705086 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:49.717765 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.718063 22036 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.718369 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.709929 23609 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.704459 23809 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.721288 23609 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.721377 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.722002 23809 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.722193 21465 raft_consensus.cc:2368] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:49.708235 23748 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:49.722744 23748 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.723117 23748 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.724123 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.725270 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.723130 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.727087 23755 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.718390 22031 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:49.729128 21465 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:49.719708 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.731315 22040 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:49.703455 23836 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.734261 22036 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:49.706174 23837 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.694906 23730 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:49.737674 22036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 796) took 2369 ms (client timeout 1890 ms). Trace:
I20260709 13:10:49.744230 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:49.743147 22039 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:49.759115 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:49.759999 22036 rpcz_store.cc:269] 0709 13:10:47.368096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.376570 (+  8474us) service_pool.cc:224] Handling call
0709 13:10:49.696941 (+2320371us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:49.737605 (+ 40664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20057472}
I20260709 13:10:49.761724 23707 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.729115 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:49.741575 23671 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:10:49.767288 23671 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:49.767701 23671 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:49.768553 23671 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.769783 23671 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.770444 23704 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.771605 21321 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:49.740335 23821 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.772876 23730 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:49.774060 23801 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:49.774263 23821 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.774861 21315 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:49.775571 21997 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.013s (SENT)
I20260709 13:10:49.740669 23705 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.733110 23845 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:10:49.776007 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:49.778117 21997 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.016s (SENT)
I20260709 13:10:49.778517 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:49.778551 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.779469 22039 raft_consensus.cc:2410] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:49.780062 23730 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:49.739821 23609 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:10:49.780315 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.780830 23730 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.780946 22039 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:49.781821 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:49.782508 22039 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:49.783185 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.783700 22039 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
W20260709 13:10:49.788800 23800 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.002s
W20260709 13:10:49.789400 23791 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.000s
I20260709 13:10:49.789535 23800 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.791035 21389 raft_consensus.cc:2368] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
I20260709 13:10:49.792135 22040 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
W20260709 13:10:49.792712 21396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 370) took 2061 ms (client timeout 2096 ms). Trace:
I20260709 13:10:49.793377 22040 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:49.795593 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 898217us
W20260709 13:10:49.793097 21396 rpcz_store.cc:269] 0709 13:10:47.731333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.742736 (+ 11403us) service_pool.cc:224] Handling call
0709 13:10:49.792588 (+2049852us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54001c7854. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:49.792666 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948704128}
I20260709 13:10:49.789947 23791 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:49.795396 22040 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.799233 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:49.800119 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55962.4us
I20260709 13:10:49.802029 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:49.807353 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.813817 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 117995us
I20260709 13:10:49.814529 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:49.814772 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.816715 21396 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:49.817167 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:49.817836 21316 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:49.810456 23755 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.805792 23800 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.808612 23515 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:49.811123 23849 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:49.824601 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:49.824788 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 362730us
I20260709 13:10:49.832317 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:49.833568 22041 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.821213 23801 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.837895 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:49.838402 21396 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.836617 23755 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:49.840857 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1632) took 1101 ms. Trace:
I20260709 13:10:49.841073 23755 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.842038 23704 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.841248 21466 rpcz_store.cc:276] 0709 13:10:48.739183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.393058 (+653875us) service_pool.cc:224] Handling call
0709 13:10:49.426081 (+ 33023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.426220 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:49.663465 (+237245us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.840519 (+177054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.840578 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:49.840618 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.840681 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.840805 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128378,"prepare.queue_time_us":107543,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":125940,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":265463,"threads_started":2,"wal-append.queue_time_us":88449}
I20260709 13:10:49.843145 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.844727 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.822960 23780 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:49.851037 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.851735 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.854351 21466 raft_consensus.cc:2376] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7. Re-sending same reply.
I20260709 13:10:49.832940 23849 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:49.867481 21394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1431) took 1691 ms (client timeout 2094 ms). Trace:
I20260709 13:10:49.868074 21393 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:49.869711 21394 rpcz_store.cc:269] 0709 13:10:48.234790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.951449 (+716659us) service_pool.cc:224] Handling call
0709 13:10:49.867309 (+915860us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b540017e3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:49.867427 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206582656}
I20260709 13:10:49.871433 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.874344 21314 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:49.878947 21396 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:49.880292 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:49.881003 23730 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:49.882074 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.882544 21395 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.823432 23477 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:10:49.886412 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1452) took 2142 ms. Trace:
I20260709 13:10:49.852576 23809 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:49.865604 23492 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:49.906424 21312 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:49.893114 21467 rpcz_store.cc:276] 0709 13:10:47.744273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.744422 (+   149us) service_pool.cc:224] Handling call
0709 13:10:47.777249 (+ 32827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.777555 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:47.982913 (+205358us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.895106 (+912193us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.740327 (+845221us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b18003a1bc0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:10:49.795265 (+ 54938us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18003a1bc0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:10:49.885993 (+ 90728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.886047 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:49.886106 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.886195 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.886339 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":960690,"prepare.queue_time_us":819937,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":71,"raft.queue_time_us":901040,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":13108,"spinlock_wait_cycles":10685952,"thread_start_us":1052990,"threads_started":3,"wal-append.queue_time_us":840380}
I20260709 13:10:49.862047 23801 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:49.884097 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:49.925309 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:49.925917 21317 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.871775 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1451) took 2162 ms. Trace:
I20260709 13:10:49.873140 23744 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.928119 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 59118.1us
I20260709 13:10:49.930020 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:49.931665 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:49.933418 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59793.7us
I20260709 13:10:49.934122 21433 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:49.936275 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:49.938868 21314 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:49.947695 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:49.948469 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1627) took 1312 ms. Trace:
I20260709 13:10:49.873313 23849 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.948669 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:49.952865 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:49.951633 21466 raft_consensus.cc:2368] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:49.881585 23730 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:49.916991 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:49.993355 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:49.994086 21394 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:49.994356 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:49.948845 21468 rpcz_store.cc:276] 0709 13:10:48.635722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.374483 (+738761us) service_pool.cc:224] Handling call
0709 13:10:49.404518 (+ 30035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.439469 (+ 34951us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:49.490675 (+ 51206us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.875054 (+384379us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.948136 (+ 73082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.948185 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:49.948228 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.948286 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.948399 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258513,"prepare.queue_time_us":98360,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":185719,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":12438,"thread_start_us":218362,"threads_started":2,"wal-append.queue_time_us":221315}
I20260709 13:10:50.022122 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:50.075039 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:49.917972 23809 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.964123 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:50.073789 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 122878us
I20260709 13:10:50.074349 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:50.075685 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.076165 21469 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:50.013105 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:50.074460 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 125910us
I20260709 13:10:50.078949 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:49.964530 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:50.075227 21466 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:50.087615 23721 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:50.082993 23687 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:10:50.090860 23721 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.947317 23472 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:10:50.091310 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.080914 23809 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:50.092760 23851 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:10:50.094712 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.095907 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:50.094863 23857 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:10:50.096424 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:50.097031 21466 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:50.097900 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:50.098389 23858 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 13:10:50.098837 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:50.099354 21466 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:49.965108 23744 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:50.090881 23763 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:50.101037 23763 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.080861 23836 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:50.101367 23744 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:50.101583 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.091328 23730 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:49.996596 23837 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.259s
I20260709 13:10:50.022370 23800 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.292s
I20260709 13:10:50.249013 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:50.133857 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55038us
I20260709 13:10:50.135980 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1637) took 1395 ms. Trace:
I20260709 13:10:50.787355 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:50.311800 21387 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.025s
W20260709 13:10:50.790042 21387 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.026s	sys 0.032s
W20260709 13:10:50.118402 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.023257 22032 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.496577 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:50.794432 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:50.117547 21312 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:50.126230 21389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1685) took 1979 ms (client timeout 1899 ms). Trace:
W20260709 13:10:50.797065 21389 rpcz_store.cc:269] 0709 13:10:48.146436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.898313 (+751877us) service_pool.cc:224] Handling call
0709 13:10:50.125930 (+1227617us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54001c4154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:50.126109 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703869184}
I20260709 13:10:50.117846 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:50.798345 21314 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.798528 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:50.799479 23849 consensus_meta.cc:287] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.000s
I20260709 13:10:50.151980 21394 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:50.120289 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:50.801895 21316 raft_consensus.cc:2410] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:10:50.135349 23472 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.803269 23472 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:10:50.487437 22041 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.089s	sys 0.127s
W20260709 13:10:50.102653 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 89646.5us
W20260709 13:10:50.804174 22041 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.093s	sys 0.140s
I20260709 13:10:50.804878 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:50.330335 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:50.120556 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:50.113765 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:50.096472 21392 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
W20260709 13:10:50.134104 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51594.1us
I20260709 13:10:50.151207 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:50.121323 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.134331 23757 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:50.806118 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:50.795825 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:50.254240 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:50.147781 23856 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:50.818118 21316 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:10:50.842299 23555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.008s	sys 0.002s
W20260709 13:10:50.842792 23555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.008s	sys 0.002s
I20260709 13:10:50.843053 21314 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:50.147045 23791 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:49.995438 23515 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:50.844762 23705 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:50.845120 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.131070 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1686) took 1984 ms. Trace:
I20260709 13:10:50.924474 21395 rpcz_store.cc:276] 0709 13:10:48.146776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.474036 (+1327260us) service_pool.cc:224] Handling call
0709 13:10:49.506787 (+ 32751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.883096 (+376309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.130731 (+247635us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000ab9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:50.130991 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863575808}
I20260709 13:10:50.021873 23747 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.823218 23780 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.818809 23811 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:50.120512 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:50.824295 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:50.444269 23809 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:50.274659 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.847692 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.005s	sys 0.005s
I20260709 13:10:50.831799 23874 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:50.820842 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1814) took 1712 ms. Trace:
I20260709 13:10:50.787125 21470 rpcz_store.cc:276] 0709 13:10:48.740658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.726110 (+985452us) service_pool.cc:224] Handling call
0709 13:10:49.726411 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.844257 (+117846us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:49.844285 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.844726 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.135405 (+290679us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b180048eaa0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1
0709 13:10:50.135548 (+   143us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:50.135581 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.135643 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.135682 (+    39us) raft_consensus.cc:1685] finished
0709 13:10:50.135692 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.135898 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163276,"raft.queue_time_us":118762,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8557,"spinlock_wait_cycles":4979072,"thread_start_us":70990,"threads_started":1,"wal-append.queue_time_us":243601}
I20260709 13:10:50.849637 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.850097 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.849795 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.849967 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.851905 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1822) took 1353 ms. Trace:
W20260709 13:10:50.452620 23748 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.729s	user 0.005s	sys 0.005s
I20260709 13:10:50.809655 23855 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.101621 23836 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.904831 23472 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:50.807498 22034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 666) took 1183 ms (client timeout 1563 ms). Trace:
I20260709 13:10:50.117520 22031 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:50.908104 22032 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:50.831799 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1681) took 2686 ms. Trace:
W20260709 13:10:50.847693 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 685332us
I20260709 13:10:51.090377 21393 rpcz_store.cc:276] 0709 13:10:48.144974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.420379 (+1275405us) service_pool.cc:224] Handling call
0709 13:10:49.867889 (+447510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.869852 (+  1963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.831582 (+961730us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540017e3d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:50.831733 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028627712}
I20260709 13:10:51.091532 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.092307 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 377) took 1350 ms. Trace:
I20260709 13:10:51.092643 21393 rpcz_store.cc:276] 0709 13:10:49.741711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.091282 (+1349571us) service_pool.cc:224] Handling call
0709 13:10:51.092252 (+   970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.914111 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1464) took 1489 ms. Trace:
I20260709 13:10:50.908370 23757 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:50.927351 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 95196.2us
I20260709 13:10:50.091346 23721 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:50.995949 21467 raft_consensus.cc:2368] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4.
I20260709 13:10:50.101377 23763 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.057060 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 316) took 1338 ms. Trace:
I20260709 13:10:50.857879 23859 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:51.104022 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 379) took 1315 ms. Trace:
I20260709 13:10:50.135747 23687 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:51.085168 21320 rpcz_store.cc:276] 0709 13:10:49.497990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.528158 (+ 30168us) service_pool.cc:224] Handling call
0709 13:10:49.528462 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.537158 (+  8696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.537201 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.563788 (+ 26587us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.819063 (+255275us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.819098 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.819156 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.851613 (+1032457us) raft_consensus.cc:1685] finished
0709 13:10:50.851641 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.851814 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1102,"raft.queue_time_us":966,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":9002,"thread_start_us":159931,"threads_started":1,"wal-append.queue_time_us":284519}
I20260709 13:10:51.087239 21321 rpcz_store.cc:276] 0709 13:10:49.108627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.145540 (+ 36913us) service_pool.cc:224] Handling call
0709 13:10:49.145904 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.772003 (+626099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.820521 (+1048518us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400227c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:50.820758 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438570240}
I20260709 13:10:51.093675 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.094611 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:51.097669 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.011s	sys 0.008s
I20260709 13:10:51.106194 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1693) took 1218 ms. Trace:
W20260709 13:10:51.098182 21396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1697) took 1168 ms (client timeout 1507 ms). Trace:
W20260709 13:10:51.107012 21396 rpcz_store.cc:269] 0709 13:10:49.930203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.077938 (+147735us) service_pool.cc:224] Handling call
0709 13:10:51.098109 (+1020171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.106619 21395 rpcz_store.cc:276] 0709 13:10:49.888311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.926262 (+1037951us) service_pool.cc:224] Handling call
0709 13:10:51.106132 (+179870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.103310 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1703) took 1158 ms. Trace:
I20260709 13:10:51.101233 22041 rpcz_store.cc:276] 0709 13:10:49.719001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.843924 (+124923us) service_pool.cc:224] Handling call
0709 13:10:49.844234 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.844411 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:50.804958 (+960547us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.056333 (+251375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.056430 (+    97us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:51.056535 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.056674 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.056932 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1357,"prepare.queue_time_us":66288,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":5736,"raft.queue_time_us":10304,"thread_start_us":1199449,"threads_started":2}
I20260709 13:10:51.108776 21388 rpcz_store.cc:276] 0709 13:10:49.931797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.819821 (+888024us) service_pool.cc:224] Handling call
0709 13:10:51.089676 (+269855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.109335 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.109728 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:50.832322 23695 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.825366 23869 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:51.111560 21388 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:51.132212 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 375) took 1391 ms. Trace:
W20260709 13:10:51.132551 21317 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.200s	user 0.009s	sys 0.003s
I20260709 13:10:51.132687 21388 rpcz_store.cc:276] 0709 13:10:49.741192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.109495 (+1368303us) service_pool.cc:224] Handling call
0709 13:10:51.132129 (+ 22634us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.133322 21317 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:51.133919 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.134063 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1922) took 1261 ms. Trace:
I20260709 13:10:51.134733 21313 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.924225 23705 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:51.113819 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:51.108301 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.114202 21394 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:51.140743 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 373) took 1400 ms. Trace:
I20260709 13:10:51.141225 21396 rpcz_store.cc:276] 0709 13:10:49.740525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.108068 (+1367543us) service_pool.cc:224] Handling call
0709 13:10:51.140665 (+ 32597us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.142418 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.114961 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 673) took 1458 ms. Trace:
W20260709 13:10:51.095165 23755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.003s	sys 0.010s
I20260709 13:10:51.117133 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 326) took 1272 ms. Trace:
I20260709 13:10:51.094512 21463 rpcz_store.cc:276] 0709 13:10:49.424678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.738184 (+313506us) service_pool.cc:224] Handling call
0709 13:10:49.738487 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.845610 (+107123us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:49.872713 (+ 27103us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.093682 (+220969us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b18003a1980. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:10:50.303623 (+209941us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:50.833108 (+529485us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.833252 (+   144us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:50.833289 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.833380 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.892009 (+ 58629us) raft_consensus.cc:1685] finished
0709 13:10:50.913249 (+ 21240us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.913915 (+   666us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147165,"prepare.queue_time_us":27368,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":96977,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":73409,"spinlock_wait_cycles":15990016,"thread_start_us":351762,"threads_started":1,"wal-append.queue_time_us":915786}
I20260709 13:10:51.153707 21470 rpcz_store.cc:276] 0709 13:10:49.844435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.099001 (+1254566us) service_pool.cc:224] Handling call
0709 13:10:51.117057 (+ 18056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.154212 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.155049 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1689) took 1290 ms. Trace:
I20260709 13:10:51.155551 21463 rpcz_store.cc:276] 0709 13:10:49.864534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.153964 (+1289430us) service_pool.cc:224] Handling call
0709 13:10:51.154977 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.134577 21317 rpcz_store.cc:276] 0709 13:10:49.872916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.908500 (+ 35584us) service_pool.cc:224] Handling call
0709 13:10:51.133982 (+1225482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.105499 21393 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:51.157970 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1455) took 1312 ms. Trace:
I20260709 13:10:51.109305 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 319) took 1305 ms. Trace:
I20260709 13:10:51.065970 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1454) took 1224 ms. Trace:
I20260709 13:10:50.144569 23801 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.182140 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.143404 22040 rpcz_store.cc:276] 0709 13:10:49.656634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.798446 (+141812us) service_pool.cc:224] Handling call
0709 13:10:49.798754 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.822720 (+ 23966us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:49.848824 (+ 26104us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.606317 (+757493us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18002d4ea0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:10:51.102906 (+496589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.103014 (+   108us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:51.103064 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.114575 (+ 11511us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.114870 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16795,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":5766912,"thread_start_us":480729,"threads_started":1}
I20260709 13:10:51.184404 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:51.105151 22038 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:51.150573 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1704) took 1218 ms. Trace:
I20260709 13:10:51.125180 23695 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:51.158397 21393 rpcz_store.cc:276] 0709 13:10:49.846055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.093355 (+1247300us) service_pool.cc:224] Handling call
0709 13:10:51.157914 (+ 64559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.149613 22035 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:51.192700 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:50.799981 23849 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.097518 23874 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:51.175302 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1456) took 1307 ms. Trace:
I20260709 13:10:51.180663 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:51.103438 22032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 307) took 1476 ms (client timeout 1941 ms). Trace:
I20260709 13:10:51.095748 23836 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.115618 23687 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:51.104218 23859 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.183030 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1705) took 1250 ms. Trace:
I20260709 13:10:50.995177 23747 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.201545 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 329) took 1356 ms. Trace:
I20260709 13:10:51.085351 23780 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:10:51.154623 23755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.003s	sys 0.010s
I20260709 13:10:51.182243 23472 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.205298 21463 rpcz_store.cc:276] 0709 13:10:49.845164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.180308 (+1335144us) service_pool.cc:224] Handling call
0709 13:10:51.201460 (+ 21152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.153339 23705 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:51.190810 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 344634us
I20260709 13:10:51.191108 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.201713 21396 rpcz_store.cc:276] 0709 13:10:49.867481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.142047 (+1274566us) service_pool.cc:224] Handling call
0709 13:10:51.174929 (+ 32882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.209439 21393 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:51.209947 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1694) took 1283 ms. Trace:
I20260709 13:10:51.210278 21393 rpcz_store.cc:276] 0709 13:10:49.926678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.190853 (+1264175us) service_pool.cc:224] Handling call
0709 13:10:51.209889 (+ 19036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.211265 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:51.210048 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 955757us
I20260709 13:10:51.104425 21392 rpcz_store.cc:276] 0709 13:10:49.782504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.810281 (+1027777us) service_pool.cc:224] Handling call
0709 13:10:51.097351 (+287070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.212090 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.212210 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1702) took 1280 ms. Trace:
I20260709 13:10:51.212538 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.212605 21394 rpcz_store.cc:276] 0709 13:10:49.931536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.800957 (+869421us) service_pool.cc:224] Handling call
0709 13:10:51.212056 (+411099us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b54000ad2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:51.212158 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59574656}
I20260709 13:10:51.213326 21392 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:51.213670 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.213933 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1707) took 1190 ms. Trace:
I20260709 13:10:51.214394 21392 rpcz_store.cc:276] 0709 13:10:50.023743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.212330 (+1188587us) service_pool.cc:224] Handling call
0709 13:10:51.213872 (+  1542us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.085131 22034 rpcz_store.cc:269] 0709 13:10:49.624495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.632635 (+  8140us) service_pool.cc:224] Handling call
0709 13:10:50.115895 (+483260us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:50.807413 (+691518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104512}
I20260709 13:10:51.215451 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.193071 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.193287 22040 raft_consensus.cc:2376] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6. Re-sending same reply.
I20260709 13:10:51.100736 23748 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.214411 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1708) took 1124 ms. Trace:
I20260709 13:10:51.219094 21394 rpcz_store.cc:276] 0709 13:10:50.090310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.213473 (+1123163us) service_pool.cc:224] Handling call
0709 13:10:51.214360 (+   887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.152084 23869 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.201254 21395 rpcz_store.cc:276] 0709 13:10:49.932297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.143217 (+1210920us) service_pool.cc:224] Handling call
0709 13:10:51.182966 (+ 39749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.187760 21388 rpcz_store.cc:276] 0709 13:10:49.932023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.133678 (+1201655us) service_pool.cc:224] Handling call
0709 13:10:51.150490 (+ 16812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.192837 23867 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:51.220212 21392 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
W20260709 13:10:51.186583 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 369970us
I20260709 13:10:51.211802 21393 raft_consensus.cc:2376] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3. Re-sending same reply.
W20260709 13:10:51.195834 22038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 664) took 1572 ms (client timeout 1672 ms). Trace:
I20260709 13:10:51.183153 21389 rpcz_store.cc:276] 0709 13:10:49.831162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.799768 (+968606us) service_pool.cc:224] Handling call
0709 13:10:51.055386 (+255618us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.223021 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 304) took 1385 ms. Trace:
I20260709 13:10:51.300088 21470 rpcz_store.cc:276] 0709 13:10:49.837873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.176041 (+1338168us) service_pool.cc:224] Handling call
0709 13:10:51.222930 (+ 46889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.241798 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:51.266587 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 402737us
W20260709 13:10:51.277179 21997 leader_election.cc:336] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.633s (SENT)
I20260709 13:10:51.253306 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1706) took 1258 ms. Trace:
I20260709 13:10:51.298274 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:51.307271 21314 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:51.221655 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:51.307910 21997 leader_election.cc:336] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.003s (SENT)
I20260709 13:10:51.306516 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:51.309147 21317 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.311299 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1689) took 2405 ms. Trace:
I20260709 13:10:51.301529 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 327) took 1456 ms. Trace:
I20260709 13:10:51.238655 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 381) took 1429 ms. Trace:
I20260709 13:10:51.204427 23859 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.203538 23874 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:51.340940 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:51.314785 21463 rpcz_store.cc:276] 0709 13:10:49.844663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.206987 (+1362324us) service_pool.cc:224] Handling call
0709 13:10:51.301471 (+ 94484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.335498 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:51.341662 21321 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:51.336134 21387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.001s
I20260709 13:10:51.175681 22031 rpcz_store.cc:276] 0709 13:10:49.803700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.116871 (+313171us) service_pool.cc:224] Handling call
0709 13:10:50.117162 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.089522 (+972360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.109220 (+ 19698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.338172 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:51.373054 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:51.311767 21394 rpcz_store.cc:276] 0709 13:10:48.892396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.247558 (+2355162us) service_pool.cc:224] Handling call
0709 13:10:51.247922 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.296726 (+ 48804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.296772 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.296831 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:51.296887 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.296972 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.297146 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.299445 23730 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:51.336576 21393 rpcz_store.cc:276] 0709 13:10:49.994831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.211016 (+1216185us) service_pool.cc:224] Handling call
0709 13:10:51.253240 (+ 42224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.375252 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:51.369172 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:51.342267 22039 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.019s	sys 0.048s
I20260709 13:10:51.339623 21392 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:51.412523 22039 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.019s	sys 0.052s
I20260709 13:10:51.412808 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1690) took 2520 ms. Trace:
I20260709 13:10:51.413218 21392 rpcz_store.cc:276] 0709 13:10:48.892688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.306023 (+2413335us) service_pool.cc:224] Handling call
0709 13:10:51.313208 (+  7185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.412545 (+ 99337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.412749 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.414453 23755 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.338321 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.376582 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:51.406227 21470 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:51.333830 23811 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.407289 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 371) took 1698 ms. Trace:
I20260709 13:10:51.433598 21394 rpcz_store.cc:276] 0709 13:10:49.708965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.406301 (+1697336us) service_pool.cc:224] Handling call
0709 13:10:51.406631 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.406848 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.406899 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.406957 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:51.407002 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.407071 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.407216 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.435114 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:51.436021 21316 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:51.423563 21318 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
W20260709 13:10:51.441994 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.408857 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.377795 22040 raft_consensus.cc:2368] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8.
I20260709 13:10:51.405187 23791 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:51.370818 21387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.015s	sys 0.004s
I20260709 13:10:51.447942 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1450) took 2560 ms. Trace:
W20260709 13:10:51.416288 21361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.015s
I20260709 13:10:51.417677 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.297971 23867 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.418377 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:51.458170 21314 raft_consensus.cc:2410] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:10:51.322845 21396 rpcz_store.cc:276] 0709 13:10:49.783209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.209873 (+1426664us) service_pool.cc:224] Handling call
0709 13:10:51.212744 (+  2871us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.419943 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 106158us
W20260709 13:10:51.411903 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 232397us
I20260709 13:10:51.423535 21388 raft_consensus.cc:2368] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
W20260709 13:10:51.423817 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1685) took 1560 ms (client timeout 1972 ms). Trace:
W20260709 13:10:51.460251 21470 rpcz_store.cc:269] 0709 13:10:49.863351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.301021 (+1437670us) service_pool.cc:224] Handling call
0709 13:10:51.423760 (+122739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.424751 21317 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
W20260709 13:10:51.423084 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.015s
W20260709 13:10:51.425923 21997 leader_election.cc:336] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.684s (SENT)
W20260709 13:10:51.416319 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 592050us
W20260709 13:10:51.418154 23864 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.407s	user 0.001s	sys 0.001s
W20260709 13:10:51.450727 21361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.008s	sys 0.015s
W20260709 13:10:51.201503 22032 rpcz_store.cc:269] 0709 13:10:49.627017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.644277 (+ 17260us) service_pool.cc:224] Handling call
0709 13:10:49.906326 (+262049us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:51.099152 (+1192826us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8901376}
W20260709 13:10:51.451961 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.448541 21387 rpcz_store.cc:276] 0709 13:10:48.887812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.709172 (+821360us) service_pool.cc:224] Handling call
0709 13:10:49.733973 (+ 24801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.734179 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:50.790524 (+1056345us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.447573 (+657049us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.447628 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:51.447673 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.447738 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.447859 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72402,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":1275,"raft.queue_time_us":14028,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":1638231,"threads_started":3,"wal-append.queue_time_us":38624}
I20260709 13:10:51.452888 21463 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:51.298427 22038 rpcz_store.cc:269] 0709 13:10:49.620613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.636551 (+ 15938us) service_pool.cc:224] Handling call
0709 13:10:50.120383 (+483832us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3eee 0000000000375939 00007fc2c41671e0 00007fc2c42300c4 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:10:51.192629 (+1072246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10828032}
I20260709 13:10:51.453809 22040 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:51.433435 23811 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:51.528412 23811 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:51.529703 23811 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.530192 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:51.531297 22031 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:10:51.534614 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0048331570000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 13:10:51.540385 23555 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.423074 23762 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:51.541869 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 678) took 1682 ms. Trace:
I20260709 13:10:51.476341 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:51.543641 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 67412.1us
I20260709 13:10:51.437143 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:51.534741 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1832) took 1419 ms. Trace:
I20260709 13:10:51.416349 23870 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:51.469247 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:51.484769 22067 heartbeater.cc:646] Failed to heartbeat to 127.19.185.254:40067 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.185.254:40067 timed out after 15.000s (SENT)
W20260709 13:10:51.470125 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.007s	sys 0.016s
I20260709 13:10:51.487596 23889 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:51.546305 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 734721us
I20260709 13:10:51.492794 23881 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:51.439981 23755 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:51.498891 23871 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:10:51.500420 23895 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:51.501206 23890 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.504791 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.370924 23780 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.416810 23730 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.337527 23695 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:51.506551 23876 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:51.377303 23687 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:51.507555 23472 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:51.507766 23849 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:51.508555 23877 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 13:10:51.508647 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 309) took 1669 ms (client timeout 1761 ms). Trace:
W20260709 13:10:51.601465 21467 rpcz_store.cc:269] 0709 13:10:49.838998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.081445 (+242447us) service_pool.cc:224] Handling call
0709 13:10:51.508466 (+1427021us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003facd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:51.508594 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480903040}
I20260709 13:10:51.509301 23878 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:51.510188 23837 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.503973 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.513374 23855 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:10:51.516713 23865 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:10:51.515542 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:51.521574 21997 leader_election.cc:336] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.772s (SENT)
I20260709 13:10:51.609665 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:51.609934 21468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 330) took 1764 ms (client timeout 2034 ms). Trace:
W20260709 13:10:51.610818 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 89265.9us
I20260709 13:10:49.933069 21462 rpcz_store.cc:276] 0709 13:10:47.705466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.721882 (+ 16416us) service_pool.cc:224] Handling call
0709 13:10:47.765769 (+ 43887us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.230635 (+464866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.236269 (+  5634us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.562490 (+326221us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.401549 (+839059us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.522206 (+120657us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.831957 (+309751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.837699 (+  5742us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.845234 (+  7535us) raft_consensus.cc:1685] finished
0709 13:10:49.852830 (+  7596us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.866102 (+ 13272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":626171,"prepare.queue_time_us":67635,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":760358,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":12660,"thread_start_us":849101,"threads_started":2,"wal-append.queue_time_us":784639,"wal-append.run_cpu_time_us":2391,"wal-append.run_wall_time_us":1283670}
I20260709 13:10:51.525867 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.527447 23748 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:51.540609 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1466) took 2113 ms. Trace:
W20260709 13:10:51.616334 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 303) took 1778 ms (client timeout 2044 ms). Trace:
W20260709 13:10:51.617034 21469 rpcz_store.cc:269] 0709 13:10:49.837728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.525604 (+1687876us) service_pool.cc:224] Handling call
0709 13:10:51.616278 (+ 90674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.616190 21465 rpcz_store.cc:276] 0709 13:10:49.427638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.756018 (+328380us) service_pool.cc:224] Handling call
0709 13:10:49.756675 (+   657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.845266 (+ 88591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.845299 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.867302 (+ 22003us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.231187 (+363885us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:50.836401 (+605214us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.422612 (+586211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.422947 (+   335us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.540397 (+117450us) raft_consensus.cc:1685] finished
0709 13:10:51.540419 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.540556 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":230957,"prepare.queue_time_us":604321,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":433735,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":14484,"thread_start_us":796176,"threads_started":2,"wal-append.queue_time_us":926509}
I20260709 13:10:51.618398 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.618760 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:51.619149 21469 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
W20260709 13:10:51.619799 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1684) took 1756 ms (client timeout 2067 ms). Trace:
W20260709 13:10:51.620229 21469 rpcz_store.cc:269] 0709 13:10:49.863064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.618059 (+1754995us) service_pool.cc:224] Handling call
0709 13:10:51.619730 (+  1671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.621316 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.540721 23574 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:51.541350 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:51.623764 21464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 331) took 1778 ms (client timeout 2044 ms). Trace:
W20260709 13:10:51.624290 21464 rpcz_store.cc:269] 0709 13:10:49.845624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.540999 (+1695375us) service_pool.cc:224] Handling call
0709 13:10:51.623689 (+ 82690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.625443 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.542289 22035 rpcz_store.cc:276] 0709 13:10:49.859620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.145677 (+286057us) service_pool.cc:224] Handling call
0709 13:10:51.103554 (+957877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.195468 (+ 91914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.541677 (+346209us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54005c49d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:51.541810 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807999360}
I20260709 13:10:51.544917 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 318) took 1741 ms. Trace:
I20260709 13:10:51.626549 22042 rpcz_store.cc:276] 0709 13:10:49.803440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.104778 (+301338us) service_pool.cc:224] Handling call
0709 13:10:50.105171 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.607879 (+502708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.607923 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:50.812225 (+204302us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.420124 (+607899us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.420183 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.420279 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.544715 (+124436us) raft_consensus.cc:1685] finished
0709 13:10:51.544734 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.544853 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":717901,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":842806,"threads_started":2,"wal-append.queue_time_us":573396}
I20260709 13:10:51.544921 21313 rpcz_store.cc:276] 0709 13:10:50.115620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.119539 (+  3919us) service_pool.cc:224] Handling call
0709 13:10:51.134569 (+1015030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.135345 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.534559 (+399214us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000fd050. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:51.534680 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2333705472}
I20260709 13:10:51.491976 23747 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:51.546450 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 77321.8us
I20260709 13:10:51.628762 23878 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:51.629335 23878 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:51.630371 23878 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:51.488126 21463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 314) took 1647 ms (client timeout 2003 ms). Trace:
W20260709 13:10:51.632231 21463 rpcz_store.cc:269] 0709 13:10:49.840618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.373974 (+1533356us) service_pool.cc:224] Handling call
0709 13:10:51.488063 (+114089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.633401 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.525938 23869 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:51.549615 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:51.547389 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 82599.4us
W20260709 13:10:51.575938 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.471316 23809 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:51.653631 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 323) took 1810 ms (client timeout 2005 ms). Trace:
W20260709 13:10:51.654249 21470 rpcz_store.cc:269] 0709 13:10:49.843631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.476520 (+1632889us) service_pool.cc:224] Handling call
0709 13:10:51.653548 (+177028us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.585779 21466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 312) took 1745 ms (client timeout 2016 ms). Trace:
W20260709 13:10:51.655540 21466 rpcz_store.cc:269] 0709 13:10:49.839964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.504544 (+1664580us) service_pool.cc:224] Handling call
0709 13:10:51.585694 (+ 81150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.547791 23671 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.577656 22034 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:51.548313 23762 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:51.547923 23889 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:51.602396 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1451) took 2714 ms. Trace:
I20260709 13:10:51.597184 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1453) took 1775 ms. Trace:
I20260709 13:10:51.605751 21461 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:51.549793 21216 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 3, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.577965 23492 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:51.610525 21468 rpcz_store.cc:269] 0709 13:10:49.845397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.515171 (+1669774us) service_pool.cc:224] Handling call
0709 13:10:51.609839 (+ 94668us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.614058 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 360131us
I20260709 13:10:51.615378 23887 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:51.649712 22002 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.066s (SENT)
I20260709 13:10:51.648484 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 672) took 2001 ms. Trace:
I20260709 13:10:51.546641 23791 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.576531 23757 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:10:51.693753 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 311) took 1854 ms (client timeout 2013 ms). Trace:
I20260709 13:10:51.592512 23890 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.603480 23472 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:51.655081 23883 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:10:51.683501 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.611069 23855 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.550034 23870 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.706295 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:51.742014 21466 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.708323 21465 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:51.708913 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.742806 21396 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.709801 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.743687 21394 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
W20260709 13:10:51.710280 21997 leader_election.cc:336] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.927s (SENT)
I20260709 13:10:51.744612 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:51.679158 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.695742 21392 rpcz_store.cc:276] 0709 13:10:49.821388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.414019 (+1592631us) service_pool.cc:224] Handling call
0709 13:10:51.414297 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.414498 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:51.414788 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.596827 (+182039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.596881 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:51.596926 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.596990 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.597124 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95652,"prepare.queue_time_us":5882,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2624,"raft.queue_time_us":6160,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6321,"thread_start_us":176684,"threads_started":1}
I20260709 13:10:51.745867 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.746383 21392 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.716799 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:51.718755 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 69012.4us
I20260709 13:10:51.655441 23747 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.718739 22039 rpcz_store.cc:276] 0709 13:10:49.656276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.797743 (+141467us) service_pool.cc:224] Handling call
0709 13:10:49.807414 (+  9671us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:49.807862 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.807890 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:49.813643 (+  5753us) log.cc:844] Serialized 52 byte log entry
0709 13:10:50.304298 (+490655us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:50.397681 (+ 93383us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.413506 (+1015825us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.413689 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.413761 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.648229 (+234468us) raft_consensus.cc:1685] finished
0709 13:10:51.648256 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.648422 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119259,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":87,"raft.queue_time_us":428018,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":272,"thread_start_us":996268,"threads_started":2,"wal-append.queue_time_us":1400184}
I20260709 13:10:51.575671 23881 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:51.732414 21461 rpcz_store.cc:269] 0709 13:10:49.839655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.503692 (+1664037us) service_pool.cc:224] Handling call
0709 13:10:51.693664 (+189972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.654803 23687 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:51.616514 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:51.735010 21387 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:51.716493 23845 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:51.736430 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.767410 21388 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.767488 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 333) took 1921 ms. Trace:
I20260709 13:10:51.692994 23780 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.692607 23695 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:51.728627 23707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.006s	sys 0.015s
I20260709 13:10:51.703224 23492 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.752980 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:51.738665 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.001s	sys 0.021s
W20260709 13:10:51.754997 21997 leader_election.cc:336] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.954s (SENT)
I20260709 13:10:51.677541 23849 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:10:51.762315 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.735711 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.764904 21469 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:51.726933 23671 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:51.732060 23833 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:51.787400 21360 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.561s (SENT)
I20260709 13:10:51.767789 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:51.614107 23874 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:51.767861 21470 rpcz_store.cc:276] 0709 13:10:49.846131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.655137 (+1809006us) service_pool.cc:224] Handling call
0709 13:10:51.767427 (+112290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.764361 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:51.773434 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.001s	sys 0.021s
W20260709 13:10:51.789235 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 688884us
I20260709 13:10:51.790741 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:51.773530 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:51.792163 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:51.695353 23891 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:10:51.760921 23809 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:51.796515 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 257347us
I20260709 13:10:51.796577 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.797734 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:51.773442 23707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.007s	sys 0.015s
I20260709 13:10:51.770812 23878 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.803086 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:51.786621 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.798853 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:51.755733 23879 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:10:51.803707 21470 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.804876 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 332) took 1959 ms. Trace:
I20260709 13:10:51.805275 21461 rpcz_store.cc:276] 0709 13:10:49.845876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.765495 (+1919619us) service_pool.cc:224] Handling call
0709 13:10:51.804811 (+ 39316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.806013 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:51.803732 21391 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.022s
W20260709 13:10:51.806731 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 247172us
I20260709 13:10:51.808214 21389 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:51.813014 21997 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.005s (SENT)
I20260709 13:10:51.821116 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:51.812505 21388 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:10:51.793921 23869 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.764828 23747 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.815086 21396 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:51.824667 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:51.827242 21466 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:51.781349 23886 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:10:51.796119 23887 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:51.828800 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.830163 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:51.845491 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.832491 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:51.833235 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 252799us
I20260709 13:10:51.836467 23911 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:51.787657 23757 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:51.791303 23574 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:10:51.694285 21390 rpcz_store.cc:276] 0709 13:10:48.888148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.713975 (+825827us) service_pool.cc:224] Handling call
0709 13:10:49.714211 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.714387 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:49.737311 (+ 22924us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.826075 (+1088764us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180026c5c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:10:51.576605 (+750530us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.591818 (+ 15213us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.598179 (+  6361us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.598247 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:51.598307 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.598402 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.602325 (+  3923us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":243592,"prepare.queue_time_us":139500,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":113,"raft.queue_time_us":322155,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":8876,"spinlock_wait_cycles":44610176,"thread_start_us":669143,"threads_started":2,"wal-append.queue_time_us":1701923}
I20260709 13:10:51.840468 23902 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:51.815958 23891 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:10:51.794808 23833 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:51.774650 23845 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:51.812158 23899 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:10:51.635484 23515 consensus_queue.cc:1175] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d41c71e861344f0b90e8d44a8d0a3173" responder_term: 6 status { last_received { term: 5 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:51.799654 23748 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:10:51.822692 23721 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.695s	user 0.007s	sys 0.003s
I20260709 13:10:51.840866 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:51.844815 21461 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:51.949518 21466 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:51.859751 21465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 313) took 2019 ms (client timeout 2096 ms). Trace:
W20260709 13:10:51.841382 21997 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.034s (SENT)
W20260709 13:10:51.805588 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 319) took 1961 ms (client timeout 2077 ms). Trace:
I20260709 13:10:51.868502 21216 catalog_manager.cc:5697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 3, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.818555 23707 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:51.950121 21465 rpcz_store.cc:269] 0709 13:10:49.840307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.618518 (+1778211us) service_pool.cc:224] Handling call
0709 13:10:51.859516 (+240998us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b540029a9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:51.859681 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203160448}
I20260709 13:10:51.854456 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.958602 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:51.960119 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:51.878391 21387 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:51.850363 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1680) took 3705 ms. Trace:
I20260709 13:10:51.961220 21391 rpcz_store.cc:276] 0709 13:10:48.144554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.419691 (+1275137us) service_pool.cc:224] Handling call
0709 13:10:49.434737 (+ 15046us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:49.537050 (+102313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.537078 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:49.562030 (+ 24952us) log.cc:844] Serialized 52 byte log entry
0709 13:10:50.828962 (+1266932us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18003813a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:10:51.189931 (+360969us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:51.234147 (+ 44216us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.807524 (+573377us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.845485 (+ 37961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.845569 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.850161 (+  4592us) raft_consensus.cc:1685] finished
0709 13:10:51.850180 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.850300 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58563,"prepare.queue_time_us":66282,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":397360,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":6370,"spinlock_wait_cycles":23828736,"thread_start_us":932559,"threads_started":2,"wal-append.queue_time_us":1919606}
W20260709 13:10:51.951066 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 109707us
W20260709 13:10:51.965008 21997 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.044s (SENT)
I20260709 13:10:51.965601 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:51.951835 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 162704us
W20260709 13:10:51.968420 21360 leader_election.cc:336] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.644s (SENT)
I20260709 13:10:51.851034 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:51.953020 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 100236us
I20260709 13:10:51.968930 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:51.969985 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:51.791571 23671 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:51.846992 21388 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:51.853734 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:51.860991 22040 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:51.955494 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:51.973091 21470 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:52.028873 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.845916 23898 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:51.846139 23906 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.981725 21466 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:51.858935 23472 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:52.034382 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.844717 23809 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.034598 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:52.088810 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:52.089344 21391 raft_consensus.cc:2376] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6. Re-sending same reply.
W20260709 13:10:52.034382 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.131s (SENT)
I20260709 13:10:52.035884 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.090541 21468 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:51.870740 23874 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:51.957083 23882 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:52.041354 23845 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:52.046469 23811 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.003s
I20260709 13:10:52.045921 21216 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 5, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 5 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.860745 23881 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:52.047318 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:51.852700 23890 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:52.048506 23913 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:52.048816 23671 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:52.048931 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79011.2us
I20260709 13:10:52.028379 23757 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:10:52.049924 23901 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:10:51.852051 23867 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:52.055205 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 201529us
I20260709 13:10:52.165433 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.056608 21470 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:10:52.060637 21215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 285) took 16764 ms (client timeout 15000 ms). Trace:
I20260709 13:10:51.850035 22032 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:52.061983 23870 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:51.954329 21462 rpcz_store.cc:269] 0709 13:10:49.841930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.616217 (+1774287us) service_pool.cc:224] Handling call
0709 13:10:51.803464 (+187247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.847164 23911 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:51.849874 23755 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:51.843876 23887 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.869558 23730 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:51.858314 23747 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:51.848112 23385 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:51.969549 21390 raft_consensus.cc:2376] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7. Re-sending same reply.
I20260709 13:10:52.170053 23899 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:51.852617 23879 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:52.082005 21396 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:51.858057 23833 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:52.084864 22040 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:52.087121 21392 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
W20260709 13:10:52.039059 23859 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.001s
I20260709 13:10:52.189374 23921 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.194255 23859 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.183372 23887 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.196633 23859 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:52.090751 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 56392.5us
I20260709 13:10:51.865716 23791 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:51.975170 23707 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:51.858865 23889 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:52.152088 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 187120us
W20260709 13:10:52.200770 21997 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.066s (SENT)
I20260709 13:10:52.180994 23911 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.201028 23889 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.201257 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:52.202700 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:52.206399 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:52.175956 23492 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.178001 23878 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.033586 23869 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.154914 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:52.119666 23836 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.880s	user 0.009s	sys 0.000s
I20260709 13:10:52.158452 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:52.241921 21314 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:51.865975 23910 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:52.242990 23910 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:52.243376 23910 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.954212 23574 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:52.154399 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 314729us
I20260709 13:10:52.249924 23707 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:52.159276 21317 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:52.254454 23872 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.255120 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:52.255052 23872 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:52.255851 21317 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:52.256538 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:52.257562 23872 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:52.259661 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:52.260250 21316 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:52.089589 23919 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:51.864410 23744 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.286s
I20260709 13:10:51.956669 23721 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:52.162108 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 203584us
W20260709 13:10:52.162562 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 316) took 2321 ms (client timeout 2232 ms). Trace:
W20260709 13:10:52.270741 21469 rpcz_store.cc:269] 0709 13:10:49.841153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.621003 (+1779850us) service_pool.cc:224] Handling call
0709 13:10:52.162372 (+541369us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001a77d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:52.162494 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328563456}
I20260709 13:10:52.271320 21359 leader_election.cc:400] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8.
I20260709 13:10:52.271701 21359 leader_election.cc:403] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.272064 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.272729 21469 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.166527 21465 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:52.088807 23915 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:52.168675 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 200301us
W20260709 13:10:52.287896 21360 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.829s (SENT)
W20260709 13:10:52.289130 21360 leader_election.cc:336] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.890s (SENT)
I20260709 13:10:52.169387 21313 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:52.175005 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 306) took 2328 ms. Trace:
I20260709 13:10:52.291297 21470 rpcz_store.cc:276] 0709 13:10:49.838305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.055934 (+2217629us) service_pool.cc:224] Handling call
0709 13:10:52.056292 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.166034 (+109742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.166212 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:52.176494 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:52.177646 21216 catalog_manager.cc:5697] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 4, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 4 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.188177 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:51.869064 23763 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.741s	user 0.006s	sys 0.003s
I20260709 13:10:52.177625 23898 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:52.196753 21468 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:52.305452 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.306056 21468 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:52.079874 23906 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:10:52.128399 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 322439us
I20260709 13:10:52.310889 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.153961 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:52.207716 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.193969 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:52.233393 23747 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.191222 23890 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:10:52.231748 21997 leader_election.cc:336] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.096s (SENT)
W20260709 13:10:52.336869 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 105168us
I20260709 13:10:52.235107 23555 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:52.201089 21464 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:52.237741 23492 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:52.286522 23899 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:52.207177 22038 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:52.192266 23879 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:52.275255 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:52.279203 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:52.348440 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.280254 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:52.280540 21315 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:52.266963 23836 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.268703 23919 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:52.302567 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:52.313112 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:52.331039 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:52.331601 21216 catalog_manager.cc:5697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 5, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 5 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.333153 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:52.318338 22041 raft_consensus.cc:2368] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7.
I20260709 13:10:52.234336 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:52.338951 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:52.339804 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 132173us
I20260709 13:10:52.368595 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.304255 23910 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:52.340854 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:52.373298 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:52.374361 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:52.375362 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:52.341377 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:52.240420 22042 raft_consensus.cc:2376] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5. Re-sending same reply.
W20260709 13:10:52.375823 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 62807us
W20260709 13:10:52.350348 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 70185.4us
I20260709 13:10:52.354075 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:52.342239 23791 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:10:52.169641 21215 rpcz_store.cc:269] 0709 13:10:35.296288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.322059 (+ 25771us) service_pool.cc:224] Handling call
0709 13:10:52.060394 (+16738335us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:44.007190 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:44.145539 (+138349us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:44.147931 (+  2392us) write_op.cc:435] Acquired schema lock
0709 13:10:44.152977 (+  5046us) tablet.cc:662] Decoding operations
0709 13:10:44.321457 (+168480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:44.321538 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:44.321573 (+    35us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:10:44.322824 (+  1251us) tablet.cc:701] Row locks acquired
0709 13:10:44.322850 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:10:44.323021 (+   171us) write_op.cc:270] Start()
0709 13:10:44.323154 (+   133us) write_op.cc:276] Timestamp: P: 1783602644322957 usec, L: 0
0709 13:10:44.323173 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:44.516273 (+193100us) log.cc:844] Serialized 5256 byte log entry
0709 13:10:46.037430 (+1521157us) op_driver.cc:464] REPLICATION: finished
0709 13:10:46.029433 (+ -7997us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf213e28 00007fc2c2c4e581 00007fc2c2c4dd58 00007fc2c2c529f1 00007fc2c2c529a9 00007fc2c2c52939 00007fc2c2c52901 00007fc2c2c51b2d 000000000038f354 000000000038f199
0709 13:10:46.237937 (+208504us) write_op.cc:301] APPLY: starting
0709 13:10:46.239227 (+  1290us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:46.336790 (+ 97563us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:46.336840 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:46.343507 (+  6667us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:46.343806 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:10:46.343851 (+    45us) write_op.cc:312] APPLY: finished
0709 13:10:46.344373 (+   522us) log.cc:844] Serialized 95 byte log entry
0709 13:10:46.369287 (+ 24914us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:46.413014 (+ 43727us) write_op.cc:454] Released schema lock
0709 13:10:46.413080 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:46.413586 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:46.413613 (+    27us) write_op.cc:454] Released schema lock
0709 13:10:46.658169 (+244556us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21532a 00007fc2bf19af14 00007fc2bf19aec3 00007fc2bf19ae38 00007fc2bf19adf3 00007fc2bf19a0dc 00007fc2bf1c3e16 00007fc2bf1abcbb 00007fc2bf19639d 00007fc2bf199d75
Metrics: {"mutex_wait_us":2482217,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":152566,"apply.run_cpu_time_us":6225,"apply.run_wall_time_us":205692,"num_ops":13,"prepare.queue_time_us":313896,"prepare.run_cpu_time_us":56977,"prepare.run_wall_time_us":2033516,"raft.queue_time_us":1113,"raft.run_cpu_time_us":14309,"raft.run_wall_time_us":1028640,"replication_time_us":1714016,"spinlock_wait_cycles":954782336,"thread_start_us":1763086,"threads_started":4,"wal-append.queue_time_us":1101169,"wal-append.run_cpu_time_us":5439,"wal-append.run_wall_time_us":1738537}]]}
I20260709 13:10:52.337623 23800 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8.
I20260709 13:10:52.343477 23472 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.356853 23916 raft_consensus.cc:2764] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:10:52.358165 23923 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:10:52.360868 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:52.361068 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:52.311760 23915 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:52.363085 21469 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:52.367686 21388 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:52.371385 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:52.345357 23780 consensus_meta.cc:287] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 13:10:52.371999 21392 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:10:52.450795 21464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 320) took 2608 ms (client timeout 2757 ms). Trace:
I20260709 13:10:52.307098 23730 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.373972 23890 consensus_queue.cc:1243] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:52.377641 23757 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.311031 23763 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.381433 21393 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:52.383437 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.384332 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:52.385356 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44050.3us
I20260709 13:10:52.387907 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:52.390196 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:52.459491 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 105504us
W20260709 13:10:52.377131 23904 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.501s	user 0.004s	sys 0.000s
I20260709 13:10:52.392865 22040 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
W20260709 13:10:52.460577 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 89238.7us
I20260709 13:10:52.358942 23899 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.462297 23878 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:52.462785 23878 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:52.369849 23492 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:52.463325 23878 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:52.463605 23492 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:52.464529 23492 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.465755 23763 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:52.465869 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 78030.7us
I20260709 13:10:52.391633 23881 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.467710 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1470) took 1046 ms. Trace:
I20260709 13:10:52.435240 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1691) took 3277 ms. Trace:
I20260709 13:10:52.468214 21467 raft_consensus.cc:2368] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 7.
I20260709 13:10:52.340207 23574 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:10:52.442406 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.474092 21470 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:52.342080 23707 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:10:52.437512 23907 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.579s	user 0.002s	sys 0.000s
I20260709 13:10:52.436497 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.487565 21319 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.448854 23889 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:52.451205 21464 rpcz_store.cc:269] 0709 13:10:49.842170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.625102 (+1782932us) service_pool.cc:224] Handling call
0709 13:10:52.450611 (+825509us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54001edcd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:52.450743 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320184192}
I20260709 13:10:52.431768 21316 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:52.435111 23721 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:52.382196 23744 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.381238 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:52.460811 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:52.462728 23755 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:52.348011 23747 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.468474 21389 rpcz_store.cc:276] 0709 13:10:49.157889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.337412 (+2179523us) service_pool.cc:224] Handling call
0709 13:10:51.447421 (+110009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.820628 (+373207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.435028 (+614400us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54001ecb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:52.435183 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829076864}
I20260709 13:10:52.459851 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:52.468307 21466 rpcz_store.cc:276] 0709 13:10:51.421568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.081308 (+659740us) service_pool.cc:224] Handling call
0709 13:10:52.081717 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.088844 (+  7127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.088878 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.089319 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.313867 (+224548us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:52.313911 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.313986 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.467511 (+153525us) raft_consensus.cc:1685] finished
0709 13:10:52.467531 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.467656 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6724,"raft.queue_time_us":72510,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":16191,"thread_start_us":224198,"threads_started":1,"wal-append.queue_time_us":301530}
I20260709 13:10:52.470126 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:52.437964 23705 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.210s	user 0.008s	sys 0.002s
I20260709 13:10:52.472527 23916 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:52.433905 23913 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:52.431542 23910 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:52.380304 23872 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:10:52.371179 23919 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.570266 21395 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
I20260709 13:10:52.605022 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.645049 21466 raft_consensus.cc:2368] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:52.646015 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.646636 21466 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:52.647657 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.648574 21466 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:52.649415 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.650662 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.510221 23889 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:52.605990 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.652436 21470 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:52.610423 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 305) took 2772 ms. Trace:
I20260709 13:10:52.653352 21465 rpcz_store.cc:276] 0709 13:10:49.838094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.974178 (+2136084us) service_pool.cc:224] Handling call
0709 13:10:52.162951 (+188773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.273595 (+110644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.610210 (+336615us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001a77d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:52.610358 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433352576}
W20260709 13:10:52.614037 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 152093us
I20260709 13:10:52.656204 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:52.616750 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 155998us
W20260709 13:10:52.616994 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 235816us
I20260709 13:10:52.467664 23809 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.391909 23874 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:10:52.469014 23890 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:52.638074 21391 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:52.638934 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.643067 21319 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:52.657737 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.665307 21465 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:52.666241 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:52.641419 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 181639us
W20260709 13:10:52.666615 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 291282us
I20260709 13:10:52.647251 23881 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:52.635299 23721 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.674736 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.658785 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.676838 21470 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:52.434140 23898 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:52.640909 23899 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.635475 23886 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.696004 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.696846 21465 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:52.637337 23916 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:52.635388 23913 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:52.668588 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:52.705929 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.706346 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.677773 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.651763 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.709482 21466 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:52.710490 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:52.681077 23695 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.908s	user 0.009s	sys 0.001s
W20260709 13:10:52.684186 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 294470us
W20260709 13:10:52.688663 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.688702 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2342402450000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 13:10:52.725432 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2324402450000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 13:10:52.725787 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2099402449999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:10:52.725659 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:52.690305 22041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 811) took 1772 ms (client timeout 1561 ms). Trace:
I20260709 13:10:52.381816 23906 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:52.636382 23705 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:52.702111 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45980.8us
I20260709 13:10:52.677595 23721 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:52.711018 21466 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.694973 23899 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.707669 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.667754 23870 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.663753 23890 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:10:52.726392 22041 rpcz_store.cc:269] 0709 13:10:50.917382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.113138 (+195756us) service_pool.cc:224] Handling call
0709 13:10:52.690023 (+1576885us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54006c5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:52.690217 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2709959552}
I20260709 13:10:52.753953 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:52.652701 23889 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:52.726145 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2099402449999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:10:52.641191 23911 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.679536 23869 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.734730 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.652750 23763 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:52.734138 23878 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:52.761620 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1739402449999261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260709 13:10:52.825306 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1739402449999261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260709 13:10:52.825661 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1496402450000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 13:10:52.826018 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1154402449999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 13:10:52.826315 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1037402449999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:10:52.826574 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1037402449999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 13:10:52.696102 23881 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:52.721419 23913 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.727825 23757 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.732632 21463 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:52.740592 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:52.879938 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 139429us
I20260709 13:10:52.880851 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:52.754287 22034 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:52.695457 23894 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:52.672956 23780 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:10:52.783031 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:52.680176 21462 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
W20260709 13:10:52.785099 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 77509.3us
I20260709 13:10:52.822110 21470 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:52.893565 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:52.786307 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:52.708002 23916 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.664451 23887 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:52.818928 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 817) took 1819 ms. Trace:
I20260709 13:10:52.722139 23872 raft_consensus.cc:2764] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:52.819911 21313 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:52.820315 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:52.822791 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.781136 23721 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.857784 23878 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:52.820094 23933 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.859493 23911 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:52.862906 23705 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:52.784444 23890 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.822121 23836 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:52.831187 23937 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:10:52.865449 21315 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:52.866362 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:52.928153 21312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.001s
W20260709 13:10:52.933518 21312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.009s	sys 0.001s
I20260709 13:10:52.902906 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:52.867357 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 325) took 3023 ms (client timeout 2066 ms). Trace:
I20260709 13:10:52.869371 23881 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:52.780920 23899 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.895435 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:52.820775 23763 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:52.941982 22034 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:52.935540 23747 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:52.944186 22034 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:52.944705 23747 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:52.945230 23747 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:52.946197 23747 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:52.947147 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 51817.3us
I20260709 13:10:52.948868 23695 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.821794 23915 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:52.949986 23757 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:52.950816 23757 consensus_queue.cc:1243] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:52.912144 23918 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:52.956653 23918 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:52.901228 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.958997 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.952692 23872 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:10:52.911965 23515 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:10:52.960369 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.961710 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.907817 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.934012 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:52.963586 21469 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:52.964495 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:52.964780 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 137817us
W20260709 13:10:52.965430 21285 leader_election.cc:336] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.652s (SENT)
I20260709 13:10:52.965895 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.966156 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1476) took 1515 ms. Trace:
I20260709 13:10:52.866505 23889 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:52.934626 21467 rpcz_store.cc:269] 0709 13:10:49.844165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.606040 (+1761875us) service_pool.cc:224] Handling call
0709 13:10:52.867118 (+1261078us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400216e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:52.867281 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662096640}
W20260709 13:10:52.935840 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 278188us
I20260709 13:10:52.937758 22036 rpcz_store.cc:276] 0709 13:10:50.999359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.492511 (+493152us) service_pool.cc:224] Handling call
0709 13:10:51.492889 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:51.493301 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.493330 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:51.493928 (+   598us) log.cc:844] Serialized 52 byte log entry
0709 13:10:51.771111 (+277183us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.771148 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.771211 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.436850 (+665639us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:52.818512 (+381662us) raft_consensus.cc:1685] finished
0709 13:10:52.818542 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.818841 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6944,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":210450176,"thread_start_us":276549,"threads_started":1,"wal-append.queue_time_us":343937}
I20260709 13:10:52.890836 23894 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:52.957607 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:52.890892 23755 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:52.967037 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0812402450000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:10:52.966572 21469 rpcz_store.cc:276] 0709 13:10:51.450512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.965342 (+1514830us) service_pool.cc:224] Handling call
0709 13:10:52.965597 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.965864 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.965891 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:52.965930 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:52.965959 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.966012 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.966106 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:52.989114 21285 leader_election.cc:336] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.736s (SENT)
I20260709 13:10:52.898406 21466 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
W20260709 13:10:52.990080 21285 leader_election.cc:336] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.753s (SENT)
I20260709 13:10:52.993392 22035 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:10:52.992524 21285 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.908s (SENT)
I20260709 13:10:52.999679 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:53.003439 21359 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.561s (SENT)
I20260709 13:10:53.003969 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:53.009150 21285 leader_election.cc:336] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.977s (SENT)
I20260709 13:10:53.009760 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:52.972462 23911 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:52.971376 23492 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:52.973798 23895 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:53.001332 23855 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.237s	user 0.011s	sys 0.001s
I20260709 13:10:53.017474 22039 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:53.012059 21465 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:53.020794 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0290402450000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 13:10:53.001968 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:53.062160 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1479) took 1610 ms. Trace:
I20260709 13:10:53.062542 21465 rpcz_store.cc:276] 0709 13:10:51.451281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.974184 (+1522903us) service_pool.cc:224] Handling call
0709 13:10:53.011787 (+ 37603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.061914 (+ 50127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.062102 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:53.062891 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 114403us
I20260709 13:10:53.065183 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:53.060999 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 153263us
W20260709 13:10:53.068204 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 187430us
I20260709 13:10:53.015368 23705 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:53.068810 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:53.070753 21434 leader_election.cc:400] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
I20260709 13:10:53.064358 23911 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:53.057013 23892 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.073588 21434 leader_election.cc:403] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.070251 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:53.151111 21389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:53.057358 23903 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:53.063126 23878 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.060904 23895 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:53.151773 21389 raft_consensus.cc:606] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:53.018632 23899 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.064921 23943 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.161139 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.065220 23855 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.172590 23899 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:53.164634 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.067385 23872 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:10:53.167009 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 205600us
W20260709 13:10:53.147179 23941 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:10:53.132164 23515 consensus_queue.cc:1243] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:53.174710 23887 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:53.162928 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.175763 23887 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:53.176301 23887 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:53.176926 23913 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.177224 23887 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.180377 23913 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:53.058992 23894 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.206491 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:53.206768 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 138769us
I20260709 13:10:53.158149 23908 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.207266 21396 raft_consensus.cc:2368] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8.
I20260709 13:10:53.156770 23780 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.207158 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.180799 23889 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:53.210485 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.212719 21396 raft_consensus.cc:2368] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:53.211530 21388 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.212484 21392 raft_consensus.cc:2376] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4. Re-sending same reply.
I20260709 13:10:53.213773 21390 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:53.216739 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:53.218888 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.218948 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:53.219623 21392 raft_consensus.cc:2368] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8.
I20260709 13:10:53.165660 23878 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.224888 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.152043 23919 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.229142 21396 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:53.229987 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.230464 21396 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.233990 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.234994 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.236071 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.244364 21396 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:53.245760 22036 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:53.251569 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 385) took 1543 ms. Trace:
I20260709 13:10:53.252941 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 372) took 3519 ms. Trace:
I20260709 13:10:53.214349 23954 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:53.156342 23892 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.264473 21466 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:53.154748 23918 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.266016 23872 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:53.266767 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59349.7us
I20260709 13:10:53.266893 23913 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
W20260709 13:10:53.272428 23942 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:10:53.321352 23954 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:53.277624 21463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 302) took 3440 ms (client timeout 2882 ms). Trace:
W20260709 13:10:53.322669 21463 rpcz_store.cc:269] 0709 13:10:49.837581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.633061 (+1795480us) service_pool.cc:224] Handling call
0709 13:10:53.277372 (+1644311us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000b8454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:53.277544 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2488506624}
I20260709 13:10:53.324966 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.325785 21387 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:53.205000 23911 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:53.266806 23940 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:10:53.214839 23908 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.283006 23879 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.288591 21467 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:53.331468 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:53.291263 23878 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:53.291744 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 221545us
W20260709 13:10:53.292284 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 90059.2us
I20260709 13:10:53.300889 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.302501 21388 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:53.306141 21395 rpcz_store.cc:276] 0709 13:10:51.708581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.709451 (+   870us) service_pool.cc:224] Handling call
0709 13:10:53.251292 (+1541841us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b540017edd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:53.251482 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559202176}
I20260709 13:10:53.306319 21393 rpcz_store.cc:276] 0709 13:10:49.733424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.415724 (+1682300us) service_pool.cc:224] Handling call
0709 13:10:51.416016 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.458603 (+1042587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.252627 (+794024us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54000f14d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:53.252859 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219530624}
I20260709 13:10:53.222810 23755 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:53.265434 23894 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.218581 23780 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:53.322526 23954 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:53.339272 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.340121 21392 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.330212 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.233536 23721 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:53.290119 23931 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
I20260709 13:10:53.334704 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:53.335389 21360 leader_election.cc:400] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:53.343712 21360 leader_election.cc:403] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.345048 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:53.338330 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.338315 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.341213 21387 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.350266 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:53.351401 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:53.353866 21392 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:53.354955 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:53.342087 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 104777us
I20260709 13:10:53.357466 23890 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.360944 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.338081 23913 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.325932 23872 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:53.355396 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:10:53.373245 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.374486 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:53.366777 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:53.376204 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:53.361810 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.360242 23920 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:53.367134 23955 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:10:53.339196 23747 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:53.368564 23916 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.369771 23913 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.365535 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:53.372362 21394 raft_consensus.cc:2376] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6. Re-sending same reply.
I20260709 13:10:53.338194 23911 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.378916 21387 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:53.353731 23943 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4.
I20260709 13:10:53.377674 21395 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:10:53.379653 22002 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.613s (SENT)
I20260709 13:10:53.344426 23954 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:53.380878 21392 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:10:53.361393 23878 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.394909 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:53.399150 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:53.399451 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:53.400689 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.401281 21395 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.412140 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:53.413491 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:53.414933 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:53.383527 23730 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:53.420193 21320 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:53.392174 23913 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.393702 23962 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:53.393183 23961 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.412715 23811 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.397511 23878 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.398707 23800 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:53.398850 23903 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.407980 23944 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:10:53.431298 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.383361 23809 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:53.418546 23671 raft_consensus.cc:2764] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:10:53.423630 23943 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:53.427234 23920 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:53.441263 21395 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:53.420254 23889 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:53.455212 23906 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.454767 23954 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.436868 23780 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:53.465742 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50880.5us
I20260709 13:10:53.437556 23800 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:53.436273 23903 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:10:53.450927 23891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.026s	sys 0.007s
I20260709 13:10:53.441833 23878 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.467082 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:53.468492 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:53.451483 23920 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:53.427727 23755 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:53.454704 23965 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:53.472159 23889 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:53.474022 23800 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.427654 23730 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.477736 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.478070 23890 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:53.479315 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 323) took 1279 ms. Trace:
I20260709 13:10:53.480185 23954 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.494127 23903 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.445912 23943 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:53.461933 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 327) took 1250 ms. Trace:
I20260709 13:10:53.495422 23780 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:53.495397 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:53.459007 23855 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:53.461091 23919 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:53.501194 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1698) took 1235 ms. Trace:
W20260709 13:10:53.494882 23891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.642s	user 0.027s	sys 0.007s
I20260709 13:10:53.506611 21392 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:53.506878 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.495469 22034 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:53.506635 22042 rpcz_store.cc:276] 0709 13:10:52.199952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.202450 (+  2498us) service_pool.cc:224] Handling call
0709 13:10:53.479088 (+1276638us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b54005c49d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:53.479242 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85242240}
I20260709 13:10:53.481011 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:53.519207 23925 consensus_queue.cc:765] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 4 is ahead of the local log (next sequential op: 4). Destination peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.452s
I20260709 13:10:53.520443 23872 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:53.498888 23920 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:53.502562 23921 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:53.524560 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:53.510500 23953 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:53.523166 23908 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:53.525835 22002 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.662s (SENT)
I20260709 13:10:53.633409 23953 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:10:53.634073 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 108282us
I20260709 13:10:53.634420 23953 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:53.634953 22002 leader_election.cc:336] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.747s (SENT)
I20260709 13:10:53.635463 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:53.516186 23892 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:53.636273 23869 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.523429 23943 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:53.636790 21316 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:53.514031 23945 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.247s
I20260709 13:10:53.638128 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:53.609747 23780 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:10:53.564410 23907 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:53.640087 21464 rpcz_store.cc:276] 0709 13:10:52.265733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.254710 (+988977us) service_pool.cc:224] Handling call
0709 13:10:53.299759 (+ 45049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.315277 (+ 15518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.315305 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.324597 (+  9292us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.381771 (+ 57174us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:53.500747 (+118976us) log.cc:844] Serialized 14 byte log entry
0709 13:10:53.500968 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.501025 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.501050 (+    25us) raft_consensus.cc:1685] finished
0709 13:10:53.501058 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.501149 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9900,"raft.queue_time_us":6123,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":19021,"thread_start_us":165126,"threads_started":2,"wal-append.queue_time_us":60820}
I20260709 13:10:53.577145 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:53.599619 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1477) took 2148 ms. Trace:
I20260709 13:10:53.643615 21467 rpcz_store.cc:276] 0709 13:10:51.450785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.971829 (+1521044us) service_pool.cc:224] Handling call
0709 13:10:52.972132 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.331811 (+359679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.599231 (+267420us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400216e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:53.599535 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727384960}
I20260709 13:10:53.644704 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:53.645207 21467 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.639703 23891 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:53.648900 23891 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.649031 23837 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:53.649418 23891 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.649518 23837 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:10:53.736794 22002 leader_election.cc:336] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.896s (SENT)
I20260709 13:10:53.506103 23958 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:53.628334 23968 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:10:53.573383 23969 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 13:10:53.581225 23973 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:10:53.781754 21467 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:53.782868 21467 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:53.641337 23780 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.609747 23730 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:53.605122 23916 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:53.747314 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:53.736475 23961 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:10:53.750291 23870 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.007s
I20260709 13:10:53.747804 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:53.783470 21469 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:53.775681 23892 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:53.786631 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1709) took 1050 ms. Trace:
I20260709 13:10:53.774750 23920 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.749526 23958 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:53.804461 23958 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:53.793881 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57112.2us
I20260709 13:10:53.806299 23920 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:53.806767 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:53.806403 23912 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:53.808660 23939 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.952s	user 0.000s	sys 0.002s
I20260709 13:10:53.808589 23912 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:53.809952 23912 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.810882 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1699) took 1544 ms. Trace:
I20260709 13:10:53.811288 21470 rpcz_store.cc:276] 0709 13:10:52.266059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.961458 (+695399us) service_pool.cc:224] Handling call
0709 13:10:53.810635 (+849177us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54002495d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:53.810782 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263096064}
I20260709 13:10:53.811736 23912 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.812645 21470 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:53.812867 21467 rpcz_store.cc:276] 0709 13:10:52.736499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.782458 (+1045959us) service_pool.cc:224] Handling call
0709 13:10:53.782735 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.786295 (+  3560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.786561 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.813350 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 347) took 1071 ms. Trace:
I20260709 13:10:53.814040 21470 rpcz_store.cc:276] 0709 13:10:52.741900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.812076 (+1070176us) service_pool.cc:224] Handling call
0709 13:10:53.812417 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.813103 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.813299 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.814843 23933 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:53.815284 23933 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:53.759824 23913 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.816125 23933 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.817379 23933 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.818189 23913 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:53.801455 21464 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:53.825810 23800 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.828716 23961 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.588667 23889 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:53.759564 23903 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:53.844317 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.002s (SENT)
I20260709 13:10:53.829783 23905 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:53.890209 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1489) took 1202 ms. Trace:
I20260709 13:10:54.489729 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:54.500730 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 656478us
I20260709 13:10:54.015926 21462 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:53.844504 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:53.820147 23870 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:54.026913 21284 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.941s (SENT)
W20260709 13:10:54.107376 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.500204 21463 rpcz_store.cc:276] 0709 13:10:52.687382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.324013 (+636631us) service_pool.cc:224] Handling call
0709 13:10:53.336685 (+ 12672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.343804 (+  7119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.343862 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.353899 (+ 10037us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.423863 (+ 69964us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:53.748329 (+324466us) log.cc:844] Serialized 14 byte log entry
0709 13:10:53.749152 (+   823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.749331 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.889924 (+140593us) raft_consensus.cc:1685] finished
0709 13:10:53.889950 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.890130 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":348250,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":3555,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":7782,"thread_start_us":333991,"threads_started":2,"wal-append.queue_time_us":65637}
I20260709 13:10:54.506378 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:53.889555 23869 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.018131 23705 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:54.560650 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 533777us
W20260709 13:10:54.133174 23984 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
I20260709 13:10:54.499835 23905 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:53.901590 23981 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:54.561554 23973 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.390s	user 0.000s	sys 0.008s
I20260709 13:10:53.872318 23878 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.571242 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1938) took 1846 ms. Trace:
I20260709 13:10:54.595723 21320 rpcz_store.cc:276] 0709 13:10:52.725283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.726716 (+  1433us) service_pool.cc:224] Handling call
0709 13:10:52.726993 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.420644 (+693651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.570991 (+1150347us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400088254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:54.571177 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584512896}
W20260709 13:10:54.572889 23988 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.740s	user 0.000s	sys 0.002s
I20260709 13:10:54.603500 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 836) took 1089 ms. Trace:
I20260709 13:10:54.603879 22042 rpcz_store.cc:276] 0709 13:10:53.514271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.566199 (+ 51928us) service_pool.cc:224] Handling call
0709 13:10:53.600591 (+ 34392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.601378 (+   787us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:53.601422 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.602128 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.784230 (+182102us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:53.784291 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.784393 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.603277 (+818884us) raft_consensus.cc:1685] finished
0709 13:10:54.603306 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.603442 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":181676,"threads_started":1,"wal-append.queue_time_us":230667}
I20260709 13:10:54.607437 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:53.829913 23892 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.518091 23954 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:54.537246 23887 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.518688 23894 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.560916 23916 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:54.572088 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 680) took 1846 ms. Trace:
I20260709 13:10:54.636926 22035 rpcz_store.cc:276] 0709 13:10:52.725231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.736754 (+ 11523us) service_pool.cc:224] Handling call
0709 13:10:54.571888 (+1835134us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54004696d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:54.572008 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234107776}
W20260709 13:10:54.637399 21436 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.035s	sys 0.044s
I20260709 13:10:54.597797 23905 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.574172 23869 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:53.522899 22031 rpcz_store.cc:276] 0709 13:10:52.207970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.357990 (+150020us) service_pool.cc:224] Handling call
0709 13:10:52.358364 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.358590 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.358625 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.359152 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.663341 (+304189us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:52.667559 (+  4218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.691243 (+ 23684us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.289509 (+598266us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:53.431113 (+141604us) raft_consensus.cc:1685] finished
0709 13:10:53.433876 (+  2763us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.458259 (+ 24383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2555136,"thread_start_us":293026,"threads_started":1,"wal-append.queue_time_us":364358,"wal-append.run_cpu_time_us":5455,"wal-append.run_wall_time_us":1715126}
I20260709 13:10:54.600693 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1477) took 1437 ms. Trace:
W20260709 13:10:54.602188 23943 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.964s	user 0.008s	sys 0.001s
I20260709 13:10:53.959591 23730 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:54.581887 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 333) took 1180 ms. Trace:
I20260709 13:10:54.609424 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 341) took 2347 ms. Trace:
I20260709 13:10:54.668903 21469 rpcz_store.cc:276] 0709 13:10:52.262219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.006361 (+744142us) service_pool.cc:224] Handling call
0709 13:10:53.006769 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.800880 (+794111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.609151 (+808271us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400025dd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:54.609360 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769382784}
I20260709 13:10:54.609465 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.580377 23705 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:54.615512 23958 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.810s	user 0.000s	sys 0.007s
W20260709 13:10:54.607976 23970 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.130s	user 0.000s	sys 0.019s
I20260709 13:10:54.679703 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:54.681141 22035 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.612779 23800 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:54.611689 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:54.682816 21314 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:54.610615 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.641914 23878 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:53.843382 23891 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:54.624701 21320 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:54.637926 21436 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.035s	sys 0.044s
I20260709 13:10:54.642874 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:54.697364 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 738955us
W20260709 13:10:54.699194 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.646675 21394 rpcz_store.cc:276] 0709 13:10:53.163579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.164329 (+   750us) service_pool.cc:224] Handling call
0709 13:10:54.600472 (+1436143us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54000f19d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:54.600618 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455612288}
I20260709 13:10:54.700888 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:54.701857 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 401) took 1090 ms. Trace:
I20260709 13:10:54.702242 21394 rpcz_store.cc:276] 0709 13:10:53.611423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.700576 (+1089153us) service_pool.cc:224] Handling call
0709 13:10:54.701787 (+  1211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.703344 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:54.649811 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49116 (request call id 18) took 1574 ms. Trace:
I20260709 13:10:54.704291 21389 rpcz_store.cc:276] 0709 13:10:53.075175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.081414 (+  6239us) service_pool.cc:224] Handling call
0709 13:10:54.649606 (+1568192us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4c00392600. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bd4e4a20 00007fc2bd4f5a29 00007fc2bd4bb644 00007fc2bd4e2f2d 00007fc2bd4e2b93 00007fc2bf212c92 00007fc2bf21284a 00007fc2c41e060a 00007fc2bd7667d4 00007fc2bd766762 00007fc2bd766691
0709 13:10:54.649741 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5343104}
I20260709 13:10:54.622036 23870 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:54.671674 22041 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:54.673831 21316 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:54.683998 21318 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:54.609887 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.660130 23903 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:54.708549 21394 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:54.670580 23905 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:54.710805 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1725) took 1186 ms. Trace:
I20260709 13:10:54.710184 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.711158 21394 rpcz_store.cc:276] 0709 13:10:53.524653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.703031 (+1178378us) service_pool.cc:224] Handling call
0709 13:10:54.710752 (+  7721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.707985 21312 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
W20260709 13:10:54.679101 23912 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.004s
W20260709 13:10:54.717175 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.147s (SENT) [suppressed 72 similar messages]
I20260709 13:10:54.715890 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:54.713662 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:54.730414 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.189s (SENT)
I20260709 13:10:54.734764 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.735425 21318 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:54.650426 23894 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:54.744940 22002 leader_election.cc:336] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.431s (SENT)
I20260709 13:10:54.745741 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:54.746122 21389 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:54.747376 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1489) took 1531 ms. Trace:
I20260709 13:10:54.729941 21316 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:54.747738 21314 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:54.748682 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.748987 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:54.750494 23989 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:54.747695 21389 rpcz_store.cc:276] 0709 13:10:53.215786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.705430 (+1489644us) service_pool.cc:224] Handling call
0709 13:10:54.736508 (+ 31078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.747090 (+ 10582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.747319 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.785003 21389 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:54.785740 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1718) took 1465 ms. Trace:
I20260709 13:10:54.786195 21389 rpcz_store.cc:276] 0709 13:10:53.320560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.784345 (+1463785us) service_pool.cc:224] Handling call
0709 13:10:54.784784 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.785465 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.785686 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.712600 23757 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.752646 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.789158 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1484) took 2115 ms. Trace:
I20260709 13:10:54.793824 21316 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:54.793954 21461 rpcz_store.cc:276] 0709 13:10:52.673987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.260748 (+586761us) service_pool.cc:224] Handling call
0709 13:10:53.277532 (+ 16784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.277922 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.277953 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.277998 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:53.278039 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.278110 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.788984 (+1510874us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54000b8450. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:54.789099 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":466,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"spinlock_wait_cycles":37645696}
I20260709 13:10:54.794699 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.641748 23887 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.756202 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:54.795770 21314 raft_consensus.cc:2376] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2. Re-sending same reply.
I20260709 13:10:54.796996 21314 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:54.667371 23943 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.667712 23954 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.810434 21389 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:54.810839 23954 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:54.811156 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1722) took 1489 ms. Trace:
I20260709 13:10:54.811424 23954 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:54.709333 23913 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.785777 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.812249 23757 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.813014 21318 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:54.814507 23757 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:54.815460 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 336) took 2564 ms. Trace:
I20260709 13:10:54.815899 21466 rpcz_store.cc:276] 0709 13:10:52.251409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.990045 (+738636us) service_pool.cc:224] Handling call
0709 13:10:52.990310 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.311685 (+321375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.815086 (+1503401us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54001a7cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:54.815386 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630064384}
I20260709 13:10:54.817049 23892 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:54.818456 22041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 683) took 2084 ms (client timeout 1551 ms). Trace:
W20260709 13:10:54.818974 22041 rpcz_store.cc:269] 0709 13:10:52.734083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.753676 (+ 19593us) service_pool.cc:224] Handling call
0709 13:10:54.818240 (+2064564us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b540069d054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:54.818371 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4085921024}
W20260709 13:10:54.819571 21997 leader_election.cc:336] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.077s (SENT)
I20260709 13:10:54.752286 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:54.820782 21315 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:54.812285 23913 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.822299 23891 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:54.822894 23913 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:54.824123 23894 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:54.826239 23705 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:54.826905 21320 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:10:54.800215 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1474) took 2985 ms. Trace:
W20260709 13:10:54.836417 21319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1932) took 2470 ms (client timeout 1551 ms). Trace:
W20260709 13:10:54.836829 21319 rpcz_store.cc:269] 0709 13:10:52.366354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.367160 (+   806us) service_pool.cc:224] Handling call
0709 13:10:54.836239 (+2469079us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b54003aedd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:54.836358 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64802688}
I20260709 13:10:54.836715 21391 rpcz_store.cc:276] 0709 13:10:51.814904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.369659 (+554755us) service_pool.cc:224] Handling call
0709 13:10:52.492369 (+122710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.659742 (+167373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.799973 (+2140231us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54002e3bd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:54.800145 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239172480}
I20260709 13:10:54.838635 21391 raft_consensus.cc:1217] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-3.3]   Dedup: 2.2->[3.3-3.3]
I20260709 13:10:54.838758 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 395) took 2525 ms. Trace:
I20260709 13:10:54.674319 23730 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:54.839670 23933 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.022s	user 0.009s	sys 0.002s
I20260709 13:10:54.839169 21390 rpcz_store.cc:276] 0709 13:10:52.313441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.386019 (+ 72578us) service_pool.cc:224] Handling call
0709 13:10:52.386398 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.217519 (+831121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.838546 (+1621027us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54002ce054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:54.838705 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896089856}
W20260709 13:10:54.840564 23938 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 2.015s	user 0.009s	sys 0.016s
I20260709 13:10:54.841037 23730 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:54.841322 23869 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:54.841584 21390 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:54.839110 21391 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:10:54.782781 23992 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:54.842203 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 402) took 1065 ms. Trace:
I20260709 13:10:54.832314 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1484) took 1620 ms. Trace:
I20260709 13:10:54.833825 21465 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:54.843940 23943 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:54.844254 21465 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:54.842674 21396 rpcz_store.cc:276] 0709 13:10:53.211989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.306136 (+ 94147us) service_pool.cc:224] Handling call
0709 13:10:53.306522 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:53.310090 (+  3568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.310136 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:53.311001 (+   865us) log.cc:844] Serialized 52 byte log entry
0709 13:10:53.429247 (+118246us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:53.447444 (+ 18197us) log.cc:844] Serialized 14 byte log entry
0709 13:10:53.447830 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.447893 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.607388 (+1159495us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:54.831979 (+224591us) raft_consensus.cc:1685] finished
0709 13:10:54.832101 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.832241 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3137,"prepare.queue_time_us":18178,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2619,"raft.queue_time_us":3431,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":6138,"spinlock_wait_cycles":49710720,"thread_start_us":88910,"threads_started":1,"wal-append.queue_time_us":146273}
I20260709 13:10:54.684500 23958 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.845064 21465 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.845958 21465 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.785341 23912 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:10:54.846958 23912 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:54.847344 23912 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:54.848218 23912 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.849571 23912 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:54.668577 22038 rpcz_store.cc:276] 0709 13:10:53.399354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.419897 (+ 20543us) service_pool.cc:224] Handling call
0709 13:10:53.452270 (+ 32373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.482591 (+ 30321us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:53.787543 (+304952us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.504538 (+716995us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.523236 (+ 18698us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:54.543349 (+ 20113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.559671 (+ 16322us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.579698 (+ 20027us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22506,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":465623,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":12081,"thread_start_us":907078,"threads_started":3,"wal-append.queue_time_us":946666}
I20260709 13:10:54.836194 22035 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:54.832118 23890 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.789001 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:54.853621 23890 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.854385 21312 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:54.842308 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1726) took 1199 ms. Trace:
I20260709 13:10:54.855100 21391 rpcz_store.cc:276] 0709 13:10:53.643198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.838103 (+1194905us) service_pool.cc:224] Handling call
0709 13:10:54.838469 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:54.842092 (+  3623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.842255 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.811524 21389 rpcz_store.cc:276] 0709 13:10:53.321586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.787093 (+1465507us) service_pool.cc:224] Handling call
0709 13:10:54.810254 (+ 23161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.810909 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.811093 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.835971 23721 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:54.854722 21318 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:54.856511 21390 rpcz_store.cc:276] 0709 13:10:53.777245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.840885 (+1063640us) service_pool.cc:224] Handling call
0709 13:10:54.841186 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.841984 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.842153 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.856950 21318 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:54.859570 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:54.858193 21318 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.861518 23574 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:54.862002 23574 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:54.862937 23574 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.834982 23887 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:54.852560 23895 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.869948 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:54.870644 23895 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.878327 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:54.879040 22038 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:10:54.882103 22035 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:54.882763 23687 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:54.883298 23687 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:54.884342 23687 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.885569 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:54.886698 23705 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:54.887092 23705 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:54.887524 23705 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.888883 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:54.890626 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.891150 21433 connection.cc:256] RPC call timeout handler was delayed by -1.2245416410000871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:10:54.890179 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:54.899919 21466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:10:54.900522 21466 raft_consensus.cc:606] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:54.900836 21466 raft_consensus.cc:614] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:54.899523 21465 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:10:54.901551 21465 pending_rounds.cc:85] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 2
I20260709 13:10:54.901837 21465 pending_rounds.cc:107] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:10:54.902148 21465 raft_consensus.cc:2889] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:54.903064 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1696) took 2638 ms. Trace:
I20260709 13:10:54.903494 21465 rpcz_store.cc:276] 0709 13:10:52.265044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.122119 (+857075us) service_pool.cc:224] Handling call
0709 13:10:53.154353 (+ 32234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.833731 (+1679378us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5400198320. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18fdc0 00007fc2bf21a1c0 00007fc2bf21b231 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c
0709 13:10:54.902770 (+ 69039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.903004 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47776000}
W20260709 13:10:54.910782 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.889109 23755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.367s	user 0.003s	sys 0.044s
W20260709 13:10:54.899304 23915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.417s	user 0.013s	sys 0.023s
W20260709 13:10:54.911942 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.911183 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:54.879108 23890 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:54.898957 23961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.012s	sys 0.030s
I20260709 13:10:54.906692 23472 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:54.906719 23889 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:10:54.911980 23932 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 13:10:54.972975 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.973848 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 348374us
I20260709 13:10:54.907471 23887 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:54.916621 23915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.013s	sys 0.023s
I20260709 13:10:54.910244 23869 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:10:54.910414 23730 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:10:54.910915 23892 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:10:54.910437 23992 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:54.966387 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:54.912905 23800 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:54.912868 23755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.390s	user 0.003s	sys 0.045s
I20260709 13:10:54.922744 23886 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.963081 23958 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:54.974977 23757 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:55.004303 23757 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:54.981005 23912 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.983498 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:54.961265 23780 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.992184 21390 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.922392 23943 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.993417 23992 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:54.990291 23705 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.981201 23894 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.999750 23886 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.000301 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1850) took 2648 ms. Trace:
I20260709 13:10:55.001053 23730 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:54.993567 23889 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:54.980688 21389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
W20260709 13:10:55.005636 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 206117us
W20260709 13:10:55.000316 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.008268 22040 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:54.921660 23961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.012s	sys 0.030s
W20260709 13:10:55.014477 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.089080 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 105667us
W20260709 13:10:55.011901 22002 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.540s (SENT)
W20260709 13:10:54.982332 23934 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 2.126s	user 0.003s	sys 0.020s
I20260709 13:10:54.961534 23472 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.009299 23887 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:10:55.099792 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 178012us
I20260709 13:10:55.094116 23947 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.110260 21313 rpcz_store.cc:276] 0709 13:10:52.351973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.352101 (+   128us) service_pool.cc:224] Handling call
0709 13:10:52.377635 (+ 25534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.939931 (+562296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.000063 (+2060132us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b540021b1d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:55.000234 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016557312}
I20260709 13:10:55.112551 23574 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:55.120867 21319 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:55.114328 21389 raft_consensus.cc:606] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:55.126530 21465 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:55.136322 21389 raft_consensus.cc:614] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:55.124733 21466 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.125545 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.121665 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:55.125730 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.006735 23800 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.096415 23905 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.135027 21316 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:55.137315 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:55.137338 21314 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:55.140120 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:55.078050 23912 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.145969 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:55.148572 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 136716us
I20260709 13:10:55.148687 21319 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:55.148078 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:10:55.150043 22002 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.765s (SENT)
I20260709 13:10:55.152454 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:55.153412 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:55.154018 21467 raft_consensus.cc:2376] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6. Re-sending same reply.
I20260709 13:10:55.157295 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:55.158368 21392 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:55.159482 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.101538 23992 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:55.166908 21314 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:55.168143 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:55.169304 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:55.170408 21470 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:55.172075 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:55.172890 21320 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.174659 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.175005 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:55.113977 23913 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:55.113749 23730 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:55.175688 21315 raft_consensus.cc:2376] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7. Re-sending same reply.
I20260709 13:10:55.175375 21391 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
W20260709 13:10:55.183280 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57806.1us
I20260709 13:10:55.183528 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.184203 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.096611 23780 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.189436 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:55.147771 23953 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.208247 23953 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.210369 23953 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.211844 23705 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.213354 21320 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:55.214315 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:55.214941 21320 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:55.186012 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:55.197168 21392 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:55.110265 23943 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.197093 21469 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:55.200620 23730 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.202003 24019 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:55.203711 23472 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.204183 23837 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.217743 24019 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.205505 23800 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:55.218173 23837 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.186789 23574 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:55.185915 23836 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:10:55.220753 23574 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.174754 23951 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:55.206261 24007 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:55.223901 24007 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.224818 23943 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:55.226991 21321 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.224843 21314 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:10:55.229243 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:55.233600 21319 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:55.224298 21392 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:55.148018 23921 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:55.113415 23894 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.246417 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.246613 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1846) took 2993 ms. Trace:
I20260709 13:10:55.248719 21392 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:55.249014 21317 rpcz_store.cc:276] 0709 13:10:52.253680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.256698 (+  3018us) service_pool.cc:224] Handling call
0709 13:10:52.256998 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.296372 (+ 39374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.296425 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.308446 (+ 12021us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.700829 (+392383us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:52.700891 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.700990 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.981785 (+2280795us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:55.226612 (+244827us) raft_consensus.cc:1685] finished
0709 13:10:55.226632 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.246539 (+ 19907us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61415,"raft.queue_time_us":43842,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":2356,"spinlock_wait_cycles":4155264,"thread_start_us":354402,"threads_started":1,"wal-append.queue_time_us":491396}
I20260709 13:10:55.246063 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:55.198347 23913 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.253176 23913 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.196300 23892 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:55.256767 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.255904 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:55.258800 21465 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:55.264559 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.227643 23898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.362s	user 0.018s	sys 0.026s
I20260709 13:10:55.266367 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 403) took 1158 ms. Trace:
I20260709 13:10:55.266921 21396 rpcz_store.cc:276] 0709 13:10:54.107814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.845078 (+737264us) service_pool.cc:224] Handling call
0709 13:10:54.845374 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.845544 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:55.097109 (+251565us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.265769 (+168660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:55.265919 (+   150us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:55.266074 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.266143 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.266295 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4515,"prepare.queue_time_us":15568,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":4642,"thread_start_us":411550,"threads_started":2}
I20260709 13:10:55.268419 21391 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
W20260709 13:10:55.272897 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 176914us
W20260709 13:10:55.282657 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 137619us
W20260709 13:10:55.285014 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 100881us
I20260709 13:10:55.289206 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.290577 21285 leader_election.cc:400] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8.
I20260709 13:10:55.291659 21285 leader_election.cc:403] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:55.291108 24028 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.292683 24005 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8.
I20260709 13:10:55.153831 23905 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.294934 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:55.298619 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:55.270705 23898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.405s	user 0.021s	sys 0.026s
W20260709 13:10:55.305116 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 149924us
I20260709 13:10:55.302886 21285 leader_election.cc:400] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:55.147533 23947 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.310989 21392 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:55.306420 21285 leader_election.cc:403] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:55.306895 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:55.304808 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:55.312100 21320 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:55.276530 23705 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.297701 24019 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:55.324810 21465 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:55.326625 21312 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.256171 24004 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:55.332409 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:55.335047 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 686) took 2600 ms. Trace:
I20260709 13:10:55.335515 24005 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 3. Current term is 4.
I20260709 13:10:55.336098 23894 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:55.338007 23947 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:55.226420 24001 consensus_queue.cc:1175] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33be1cb5cfc143fc90e164888c96cc6f" responder_term: 6 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:55.339509 21396 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:55.271631 23921 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.342139 23687 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:55.343461 23921 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.347733 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:55.348188 23870 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:55.348675 21468 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:55.214318 23887 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.349695 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.350831 21320 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:55.356062 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.375305 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 72608.9us
I20260709 13:10:55.381428 21285 leader_election.cc:400] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8.
I20260709 13:10:55.382809 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.398099 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:55.400309 21312 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:55.305405 23945 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:10:55.407271 22035 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:55.407472 21320 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:55.416903 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.400878 23895 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:55.418236 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 118478us
W20260709 13:10:55.419492 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 116997us
I20260709 13:10:55.419441 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:55.402609 24005 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:55.375891 24020 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.404724 23859 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.435084 21390 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:55.429957 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:55.426645 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:55.436501 21465 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:55.437074 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.429216 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:55.437479 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.432776 24019 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.335633 22034 rpcz_store.cc:276] 0709 13:10:52.734956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.946047 (+211091us) service_pool.cc:224] Handling call
0709 13:10:53.492293 (+546246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.572434 (+ 80141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.315232 (+1742798us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54005c49d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:55.334942 (+ 19710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231945088}
I20260709 13:10:55.449379 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:55.450412 21465 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:55.450675 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:55.451342 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:55.451901 21465 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:55.451824 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:55.348685 23870 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.453084 23886 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.453233 24028 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:55.453475 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:55.454125 24028 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:55.454509 24028 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:55.454630 23870 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:55.432339 23894 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.431227 23707 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:55.455331 23894 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.455888 23707 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:55.437937 21394 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:55.437996 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.456905 23707 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.458201 21436 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:55.459015 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:55.459803 23953 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:55.460278 23953 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:55.460785 23472 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:55.461200 23953 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.462190 23905 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.435086 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:55.463973 22031 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.464723 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:55.461233 23472 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.465618 23472 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:55.465502 23574 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:55.418699 24004 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:55.439118 21388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 397) took 2418 ms (client timeout 2103 ms). Trace:
I20260709 13:10:55.442845 23888 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.443310 23837 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:55.443781 24012 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:10:55.418221 24015 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:55.434388 24020 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.426086 24005 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:55.445113 24026 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:55.445668 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:55.446667 24021 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:10:55.477523 23888 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.486377 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1931) took 3120 ms. Trace:
I20260709 13:10:55.486790 21321 rpcz_store.cc:276] 0709 13:10:52.366016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.368833 (+  2817us) service_pool.cc:224] Handling call
0709 13:10:55.226833 (+2858000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.227388 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.486173 (+258785us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b54000fb750. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:55.486318 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6529776384}
I20260709 13:10:55.488003 23730 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.488096 23888 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:55.452296 24029 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.489418 24029 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.490267 23990 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:55.490664 23990 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:55.401589 23921 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:55.492292 23921 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.454897 22034 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:55.496511 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:55.497390 22034 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:55.498306 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:55.500620 24006 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.592s	user 0.002s	sys 0.005s
I20260709 13:10:55.501874 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 400) took 2056 ms. Trace:
I20260709 13:10:55.502004 24015 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:55.502471 24015 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:55.459089 23894 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:55.455351 23992 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.505545 23992 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:55.440632 21390 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.508234 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.508934 21390 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:55.509956 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.511090 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.440582 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.513398 21389 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:55.466938 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:10:55.513901 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47077.2us
I20260709 13:10:55.514554 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:55.492898 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:55.467500 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.515806 21461 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:55.471458 21388 rpcz_store.cc:269] 0709 13:10:53.016080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.052566 (+ 36486us) service_pool.cc:224] Handling call
0709 13:10:55.434398 (+2381832us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000acdd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:55.434504 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333956352}
I20260709 13:10:55.426349 24024 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:55.469749 23892 raft_consensus.cc:2764] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:10:55.466845 24007 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.503376 24015 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.442232 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:55.491732 24029 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:55.499462 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:55.502254 21387 rpcz_store.cc:276] 0709 13:10:53.445643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.791370 (+1345727us) service_pool.cc:224] Handling call
0709 13:10:54.791761 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.795385 (+  3624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.795417 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.795940 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.909866 (+113926us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:54.909929 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.910031 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.481194 (+571163us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:55.501521 (+ 20327us) raft_consensus.cc:1685] finished
0709 13:10:55.501547 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.501795 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17736,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":4111744,"thread_start_us":100070,"threads_started":1,"wal-append.queue_time_us":99172}
I20260709 13:10:55.532909 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.521159 21389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:55.488552 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.448172 24019 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.527752 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.438863 23859 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.512018 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:55.533329 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:55.571507 21461 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:55.572407 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:55.572618 23995 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:55.554855 21395 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:55.533257 23992 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:10:55.519757 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:55.559273 23755 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:55.559847 23870 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.532982 23894 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:10:55.556854 24019 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.566571 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:55.575838 23870 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.577661 22041 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:55.578336 23870 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:55.579005 22041 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:55.579658 24019 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:55.580015 24019 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:55.554417 21389 raft_consensus.cc:606] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:55.580847 24019 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.582067 23945 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.582350 23889 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.528414 21465 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:10:55.582617 23945 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.584388 23886 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:55.584991 23886 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:55.585937 23886 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:55.584395 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 142259us
I20260709 13:10:55.524281 23891 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:55.572679 21387 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:55.591091 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.583853 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:55.605232 21465 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:55.528596 23913 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:55.519309 24026 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:55.596333 22041 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:55.481737 23916 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
W20260709 13:10:55.613952 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.491473 23990 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.626377 21461 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:55.519850 22038 raft_consensus.cc:2376] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7. Re-sending same reply.
I20260709 13:10:55.628602 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:55.629678 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 163592us
W20260709 13:10:55.636142 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 84465.9us
W20260709 13:10:55.640467 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.642040 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.562645 24007 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:10:55.606906 23891 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:55.631788 23809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.169s	user 0.015s	sys 0.020s
I20260709 13:10:55.650972 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.455343 24028 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:55.654969 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 187570us
I20260709 13:10:55.552145 24034 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:10:55.631856 23913 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:10:55.666405 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 150819us
I20260709 13:10:55.633922 24015 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.649982 23990 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.658567 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.668174 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.639808 24044 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:55.664014 23809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.198s	user 0.016s	sys 0.020s
I20260709 13:10:55.657801 23916 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:55.657370 23891 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.695530 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:55.634068 23892 consensus_queue.cc:1175] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d41c71e861344f0b90e8d44a8d0a3173" responder_term: 4 status { last_received { term: 2 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:55.688337 23574 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:55.669934 23905 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.688657 24044 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:55.709067 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:55.698765 23915 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.701140 24028 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:55.698380 23916 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:55.700645 24007 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:55.707507 23905 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.702034 23721 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:10:55.719455 23995 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:55.749313 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.724292 23921 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:55.726111 24034 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.728912 23916 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.714907 23763 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:55.761363 23763 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:55.729557 24038 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:55.606429 24005 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:55.786034 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 97285.2us
I20260709 13:10:55.753331 23995 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.727283 23915 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:55.797633 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 102226us
I20260709 13:10:55.791817 23695 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.801141 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.698313 24026 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.768347 23859 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:55.792101 23995 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:55.787118 23574 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:55.764526 23889 consensus_queue.cc:1175] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "058db415e9884ea0ba23f1e1ff59127a" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: [5.6-5.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:55.811748 24005 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.775364 24034 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.739064 23913 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:10:55.885452 24049 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:10:55.777874 24044 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.891245 24038 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:55.892421 24038 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.894932 24044 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:55.895965 24034 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:55.899689 23995 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:55.947232 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:55.950425 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:55.954612 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:55.955286 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.981386 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.001881 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 200676us
I20260709 13:10:56.004873 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:56.007177 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.012718 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.014381 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.013119 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.025944 23574 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:56.054831 23472 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.006s
I20260709 13:10:56.055274 23995 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:56.057453 23905 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.057547 24053 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:56.059398 24058 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:56.051707 23921 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.061035 23921 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.064519 24058 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:56.065384 24058 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.065536 23859 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:56.069152 23921 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.078840 23915 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.080084 23953 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:56.081378 24034 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.084596 23707 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:56.086006 23707 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:56.086514 23707 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:10:56.082177 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 54205.4us
I20260709 13:10:55.890177 23945 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.091118 24044 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.091915 24048 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:55.806614 23695 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.092485 24048 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:56.093073 24048 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.055534 23472 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.080549 24007 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:56.096189 24007 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.096652 24007 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:56.100698 21465 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:56.102536 23891 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.103881 23472 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:56.105111 23891 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:56.111261 24040 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:56.114539 23687 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.771s	user 0.015s	sys 0.000s
I20260709 13:10:56.115643 24055 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.116343 24055 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.114529 24007 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.118561 24040 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.120317 21318 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.121207 24007 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:56.126142 24040 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.128491 23707 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.130129 23707 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:56.132509 22031 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.011s
I20260709 13:10:56.133074 22031 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:56.134706 21389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:10:56.137039 21389 raft_consensus.cc:606] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:56.137606 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1697) took 3872 ms. Trace:
I20260709 13:10:56.137944 21389 raft_consensus.cc:614] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:56.138162 21468 rpcz_store.cc:276] 0709 13:10:52.265343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.246340 (+980997us) service_pool.cc:224] Handling call
0709 13:10:53.304701 (+ 58361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.349056 (+2044355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.136831 (+787775us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b5400259c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:56.137244 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4700039040}
I20260709 13:10:56.141191 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:56.141573 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:56.144840 21468 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:56.146740 21396 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:10:56.147503 23837 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.670s	user 0.006s	sys 0.011s
I20260709 13:10:56.148159 23837 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.153172 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.147503 22032 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:56.165309 24048 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:56.159901 22036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 334) took 2642 ms (client timeout 2037 ms). Trace:
W20260709 13:10:56.170296 22036 rpcz_store.cc:269] 0709 13:10:53.517112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.524709 (+  7597us) service_pool.cc:224] Handling call
0709 13:10:56.159405 (+2634696us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54005221d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:56.159639 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3433304832}
I20260709 13:10:56.171505 24048 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.166767 23747 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:56.171399 23780 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.177403 23757 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:56.179780 23730 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.008s
W20260709 13:10:56.188362 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 76479.9us
I20260709 13:10:56.189615 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1950) took 1474 ms. Trace:
I20260709 13:10:56.190043 21318 rpcz_store.cc:276] 0709 13:10:54.715315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.813663 (+ 98348us) service_pool.cc:224] Handling call
0709 13:10:54.813993 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.854625 (+ 40632us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5400532620. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18fdc0 00007fc2bf21a1c0 00007fc2bf21b231 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c
0709 13:10:56.119468 (+1264843us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b58005657d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4
0709 13:10:56.188737 (+ 69269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.188770 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.188955 (+   185us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:56.189015 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.189258 (+   243us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.189487 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2340,"spinlock_wait_cycles":348179968}
I20260709 13:10:56.193356 21468 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:10:56.198078 22042 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:56.201507 21387 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:56.183274 23747 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:10:56.203861 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 196988us
I20260709 13:10:56.182456 23912 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.206831 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1722) took 1057 ms. Trace:
I20260709 13:10:56.207299 21468 rpcz_store.cc:276] 0709 13:10:55.139453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.140923 (+1001470us) service_pool.cc:224] Handling call
0709 13:10:56.196322 (+ 55399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.209131 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:56.210089 21468 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:56.210811 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1719) took 1072 ms. Trace:
I20260709 13:10:56.211211 21468 rpcz_store.cc:276] 0709 13:10:55.138744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.208688 (+1069944us) service_pool.cc:224] Handling call
0709 13:10:56.210726 (+  2038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.212387 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:56.213121 21468 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.213016 24058 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:56.215919 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.216464 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:56.217938 24058 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.219581 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.218705 24058 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:56.221583 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.221845 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.223121 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.224275 22032 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:56.223250 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.225585 22039 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:56.231608 23695 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.237090 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:56.238332 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.238546 23917 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:56.238543 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:56.239521 23917 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:56.240865 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1858) took 1120 ms. Trace:
I20260709 13:10:56.241489 21316 rpcz_store.cc:276] 0709 13:10:55.120389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.121891 (+  1502us) service_pool.cc:224] Handling call
0709 13:10:55.122233 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.141418 (+ 19185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.240071 (+1098653us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b540021a7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:56.240592 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28859776}
I20260709 13:10:56.240677 24047 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:56.244644 24047 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.245031 24047 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:56.246054 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.247112 22039 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:56.241300 23917 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.249926 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:56.250697 21463 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:56.251426 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 351) took 1108 ms. Trace:
I20260709 13:10:56.251039 23947 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:56.253273 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1715) took 1117 ms. Trace:
I20260709 13:10:56.253700 21464 rpcz_store.cc:276] 0709 13:10:55.135761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.135944 (+   183us) service_pool.cc:224] Handling call
0709 13:10:55.171495 (+ 35551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.377191 (+205696us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:55.593421 (+216230us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.699731 (+106310us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.700453 (+   722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:55.700507 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:55.700560 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.208880 (+508320us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b180000d8a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:10:56.252810 (+ 43930us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400249fd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:56.252867 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.253086 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5059,"prepare.queue_time_us":189420,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":16771,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":16489,"spinlock_wait_cycles":505041024,"thread_start_us":277418,"threads_started":2,"wal-append.queue_time_us":135737}
I20260709 13:10:56.232618 21468 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:56.242390 23721 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:10:56.258780 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:56.259171 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:56.259691 21464 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:56.260067 21470 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:10:56.241433 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:56.265918 21465 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:56.267298 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:56.231129 23916 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.251775 21463 rpcz_store.cc:276] 0709 13:10:55.143385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.249315 (+1105930us) service_pool.cc:224] Handling call
0709 13:10:56.251361 (+  2046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.257443 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 355) took 1113 ms. Trace:
I20260709 13:10:56.269025 21468 rpcz_store.cc:276] 0709 13:10:55.144371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.211962 (+1067591us) service_pool.cc:224] Handling call
0709 13:10:56.257377 (+ 45415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.261250 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:56.274464 24066 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:10:56.275765 23730 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:56.276646 24046 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.003s
I20260709 13:10:56.279470 21464 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:56.282559 23721 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:10:56.287874 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:56.288959 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 354) took 1144 ms. Trace:
I20260709 13:10:56.289364 21463 rpcz_store.cc:276] 0709 13:10:55.144139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.268630 (+1124491us) service_pool.cc:224] Handling call
0709 13:10:56.288892 (+ 20262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.290854 21463 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:56.291580 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1727) took 1145 ms. Trace:
I20260709 13:10:56.293265 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:56.293993 22031 raft_consensus.cc:2376] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4. Re-sending same reply.
I20260709 13:10:56.288069 23721 consensus_queue.cc:1243] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:56.297621 23933 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:56.298156 23933 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:56.301395 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:56.303485 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:56.304368 21468 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:56.291935 21463 rpcz_store.cc:276] 0709 13:10:55.146421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.290117 (+1143696us) service_pool.cc:224] Handling call
0709 13:10:56.290602 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.291293 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.291498 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.308789 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.312472 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:56.313844 21468 raft_consensus.cc:2368] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:10:56.282637 23695 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:56.318778 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:56.322468 24019 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.326989 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.329290 24030 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:56.339259 24068 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:10:56.346144 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:56.354316 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:56.355103 21387 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:56.356295 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:56.355159 23874 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.353588 21464 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:56.344342 24030 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:56.363902 23874 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.362974 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 690) took 1016 ms. Trace:
I20260709 13:10:56.364377 24017 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.365513 22042 rpcz_store.cc:276] 0709 13:10:55.346947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.347483 (+   536us) service_pool.cc:224] Handling call
0709 13:10:56.362781 (+1015298us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b540048b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:56.362921 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924695296}
I20260709 13:10:56.364624 24030 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.362792 23833 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:56.376564 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 58053.7us
I20260709 13:10:56.299248 23933 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.383841 23721 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:56.393847 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:56.405941 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1726) took 1258 ms. Trace:
I20260709 13:10:56.405495 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:56.406414 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:56.408944 21463 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:56.391994 24030 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:56.430495 23874 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:56.434026 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.435190 23916 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.393386 23833 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:56.436611 23933 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.422749 24055 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.439031 24039 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:56.441303 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44859.7us
I20260709 13:10:56.392957 23960 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:56.407131 21465 rpcz_store.cc:276] 0709 13:10:55.140444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.283047 (+1142603us) service_pool.cc:224] Handling call
0709 13:10:56.346975 (+ 63928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.393090 (+ 46115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.393134 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.398117 (+  4983us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:56.398175 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.398251 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.398405 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.462131 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:56.471984 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 72472.5us
I20260709 13:10:56.473558 23721 raft_consensus.cc:2764] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:10:56.475638 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 345) took 3734 ms (client timeout 2077 ms). Trace:
W20260709 13:10:56.476214 21462 rpcz_store.cc:269] 0709 13:10:52.741258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.930429 (+189171us) service_pool.cc:224] Handling call
0709 13:10:56.470932 (+3540503us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540025ba54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:56.475415 (+  4483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548538240}
I20260709 13:10:56.476428 23898 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:56.477561 23898 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:56.475569 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 98895.9us
I20260709 13:10:56.477494 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:56.480154 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.481950 21462 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:56.485049 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:56.480139 23960 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:56.488624 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:56.486928 24017 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.467137 24039 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:10:56.496227 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.500816 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.494659 24055 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.507962 21462 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:56.510054 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1737) took 1060 ms. Trace:
I20260709 13:10:56.510615 21390 rpcz_store.cc:276] 0709 13:10:55.440264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.511816 (+ 71552us) service_pool.cc:224] Handling call
0709 13:10:56.494947 (+983131us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54000ac3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:56.500803 (+  5856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248414976}
I20260709 13:10:56.512351 23809 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:56.491976 24017 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.517094 21465 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:56.515846 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 50618.8us
I20260709 13:10:56.521193 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.524508 23932 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.525489 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:56.525993 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:56.526773 21316 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
W20260709 13:10:56.514536 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.651s (SENT)
I20260709 13:10:56.512531 23960 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.538214 23932 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.538379 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:56.540139 21463 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:56.553181 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.562142 21465 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:56.562889 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 63824.9us
W20260709 13:10:56.556277 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 75292.8us
W20260709 13:10:56.564729 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.521466 24047 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.568487 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:56.569321 21315 raft_consensus.cc:2376] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3. Re-sending same reply.
I20260709 13:10:56.578338 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:56.596930 21316 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:56.577788 23833 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.597986 21433 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.550397 23916 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.513041 23809 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:56.572542 24070 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:56.603612 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:56.608685 21318 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:10:56.535181 24055 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.613629 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:56.621546 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:56.617532 21465 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:56.549669 23932 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.641870 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:56.627523 24074 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:56.629769 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:56.643824 21318 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:56.632838 21315 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:10:56.632143 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:56.633431 24055 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:56.624065 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:56.634840 24047 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.637432 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:56.637652 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:56.637876 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:56.639082 21321 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:56.639514 21312 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:56.639768 24044 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.639912 24053 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:56.558535 24039 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.633049 24017 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.663216 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:56.664741 24055 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.665766 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:56.667065 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:56.669009 22002 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.691s (SENT)
I20260709 13:10:56.669543 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.670756 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:56.672583 21314 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:56.673527 21390 raft_consensus.cc:2376] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5. Re-sending same reply.
I20260709 13:10:56.649505 23916 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.677356 21321 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:56.678943 24044 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.681551 24044 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.681902 23878 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.682183 24053 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.682483 23878 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.645953 21464 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:10:56.649152 22042 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:10:56.650223 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 52319.8us
I20260709 13:10:56.716806 21313 raft_consensus.cc:2376] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7. Re-sending same reply.
I20260709 13:10:56.702750 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:56.725786 23878 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:56.728135 21395 raft_consensus.cc:2376] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7. Re-sending same reply.
I20260709 13:10:56.728595 21319 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:10:56.730993 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61998.8us
I20260709 13:10:56.736981 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:56.745388 21464 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:56.734711 21390 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:56.740697 23916 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:56.764070 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 61384.5us
I20260709 13:10:56.764930 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.765626 21396 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:56.766224 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.766934 21396 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:56.767405 23933 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:56.768750 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 131401us
I20260709 13:10:56.769229 23809 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.769476 24029 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:56.769721 23730 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:56.770059 24029 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:56.770331 23730 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.771137 24029 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.772204 23912 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.772346 23887 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.773334 23385 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.773660 24053 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.774053 23385 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.773988 23878 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.759377 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.780416 22042 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:10:56.749938 21387 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:56.767807 23933 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.797874 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.774677 23385 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.810949 21315 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:56.823024 21465 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:56.811930 21320 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
W20260709 13:10:56.823628 22002 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.926s (SENT)
I20260709 13:10:56.777467 23917 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:56.832139 22040 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:56.806689 23933 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:56.837117 21464 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:10:56.835227 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:56.837647 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:56.841240 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:56.844906 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47028us
W20260709 13:10:56.847544 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51571.5us
I20260709 13:10:56.847832 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.848515 22042 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:56.837592 21464 pending_rounds.cc:85] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 5
I20260709 13:10:56.851176 21465 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:56.861553 21396 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:56.851531 21465 pending_rounds.cc:85] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 1
I20260709 13:10:56.864667 21388 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:56.860441 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:56.774832 23878 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:56.809146 23916 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:56.850862 21464 pending_rounds.cc:107] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:10:56.862708 21465 pending_rounds.cc:107] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:56.898520 21464 raft_consensus.cc:2889] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.898659 21465 raft_consensus.cc:2889] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.874294 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:56.872642 21395 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:56.877643 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:56.878520 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:56.879159 24028 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:56.882187 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 1.1845e+06us
W20260709 13:10:56.883092 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 353) took 1739 ms (client timeout 2065 ms). Trace:
I20260709 13:10:56.884604 23903 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:56.885424 23385 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.887851 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1713) took 3568 ms. Trace:
I20260709 13:10:56.888674 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:56.889869 23878 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:56.809342 24048 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:10:56.847538 23809 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:56.901484 21391 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:56.908839 21389 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:56.868644 23730 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:56.914256 24078 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
I20260709 13:10:56.924333 23990 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:56.915211 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:56.895931 24039 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:56.925034 24020 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:56.925535 24043 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:56.926105 23951 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:56.932547 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.933102 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:57.006073 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 407) took 1763 ms. Trace:
I20260709 13:10:57.005931 23951 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.006520 21392 rpcz_store.cc:276] 0709 13:10:55.242563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.250321 (+  7758us) service_pool.cc:224] Handling call
0709 13:10:55.250543 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.311485 (+ 60942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.005573 (+1694088us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b5400405954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:57.005908 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138207616}
I20260709 13:10:56.867651 23917 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:57.008550 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1720) took 1869 ms (client timeout 2028 ms). Trace:
W20260709 13:10:57.009066 21467 rpcz_store.cc:269] 0709 13:10:55.138969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.519507 (+380538us) service_pool.cc:224] Handling call
0709 13:10:57.008146 (+1488639us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54004358d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:57.008365 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356671360}
I20260709 13:10:57.009548 23917 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:56.955050 21461 rpcz_store.cc:269] 0709 13:10:55.143882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.572136 (+428254us) service_pool.cc:224] Handling call
0709 13:10:56.882766 (+1310630us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b54000b8954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:56.882920 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122736512}
W20260709 13:10:56.961594 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 72995us
W20260709 13:10:57.006107 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.012262 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.016173 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.091s (SENT)
I20260709 13:10:57.016796 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:56.961879 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:56.917450 24030 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:10:56.965878 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 88307.4us
I20260709 13:10:56.973356 23886 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:56.965739 24044 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:56.973740 23888 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.041s	sys 0.043s
I20260709 13:10:56.956346 21394 rpcz_store.cc:276] 0709 13:10:53.318904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.711829 (+1392925us) service_pool.cc:224] Handling call
0709 13:10:55.436169 (+724340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.457319 (+ 21150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.887477 (+1430158us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54000acdd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:56.887673 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665134976}
I20260709 13:10:56.919581 24028 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:56.977416 23990 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.004380 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.004223 23903 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.006372 21395 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:56.936615 21465 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:10:57.019465 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.021101 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 153232us
I20260709 13:10:57.010664 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1713) took 1882 ms. Trace:
W20260709 13:10:57.024756 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.943997 23916 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.027287 22042 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:57.032573 21469 rpcz_store.cc:276] 0709 13:10:55.128159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.128280 (+   121us) service_pool.cc:224] Handling call
0709 13:10:55.128559 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.217029 (+ 88470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.010234 (+1793205us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b5400216454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:57.010504 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156815104}
I20260709 13:10:57.035012 22039 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:10:57.023784 23888 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.041s	sys 0.044s
I20260709 13:10:57.020525 23886 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.031052 23990 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.023541 24044 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.025980 23878 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.038062 23870 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:57.024955 23932 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:57.023689 23951 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:56.979043 23809 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.061851 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:57.066445 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:57.068357 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 89643.1us
I20260709 13:10:57.069284 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:57.070367 22002 leader_election.cc:336] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.147s (SENT)
I20260709 13:10:57.070493 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.070827 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:57.071202 21321 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:57.072081 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.072343 23730 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:57.068423 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.073503 24028 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:57.075634 23903 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:57.076122 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.076570 24004 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:57.077078 24004 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:57.077370 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.078734 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.078347 24004 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.083406 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.086359 21318 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:10:57.092384 23916 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.096479 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:57.050921 23886 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.096510 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.056787 24044 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.057981 23878 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.113054 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 356) took 1961 ms. Trace:
I20260709 13:10:57.034499 24043 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.101596 24004 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.113641 21470 rpcz_store.cc:276] 0709 13:10:55.144600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.284479 (+1139879us) service_pool.cc:224] Handling call
0709 13:10:56.360302 (+ 75823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.360828 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.360870 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.375325 (+ 14455us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.467984 (+ 92659us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:56.468050 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.468124 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.105653 (+637529us) raft_consensus.cc:1685] finished
0709 13:10:57.105680 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.105845 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":173,"thread_start_us":77204,"threads_started":1,"wal-append.queue_time_us":135679}
I20260709 13:10:57.108843 23878 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.214735 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.030850 23747 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.225914 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:57.227865 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:57.229477 21321 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.232131 21317 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:57.232357 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:57.232738 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 182781us
I20260709 13:10:57.233163 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.233568 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:57.233711 21316 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.234278 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.234810 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:57.235550 23385 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.236750 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:57.242847 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:57.244104 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.244913 21320 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:57.235955 23385 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:57.232435 23943 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:57.257679 24043 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.263559 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:57.264483 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:57.265568 21392 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:57.266217 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:57.268567 21387 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:57.271903 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.275910 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.281061 21470 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:57.217003 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:57.239655 23944 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:57.284418 21316 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:10:57.286233 21469 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:57.286676 23385 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.287405 23944 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:57.288350 23385 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.288385 23944 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.292351 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.293282 21319 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:57.250514 23747 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.300139 21390 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:57.301177 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.302696 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.303619 21316 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:10:57.304445 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.305632 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.305476 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.306296 21319 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:10:57.306583 23933 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.307220 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.309984 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:57.310508 21319 raft_consensus.cc:2376] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4. Re-sending same reply.
I20260709 13:10:57.245872 24017 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:57.311321 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.311606 24017 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:57.312079 24017 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.313671 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:57.306803 21316 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:10:57.317497 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:57.318425 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:57.318866 23879 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:57.321689 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46056.4us
I20260709 13:10:57.322480 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:57.321705 21467 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:57.324783 21467 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:57.326184 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.326889 21467 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:57.317384 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:57.328383 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.331992 22036 raft_consensus.cc:2410] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:57.334450 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 703) took 1116 ms. Trace:
I20260709 13:10:57.334807 22036 rpcz_store.cc:276] 0709 13:10:56.218546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.219195 (+   649us) service_pool.cc:224] Handling call
0709 13:10:57.334192 (+1114997us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54007e0c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:57.334369 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2556109696}
I20260709 13:10:57.277137 23943 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:57.336170 22035 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:57.336546 22035 pending_rounds.cc:85] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 7
I20260709 13:10:57.336799 22035 pending_rounds.cc:107] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:57.337330 22035 raft_consensus.cc:2889] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:57.338497 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 851) took 1073 ms. Trace:
I20260709 13:10:57.338550 23809 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:57.338877 22035 rpcz_store.cc:276] 0709 13:10:56.264941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.278310 (+ 13369us) service_pool.cc:224] Handling call
0709 13:10:57.335773 (+1057463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.337736 (+  1963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.338299 (+   563us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54007e0c50. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:57.338422 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2380214528}
I20260709 13:10:57.340703 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.341856 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:57.342953 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.344134 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.345155 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.345690 21464 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:57.345613 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.347059 21464 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:57.347312 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:57.348237 21469 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:57.317318 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.350160 21316 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:10:57.323678 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:57.359021 21388 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:57.360294 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.282462 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:57.364593 22035 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:57.364738 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:57.368351 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1736) took 1676 ms. Trace:
W20260709 13:10:57.406100 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.405233 21319 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:10:57.376542 21462 rpcz_store.cc:276] 0709 13:10:55.691730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.509000 (+817270us) service_pool.cc:224] Handling call
0709 13:10:56.509503 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.778729 (+269226us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:10:56.778758 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.779225 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.116686 (+337461us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:57.116733 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.224082 (+107349us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540029a4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:57.224132 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.367993 (+143861us) raft_consensus.cc:1685] finished
0709 13:10:57.368014 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.368284 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28911,"raft.queue_time_us":29948,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":306387328,"thread_start_us":337067,"threads_started":1,"wal-append.queue_time_us":580595}
I20260709 13:10:57.380532 21320 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:57.413311 21318 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:57.415750 21395 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
W20260709 13:10:57.417297 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 93680.5us
I20260709 13:10:57.441577 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:57.417467 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.418926 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.442773 21461 raft_consensus.cc:2410] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:57.420162 24030 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:57.420737 23886 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.423107 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:57.424651 24044 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.425104 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:57.449365 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 403630us
I20260709 13:10:57.425927 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.423476 23878 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.434985 23990 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:57.436159 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 163304us
I20260709 13:10:57.436865 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.438315 23932 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.336946 23943 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.443924 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.444141 21467 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:10:57.449957 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.450263 21312 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:10:57.450981 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.428726 23933 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:57.450799 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:10:57.449013 24084 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:10:57.454290 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.455693 22035 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:57.466795 21320 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:57.468014 21461 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:57.469774 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:57.459235 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.460949 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.438393 24020 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.463393 21321 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
W20260709 13:10:57.458365 21463 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.010s	sys 0.028s
I20260709 13:10:57.449159 24030 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.473961 21388 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:10:57.474257 21463 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.011s	sys 0.028s
I20260709 13:10:57.472196 21317 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:57.472980 21394 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:57.473011 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:57.477033 21320 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:57.478092 21316 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:57.476922 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.480880 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.483218 21319 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:57.483430 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.484990 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.485807 21389 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:10:57.471103 23695 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:57.472074 23943 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:57.488811 22039 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEARNER]: Advancing to term 7
I20260709 13:10:57.498049 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:57.502385 21318 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:57.502496 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:57.473313 24053 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.476817 24030 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.503309 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:57.537106 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.489323 23933 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:57.555348 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:57.556175 24043 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:57.556072 24090 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:10:57.556890 24087 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:57.557169 24031 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:57.557328 21285 leader_election.cc:400] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:10:57.557741 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:57.580297 21285 leader_election.cc:403] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:57.558545 24048 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:57.558921 23695 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:57.557785 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59872.4us
W20260709 13:10:57.564646 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.567274 22036 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:57.576503 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 74085.1us
I20260709 13:10:57.576841 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 361) took 1190 ms. Trace:
I20260709 13:10:57.577224 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:57.535889 23385 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.580525 22035 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:57.566764 23933 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.536065 23730 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:57.581867 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45619.8us
I20260709 13:10:57.474134 24020 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.589520 21468 rpcz_store.cc:276] 0709 13:10:56.386594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.885610 (+499016us) service_pool.cc:224] Handling call
0709 13:10:56.885958 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.886276 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.886304 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.886815 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.116823 (+230008us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:57.576180 (+459357us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.576501 (+   321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.576589 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.576642 (+    53us) raft_consensus.cc:1685] finished
0709 13:10:57.576654 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.576786 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1662,"thread_start_us":560959,"threads_started":2,"wal-append.queue_time_us":325415}
I20260709 13:10:57.535987 23707 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.547297 24050 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.599280 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:57.606444 21390 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:57.609863 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:57.605383 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:57.615463 21389 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:57.583261 24031 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.579988 22031 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:57.565649 24053 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.620061 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:57.613276 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.592749 24043 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.623365 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:57.624063 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.623883 24050 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.643411 23809 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:57.662048 23809 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.662691 23809 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.663173 24050 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.663328 23888 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.663707 23888 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:57.606789 23747 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:57.653228 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 57336.2us
I20260709 13:10:57.648527 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:57.597586 23903 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:10:57.654518 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:57.652135 21216 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 274) took 22493 ms (client timeout 15000 ms). Trace:
I20260709 13:10:57.598687 23933 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:57.613221 23707 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.643945 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:57.676151 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 56213.8us
I20260709 13:10:57.667737 23888 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.622269 24031 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:57.683122 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70172.7us
W20260709 13:10:57.677536 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 226840us
I20260709 13:10:57.611155 24044 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:57.665693 21394 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:10:57.595147 23695 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.684427 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:57.681941 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:57.686411 22039 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:57.597828 24048 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.689245 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:57.673813 23747 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:57.702925 21395 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:57.707139 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:57.618654 23730 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.713832 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.643586 21218 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.692802 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:57.695312 23833 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:57.698225 24058 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:57.673552 23385 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:10:57.732316 23903 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.732690 23695 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:57.732865 23903 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.693224 24003 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.733551 23695 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:57.733835 24003 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.734256 23695 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.700330 23886 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.726562 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:57.735029 21393 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:57.736191 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:57.736418 23730 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:57.736930 23870 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:57.737447 23870 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:57.737815 24043 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:57.738325 23870 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.739130 23707 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:57.705149 23747 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.724215 23990 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:57.676218 21216 rpcz_store.cc:269] 0709 13:10:35.008764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.009972 (+  1208us) service_pool.cc:224] Handling call
0709 13:10:35.181252 (+171280us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf182090 00007fc2bf220f3a 00007fc2c4fd71cc 00007fc2c50d537e 00007fc2c35962a4 00007fc2c3596232 00007fc2c3596161 00007fc2c35960dc 00007fc2c3595392 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:57.501852 (+22320600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:53.280204 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:53.280986 (+   782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:53.281043 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:10:53.281056 (+    13us) tablet.cc:662] Decoding operations
0709 13:10:53.281826 (+   770us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:53.281924 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:53.281959 (+    35us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:53.282590 (+   631us) tablet.cc:701] Row locks acquired
0709 13:10:53.282638 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:10:53.282803 (+   165us) write_op.cc:270] Start()
0709 13:10:53.282994 (+   191us) write_op.cc:276] Timestamp: P: 1783602653282738 usec, L: 0
0709 13:10:53.283015 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:10:53.283716 (+   701us) log.cc:844] Serialized 2094 byte log entry
0709 13:10:53.518696 (+234980us) op_driver.cc:464] REPLICATION: finished
0709 13:10:54.311489 (+792793us) write_op.cc:301] APPLY: starting
0709 13:10:54.319934 (+  8445us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:54.540233 (+220299us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:54.565742 (+ 25509us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:54.570236 (+  4494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:54.570455 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:10:54.570500 (+    45us) write_op.cc:312] APPLY: finished
0709 13:10:54.570732 (+   232us) log.cc:844] Serialized 47 byte log entry
0709 13:10:54.910352 (+339620us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:54.912724 (+  2372us) write_op.cc:454] Released schema lock
0709 13:10:54.913525 (+   801us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:54.913911 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:54.913941 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1847692,"reported_tablets":35,"spinlock_wait_cycles":76022144,"child_traces":[["op",{"apply.queue_time_us":586513,"apply.run_cpu_time_us":25954,"apply.run_wall_time_us":734486,"num_ops":5,"prepare.queue_time_us":364777,"prepare.run_cpu_time_us":10366,"prepare.run_wall_time_us":85219,"raft.queue_time_us":116052,"raft.run_cpu_time_us":12209,"raft.run_wall_time_us":298215,"replication_time_us":235505,"thread_start_us":968728,"threads_started":5,"wal-append.queue_time_us":392726,"wal-append.run_cpu_time_us":35594,"wal-append.run_wall_time_us":2110880}]]}
I20260709 13:10:57.729682 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.733070 23879 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:57.697573 23878 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.728192 21218 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.707093 24090 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:57.741669 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:57.726724 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49431.8us
I20260709 13:10:57.739576 24017 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.688233 24050 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:10:57.744372 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:57.745817 22036 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:57.734606 23695 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.740561 22031 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.735021 23903 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.699573 23944 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:10:57.764652 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:57.767390 21392 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:57.742545 24092 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.745131 24058 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:57.752954 23695 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:57.782912 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 65744.3us
W20260709 13:10:57.783159 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 69844.6us
I20260709 13:10:57.788803 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:57.783699 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:57.782366 23385 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:10:57.797079 23944 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:57.786702 21218 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 2 to 3, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 3 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.764016 24090 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:57.753252 24044 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:10:57.804558 23385 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:57.790340 23951 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:57.809361 23951 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.808909 24058 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.809720 23951 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:57.813401 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:57.814292 23730 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:57.815698 23892 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:57.816700 23892 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:57.817020 23892 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:57.815728 23730 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.817888 23892 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.818387 23730 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:57.818835 23730 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.819109 23892 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.820544 24090 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.824674 24053 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.825423 24020 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:57.826025 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.826467 23730 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.826690 23898 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:10:57.827683 23898 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:57.828014 23898 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:57.828848 23898 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:57.830015 23898 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.830734 23747 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.833333 24030 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.835541 24030 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:57.798285 24050 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:57.837240 23730 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.838184 23916 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:57.838649 23916 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.839010 23916 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:57.841315 23951 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:57.846019 23747 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.794890 23903 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:10:57.849440 23903 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:57.849835 23903 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:57.850178 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:57.850744 23903 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.131218 23933 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:57.855216 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63694.3us
W20260709 13:10:57.889842 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 88908.8us
I20260709 13:10:57.850839 21317 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:57.789459 24029 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:57.797551 24048 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:57.985091 21218 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.797549 23944 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:10:57.994140 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 309819us
W20260709 13:10:58.019817 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 524119us
W20260709 13:10:58.030622 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 382160us
I20260709 13:10:58.142338 21320 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:58.105402 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1970) took 1031 ms. Trace:
W20260709 13:10:58.132892 23932 consensus_meta.cc:287] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.006s
W20260709 13:10:58.032989 21466 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.011s	sys 0.012s
I20260709 13:10:58.110141 24104 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:58.110463 21390 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:58.149822 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:58.148770 21466 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.011s	sys 0.019s
I20260709 13:10:58.112187 23809 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.113396 23951 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:58.113551 23990 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:58.161062 23990 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:58.114746 24031 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.125758 24003 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:58.162163 22039 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:10:58.127553 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.128645 23747 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.154703 24048 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:58.163381 23747 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.163690 24048 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.165791 23747 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:58.165934 24048 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.130048 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1492) took 1937 ms. Trace:
W20260709 13:10:57.852022 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 66321.4us
I20260709 13:10:58.134020 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:58.167105 21319 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:10:58.062009 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 318750us
I20260709 13:10:58.168097 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:58.166538 21463 rpcz_store.cc:276] 0709 13:10:56.192919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.558353 (+365434us) service_pool.cc:224] Handling call
0709 13:10:56.883449 (+325096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.883895 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:57.474849 (+590954us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.104780 (+629931us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.114082 (+  9302us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.114242 (+   160us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:58.114470 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.114958 (+   488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.115040 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.129006 (+ 13966us) raft_consensus.cc:1685] finished
0709 13:10:58.129023 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.129861 (+   838us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54000b8950. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:58.129990 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1675,"prepare.queue_time_us":742650,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":11916,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":278,"spinlock_wait_cycles":746845568,"thread_start_us":935435,"threads_started":2,"wal-append.queue_time_us":589558}
I20260709 13:10:58.168766 21319 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:58.168651 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:58.165683 23944 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.142917 21320 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:58.169474 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:58.169662 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:58.170317 21396 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:58.170810 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:58.137379 24039 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.170987 23886 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:58.171028 21319 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:58.171604 21319 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:58.145632 24109 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:58.169528 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:58.172394 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:58.173401 23874 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:58.173801 23874 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.174190 23874 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.174132 21319 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.143034 21314 rpcz_store.cc:276] 0709 13:10:57.073984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.074767 (+   783us) service_pool.cc:224] Handling call
0709 13:10:57.075055 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.075251 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:57.408236 (+332985us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.917866 (+509630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:58.105106 (+187240us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:58.105153 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.105216 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.105342 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":886,"prepare.queue_time_us":514401,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":12065,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":31616,"thread_start_us":829577,"threads_started":2,"wal-append.queue_time_us":722148}
I20260709 13:10:58.176447 23944 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.180687 24110 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:58.144742 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:58.146837 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:58.182881 23917 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.152073 21315 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:57.915716 24044 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:58.151403 23695 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.187302 24044 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.187784 24044 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.188660 23695 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:58.158798 23845 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:58.159919 24053 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.128558 23916 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.190735 23990 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.191555 23916 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:58.159467 21218 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 2 to 4, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:10:58.177616 21319 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.169571 23747 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:58.180059 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:58.180469 24031 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:58.179766 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:58.183111 21317 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:58.184197 24111 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:58.137751 24029 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.171525 23886 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.185263 21312 raft_consensus.cc:2410] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:10:58.185942 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.178052 21314 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:58.186796 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1961) took 1121 ms. Trace:
W20260709 13:10:58.194721 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.211241 24029 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:58.193441 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:10:58.211827 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.217126 23695 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:58.198630 23705 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:58.217569 23695 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.217958 23695 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.218410 22039 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:58.219278 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:58.216388 23845 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:58.220346 23845 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.220443 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:58.217821 23705 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.220811 23845 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:58.221060 21314 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.221415 24048 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:58.162946 23809 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:58.225468 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:58.191798 23990 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.226645 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:58.227452 21312 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:58.228150 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48181.5us
I20260709 13:10:58.232559 24039 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:58.216990 23886 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:58.229454 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 86828.9us
I20260709 13:10:58.229910 24109 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.230080 23933 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.231597 24111 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.211308 23747 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.193451 24050 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:10:58.234867 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:10:58.193997 23943 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.000s
I20260709 13:10:58.137712 23892 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.142357 21393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1716) took 4812 ms (client timeout 2131 ms). Trace:
I20260709 13:10:58.228622 21312 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:58.111903 22031 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
W20260709 13:10:58.235252 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.241607 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:58.241518 21319 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:58.218104 21315 rpcz_store.cc:276] 0709 13:10:57.065219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.065390 (+   171us) service_pool.cc:224] Handling call
0709 13:10:57.065824 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.184440 (+1118616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.186557 (+  2117us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000bdbd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:58.186737 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493741440}
W20260709 13:10:58.243057 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.241691 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1741) took 1865 ms. Trace:
I20260709 13:10:58.239840 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:58.247365 22039 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:58.226732 23705 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.135814 23888 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:58.255707 21393 rpcz_store.cc:269] 0709 13:10:53.319942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.338022 (+ 18080us) service_pool.cc:224] Handling call
0709 13:10:57.957344 (+4619322us) spinlock_profiling.cc:243] Waited 4.39 s on lock 0x7b54001c4654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:58.132695 (+175351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10091258368}
I20260709 13:10:58.250233 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:58.261080 22035 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:10:58.260120 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:58.250391 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.250851 21316 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:58.153132 23932 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:58.152868 24017 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.248773 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:58.241403 24109 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.244665 23903 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:58.268565 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 82697.9us
I20260709 13:10:58.272455 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:58.246497 24110 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.274127 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:58.248718 23916 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:58.249910 23917 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:58.287026 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.261965 24031 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.257751 21466 rpcz_store.cc:276] 0709 13:10:56.376306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.876085 (+499779us) service_pool.cc:224] Handling call
0709 13:10:56.876566 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.877165 (+   599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.877213 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.877817 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.100355 (+222538us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:57.305844 (+205489us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:58.152660 (+846816us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.236089 (+ 83429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.236166 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.236208 (+    42us) raft_consensus.cc:1685] finished
0709 13:10:58.241498 (+  5290us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.241633 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83123,"prepare.queue_time_us":552071,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":87578,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":5556,"spinlock_wait_cycles":19370240,"thread_start_us":1256049,"threads_started":2,"wal-append.queue_time_us":373311}
I20260709 13:10:58.290521 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.290122 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:58.304919 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.305742 21461 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:58.300144 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.301204 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.269464 23933 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.307538 21470 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:58.269270 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:58.273989 23879 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.271078 24109 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.311082 21314 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:10:58.313262 21467 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:58.253631 23695 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.324908 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.289803 24017 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.262814 23892 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.325951 21464 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 4: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:58.284622 23916 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:58.283819 24107 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.307341 23833 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.328821 21462 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:10:58.333938 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.339534 21463 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:10:58.333549 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.020s	sys 0.046s
I20260709 13:10:58.167210 24104 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:58.340236 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.020s	sys 0.046s
I20260709 13:10:58.319188 23385 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:58.342060 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 526923us
I20260709 13:10:58.343668 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.320400 23879 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:58.323879 24116 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.304042 23917 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.339344 24050 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:58.372231 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:58.309873 23874 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.315351 23932 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:10:58.366442 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 172001us
I20260709 13:10:58.375981 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.339305 23833 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.368274 23809 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:58.358278 23879 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:58.347541 23898 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.004s
W20260709 13:10:58.377534 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 105634us
I20260709 13:10:58.388418 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:58.396790 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:58.375505 21466 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:10:58.350785 24110 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.309998 24031 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.319633 23933 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.387272 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:58.388070 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:58.403601 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:58.384106 23833 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.392351 24114 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:58.393046 23888 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.393844 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:58.393618 23916 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.402462 21392 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:58.497634 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:58.402822 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:58.349443 24003 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:10:58.413831 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:58.500579 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.414791 21393 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
W20260709 13:10:58.414472 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 127555us
I20260709 13:10:58.429759 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:58.445350 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.446913 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.452291 23747 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:58.460696 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:58.463053 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 75859.5us
I20260709 13:10:58.461841 21388 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:58.493752 23917 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.500744 21396 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:58.417346 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:58.509323 21389 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:10:58.509734 21464 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:10:58.509364 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 112664us
I20260709 13:10:58.512235 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.462934 21390 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:58.502229 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:58.506111 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 187421us
I20260709 13:10:58.405659 24116 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:58.516815 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 104222us
I20260709 13:10:58.523044 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.460533 24047 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.489113 24114 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:58.529686 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:58.504598 23951 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:58.533474 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:58.528661 21463 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:58.486407 23385 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:10:58.461812 24113 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:10:58.548941 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.544360 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.557423 21467 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:10:58.540688 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:10:58.535696 24101 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:10:58.580492 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.543035 21320 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.570291 23695 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.571682 23892 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:58.572459 23932 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.553511 23951 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:58.574064 24029 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.574596 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:58.575429 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 73277.7us
I20260709 13:10:58.617949 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:58.576290 23874 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.546680 24114 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.558638 23888 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:58.531152 24110 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:58.547384 24098 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.295s	user 0.001s	sys 0.001s
I20260709 13:10:58.528379 24053 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:10:58.534971 24039 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:58.526609 23707 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:58.580281 24113 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:58.527911 24111 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:10:58.560313 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:58.581871 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 354) took 1509 ms. Trace:
I20260709 13:10:58.584378 21467 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:58.601537 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.611557 21320 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.540619 23747 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.616357 21463 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:10:58.611275 24050 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:58.628170 21318 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:58.542747 23845 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.629719 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.674073 21469 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:58.632164 24047 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:58.632866 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.632436 24058 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.565521 24122 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.638008 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 69643.7us
I20260709 13:10:58.640875 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:58.641130 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.652670 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 103797us
I20260709 13:10:58.615993 23951 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:58.665062 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.660408 22042 rpcz_store.cc:276] 0709 13:10:57.095485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.103080 (+  7595us) service_pool.cc:224] Handling call
0709 13:10:57.119064 (+ 15984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.238647 (+119583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.238699 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.316864 (+ 78165us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.751795 (+434931us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:57.751837 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.751907 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.581618 (+829711us) raft_consensus.cc:1685] finished
0709 13:10:58.581644 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.581801 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68837,"raft.queue_time_us":123411,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4162,"thread_start_us":434517,"threads_started":1,"wal-append.queue_time_us":821261}
I20260709 13:10:58.691434 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:58.665359 23932 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:58.681144 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 140550us
W20260709 13:10:58.681196 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 119326us
I20260709 13:10:58.678607 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.697273 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:58.639693 24110 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:58.661723 24113 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:58.691622 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:58.691917 21470 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:58.660483 24109 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.677937 23888 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:58.676870 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.704459 21463 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:10:58.674728 24029 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:10:58.690603 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.673676 23385 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.687706 21320 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:58.702857 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:58.705650 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.695492 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.648701 24020 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:10:58.707074 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.712739 21469 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:58.712834 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:58.659948 23695 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:10:58.713784 21463 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:58.712766 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:58.718578 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:58.666008 23707 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.735350 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:58.733304 24043 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:58.737995 24047 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.739308 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:10:58.739531 23990 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.000s
I20260709 13:10:58.739948 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:10:58.745682 22041 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:10:58.745886 21470 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:10:58.740199 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:58.746816 22042 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.699076 24110 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:58.699498 23933 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.701853 24039 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.750797 24047 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:58.750535 24039 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.751446 24047 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:58.751811 24047 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.752174 24047 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:58.752737 24117 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:58.753648 21470 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:58.754163 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:58.755556 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:58.756340 24029 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:58.756956 24121 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:10:58.708427 23917 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:58.742347 24135 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:58.758451 24135 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:58.759352 24135 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.760742 24109 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:58.730672 24123 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:10:58.761857 24044 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.001s
I20260709 13:10:58.762315 24044 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.762682 24039 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.707723 24058 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:10:58.749007 21467 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:10:58.693548 23809 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:10:58.764451 21313 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:58.765003 24058 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:58.765525 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.704288 24090 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:10:58.766404 23707 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.767163 21467 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:58.654887 24053 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:58.769729 24108 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:10:58.770280 24050 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.770831 24053 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:58.768620 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:58.773182 21467 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:58.768828 22042 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:10:58.746419 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 128450us
I20260709 13:10:58.675892 23747 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:58.775720 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:58.708909 24104 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.734551 24120 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:58.734339 23879 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.807264 21467 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:58.807639 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 68430us
I20260709 13:10:58.808498 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.746935 24031 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.814677 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:58.815604 21314 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:10:58.773583 23932 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:58.806177 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1755) took 1544 ms. Trace:
I20260709 13:10:58.811182 21320 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:58.774134 24111 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.820439 21467 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:58.782236 24058 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:58.695777 24122 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:10:58.821112 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 129736us
I20260709 13:10:58.818380 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:10:58.802155 23809 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.802062 24029 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:58.809527 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.825474 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:58.781344 23878 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:10:58.945063 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:58.955159 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:58.955730 21315 raft_consensus.cc:2410] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:58.955865 21312 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:10:58.825453 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 241828us
I20260709 13:10:58.821497 21391 rpcz_store.cc:276] 0709 13:10:57.262244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.262360 (+   116us) service_pool.cc:224] Handling call
0709 13:10:57.262695 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.263077 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.263106 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.263553 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.743976 (+480423us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:58.061148 (+317172us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.111580 (+ 50432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.111663 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.805956 (+694293us) raft_consensus.cc:1685] finished
0709 13:10:58.805980 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.806114 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":379004,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":1115,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":176,"thread_start_us":774046,"threads_started":2,"wal-append.queue_time_us":871580}
W20260709 13:10:58.957861 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 244238us
W20260709 13:10:58.957484 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 239017us
I20260709 13:10:58.958374 21467 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:10:58.957482 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:10:58.953784 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:58.960878 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:58.962430 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 153020us
I20260709 13:10:58.962958 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.826889 24120 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:58.971642 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:58.982426 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:58.983283 21321 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:58.976663 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:10:58.975858 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.957721 24104 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:58.996378 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:58.998625 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 190193us
W20260709 13:10:59.004055 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46604.6us
I20260709 13:10:58.964109 24129 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:59.006369 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:59.003710 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:58.969235 24044 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:58.979966 23933 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.009618 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:59.014474 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:59.028678 21316 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:10:59.031211 21392 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:59.034772 24141 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:59.035383 24141 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:59.035629 24144 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:59.036224 24144 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:59.037258 21466 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:10:59.036706 24141 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.037117 24144 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.042904 23951 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.019057 24123 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:59.047722 24123 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:59.048285 24123 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:59.048931 24140 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:10:59.049530 23951 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:59.055812 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:59.050681 24039 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.057816 23879 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:59.020001 23833 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.003s
I20260709 13:10:59.060735 21312 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:10:59.065843 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:10:59.068259 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 64661.2us
W20260709 13:10:59.050716 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97033.2us
I20260709 13:10:59.070878 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:59.071024 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:58.956972 23888 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.071723 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:59.025606 24120 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.075178 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:59.091239 21315 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:59.077029 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 114115us
I20260709 13:10:59.078977 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:59.082553 21321 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
W20260709 13:10:59.090483 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.054306 23845 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:59.103864 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:10:59.102818 24104 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:58.995533 24110 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:58.994413 24148 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:10:59.068241 24122 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:59.077099 24058 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:59.090888 24090 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:59.097780 23951 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:59.153740 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45131.7us
I20260709 13:10:59.154592 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:59.110245 24137 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:10:59.156090 23747 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:59.058462 23932 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.075807 23833 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.147969 23951 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.146701 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:59.033041 24129 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.169673 24151 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:59.104576 24120 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.172394 24151 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.174050 24120 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:59.174408 24151 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:59.180099 24145 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.180757 24145 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:59.182646 21313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 1892) took 1332 ms (client timeout 1503 ms). Trace:
I20260709 13:10:59.183020 24145 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:10:59.183173 21313 rpcz_store.cc:269] 0709 13:10:57.850400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.132752 (+282352us) service_pool.cc:224] Handling call
0709 13:10:59.182366 (+1049614us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b540032afd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:10:59.182545 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335310208}
I20260709 13:10:59.187438 24129 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:59.188105 24143 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.159752 24109 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.150735 24090 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.223439 24145 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:10:59.224196 23879 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.224370 24145 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.224844 23879 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.227638 24147 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.228456 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:59.228415 24147 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.230103 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:59.231468 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:59.232453 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:59.157301 24044 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:10:59.167577 23951 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:59.189785 23886 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.936s	user 0.012s	sys 0.001s
I20260709 13:10:59.171386 23747 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:10:59.223613 21359 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:59.571422 21467 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:59.486809 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 327941us
I20260709 13:10:59.571834 21315 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:10:59.290246 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:10:59.477507 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 333071us
I20260709 13:10:59.573999 21390 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:10:59.574235 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:59.574659 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:59.405565 21392 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:59.575327 22039 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:10:59.266222 21393 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:59.565524 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 259977us
I20260709 13:10:59.189445 24141 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:59.218883 24104 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.577955 24141 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:59.268554 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74851.6us
I20260709 13:10:59.580902 24141 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:59.581326 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:10:59.233438 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:59.517200 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 362676us
I20260709 13:10:59.592305 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:59.572582 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:10:59.594138 21387 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:59.573264 21391 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:10:59.588573 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:10:59.570931 24029 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.013s
W20260709 13:10:59.488350 24114 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.828s	user 0.002s	sys 0.010s
W20260709 13:10:59.441939 24159 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:10:59.592804 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:59.588984 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 365459us
I20260709 13:10:59.596055 21396 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:59.218459 24143 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:59.598786 21393 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:59.598685 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:59.615406 22042 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:10:59.361541 24166 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:10:59.571336 23916 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:59.271514 24139 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:59.544570 24030 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:59.575645 24110 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:59.232745 24147 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:59.384622 24123 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.606329 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:10:59.599813 24029 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.007s	sys 0.013s
I20260709 13:10:59.675531 24029 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:10:59.533206 23943 raft_consensus.cc:3055] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.717661 23943 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:59.718182 24029 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.718832 23943 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.221639 24109 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:10:59.717195 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 103660us
I20260709 13:10:59.414431 24164 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.332s
I20260709 13:10:59.654197 23951 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.599184 24145 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:59.665035 21393 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:59.676267 24030 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:59.616200 24114 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.677605 24139 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:59.678999 24129 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.679041 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.679855 23705 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.683616 24123 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:59.630185 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:59.756605 21387 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
W20260709 13:10:59.652740 24161 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:10:59.591518 23886 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.625841 24141 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:59.685156 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.685063 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:10:59.614429 24143 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:59.794787 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.610392 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:10:59.796317 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 186019us
I20260709 13:10:59.687269 21466 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:59.688292 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:59.689465 22032 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:10:59.690304 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:59.598248 23932 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:59.701088 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:59.701774 24127 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:10:59.667589 24047 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.915s	user 0.005s	sys 0.005s
I20260709 13:10:59.709805 24090 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:59.710321 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 136169us
I20260709 13:10:59.618181 24137 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:10:59.824982 24137 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:59.781525 23705 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.825350 24137 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:59.826247 24137 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.827054 23705 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:59.593538 24053 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:59.827603 23705 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.828015 24053 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:10:59.800241 24143 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:59.828970 24053 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.590850 23888 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.832482 21462 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:59.832407 23888 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.833703 23886 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:10:59.814288 23932 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.836225 23932 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:59.837244 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:59.838796 23833 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:59.723759 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:59.726367 23943 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.717082 24166 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.733740 23951 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:59.722209 24109 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:10:59.670908 24134 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.364s	user 0.003s	sys 0.000s
I20260709 13:10:59.741856 24139 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.814038 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:10:59.814945 21394 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:10:59.809684 23990 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.818413 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1891) took 1968 ms. Trace:
I20260709 13:10:59.819921 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:10:59.863795 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49874.5us
I20260709 13:10:59.821066 24142 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:59.823984 24175 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.590550 23385 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:59.827427 24137 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:59.857422 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 133740us
I20260709 13:10:59.809473 22038 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:59.835417 23888 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:59.861920 21462 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:10:59.863914 21318 rpcz_store.cc:276] 0709 13:10:57.850112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.132502 (+282390us) service_pool.cc:224] Handling call
0709 13:10:58.142181 (+  9679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.669735 (+527554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.812731 (+1142996us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54000fc154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:59.818347 (+  5616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116693376}
I20260709 13:10:59.774293 24129 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.856181 23933 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.873126 21997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.900s (SENT) [suppressed 18 similar messages]
I20260709 13:10:59.853955 23916 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.864176 23845 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:59.856379 24135 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:59.861105 24116 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:10:59.866494 24142 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:10:59.852988 24047 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.880375 23809 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:59.914860 24116 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.852268 24127 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.908313 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:59.925420 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:59.885983 23833 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:59.853911 23705 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.901604 23845 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.929569 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:10:59.957679 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:10:59.927033 24107 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.932152 24176 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:59.932417 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:59.932690 23878 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.933274 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1758) took 1635 ms. Trace:
I20260709 13:10:59.933732 24138 raft_consensus.cc:1064] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:10:59.937780 23833 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:10:59.939898 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:10:59.909606 24135 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.941597 24116 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:10:59.942279 23809 consensus_queue.cc:1243] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:59.948493 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:10:59.952850 22032 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:59.860826 24030 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.874235 23990 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.960314 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1525) took 1539 ms. Trace:
I20260709 13:10:59.963168 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:00.019407 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:00.019131 21467 rpcz_store.cc:276] 0709 13:10:58.421322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.966416 (+545094us) service_pool.cc:224] Handling call
0709 13:10:58.986431 (+ 20015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.571939 (+585508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.960089 (+388150us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540025e254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:10:59.960257 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344893184}
I20260709 13:11:00.021432 21395 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:00.022723 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:00.023741 21321 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:10:59.969177 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:59.971082 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:59.978174 22040 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:10:59.877888 24175 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:10:59.981631 21468 rpcz_store.cc:276] 0709 13:10:58.297458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.375138 (+ 77680us) service_pool.cc:224] Handling call
0709 13:10:58.399753 (+ 24615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:58.412720 (+ 12967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.412765 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.418885 (+  6120us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.812637 (+393752us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:58.812678 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.812754 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.670387 (+857633us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:10:59.931354 (+260967us) raft_consensus.cc:1685] finished
0709 13:10:59.931378 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.933175 (+  1797us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":57834,"spinlock_wait_cycles":13540224,"thread_start_us":290504,"threads_started":1,"wal-append.queue_time_us":700012}
I20260709 13:10:59.985062 21318 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:59.985512 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:59.935719 23705 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:10:59.992964 21312 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:59.996348 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:10:59.906512 23933 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:10:59.894173 24158 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:10:59.959889 23845 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:00.003046 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 165874us
I20260709 13:11:00.000375 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:10:59.959667 24110 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.979789 24109 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:00.006054 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:00.012094 21393 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:00.079329 21396 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:11:00.012856 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64503.6us
I20260709 13:11:00.081192 21436 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:00.082824 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:00.019630 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56540us
I20260709 13:10:59.964268 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:00.026587 21316 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:00.026605 21315 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:10:59.991343 24111 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.006747 24138 raft_consensus.cc:1068] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Unable to promote non-voter bfcd9560f8f44414b25f8069384c5a73: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:00.088771 21436 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:00.032980 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:59.985819 24107 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.039598 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:10:59.980124 24157 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:11:00.042791 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:00.043531 21464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 368) took 1744 ms (client timeout 1900 ms). Trace:
I20260709 13:11:00.028124 24003 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:11:00.047914 23695 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:00.049736 24114 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:00.050812 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:00.051676 24182 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:11:00.052780 21395 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:00.056109 23833 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:00.059989 21390 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:00.061182 24166 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.064731 24175 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.141495 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:00.064970 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:00.065547 24142 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.068921 23932 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:00.028503 24176 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:00.070640 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:00.071542 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1760) took 1773 ms. Trace:
I20260709 13:11:00.072863 23990 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:00.073029 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1519) took 1677 ms. Trace:
I20260709 13:11:00.149441 21394 rpcz_store.cc:276] 0709 13:10:58.395191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.402479 (+  7288us) service_pool.cc:224] Handling call
0709 13:11:00.072817 (+1670338us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002e27d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:00.072939 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3012815616}
I20260709 13:11:00.024163 24116 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:00.045578 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:00.080171 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:00.084578 21314 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:00.038547 24127 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.086757 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:00.093693 24143 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.086014 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:00.166548 21467 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:00.089722 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:00.101462 21464 rpcz_store.cc:269] 0709 13:10:58.299117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.360403 (+ 61286us) service_pool.cc:224] Handling call
0709 13:11:00.039653 (+1679250us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b5400216e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:00.043478 (+  3825us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195898624}
I20260709 13:11:00.107056 24158 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:00.122272 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:00.134411 24110 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:11:00.146008 24166 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.175717 24166 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.176353 24166 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.170626 24142 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.184546 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:00.185460 21468 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.138509 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:00.101574 24138 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:00.142509 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 77650.1us
I20260709 13:11:00.122778 24141 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:00.120218 23695 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:00.131871 24164 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:00.196875 24141 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:00.148998 21321 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:00.153543 21395 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:00.202339 22039 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:00.203037 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 90082.4us
I20260709 13:11:00.149005 21463 rpcz_store.cc:276] 0709 13:10:58.298013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.714427 (+416414us) service_pool.cc:224] Handling call
0709 13:10:58.714775 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:59.078091 (+363316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.078125 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:59.078602 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:10:59.204173 (+125571us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:59.277716 (+ 73543us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.279060 (+  1344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.071204 (+792144us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400216454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:00.071246 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:00.071289 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:00.071363 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.071487 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20707,"prepare.queue_time_us":73341,"raft.queue_time_us":87638,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":6907,"spinlock_wait_cycles":592977664,"thread_start_us":212997,"threads_started":2,"wal-append.queue_time_us":575950}
I20260709 13:11:00.158775 21396 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.033119 21312 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:00.205384 21315 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:00.161783 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:00.205992 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:00.206230 21314 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:00.163249 21394 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:00.210191 24122 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:00.211056 24122 consensus_queue.cc:1243] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:00.212060 22036 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:00.215286 24143 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.092072 24111 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:00.216971 23845 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.219458 24111 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.167834 21318 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:00.082643 24109 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.134758 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1528) took 1712 ms. Trace:
I20260709 13:11:00.151077 24129 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.151719 23385 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.169816 24047 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.206540 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:00.219981 23845 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:00.302897 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:00.202560 24136 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.205s
I20260709 13:11:00.300257 24166 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.286350 21321 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:00.365124 21468 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:00.224367 21463 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:00.284956 21312 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:00.378623 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.406898 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 272440us
W20260709 13:11:00.298324 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.413095 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 436) took 1352 ms. Trace:
W20260709 13:11:00.409530 22038 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.003s
I20260709 13:11:00.418823 21392 rpcz_store.cc:276] 0709 13:10:59.060619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.061438 (+   819us) service_pool.cc:224] Handling call
0709 13:10:59.061800 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.586693 (+524893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.412820 (+826127us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54000ac8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:00.413032 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789971328}
W20260709 13:11:00.407938 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.408565 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 202198us
I20260709 13:11:00.411818 21461 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.416249 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:00.411707 21465 rpcz_store.cc:276] 0709 13:10:58.422544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.012567 (+590023us) service_pool.cc:224] Handling call
0709 13:10:59.026516 (+ 13949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:59.030616 (+  4100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.030645 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:59.031058 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:10:59.689568 (+658510us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b18003a23a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:10:59.866389 (+176821us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:00.084972 (+218583us) log.cc:844] Serialized 14 byte log entry
0709 13:11:00.121883 (+ 36911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.121987 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:00.122039 (+    52us) raft_consensus.cc:1685] finished
0709 13:11:00.134560 (+ 12521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.134710 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29158,"prepare.queue_time_us":281996,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":53080,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":9373,"spinlock_wait_cycles":9509760,"thread_start_us":372810,"threads_started":2,"wal-append.queue_time_us":924751}
I20260709 13:11:00.423970 21312 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:00.413786 24122 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:00.413491 24109 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:00.426652 22040 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:00.347958 24143 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:00.420758 22038 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:00.442238 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:00.442574 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:00.432046 24166 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.284861 23695 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.437410 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:00.446115 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:00.413266 23385 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:00.236894 24113 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.452735 24113 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.452380 24203 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:11:00.439410 24122 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.453794 24202 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:00.454005 24122 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.454228 24202 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:00.455375 24202 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:00.443892 23943 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
I20260709 13:11:00.453835 23385 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:00.456736 24202 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.459167 21461 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
W20260709 13:11:00.461838 24139 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 13:11:00.462316 24139 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.454191 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:00.465353 22032 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:00.465392 21465 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:00.293840 24141 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.474449 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:00.476011 23932 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:00.478880 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:00.480785 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:00.481674 21468 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:00.491585 21312 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:11:00.492156 21312 pending_rounds.cc:85] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 3
I20260709 13:11:00.492444 21312 pending_rounds.cc:107] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:00.492733 21312 raft_consensus.cc:2889] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:00.494269 21396 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:11:00.495664 24202 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.496676 23695 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.497756 24139 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:00.499814 21395 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:00.501787 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:00.502405 21395 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:00.504438 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:00.505611 21395 raft_consensus.cc:2410] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:00.507505 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:00.513990 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1759) took 2216 ms. Trace:
I20260709 13:11:00.514422 21469 rpcz_store.cc:276] 0709 13:10:58.297738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.713299 (+415561us) service_pool.cc:224] Handling call
0709 13:10:59.017243 (+303944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.017431 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.017455 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.017499 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:59.017531 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.017578 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.513808 (+1496230us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400249fd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:00.513920 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698337536}
I20260709 13:11:00.515789 21469 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:00.517551 24203 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:00.518806 21390 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:11:00.521405 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.512771 21395 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:00.528650 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 369) took 1458 ms. Trace:
I20260709 13:11:00.527629 24203 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.529107 22038 rpcz_store.cc:276] 0709 13:10:59.070215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.073772 (+  3557us) service_pool.cc:224] Handling call
0709 13:11:00.528465 (+1454693us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400614754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:00.528588 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462710528}
I20260709 13:11:00.525880 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:00.448124 24201 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.635114 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.698544 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 159182us
I20260709 13:11:00.520372 24206 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.444898 24143 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.492282 23932 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.537503 23943 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.668542 24017 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:00.847769 24139 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.847891 24157 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:00.847525 24113 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:11:00.884610 24184 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:11:00.872498 24166 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:00.811762 24158 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:11:00.884843 24017 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.853682 24029 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:11:00.960202 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.702090 24201 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:00.856858 23932 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:01.011363 24136 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.918931 24110 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.952934 24017 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.067299 21461 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:00.887660 23943 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.012077 24136 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.924115 24113 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:01.121919 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.034529 23932 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.919518 24139 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:01.116182 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 434016us
I20260709 13:11:00.953439 24166 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:00.918557 24157 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.111944 24202 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:01.142426 24202 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:01.143124 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 888) took 1129 ms. Trace:
I20260709 13:11:01.143266 23943 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.143567 24202 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.145177 24157 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.146241 24135 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.143543 22032 rpcz_store.cc:276] 0709 13:11:00.013498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.085519 (+ 72021us) service_pool.cc:224] Handling call
0709 13:11:00.140965 (+ 55446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.466009 (+325044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.142901 (+676892us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54005221d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:01.143065 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745063296}
I20260709 13:11:01.149781 24113 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:01.150215 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.150483 24113 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.150820 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 728) took 1073 ms. Trace:
I20260709 13:11:01.151170 24113 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:01.159749 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.161453 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.151685 23916 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.152155 23705 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.153018 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.11028e+06us
I20260709 13:11:01.153245 24107 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.153277 24044 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:01.154256 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.156165 24139 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.141712 24203 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.184268 21317 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:01.151196 22040 rpcz_store.cc:276] 0709 13:11:00.077436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.137246 (+ 59810us) service_pool.cc:224] Handling call
0709 13:11:00.148194 (+ 10948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.427098 (+278904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.150589 (+723491us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54005055d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:01.150765 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639958272}
I20260709 13:11:01.173161 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:01.174226 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.185014 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.129137 23886 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:01.190230 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:01.191454 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:01.145227 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1776) took 1190 ms. Trace:
I20260709 13:11:01.055218 24110 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.179251 21318 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:01.192145 21463 rpcz_store.cc:276] 0709 13:10:59.955067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.205730 (+250663us) service_pool.cc:224] Handling call
0709 13:11:01.145044 (+939314us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54002f2e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:01.145170 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39838592}
I20260709 13:11:01.180567 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:01.185622 21321 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.172691 23990 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.180280 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2005) took 1209 ms. Trace:
I20260709 13:11:01.177681 24047 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.174983 24191 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.172400 23707 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:01.198168 21396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.059s	sys 0.094s
W20260709 13:11:01.248271 21396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.059s	sys 0.094s
I20260709 13:11:01.196363 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:01.201948 24143 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.250710 24143 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:01.251341 24143 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.254056 24143 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.199061 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.256611 23833 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:01.257205 23833 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.257622 23833 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.247454 23707 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.260360 24166 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.262498 23707 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.200413 24189 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:11:01.255928 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.264989 21315 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:01.266253 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.268761 21315 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:01.179705 23705 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.188856 24139 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.270434 24139 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.271697 23705 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.272544 24139 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.263296 23707 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:01.280817 24201 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.282493 24113 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.176564 23695 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:11:01.192487 24044 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.180102 24135 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:01.219210 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.193837 23886 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.222296 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.179802 23916 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:01.225705 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.203367 23943 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.227926 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47411.2us
I20260709 13:11:01.220472 24158 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:11:01.205653 24129 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:01.233713 21319 rpcz_store.cc:276] 0709 13:10:59.971027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.972552 (+  1525us) service_pool.cc:224] Handling call
0709 13:10:59.992797 (+ 20245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.002455 (+  9658us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:00.031835 (+ 29380us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.147800 (+1115965us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b1800462d60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2c30ec58f 00007fc2bc12b571 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd
0709 13:11:01.154046 (+  6246us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.154521 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.154659 (+   138us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:01.154699 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.154767 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.166789 (+ 12022us) raft_consensus.cc:1685] finished
0709 13:11:01.180008 (+ 13219us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.180219 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1039571,"prepare.queue_time_us":25968,"prepare.run_cpu_time_us":437,"prepare.run_wall_time_us":2569,"raft.queue_time_us":1030494,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":6719,"spinlock_wait_cycles":18620288,"thread_start_us":38441,"threads_started":1,"wal-append.queue_time_us":270973}
I20260709 13:11:01.316687 23695 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:01.312801 23943 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.317286 23695 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.310300 24044 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.318815 23943 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.317210 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.320919 21321 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:01.320194 21319 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:01.322573 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:01.324908 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 373) took 1637 ms. Trace:
I20260709 13:11:01.193244 24053 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.224861 24175 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.245464 23990 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.302363 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.335180 21313 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:01.240653 23845 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:01.237679 21461 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
W20260709 13:11:01.290052 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.021s	sys 0.066s
W20260709 13:11:01.341146 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.021s	sys 0.066s
I20260709 13:11:01.325327 22041 rpcz_store.cc:276] 0709 13:10:59.687464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.689880 (+  2416us) service_pool.cc:224] Handling call
0709 13:10:59.690129 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.875686 (+185557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.875741 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.875800 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:59.875843 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.324660 (+1448817us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400319554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:01.324711 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.324847 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426185984}
I20260709 13:11:01.337038 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:01.285104 24047 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:01.344571 21465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.021s	sys 0.024s
I20260709 13:11:01.291189 24191 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.338651 23879 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.354916 21318 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:01.331300 24214 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:01.344863 23845 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:01.342414 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 642629us
I20260709 13:11:01.386677 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:01.340076 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.295722 24201 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:11:01.320884 23695 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.350047 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.405792 21319 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:01.351218 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.327872 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:01.408262 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 80473us
W20260709 13:11:01.384763 24109 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.907s	user 0.009s	sys 0.002s
I20260709 13:11:01.414055 23943 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:01.442703 23943 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.388451 23845 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.443188 23943 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.410897 24214 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:01.445497 24214 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.447453 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1769) took 1495 ms. Trace:
W20260709 13:11:01.420665 24122 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.966s	user 0.013s	sys 0.000s
I20260709 13:11:01.448313 24122 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.450922 21468 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:01.396590 23833 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.422040 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 878) took 1822 ms. Trace:
I20260709 13:11:01.428464 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.430600 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:01.360714 24044 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.458647 24017 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:01.460752 24192 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.289s	user 0.017s	sys 0.039s
I20260709 13:11:01.461185 24017 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.461761 24030 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.463400 24166 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:01.464111 24166 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:01.465750 24166 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.466598 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.468997 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 369) took 3087 ms. Trace:
I20260709 13:11:01.432791 24139 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:01.434000 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 371) took 3051 ms (client timeout 2004 ms). Trace:
I20260709 13:11:01.434082 24047 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.365370 24136 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.432822 21464 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:01.447969 21461 rpcz_store.cc:276] 0709 13:10:59.952176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.459951 (+507775us) service_pool.cc:224] Handling call
0709 13:11:01.447246 (+987295us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b540042fed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:01.447383 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361606528}
I20260709 13:11:01.483134 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1781) took 1436 ms. Trace:
I20260709 13:11:01.452499 24109 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.431895 24113 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:01.473593 21316 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:01.456478 22039 rpcz_store.cc:276] 0709 13:10:59.599401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.599586 (+   185us) service_pool.cc:224] Handling call
0709 13:10:59.599857 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.202776 (+602919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.421815 (+1219039us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400622854. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:01.421984 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361542912}
W20260709 13:11:01.473869 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 87310us
W20260709 13:11:01.470973 21469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.000s	sys 0.047s
W20260709 13:11:01.476405 21462 rpcz_store.cc:269] 0709 13:10:58.382258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.446560 (+ 64302us) service_pool.cc:224] Handling call
0709 13:11:01.433763 (+2987203us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000b8954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:01.433914 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3056032128}
W20260709 13:11:01.519186 21469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.000s	sys 0.048s
I20260709 13:11:01.526006 21316 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:01.483678 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:01.483623 21461 rpcz_store.cc:276] 0709 13:11:00.046924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.482096 (+1435172us) service_pool.cc:224] Handling call
0709 13:11:01.482470 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.482717 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.482755 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.482812 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:01.482858 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.482928 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.483061 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.471971 23933 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.481513 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1779) took 1470 ms. Trace:
I20260709 13:11:01.469525 21470 rpcz_store.cc:276] 0709 13:10:58.381385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.754465 (+373080us) service_pool.cc:224] Handling call
0709 13:10:58.754806 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:59.739690 (+984884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.739735 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:59.740355 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.075218 (+334863us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:00.123633 (+ 48415us) log.cc:844] Serialized 14 byte log entry
0709 13:11:00.137475 (+ 13842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.465130 (+1327655us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b180029dd60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:11:01.468634 (+  3504us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b540025ba54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:01.468726 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.468769 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:01.468779 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.468943 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18545,"prepare.queue_time_us":121311,"prepare.run_cpu_time_us":445,"prepare.run_wall_time_us":4808,"raft.queue_time_us":48161,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":191,"spinlock_wait_cycles":2263572608,"thread_start_us":298464,"threads_started":2,"wal-append.queue_time_us":383235,"wal-append.run_cpu_time_us":2033,"wal-append.run_wall_time_us":1042737}
I20260709 13:11:01.540282 21464 rpcz_store.cc:276] 0709 13:11:00.011508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.414133 (+1402625us) service_pool.cc:224] Handling call
0709 13:11:01.432497 (+ 18364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.481148 (+ 48651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.481433 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:01.541132 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.529266 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.541924 21318 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:11:01.481601 23695 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:01.551261 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.550828 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67242.6us
W20260709 13:11:01.560046 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.540197 24135 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.528308 24206 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:01.553076 24047 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:01.587481 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 396081us
I20260709 13:11:01.587400 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:01.588552 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:01.589272 22039 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:01.590261 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:01.593894 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:01.576141 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:01.594871 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:01.553967 23916 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.551780 24215 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:01.552572 23695 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:01.612098 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:01.592407 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:01.555017 23879 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:01.540673 24203 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:11:01.552968 24213 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.540465 24104 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:11:01.591403 24044 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:01.620786 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 428021us
I20260709 13:11:01.588604 24047 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:01.558810 24136 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:01.618338 23990 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.597493 24175 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:01.608361 24017 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.631719 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:01.621496 23695 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.586607 23845 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.621568 23916 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:01.633533 24047 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.630545 24215 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.635317 24136 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.630064 23879 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.635792 24175 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:01.650571 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 454258us
I20260709 13:11:01.651942 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:01.608928 24129 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:11:01.591403 24206 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.593310 24053 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:11:01.617686 24144 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:11:01.632323 24189 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.636791 24017 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.640492 23990 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.662498 24113 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:01.664211 24143 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.665213 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.670552 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1764) took 1720 ms. Trace:
I20260709 13:11:01.680102 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.712401 21313 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:01.689678 24110 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.690642 24202 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.634857 24213 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.647013 24044 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:01.702898 24191 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.645628 23886 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.595701 24135 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.635649 23943 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.712764 21465 rpcz_store.cc:276] 0709 13:10:59.950501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.466555 (+516054us) service_pool.cc:224] Handling call
0709 13:11:00.466903 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.467092 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:00.467603 (+   511us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.668061 (+1200458us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.670192 (+  2131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.670247 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:01.670290 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.670356 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.670487 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274566,"prepare.queue_time_us":143,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":343074,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":13287,"thread_start_us":925067,"threads_started":3,"wal-append.queue_time_us":741105}
I20260709 13:11:01.654433 24175 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.718371 24129 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:01.726286 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.703500 24200 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:01.729226 24164 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.706362 24017 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.705806 24107 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:01.740628 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.747722 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:01.748567 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:01.754890 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:01.704497 24217 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:01.774618 21392 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.775403 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:01.690789 24141 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.724689 23833 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:01.704213 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.780730 21317 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:01.782933 24231 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.783603 24231 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.786306 24231 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.786957 24231 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:01.788406 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:01.768978 24220 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:11:01.769093 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.728910 24143 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.769778 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:01.735494 24110 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.710645 23990 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.777912 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.811641 21316 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:01.757586 24109 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.781864 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.759243 24225 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:01.766732 23886 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:01.820396 23886 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:01.821264 23886 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.822379 23886 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.823321 24136 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.824255 24143 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.824420 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:01.776594 24164 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.825140 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:01.825820 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:01.826377 21388 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:01.826869 24164 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:01.827387 21388 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:01.827442 21464 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.828176 21396 raft_consensus.cc:2368] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9.
I20260709 13:11:01.828094 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:01.764065 24129 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:01.763024 24044 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:01.797199 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:01.804208 21462 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:01.802496 21465 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:01.811228 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:01.845250 21389 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:01.787405 24231 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:01.829054 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:01.829509 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.855631 21316 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:01.832469 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 180591us
I20260709 13:11:01.866869 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:01.864566 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1778) took 1856 ms. Trace:
I20260709 13:11:01.869871 21463 rpcz_store.cc:276] 0709 13:11:00.007757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.242918 (+1235161us) service_pool.cc:224] Handling call
0709 13:11:01.243304 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.243571 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:01.661242 (+417671us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.864101 (+202859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.864170 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:01.864234 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.864327 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.864488 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":524759,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":44,"raft.queue_time_us":13869,"thread_start_us":553449,"threads_started":2}
I20260709 13:11:01.867712 21465 raft_consensus.cc:2376] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5. Re-sending same reply.
W20260709 13:11:01.872432 22002 leader_election.cc:336] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.532s (SENT)
I20260709 13:11:01.873045 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:01.789068 24141 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.774595 24200 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.782267 24217 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.816004 24110 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:01.912464 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 160570us
I20260709 13:11:01.884452 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:01.946174 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1774) took 1992 ms. Trace:
I20260709 13:11:01.946327 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:01.955794 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:01.967609 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 127631us
W20260709 13:11:01.965516 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 93127.3us
I20260709 13:11:01.914742 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:01.973405 21315 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:01.973615 21388 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:01.979358 22039 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.979744 21464 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:01.982303 21316 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:01.983635 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:01.984930 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.986060 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.986848 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.970935 21469 rpcz_store.cc:276] 0709 13:10:59.954099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.524734 (+570635us) service_pool.cc:224] Handling call
0709 13:11:00.525009 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.558584 (+ 33575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.558631 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.813377 (+254746us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.519804 (+706427us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:01.519860 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.520205 (+   345us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.945921 (+425716us) raft_consensus.cc:1685] finished
0709 13:11:01.945952 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.946100 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33070,"raft.queue_time_us":287170,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10843,"thread_start_us":622635,"threads_started":1,"wal-append.queue_time_us":679524}
I20260709 13:11:01.915848 24218 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:01.991959 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:01.992383 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.992916 22034 raft_consensus.cc:2410] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:01.993539 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:01.996490 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:01.997094 21469 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:11:01.998272 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:01.946327 23705 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:02.001832 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:02.002137 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:02.004501 22040 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:11:02.004716 21463 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:11:01.931053 24164 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.994220 22032 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:02.003777 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:01.974831 24176 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:01.981751 23879 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.916883 23845 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:02.004989 21465 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:02.008919 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.008813 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:02.014868 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:01.969259 24215 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:02.025418 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:01.983940 23933 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:02.029457 22042 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:02.027446 21316 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 2: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:02.032630 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 118508us
W20260709 13:11:02.034914 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.996745 23833 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:02.030807 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:02.037701 21469 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:02.031138 21312 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:11:02.023871 22039 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:02.036293 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:02.034088 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:02.003152 23943 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:01.886077 24225 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:11:01.991767 24166 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:11:01.945567 24044 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:01.994733 24239 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:11:01.995692 24129 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.043421 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.615357 24217 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:02.229260 21317 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:02.081943 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:02.554600 23879 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.035553 24218 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.618742 24157 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.619325 24217 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:02.619343 24157 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.093300 24191 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:02.619959 24217 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.260561 23990 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:02.173915 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1783) took 2096 ms. Trace:
I20260709 13:11:02.158020 24201 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:02.622152 24240 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:02.622668 24240 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:02.047029 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:02.624575 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 577619us
I20260709 13:11:02.624066 24240 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.621804 24201 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.625844 24240 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:02.626433 21469 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:02.627581 24201 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:02.162890 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:02.629917 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.620570 24191 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.622591 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.629976 21319 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
W20260709 13:11:02.123317 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.519291 21313 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.000s
W20260709 13:11:02.674523 21359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.003s	sys 0.006s
W20260709 13:11:02.674906 21359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.003s	sys 0.006s
I20260709 13:11:02.674726 21313 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
W20260709 13:11:02.675201 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 815141us
I20260709 13:11:02.675431 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 365) took 1018 ms. Trace:
I20260709 13:11:02.675851 21316 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:11:02.338409 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1941) took 1172 ms. Trace:
I20260709 13:11:02.677119 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.621385 21462 rpcz_store.cc:276] 0709 13:11:00.077026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.545318 (+1468292us) service_pool.cc:224] Handling call
0709 13:11:01.545777 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.843433 (+297656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.173577 (+330144us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54000b7f54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:02.173831 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593804160}
I20260709 13:11:02.677441 21318 rpcz_store.cc:276] 0709 13:11:01.165768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.560624 (+394856us) service_pool.cc:224] Handling call
0709 13:11:01.593641 (+ 33017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.594042 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.594082 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.594611 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.968017 (+373406us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:01.968074 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.968144 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.338117 (+369973us) raft_consensus.cc:1685] finished
0709 13:11:02.338143 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.338332 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3793,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9078,"thread_start_us":333197,"threads_started":1,"wal-append.queue_time_us":714506}
I20260709 13:11:02.094779 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1768) took 2143 ms. Trace:
I20260709 13:11:02.680835 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.157027 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:02.680313 21468 rpcz_store.cc:276] 0709 13:10:59.951813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.482454 (+530641us) service_pool.cc:224] Handling call
0709 13:11:01.104939 (+622485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.451314 (+346375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.094390 (+643076us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b540025ab54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:02.094672 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795074944}
I20260709 13:11:02.179767 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.684413 21312 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:02.057468 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:02.686065 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 628686us
W20260709 13:11:02.674983 22002 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.004s (SENT)
I20260709 13:11:02.675881 21313 rpcz_store.cc:276] 0709 13:11:01.657506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.713201 (+ 55695us) service_pool.cc:224] Handling call
0709 13:11:02.675379 (+962178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:02.698342 21321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.057s	sys 0.100s
W20260709 13:11:02.698833 21321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.057s	sys 0.100s
I20260709 13:11:02.699913 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1938) took 1534 ms. Trace:
I20260709 13:11:02.701828 21465 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:11:02.317162 23695 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
W20260709 13:11:02.118723 24222 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260709 13:11:02.119526 24143 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:02.700598 21321 rpcz_store.cc:276] 0709 13:11:01.165064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.487955 (+322891us) service_pool.cc:224] Handling call
0709 13:11:01.550602 (+ 62647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.550807 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:01.852602 (+301795us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.699478 (+846876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.699552 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:02.699614 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.699703 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.699847 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220797,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":40,"thread_start_us":1140280,"threads_started":2}
I20260709 13:11:02.705456 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.706494 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.744601 21313 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:11:02.704131 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:02.253952 24232 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:11:02.750891 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:02.458189 23916 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:02.329169 23932 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.188s	user 0.011s	sys 0.002s
W20260709 13:11:02.261727 24236 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:11:02.254554 24228 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 13:11:02.655248 24202 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.919s	user 0.011s	sys 0.000s
I20260709 13:11:02.709682 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.704054 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:02.594853 24030 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.133s	user 0.010s	sys 0.001s
I20260709 13:11:02.711460 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:02.760214 21316 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:02.760485 21315 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:02.031454 24176 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:02.323637 24047 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
I20260709 13:11:02.156222 24135 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:02.703529 23990 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.713663 23695 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.261629 23845 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.618606 23879 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:02.717358 24175 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.940s	user 0.012s	sys 0.000s
I20260709 13:11:02.717856 24250 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.718091 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:02.718338 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.720790 24206 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:02.703967 24166 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.812426 24166 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.812954 24166 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.159324 24122 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:02.722962 24141 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:02.119994 24200 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:02.099449 23833 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:02.817268 23833 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.097038 24215 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.820312 24215 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.725688 23705 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:02.822494 23705 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:02.756520 23932 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.044554 24216 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.686s
I20260709 13:11:02.826053 24216 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:02.826413 24216 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:02.826601 23932 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:02.757354 23916 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.827230 24216 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.709052 23943 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:11:02.683446 24191 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.828691 24250 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.830343 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:02.831274 21465 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:02.726925 24158 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.831599 24175 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.727345 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1931) took 2739 ms. Trace:
I20260709 13:11:02.732132 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:02.539460 24231 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:02.618709 24218 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.833524 24218 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.834146 21470 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:02.835170 23695 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:02.317704 24213 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:02.317127 24243 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:11:02.836051 23943 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:02.836393 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1777) took 2845 ms. Trace:
I20260709 13:11:02.836467 23943 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:02.753635 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:02.754765 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.754859 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:02.755429 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:02.760604 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 366) took 1102 ms. Trace:
W20260709 13:11:02.640816 24017 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.852s	user 0.011s	sys 0.001s
I20260709 13:11:02.028615 24164 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.761225 21461 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:02.043826 23933 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:02.776630 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 142438us
I20260709 13:11:02.771133 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:02.758900 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 82560.1us
W20260709 13:11:02.757731 24139 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.001s	sys 0.019s
I20260709 13:11:02.758939 24129 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:02.832324 24158 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.837440 21312 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:02.850579 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:02.851164 21312 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:02.851567 23879 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:02.810360 23845 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.853962 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.854104 23845 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:02.803934 24047 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.855124 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.855414 24164 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:02.856319 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.856763 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.856966 21394 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:02.857123 24201 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.767246 23385 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.857589 24201 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.858335 23385 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.858825 24017 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:02.859232 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 451) took 1073 ms. Trace:
I20260709 13:11:02.860116 24157 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:02.739609 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1784) took 1020 ms. Trace:
W20260709 13:11:02.833601 24236 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:02.729211 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.837718 21463 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:02.869774 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1793) took 1147 ms. Trace:
W20260709 13:11:02.869724 21314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2011) took 1711 ms (client timeout 1601 ms). Trace:
I20260709 13:11:02.870337 21463 rpcz_store.cc:276] 0709 13:11:01.722712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.731768 (+1009056us) service_pool.cc:224] Handling call
0709 13:11:02.869719 (+137951us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:02.870448 21314 rpcz_store.cc:269] 0709 13:11:01.158117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.160461 (+  2344us) service_pool.cc:224] Handling call
0709 13:11:02.729012 (+1568551us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b5800181298. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:11:02.869651 (+140639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3819392}
I20260709 13:11:02.742568 21467 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:02.856623 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1786) took 1136 ms. Trace:
I20260709 13:11:02.871624 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:02.828881 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:02.831750 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 390) took 1041 ms. Trace:
W20260709 13:11:02.861126 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.861613 21316 rpcz_store.cc:276] 0709 13:11:01.657874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.711181 (+1053307us) service_pool.cc:224] Handling call
0709 13:11:02.760550 (+ 49369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.860853 21464 rpcz_store.cc:276] 0709 13:11:01.719479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.720139 (+   660us) service_pool.cc:224] Handling call
0709 13:11:02.739409 (+1019270us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b540029b8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:02.739545 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127230720}
I20260709 13:11:02.838205 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:02.836860 21466 rpcz_store.cc:276] 0709 13:10:59.991465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.149459 (+1157994us) service_pool.cc:224] Handling call
0709 13:11:01.149811 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.220954 (+ 71143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.221042 (+    88us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.241526 (+ 20484us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.660975 (+419449us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:01.661018 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.662712 (+  1694us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b54002490d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:01.662772 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.836104 (+1173332us) raft_consensus.cc:1685] finished
0709 13:11:02.836124 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.836336 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":7459,"spinlock_wait_cycles":144587136,"thread_start_us":348624,"threads_started":1,"wal-append.queue_time_us":562340}
I20260709 13:11:02.861915 21317 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:02.743567 24143 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:02.859586 21394 rpcz_store.cc:276] 0709 13:11:01.785629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.787004 (+  1375us) service_pool.cc:224] Handling call
0709 13:11:01.787315 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.857380 (+1070065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.859014 (+  1634us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540020eed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:02.859160 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2459623296}
I20260709 13:11:02.865397 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.865998 21313 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:02.832784 21320 rpcz_store.cc:276] 0709 13:10:59.987657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.170896 (+183239us) service_pool.cc:224] Handling call
0709 13:11:00.171216 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.155111 (+983895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.155147 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.155571 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.553676 (+398105us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:01.553745 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.553835 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.727119 (+1173284us) raft_consensus.cc:1685] finished
0709 13:11:02.727138 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.727268 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":983507,"raft.queue_time_us":983618,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":397001,"threads_started":1,"wal-append.queue_time_us":553024}
I20260709 13:11:02.837319 24217 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:02.872448 21463 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:03.008280 21312 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:03.036144 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.036918 21466 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:03.037667 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1797) took 1313 ms. Trace:
I20260709 13:11:03.038138 21466 rpcz_store.cc:276] 0709 13:11:01.723809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.035866 (+1312057us) service_pool.cc:224] Handling call
0709 13:11:03.037584 (+  1718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.805229 23990 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:02.848388 24252 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:11:02.958634 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2015) took 1790 ms. Trace:
I20260709 13:11:02.963191 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1785) took 1243 ms. Trace:
I20260709 13:11:03.041935 21470 rpcz_store.cc:276] 0709 13:11:01.719837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.720243 (+   406us) service_pool.cc:224] Handling call
0709 13:11:02.963041 (+1242798us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54004312d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:02.963132 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443178880}
I20260709 13:11:03.043874 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:02.927368 21392 raft_consensus.cc:2368] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3.
I20260709 13:11:02.947738 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 448) took 1172 ms. Trace:
W20260709 13:11:02.839102 24244 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:02.932072 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:02.847906 23886 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.025s	user 0.010s	sys 0.002s
I20260709 13:11:02.945674 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:02.955928 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1767) took 3004 ms (client timeout 2028 ms). Trace:
I20260709 13:11:03.232741 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:03.238991 21467 rpcz_store.cc:269] 0709 13:10:59.951490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.436954 (+485464us) service_pool.cc:224] Handling call
0709 13:11:02.955756 (+2518802us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54003facd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:02.955861 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5285464320}
I20260709 13:11:03.034986 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 386) took 1303 ms. Trace:
I20260709 13:11:03.240201 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.240278 21463 rpcz_store.cc:276] 0709 13:11:01.731908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.871321 (+1139413us) service_pool.cc:224] Handling call
0709 13:11:03.034927 (+163606us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.241042 22041 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:03.241314 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:02.948125 24107 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:03.237394 23705 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:03.257141 24107 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:03.253829 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:03.256853 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.258008 22040 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 2.
I20260709 13:11:03.258384 21465 rpcz_store.cc:276] 0709 13:11:01.790697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.830047 (+1039350us) service_pool.cc:224] Handling call
0709 13:11:02.831673 (+  1626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.259307 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.259855 23705 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:02.872119 21461 rpcz_store.cc:276] 0709 13:11:01.720704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.724138 (+  3434us) service_pool.cc:224] Handling call
0709 13:11:02.856456 (+1132318us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54004303d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:02.856568 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273342208}
I20260709 13:11:03.071915 23990 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:03.260839 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 368) took 1602 ms. Trace:
I20260709 13:11:03.260946 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.261328 21317 rpcz_store.cc:276] 0709 13:11:01.658478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.754535 (+1096057us) service_pool.cc:224] Handling call
0709 13:11:03.260782 (+506247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16256}
I20260709 13:11:03.035439 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 1962) took 1165 ms. Trace:
I20260709 13:11:03.262521 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:03.262560 21312 rpcz_store.cc:276] 0709 13:11:01.870056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.850343 (+980287us) service_pool.cc:224] Handling call
0709 13:11:03.035383 (+185040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.847823 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:03.263793 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:02.954053 24175 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:03.046144 21468 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:03.238059 24191 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.264432 21317 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:02.980801 24166 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.265182 21318 raft_consensus.cc:2368] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3.
I20260709 13:11:03.265318 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:03.264915 21468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 388) took 1526 ms (client timeout 1946 ms). Trace:
I20260709 13:11:03.266034 21317 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:03.266264 24191 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.030462 24176 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:03.169842 24240 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
W20260709 13:11:03.173542 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 309710us
I20260709 13:11:02.964802 24017 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.052528 24143 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.190768 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:03.268906 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:03.268834 24259 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:03.270521 24259 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:03.270985 24259 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:03.120604 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:03.271839 24259 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.272457 21321 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:03.272743 21320 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:03.273145 23933 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.045810 21396 rpcz_store.cc:276] 0709 13:11:01.774970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.775112 (+   142us) service_pool.cc:224] Handling call
0709 13:11:02.947524 (+1172412us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b54002e27d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:02.947675 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119032192}
W20260709 13:11:03.274173 21218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 183) took 27647 ms (client timeout 15000 ms). Trace:
I20260709 13:11:03.274351 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1942) took 2097 ms. Trace:
I20260709 13:11:03.275096 21313 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:02.956785 24144 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.275875 24144 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:03.029726 24109 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.961014 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1793) took 2437 ms. Trace:
I20260709 13:11:02.931916 23879 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:03.278064 24144 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:03.046453 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.242344 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:02.845225 24110 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.278117 23879 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:02.977981 23916 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:02.932514 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:03.134938 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:02.954377 23932 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:02.961918 24248 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.990074 21462 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:03.225179 24201 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.030139 24216 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:02.990532 21469 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:03.135514 24215 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.280220 24191 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:03.094547 21387 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:02.985116 23385 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:03.280808 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 335192us
W20260709 13:11:03.136502 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 79916us
W20260709 13:11:03.071010 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.281733 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:02.949781 24239 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:03.278352 21315 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:03.259985 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1795) took 1536 ms. Trace:
I20260709 13:11:03.277004 24109 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.274796 21320 rpcz_store.cc:276] 0709 13:11:01.177197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.273574 (+2096377us) service_pool.cc:224] Handling call
0709 13:11:03.273888 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.274049 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.274071 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.274109 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:03.274134 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.274212 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.274306 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.277719 21391 rpcz_store.cc:276] 0709 13:11:00.523485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.523596 (+   111us) service_pool.cc:224] Handling call
0709 13:11:00.593333 (+ 69737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.154645 (+561312us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:01.555451 (+400806us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.810401 (+254950us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.814849 (+  4448us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.815002 (+   153us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:01.815039 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.815110 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.960825 (+1145715us) raft_consensus.cc:1685] finished
0709 13:11:02.960844 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.960960 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457620,"prepare.queue_time_us":614586,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":449863,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":32926,"thread_start_us":589700,"threads_started":2,"wal-append.queue_time_us":403618}
I20260709 13:11:03.350747 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.286036 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.351758 21393 raft_consensus.cc:2410] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:03.287344 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:03.276180 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:03.288542 21316 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:03.138509 21392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 454) took 1342 ms (client timeout 1534 ms). Trace:
W20260709 13:11:03.039772 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 201643us
I20260709 13:11:03.122511 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.040791 21319 rpcz_store.cc:276] 0709 13:11:01.168319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.957745 (+1789426us) service_pool.cc:224] Handling call
0709 13:11:02.958113 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.958301 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.958330 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.958377 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:02.958413 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.958470 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.958575 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:03.266232 21468 rpcz_store.cc:269] 0709 13:11:01.739204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.828563 (+1089359us) service_pool.cc:224] Handling call
0709 13:11:03.264856 (+436293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.261649 21461 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:03.292757 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 382) took 1326 ms. Trace:
I20260709 13:11:03.273418 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:03.266891 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:03.296358 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:03.311818 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:02.856702 24047 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:02.861436 24139 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.001s	sys 0.024s
I20260709 13:11:03.313711 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.290882 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.330289 21388 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:03.331058 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:03.274583 21218 rpcz_store.cc:269] 0709 13:10:35.627048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.627294 (+   246us) service_pool.cc:224] Handling call
0709 13:11:03.274104 (+27646810us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:58.569539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:58.625805 (+ 56266us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:58.625858 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:10:58.625879 (+    21us) tablet.cc:662] Decoding operations
0709 13:10:58.626786 (+   907us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:58.626892 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:58.626925 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:58.627665 (+   740us) tablet.cc:701] Row locks acquired
0709 13:10:58.627714 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:10:58.627903 (+   189us) write_op.cc:270] Start()
0709 13:10:58.649710 (+ 21807us) write_op.cc:276] Timestamp: P: 1783602658627836 usec, L: 0
0709 13:10:58.649743 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:10:58.783508 (+133765us) log.cc:844] Serialized 2084 byte log entry
0709 13:11:00.150437 (+1366929us) op_driver.cc:464] REPLICATION: finished
0709 13:11:00.445729 (+295292us) write_op.cc:301] APPLY: starting
0709 13:11:00.472408 (+ 26679us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:00.472675 (+   267us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:00.472872 (+   197us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:00.473832 (+   960us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:00.474195 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:11:00.474267 (+    72us) write_op.cc:312] APPLY: finished
0709 13:11:00.474654 (+   387us) log.cc:844] Serialized 47 byte log entry
0709 13:11:00.474845 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:00.474950 (+   105us) write_op.cc:454] Released schema lock
0709 13:11:00.475003 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:00.475429 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:00.475470 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14833,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":254157,"apply.run_cpu_time_us":3218,"apply.run_wall_time_us":51631,"num_ops":5,"prepare.queue_time_us":108169,"prepare.run_cpu_time_us":13407,"prepare.run_wall_time_us":503398,"raft.queue_time_us":426385,"raft.run_cpu_time_us":13169,"raft.run_wall_time_us":308316,"replication_time_us":1480997,"thread_start_us":578734,"threads_started":4,"wal-append.queue_time_us":336262,"wal-append.run_cpu_time_us":46972,"wal-append.run_wall_time_us":2320961}]]}
I20260709 13:11:03.334581 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.266650 24166 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:02.976539 24250 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:03.337350 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1792) took 1614 ms (client timeout 1940 ms). Trace:
I20260709 13:11:03.101369 24231 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:03.200284 24158 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.339643 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:03.341931 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.102051 24203 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.342187 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.343358 24144 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.347018 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 1959) took 1548 ms. Trace:
I20260709 13:11:03.347024 21465 rpcz_store.cc:276] 0709 13:11:01.723270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.259060 (+1535790us) service_pool.cc:224] Handling call
0709 13:11:03.259933 (+   873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.346845 21467 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:03.285838 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.234779 24218 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.341297 24191 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.340776 23932 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:03.537354 24191 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:03.539498 23932 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:03.529471 24109 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:03.532092 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 387) took 1799 ms (client timeout 1857 ms). Trace:
W20260709 13:11:03.540480 21469 rpcz_store.cc:269] 0709 13:11:01.732225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.069974 (+337749us) service_pool.cc:224] Handling call
0709 13:11:03.531871 (+1461897us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b5400249fd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:03.532005 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18978048}
I20260709 13:11:03.530790 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1945) took 2340 ms. Trace:
I20260709 13:11:03.541589 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.541531 21320 rpcz_store.cc:276] 0709 13:11:01.190395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.529799 (+2339404us) service_pool.cc:224] Handling call
0709 13:11:03.530183 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.530401 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.530439 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.530487 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:03.530529 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.530599 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.530725 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.542894 24231 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:03.543661 24231 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.544003 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1946) took 2335 ms. Trace:
I20260709 13:11:03.544381 21320 rpcz_store.cc:276] 0709 13:11:01.208564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.543166 (+2334602us) service_pool.cc:224] Handling call
0709 13:11:03.543483 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.543664 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.543693 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.543737 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:03.543775 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.543835 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.543948 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.544497 23990 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.546219 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1947) took 2330 ms. Trace:
I20260709 13:11:03.546535 21320 rpcz_store.cc:276] 0709 13:11:01.215494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.545504 (+2330010us) service_pool.cc:224] Handling call
0709 13:11:03.545780 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.545928 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.545952 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.545990 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:03.546017 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.546063 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.546172 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.547192 21463 raft_consensus.cc:2376] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8. Re-sending same reply.
W20260709 13:11:03.346535 21285 connection.cc:256] RPC call timeout handler was delayed by -2.1459682280000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:11:03.344362 24248 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.548238 24109 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:03.548853 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7265682280000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:11:03.549274 21285 connection.cc:256] RPC call timeout handler was delayed by -1.3737682280000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.255s for a response
I20260709 13:11:03.536285 24143 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.549271 24109 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:03.533016 21387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1777) took 3530 ms (client timeout 2214 ms). Trace:
I20260709 13:11:03.551541 24143 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:02.837360 23943 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:03.551733 21387 rpcz_store.cc:269] 0709 13:11:00.002935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.003071 (+   136us) service_pool.cc:224] Handling call
0709 13:11:03.532791 (+3529720us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b54001c4154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:03.532913 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6531227520}
I20260709 13:11:03.552461 22032 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:03.552850 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:03.549955 21285 connection.cc:256] RPC call timeout handler was delayed by -1.3566682279999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2569s for a response
W20260709 13:11:03.554214 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2000682279999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2743s for a response
I20260709 13:11:03.554023 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.555236 21393 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:03.555401 24248 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:03.554601 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1442682279999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2805s for a response
I20260709 13:11:03.556061 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.542236 21469 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:03.533432 23879 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:03.548277 21463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 391) took 1748 ms (client timeout 2004 ms). Trace:
I20260709 13:11:03.554034 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.557142 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.557695 21387 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:03.558275 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.558537 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.559087 21387 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 2.
I20260709 13:11:03.559336 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:03.555949 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0290682280000283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2933s for a response
W20260709 13:11:03.556964 21463 rpcz_store.cc:269] 0709 13:11:01.800266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.241075 (+1440809us) service_pool.cc:224] Handling call
0709 13:11:03.548137 (+307062us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54000b8954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:03.548229 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702137728}
I20260709 13:11:03.552456 24109 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:03.560681 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.561057 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.561774 21394 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 3: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:03.559911 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.562233 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:03.562280 21387 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:11:03.563318 21318 rpcz_store.cc:276] 0709 13:11:01.966068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.697687 (+731619us) service_pool.cc:224] Handling call
0709 13:11:03.292507 (+594820us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540021a7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:03.292688 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044538624}
I20260709 13:11:03.536774 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.565083 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1949) took 2266 ms. Trace:
I20260709 13:11:03.565492 21464 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:03.565459 21318 rpcz_store.cc:276] 0709 13:11:01.298251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.564219 (+2265968us) service_pool.cc:224] Handling call
0709 13:11:03.564595 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.564780 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.564817 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.564863 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:03.564894 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.564941 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.565034 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.566222 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.566434 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.567070 22038 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:11:03.567543 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.567932 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.568115 22041 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:03.568584 22038 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:03.562435 23990 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.572363 22040 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:03.568944 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.569591 21470 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:03.577004 22041 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:03.352430 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:03.578167 22035 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:03.570174 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:03.570344 21462 rpcz_store.cc:269] 0709 13:11:01.722448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.710908 (+988460us) service_pool.cc:224] Handling call
0709 13:11:03.337267 (+626359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.563158 21312 raft_consensus.cc:2368] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
W20260709 13:11:03.570968 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1796) took 1847 ms (client timeout 2192 ms). Trace:
W20260709 13:11:03.580945 21461 rpcz_store.cc:269] 0709 13:11:01.723537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.260695 (+1537158us) service_pool.cc:224] Handling call
0709 13:11:03.570909 (+310214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:03.570914 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 274678us
I20260709 13:11:03.581774 21312 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:03.563051 21390 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:03.582600 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2023) took 2127 ms. Trace:
I20260709 13:11:03.570091 21317 raft_consensus.cc:2410] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:11:03.557183 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:03.583249 21469 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:03.567035 21464 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 1.
I20260709 13:11:03.579656 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.594851 23879 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:03.594978 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.596254 24203 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.562163 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.598066 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:03.701324 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.664158 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.627367 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:03.716918 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.663295 21388 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:03.662675 22034 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:03.883206 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.891397 22041 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:03.893532 21313 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:03.886425 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.629004 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.657955 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1956) took 2202 ms. Trace:
W20260709 13:11:03.616528 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55984.3us
I20260709 13:11:03.894997 21317 rpcz_store.cc:276] 0709 13:11:01.455988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.583372 (+2127384us) service_pool.cc:224] Handling call
0709 13:11:03.657229 (+ 73857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.657466 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.657505 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.657565 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:03.657609 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.657703 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.657866 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.884011 21465 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:03.895905 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:03.759004 21469 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:03.896710 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1543) took 1178 ms. Trace:
I20260709 13:11:03.896888 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1801) took 1277 ms. Trace:
I20260709 13:11:03.894567 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1539) took 1181 ms. Trace:
I20260709 13:11:03.897430 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:03.887409 21392 rpcz_store.cc:269] 0709 13:11:01.796572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.796935 (+   363us) service_pool.cc:224] Handling call
0709 13:11:03.138226 (+1341291us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000baed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:03.138428 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340816256}
I20260709 13:11:03.898106 21464 rpcz_store.cc:276] 0709 13:11:02.713310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.627722 (+914412us) service_pool.cc:224] Handling call
0709 13:11:03.894490 (+266768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918912}
I20260709 13:11:03.899353 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:03.888422 21315 rpcz_store.cc:276] 0709 13:11:01.798657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.811719 (+1013062us) service_pool.cc:224] Handling call
0709 13:11:03.346950 (+535231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.628177 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:03.800629 21997 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.003s	sys 0.016s
I20260709 13:11:03.902097 22038 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:03.886179 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.886191 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.897408 21469 rpcz_store.cc:276] 0709 13:11:02.619684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.557006 (+937322us) service_pool.cc:224] Handling call
0709 13:11:03.896834 (+339828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.892831 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1943) took 2709 ms. Trace:
I20260709 13:11:03.903791 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.903735 21316 rpcz_store.cc:276] 0709 13:11:01.184188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.287796 (+2103608us) service_pool.cc:224] Handling call
0709 13:11:03.288154 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.892584 (+604430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.892779 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.899403 21392 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:03.892318 22036 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:03.899708 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.906095 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1531) took 1288 ms. Trace:
I20260709 13:11:03.906549 21464 rpcz_store.cc:276] 0709 13:11:02.617512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.899417 (+1281905us) service_pool.cc:224] Handling call
0709 13:11:03.906021 (+  6604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.907662 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.908396 24166 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:03.908993 24166 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:03.911038 24166 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:03.656925 23990 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.911703 23990 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:03.914322 23990 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:03.914569 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.900734 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:03.915393 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:03.916060 21392 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:03.901144 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:03.902127 21997 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.004s	sys 0.017s
W20260709 13:11:03.917172 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 625105us
I20260709 13:11:03.902944 21461 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:03.917361 21464 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:03.918256 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1541) took 1201 ms. Trace:
I20260709 13:11:03.918395 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1540) took 1203 ms. Trace:
I20260709 13:11:03.918666 21461 rpcz_store.cc:276] 0709 13:11:02.717239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.581962 (+864723us) service_pool.cc:224] Handling call
0709 13:11:03.918200 (+336238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773760}
I20260709 13:11:03.629154 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:03.582996 21312 rpcz_store.cc:276] 0709 13:11:01.455594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.581086 (+2125492us) service_pool.cc:224] Handling call
0709 13:11:03.581490 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.582291 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.582528 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.908479 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1538) took 1200 ms. Trace:
I20260709 13:11:03.920011 21468 rpcz_store.cc:276] 0709 13:11:02.708183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.569648 (+861465us) service_pool.cc:224] Handling call
0709 13:11:03.908420 (+338772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432}
W20260709 13:11:03.629485 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 289907us
I20260709 13:11:03.885859 21466 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:03.897209 21465 rpcz_store.cc:276] 0709 13:11:02.718696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.597828 (+879132us) service_pool.cc:224] Handling call
0709 13:11:03.896635 (+298807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.311194 24217 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.918941 21464 rpcz_store.cc:276] 0709 13:11:02.714823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.907353 (+1192530us) service_pool.cc:224] Handling call
0709 13:11:03.918321 (+ 10968us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:03.921314 21466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1789) took 2199 ms (client timeout 2071 ms). Trace:
W20260709 13:11:03.940845 21466 rpcz_store.cc:269] 0709 13:11:01.721622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.122203 (+1400581us) service_pool.cc:224] Handling call
0709 13:11:03.921248 (+799045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.943760 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.596266 24109 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:03.971776 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:03.833593 24259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.019s
I20260709 13:11:03.929035 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.834075 24218 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:03.904402 24044 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:03.979879 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1537) took 1283 ms. Trace:
I20260709 13:11:03.991163 21464 rpcz_store.cc:276] 0709 13:11:02.696406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.943468 (+1247062us) service_pool.cc:224] Handling call
0709 13:11:03.979775 (+ 36307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.992316 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.993345 21464 raft_consensus.cc:2410] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:03.983456 23990 raft_consensus.cc:2764] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:04.016342 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1529) took 1400 ms. Trace:
I20260709 13:11:04.016857 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.930733 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:04.018169 21461 raft_consensus.cc:2410] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:04.018750 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 397) took 2051 ms. Trace:
I20260709 13:11:04.019240 21465 rpcz_store.cc:276] 0709 13:11:01.967003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.930484 (+1963481us) service_pool.cc:224] Handling call
0709 13:11:04.018668 (+ 88184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.931455 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.930770 22035 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:04.020435 22041 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:03.933229 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:03.933918 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 351156us
I20260709 13:11:03.949018 21389 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:03.942149 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:03.960677 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:03.964432 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.026921 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:04.029255 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.030817 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:04.035218 21997 connection.cc:256] RPC call timeout handler was delayed by -1.373418847000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27090000000000003s for a response
W20260709 13:11:03.969300 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68220.5us
I20260709 13:11:03.672354 24203 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:03.540227 24239 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:11:04.025161 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:03.982451 24248 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:04.000408 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:04.047115 21313 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:04.001262 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:04.047170 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:03.928125 24053 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:03.984078 24259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.008s	sys 0.019s
I20260709 13:11:03.917269 24262 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:04.062335 24262 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:04.062844 24262 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:04.063578 24231 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260709 13:11:04.064039 24231 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.066112 24231 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:04.066802 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:04.067593 21313 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:04.068384 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:04.068982 21313 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:04.069805 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:04.070647 21313 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:04.071499 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:04.073616 21313 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:04.074136 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1957) took 2601 ms. Trace:
I20260709 13:11:04.074450 21313 rpcz_store.cc:276] 0709 13:11:01.472734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.072913 (+2600179us) service_pool.cc:224] Handling call
0709 13:11:04.073267 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.073929 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.074090 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.928882 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1535) took 1240 ms. Trace:
I20260709 13:11:03.972124 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:04.077309 21469 rpcz_store.cc:276] 0709 13:11:02.688913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.903503 (+1214590us) service_pool.cc:224] Handling call
0709 13:11:03.928820 (+ 25317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.077634 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1804) took 1441 ms. Trace:
I20260709 13:11:04.077996 21468 rpcz_store.cc:276] 0709 13:11:02.636359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.920780 (+1284421us) service_pool.cc:224] Handling call
0709 13:11:04.077579 (+156799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.078397 21469 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:04.042171 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:03.990321 24107 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.732s	user 0.016s	sys 0.000s
I20260709 13:11:04.078951 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 385) took 2347 ms. Trace:
I20260709 13:11:04.079303 24107 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.079810 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:04.080577 22041 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.081475 24239 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:04.081743 24107 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:04.082326 21396 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:03.972489 22040 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:03.919318 24144 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.084408 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.084494 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:04.085004 21396 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:03.981961 24109 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:04.044265 24203 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:04.085523 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:04.085906 24109 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.085989 24203 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:04.086596 24203 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.087405 22031 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:04.087891 21395 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:04.089154 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:04.089519 22031 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:04.090206 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.090900 22031 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:04.091463 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:04.045766 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:04.048192 21319 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:04.092181 24166 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:04.094167 24216 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.001s
I20260709 13:11:04.094380 24166 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:04.094836 24166 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.048892 22038 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:04.047454 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1800) took 1428 ms. Trace:
I20260709 13:11:04.096263 21466 rpcz_store.cc:276] 0709 13:11:02.619388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.941789 (+1322401us) service_pool.cc:224] Handling call
0709 13:11:04.047387 (+105598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.096714 24250 raft_consensus.cc:1064] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:11:04.085598 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:04.098671 22040 raft_consensus.cc:2410] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:03.949774 24217 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:04.059125 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 125985us
I20260709 13:11:04.099647 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.059207 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.053049 24248 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:04.044193 24266 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:11:04.046813 24218 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:04.061342 24259 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:04.053432 24044 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:11:04.047871 24139 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:04.098573 21319 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:04.098683 22042 raft_consensus.cc:2410] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:04.085666 24144 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:04.079304 21469 rpcz_store.cc:276] 0709 13:11:01.731626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.077973 (+2346347us) service_pool.cc:224] Handling call
0709 13:11:04.078239 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.078753 (+   514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.078903 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:04.121762 22002 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.082s (SENT)
I20260709 13:11:04.016919 21464 rpcz_store.cc:276] 0709 13:11:02.615970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.991982 (+1376012us) service_pool.cc:224] Handling call
0709 13:11:04.016273 (+ 24291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.122249 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:04.123421 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 400) took 2138 ms. Trace:
I20260709 13:11:04.123901 21464 rpcz_store.cc:276] 0709 13:11:01.984962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.122516 (+2137554us) service_pool.cc:224] Handling call
0709 13:11:04.122825 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.123025 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.123063 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.123120 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:04.123164 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.123231 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.123358 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:04.125813 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.122s (SENT)
I20260709 13:11:04.126438 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:04.104127 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:11:03.351755 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.131438 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.040392 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 393) took 2210 ms. Trace:
I20260709 13:11:04.133349 21461 rpcz_store.cc:276] 0709 13:11:01.830443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.946537 (+2116094us) service_pool.cc:224] Handling call
0709 13:11:04.040294 (+ 93757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.106973 21395 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:04.085799 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.045846 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:04.115023 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:04.137625 22035 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:04.120398 21313 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:04.103856 21467 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
W20260709 13:11:04.140698 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1798) took 2416 ms (client timeout 2070 ms). Trace:
W20260709 13:11:04.141059 21467 rpcz_store.cc:269] 0709 13:11:01.730980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.239958 (+1508978us) service_pool.cc:224] Handling call
0709 13:11:04.140635 (+900677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.129216 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.142534 21469 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [6.7-7.8]
I20260709 13:11:04.146255 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 362) took 2497 ms. Trace:
I20260709 13:11:04.146682 21313 rpcz_store.cc:276] 0709 13:11:01.655321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.075111 (+2419790us) service_pool.cc:224] Handling call
0709 13:11:04.120227 (+ 45116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.137991 (+ 17764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.146058 (+  8067us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54003becd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:04.146193 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103047424}
I20260709 13:11:04.149279 24217 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:04.149881 24217 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:04.151438 24217 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:04.152748 24262 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.154906 24262 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:04.118494 24218 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:04.114703 24248 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.135046 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.160006 21395 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:11:04.160957 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.162011 21462 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:11:04.162405 21462 pending_rounds.cc:85] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 6
I20260709 13:11:04.162623 21462 pending_rounds.cc:107] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:11:04.162853 21462 raft_consensus.cc:2889] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:04.160174 21396 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:04.164024 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.165031 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.165588 22041 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:11:04.165961 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:04.166512 21396 raft_consensus.cc:2376] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7. Re-sending same reply.
I20260709 13:11:04.167263 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.151811 24217 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.176692 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:04.177543 21320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.019s	sys 0.041s
W20260709 13:11:04.178046 21320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.019s	sys 0.041s
I20260709 13:11:04.181120 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:04.182543 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1536) took 1489 ms. Trace:
I20260709 13:11:04.183080 21462 rpcz_store.cc:276] 0709 13:11:02.693602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.136866 (+1443264us) service_pool.cc:224] Handling call
0709 13:11:04.137130 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.182192 (+ 45062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.182457 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.186648 21461 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:04.186205 21319 raft_consensus.cc:2955] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:04.187264 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1803) took 1551 ms. Trace:
I20260709 13:11:04.188167 21461 rpcz_store.cc:276] 0709 13:11:02.636005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.134205 (+1498200us) service_pool.cc:224] Handling call
0709 13:11:04.186329 (+ 52124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.187024 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.187211 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.189040 21388 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:04.127625 24216 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:04.193485 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.197925 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.198761 21389 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:04.159448 24218 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.203186 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.175236 23990 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:11:04.204141 21395 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:04.181910 24217 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.212591 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.213580 21388 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:04.219839 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:04.220789 21395 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.223603 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.224468 21389 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:04.224849 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.226462 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.228464 21316 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:04.229353 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 374) took 2483 ms. Trace:
I20260709 13:11:04.230104 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 732) took 1003 ms. Trace:
I20260709 13:11:04.230633 22042 rpcz_store.cc:276] 0709 13:11:03.227230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.227770 (+   540us) service_pool.cc:224] Handling call
0709 13:11:04.229912 (+1002142us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:04.230036 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975950208}
I20260709 13:11:04.229750 21316 rpcz_store.cc:276] 0709 13:11:01.745651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.227884 (+2482233us) service_pool.cc:224] Handling call
0709 13:11:04.228225 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.229007 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.229285 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.238713 21390 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:04.199661 24053 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.246416 21316 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:04.247468 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2031) took 1605 ms. Trace:
I20260709 13:11:04.247967 21312 rpcz_store.cc:276] 0709 13:11:02.642391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.246650 (+1604259us) service_pool.cc:224] Handling call
0709 13:11:04.246904 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.247077 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.247111 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.247163 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:04.247206 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.247272 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.247403 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.249704 21312 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:04.250321 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2036) took 1318 ms. Trace:
I20260709 13:11:04.250677 21312 rpcz_store.cc:276] 0709 13:11:02.932077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.249173 (+1317096us) service_pool.cc:224] Handling call
0709 13:11:04.249492 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.250091 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.250260 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.252184 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:04.256762 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2033) took 1405 ms. Trace:
I20260709 13:11:04.257175 21316 rpcz_store.cc:276] 0709 13:11:02.851534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.245832 (+1394298us) service_pool.cc:224] Handling call
0709 13:11:04.246107 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.246856 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.256704 (+  9848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.262578 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.263413 21388 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:04.265175 21312 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:04.266057 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2039) took 1292 ms. Trace:
I20260709 13:11:04.266543 21312 rpcz_store.cc:276] 0709 13:11:02.973814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.264395 (+1290581us) service_pool.cc:224] Handling call
0709 13:11:04.264768 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.265745 (+   977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.265992 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:04.240618 24191 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.703s	user 0.014s	sys 0.004s
I20260709 13:11:04.268968 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.278698 21389 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:11:04.199461 24262 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:11:04.297036 21392 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:04.298779 21392 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:04.301285 21388 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:11:04.301949 21388 pending_rounds.cc:85] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 2
I20260709 13:11:04.302232 21388 pending_rounds.cc:107] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:11:04.302521 21388 raft_consensus.cc:2889] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:04.332486 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 399) took 2355 ms. Trace:
I20260709 13:11:04.332932 21469 rpcz_store.cc:276] 0709 13:11:01.977083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.121700 (+2144617us) service_pool.cc:224] Handling call
0709 13:11:04.142299 (+ 20599us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:04.142995 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.332260 (+189265us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400249ad0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:04.332411 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46479104}
I20260709 13:11:04.334618 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:04.335281 21391 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:11:04.335731 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1534) took 1046 ms. Trace:
I20260709 13:11:04.336009 21391 rpcz_store.cc:276] 0709 13:11:03.289821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.565135 (+275314us) service_pool.cc:224] Handling call
0709 13:11:04.334482 (+769347us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b5800124e98. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:11:04.335676 (+  1194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146396032}
W20260709 13:11:04.338630 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1794) took 2615 ms (client timeout 2028 ms). Trace:
W20260709 13:11:04.339154 21470 rpcz_store.cc:269] 0709 13:11:01.722993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.043531 (+1320538us) service_pool.cc:224] Handling call
0709 13:11:04.338395 (+1294864us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54003facd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:04.338543 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207109888}
W20260709 13:11:04.339815 24268 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:04.341209 21395 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:04.341317 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 730) took 1269 ms. Trace:
I20260709 13:11:04.341862 22034 rpcz_store.cc:276] 0709 13:11:03.071622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.071797 (+   175us) service_pool.cc:224] Handling call
0709 13:11:03.072200 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.891176 (+818976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.340984 (+449808us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54006c5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:04.341192 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345569152}
I20260709 13:11:04.344327 23990 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:04.345023 23990 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.347642 23990 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:04.289960 24109 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.397711 24109 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:04.293318 24191 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.271523 24216 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:04.261019 24053 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.364893 21215 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 3 to 6, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 6 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:04.366422 24264 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.566s	user 0.016s	sys 0.022s
I20260709 13:11:04.366295 24203 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.355636 23943 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:04.372354 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.380548 24166 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.401077 21463 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:04.403748 24216 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:04.430744 24216 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.431315 24216 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:04.436834 24191 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:04.438207 21314 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:04.375136 24250 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.425098 21215 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 3 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 4 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.445794 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2029) took 2020 ms. Trace:
I20260709 13:11:04.446367 21314 rpcz_store.cc:276] 0709 13:11:02.425551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.932229 (+506678us) service_pool.cc:224] Handling call
0709 13:11:04.445424 (+1513195us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000fcb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:04.445614 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534620544}
W20260709 13:11:04.449597 21463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1533) took 1830 ms (client timeout 1839 ms). Trace:
W20260709 13:11:04.450181 21463 rpcz_store.cc:269] 0709 13:11:02.619342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.561958 (+942616us) service_pool.cc:224] Handling call
0709 13:11:04.449338 (+887380us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400352fd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:04.449520 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154692352}
I20260709 13:11:04.455976 21466 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:04.470230 21215 catalog_manager.cc:5697] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:11:04.513509 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.526058 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2020) took 3229 ms. Trace:
I20260709 13:11:04.526645 21320 rpcz_store.cc:276] 0709 13:11:01.296735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.547367 (+2250632us) service_pool.cc:224] Handling call
0709 13:11:03.547658 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.547978 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.548004 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.571683 (+ 23679us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.178531 (+606848us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:04.178587 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.178682 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.525731 (+347049us) raft_consensus.cc:1685] finished
0709 13:11:04.525760 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.525979 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17008,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":504104,"threads_started":1,"wal-append.queue_time_us":773804}
W20260709 13:11:04.529556 21321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.020s	sys 0.016s
W20260709 13:11:04.529925 21321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.020s	sys 0.016s
I20260709 13:11:04.511276 21215 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:11:04.531260 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 494050us
W20260709 13:11:04.533411 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 508340us
I20260709 13:11:04.482771 24191 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:04.426465 24248 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:04.539079 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 422806us
I20260709 13:11:04.539759 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:04.534353 21436 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:04.533988 21215 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:04.535805 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 398) took 2564 ms. Trace:
W20260709 13:11:04.534148 24265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.000s	sys 0.030s
I20260709 13:11:04.509824 24053 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:04.544952 21466 rpcz_store.cc:276] 0709 13:11:01.971819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.096900 (+2125081us) service_pool.cc:224] Handling call
0709 13:11:04.451524 (+354624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.482413 (+ 30889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.535539 (+ 53126us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400352fd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:04.535727 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814812416}
I20260709 13:11:04.536950 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 383) took 1776 ms. Trace:
I20260709 13:11:04.567579 22039 rpcz_store.cc:276] 0709 13:11:02.760344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.760482 (+   138us) service_pool.cc:224] Handling call
0709 13:11:02.760898 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.761211 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.761238 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.850216 (+ 88978us) log.cc:844] Serialized 26 byte log entry
0709 13:11:03.310451 (+460235us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:03.310500 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.310570 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.365681 (+1055111us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:04.536575 (+170894us) raft_consensus.cc:1685] finished
0709 13:11:04.536616 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.536876 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5959,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":21923,"spinlock_wait_cycles":75505920,"thread_start_us":459786,"threads_started":1,"wal-append.queue_time_us":907026}
I20260709 13:11:04.546533 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:04.566928 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:04.570633 21469 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.552790 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:04.572830 21461 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.553648 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:04.564170 21470 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:04.579942 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 46722.8us
I20260709 13:11:04.580061 24053 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:04.581027 24053 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:04.581357 24053 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:04.582122 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:04.582240 24053 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.583549 24053 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.585505 23990 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:04.586066 23990 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.586488 23990 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.588907 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:04.594300 21461 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:11:04.554905 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:04.564878 21215 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 7, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 7 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:04.595628 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50614.9us
I20260709 13:11:04.596120 21215 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:11:04.547912 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.002s	sys 0.013s
W20260709 13:11:04.597890 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.003s	sys 0.013s
I20260709 13:11:04.552922 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:04.599036 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46189.9us
W20260709 13:11:04.598327 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 676891us
I20260709 13:11:04.600639 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.600730 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:04.547331 24109 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:04.592868 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:04.606276 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.606623 21469 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:04.537572 24262 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:11:04.608111 21436 leader_election.cc:400] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
I20260709 13:11:04.609966 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.610409 21436 leader_election.cc:403] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:04.538744 24191 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.616058 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:04.613626 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:04.547133 23845 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:11:04.613473 21215 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 3 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:04.608564 24158 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:04.605109 24239 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:04.636139 24239 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.636673 24239 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:04.636876 24273 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:11:04.637630 24017 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:04.638028 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2022) took 3184 ms. Trace:
I20260709 13:11:04.638140 24017 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.638677 24017 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.590510 24231 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:04.640260 24231 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.640739 24231 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.644673 24239 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.647002 24239 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:04.602429 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:04.619369 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:04.635536 24144 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:04.636224 21316 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:04.650207 24144 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:04.650556 24231 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.651187 24144 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.652699 24203 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:04.653339 24203 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:04.653671 24203 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.653990 24203 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.656172 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.657325 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:04.657544 21469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:11:04.658239 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:04.658527 21469 raft_consensus.cc:606] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.659018 21469 raft_consensus.cc:614] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:04.659408 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.660763 24166 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:04.631875 21215 catalog_manager.cc:5697] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 6, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 6 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.665098 24248 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:04.664441 21215 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 5 to 7, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 7 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.666610 21215 catalog_manager.cc:5697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 7, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 7 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.673900 21469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:11:04.609360 24109 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.567150 24218 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:04.611361 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:04.720960 21314 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:04.638413 21318 rpcz_store.cc:276] 0709 13:11:01.453158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.571884 (+2118726us) service_pool.cc:224] Handling call
0709 13:11:03.572228 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.606142 (+ 33914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.606190 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.606741 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.240642 (+633901us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:04.240684 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.240749 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.637827 (+397078us) raft_consensus.cc:1685] finished
0709 13:11:04.637847 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.637973 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30390,"raft.queue_time_us":32068,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":21769,"thread_start_us":472655,"threads_started":1,"wal-append.queue_time_us":858037}
I20260709 13:11:04.724485 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:04.725201 21318 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:04.684525 21359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.015s	sys 0.013s
W20260709 13:11:04.726663 21359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.015s	sys 0.013s
I20260709 13:11:04.608381 24225 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:11:04.682677 24107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.019s	sys 0.013s
I20260709 13:11:04.634200 24262 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:04.680023 24158 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:04.688567 21393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.016s	sys 0.016s
I20260709 13:11:04.682224 24265 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:04.690299 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:04.764246 22002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.042s
I20260709 13:11:04.756961 21215 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 7, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 7 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:11:04.694821 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.011s	sys 0.017s
W20260709 13:11:04.765273 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.011s	sys 0.017s
W20260709 13:11:04.701761 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.016s
W20260709 13:11:04.766264 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.008s	sys 0.016s
W20260709 13:11:04.766587 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 720760us
I20260709 13:11:04.707823 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.708194 21469 raft_consensus.cc:606] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:11:04.744506 21394 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.020s	sys 0.023s
I20260709 13:11:04.768766 21469 raft_consensus.cc:614] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:04.768906 21394 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.020s	sys 0.023s
W20260709 13:11:04.765919 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 661983us
I20260709 13:11:04.753785 21318 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
W20260709 13:11:04.686836 24259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.012s	sys 0.019s
W20260709 13:11:04.756943 21393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.017s	sys 0.017s
W20260709 13:11:04.755748 21315 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.048s
W20260709 13:11:04.757460 21317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.012s	sys 0.030s
W20260709 13:11:04.690897 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.764783 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 74620.7us
W20260709 13:11:04.770779 21315 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.049s
W20260709 13:11:04.772751 22002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.004s	sys 0.042s
W20260709 13:11:04.770768 21317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.013s	sys 0.030s
W20260709 13:11:04.719909 24139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.002s	sys 0.021s
I20260709 13:11:04.744676 23833 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:04.795621 23833 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.790069 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:04.796200 23833 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:04.720423 24109 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.773514 21215 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:04.765285 21314 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
W20260709 13:11:04.772572 22031 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.010s	sys 0.035s
I20260709 13:11:04.793998 21997 leader_election.cc:400] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9.
I20260709 13:11:04.805981 21997 leader_election.cc:403] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:11:04.806247 22031 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.014s	sys 0.035s
W20260709 13:11:04.812934 21319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.028s
W20260709 13:11:04.813446 21319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.005s	sys 0.028s
W20260709 13:11:04.794286 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 668470us
W20260709 13:11:04.755549 24107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.019s	sys 0.013s
W20260709 13:11:04.774396 24259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.013s	sys 0.020s
W20260709 13:11:04.766355 24217 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.004s
W20260709 13:11:04.798695 21464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.011s	sys 0.015s
I20260709 13:11:04.764071 24158 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.756644 24262 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:04.764325 24265 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:04.827674 21215 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 4, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 4 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:04.798650 24139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.003s	sys 0.021s
W20260709 13:11:04.818980 21464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.011s	sys 0.015s
I20260709 13:11:04.844599 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1530) took 2227 ms. Trace:
I20260709 13:11:04.845094 21464 rpcz_store.cc:276] 0709 13:11:02.616702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.126485 (+1509783us) service_pool.cc:224] Handling call
0709 13:11:04.126822 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.844094 (+717272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.844147 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.844209 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:04.844260 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.844356 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.844524 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24115,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":716528,"threads_started":1}
W20260709 13:11:04.826089 22002 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.170s (SENT)
I20260709 13:11:04.764401 24216 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:04.849831 21468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.020s
W20260709 13:11:04.850363 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.884516 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:04.882900 21468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.000s	sys 0.020s
I20260709 13:11:04.885495 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:04.887041 22042 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:11:04.893924 22035 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:11:04.898835 22034 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:04.897197 24284 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:04.901355 24285 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:04.901721 24284 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:04.902412 24284 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:04.806653 24282 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
I20260709 13:11:04.900332 21215 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 6, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 6 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.901805 24281 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.818323 24259 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:04.842832 24265 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.915444 21464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:11:04.895147 24248 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:04.843437 24139 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:04.841171 24217 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.022357 21215 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 6, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 6 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:05.039826 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 267778us
I20260709 13:11:04.922637 24282 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 13:11:05.086027 21434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 2.682s (SENT) [suppressed 45 similar messages]
I20260709 13:11:04.899194 23845 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:04.903263 24284 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:05.100067 21434 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 2.214s (SENT)
I20260709 13:11:05.100605 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:05.056171 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 439376us
W20260709 13:11:05.056448 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.058367 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 455994us
I20260709 13:11:05.062968 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1787) took 3342 ms. Trace:
I20260709 13:11:05.103431 21465 rpcz_store.cc:276] 0709 13:11:01.721052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.042871 (+2321819us) service_pool.cc:224] Handling call
0709 13:11:04.043256 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.043517 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:04.548608 (+505091us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.062552 (+513944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.062618 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:05.062675 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.062758 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.062900 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":856060,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":965232,"threads_started":2}
I20260709 13:11:04.914420 24225 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:05.060318 24047 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:05.060717 22002 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.656s (SENT)
I20260709 13:11:05.177881 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:05.059252 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:04.989828 24191 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:05.105841 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 292498us
I20260709 13:11:05.144678 24225 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:05.113690 21215 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 5 to 7, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 7 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.098419 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:04.989887 24166 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:11:04.923198 24281 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:04.989744 24290 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 13:11:05.233484 21215 catalog_manager.cc:5697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.949374 24262 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:05.068452 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 392637us
I20260709 13:11:05.147075 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 370) took 3488 ms. Trace:
I20260709 13:11:05.236300 21319 rpcz_store.cc:276] 0709 13:11:01.709275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.119434 (+2410159us) service_pool.cc:224] Handling call
0709 13:11:04.119708 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.120016 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:04.216433 (+ 96417us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.144348 (+927915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.145680 (+  1332us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:05.146321 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.146848 (+   527us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.147004 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6347,"thread_start_us":843175,"threads_started":2}
W20260709 13:11:05.137226 24250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.012s	sys 0.008s
I20260709 13:11:05.063443 24292 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9.
I20260709 13:11:05.164067 21464 raft_consensus.cc:606] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:05.164341 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1795) took 1606 ms. Trace:
W20260709 13:11:05.165382 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 375396us
I20260709 13:11:05.186982 24047 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.137859 24231 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.098387 24017 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.169338 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1820) took 1181 ms. Trace:
I20260709 13:11:05.170548 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2025) took 2989 ms. Trace:
W20260709 13:11:05.179400 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 479316us
I20260709 13:11:05.106775 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:05.181995 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:05.182216 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 121534us
I20260709 13:11:05.210234 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.167820 24254 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:05.210990 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.186702 24218 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.222607 22035 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.167747 23845 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:05.224699 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:05.237807 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 178642us
I20260709 13:11:05.201320 24225 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.259936 21395 raft_consensus.cc:2368] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3.
I20260709 13:11:05.167945 24044 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:05.257666 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:05.278756 21360 connection.cc:256] RPC call timeout handler was delayed by -2.0182073109999692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 13:11:05.260317 22002 leader_election.cc:336] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.982s (SENT)
I20260709 13:11:05.260336 24017 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.274469 21391 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:05.259105 21315 rpcz_store.cc:276] 0709 13:11:02.181381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.238523 (+2057142us) service_pool.cc:224] Handling call
0709 13:11:04.238874 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.239102 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:04.787531 (+548429us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.170178 (+382647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.170240 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:05.170296 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.170371 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.170490 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":894,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"thread_start_us":930393,"threads_started":2}
I20260709 13:11:05.258980 21389 rpcz_store.cc:276] 0709 13:11:03.988073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.291331 (+303258us) service_pool.cc:224] Handling call
0709 13:11:04.309817 (+ 18486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.310035 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:04.797197 (+487162us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.168204 (+371007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.168358 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:05.168499 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.168705 (+   206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.169179 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21779,"prepare.queue_time_us":592462,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":112324,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":45,"thread_start_us":834476,"threads_started":2}
I20260709 13:11:05.282578 21359 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:11:05.289804 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52993.6us
W20260709 13:11:05.346458 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.386674 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.256265 21394 rpcz_store.cc:276] 0709 13:11:03.557841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.895187 (+337346us) service_pool.cc:224] Handling call
0709 13:11:03.895452 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.895627 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:04.769561 (+873934us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.163843 (+394282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.163910 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:05.163979 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.164089 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.164267 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58640,"prepare.queue_time_us":1006496,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":36,"raft.queue_time_us":153011,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":1173341,"threads_started":2}
I20260709 13:11:05.386559 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:05.251149 24250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.013s	sys 0.015s
I20260709 13:11:05.249419 21215 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193), now has a pending config: VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193), VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194), VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195), VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 4 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:05.333196 22035 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:05.389178 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:05.390014 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.391021 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 108541us
I20260709 13:11:05.280807 24330 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:05.283955 24296 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 13:11:05.404352 24309 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:11:05.376004 24053 consensus_meta.cc:287] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.792s	user 0.016s	sys 0.000s
I20260709 13:11:05.405767 21464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:11:05.223685 24139 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.357124 24216 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:05.257098 24047 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:05.408344 21360 connection.cc:256] RPC call timeout handler was delayed by -1.9247852899999316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 13:11:05.256677 24262 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:05.261157 24298 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:11:05.258703 24231 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:05.396130 23943 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.945s	user 0.016s	sys 0.000s
I20260709 13:11:05.495801 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:05.496109 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.325304 24144 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.404419 24323 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:11:05.448272 21215 catalog_manager.cc:5697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.282262 23879 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:05.208072 24259 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.454340 21464 raft_consensus.cc:606] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:05.516556 21464 raft_consensus.cc:614] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:05.458654 24153 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:05.459826 23990 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.873s	user 0.013s	sys 0.000s
W20260709 13:11:05.460286 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73833.6us
W20260709 13:11:05.467870 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.474041 21360 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.028s (SENT)
I20260709 13:11:05.409929 24218 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:05.486881 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 386828us
I20260709 13:11:05.565619 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:05.528798 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 271185us
W20260709 13:11:05.566047 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 92065.3us
I20260709 13:11:05.416653 24191 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.497334 24291 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:05.479363 21284 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:05.461998 24325 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:11:05.321791 24248 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:05.494336 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.518916 24217 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:05.495363 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.631476 21394 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:05.461339 24017 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:05.500648 21396 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:05.505215 24144 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:05.507943 24109 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 13:11:05.519547 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.532289 24216 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.646545 24144 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.646699 24343 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:05.647233 24343 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.646944 24216 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.647650 24343 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.468431 23845 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.646957 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1803) took 2087 ms. Trace:
I20260709 13:11:05.648622 21392 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:05.647406 24109 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:05.564380 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 461114us
I20260709 13:11:05.568177 21215 catalog_manager.cc:5697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 4, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:05.513451 23879 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:05.575042 21434 leader_election.cc:336] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.699s (SENT)
W20260709 13:11:05.664738 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 89723us
W20260709 13:11:05.665051 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 404734us
I20260709 13:11:05.594229 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.610270 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 371) took 3897 ms. Trace:
I20260709 13:11:05.414369 24330 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:05.619463 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.619982 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.400017 24239 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:11:05.518623 24231 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:05.634123 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59470us
I20260709 13:11:05.639935 24292 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.676720 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:05.634606 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 155314us
I20260709 13:11:05.519726 24294 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:05.682319 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:05.683214 21464 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:05.596962 24291 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:11:05.645591 24300 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:05.646358 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 372) took 3911 ms. Trace:
I20260709 13:11:05.693691 21317 rpcz_store.cc:276] 0709 13:11:01.744875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.156978 (+2412103us) service_pool.cc:224] Handling call
0709 13:11:04.157359 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.157699 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.157742 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.158218 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.788180 (+629962us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:04.788224 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.788308 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.646161 (+857853us) raft_consensus.cc:1685] finished
0709 13:11:05.646179 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.646301 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1361,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":12462,"thread_start_us":629576,"threads_started":1,"wal-append.queue_time_us":775595}
I20260709 13:11:05.519811 24331 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:05.518203 24333 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:05.608740 23943 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:05.610846 24275 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.618587 24282 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:05.565608 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:05.750375 24254 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:05.751078 24254 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.752007 24343 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.754473 24343 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:05.643783 24017 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.756628 24275 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.758512 24017 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:05.758770 24275 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.761135 24291 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.762318 24291 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.763053 24047 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.745724 24333 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:05.764770 24333 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.708679 24292 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.767582 24292 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.728943 24323 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:11:05.768230 24231 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.768712 24216 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.769387 24109 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:05.674620 24337 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:05.770834 24337 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:05.661092 24318 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:11:05.628307 24248 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.640928 24308 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:05.638401 24044 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.638885 24329 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:05.569345 23990 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.665922 21313 rpcz_store.cc:276] 0709 13:11:01.712573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.147562 (+2434989us) service_pool.cc:224] Handling call
0709 13:11:04.147920 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.161084 (+ 13164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.161108 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.191348 (+ 30240us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.482815 (+291467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:04.482868 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.482961 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.609937 (+1126976us) raft_consensus.cc:1685] finished
0709 13:11:05.609968 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.610185 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":254493,"threads_started":1,"wal-append.queue_time_us":591340}
W20260709 13:11:05.618952 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 43645.1us
I20260709 13:11:05.759840 24286 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:05.667408 22002 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.101s (SENT)
I20260709 13:11:05.655406 21390 rpcz_store.cc:276] 0709 13:11:03.559931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.240570 (+680639us) service_pool.cc:224] Handling call
0709 13:11:04.240846 (+   276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:04.241184 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.241210 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:04.300556 (+ 59346us) log.cc:844] Serialized 52 byte log entry
0709 13:11:04.812640 (+512084us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:04.812703 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.812804 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.646761 (+833957us) raft_consensus.cc:1685] finished
0709 13:11:05.646782 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.646904 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":297,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":15565,"spinlock_wait_cycles":1408,"thread_start_us":487604,"threads_started":1,"wal-append.queue_time_us":1320022}
W20260709 13:11:05.674537 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 567840us
I20260709 13:11:05.677639 21215 catalog_manager.cc:5697] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 5, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 5 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.696149 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:05.696269 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:05.700726 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.709009 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.708951 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.714434 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:05.714624 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:05.715844 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:05.717809 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:05.726421 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:05.727188 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:05.728336 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:05.731890 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74234.5us
I20260709 13:11:05.674110 24330 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.785068 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:05.792223 21469 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:05.786706 21388 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.795125 21395 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:05.765226 24294 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:05.771519 21396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1813) took 1860 ms (client timeout 2260 ms). Trace:
W20260709 13:11:05.772426 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 206900us
I20260709 13:11:05.646301 24332 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:05.750408 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1797) took 2192 ms. Trace:
I20260709 13:11:05.801759 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:05.801348 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:05.803000 21215 catalog_manager.cc:5697] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 2 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:05.755378 24280 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:05.791285 21394 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:05.783973 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:05.811882 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 389) took 4047 ms. Trace:
W20260709 13:11:05.812076 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 144700us
I20260709 13:11:05.812295 21468 rpcz_store.cc:276] 0709 13:11:01.765003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.078604 (+2313601us) service_pool.cc:224] Handling call
0709 13:11:04.346849 (+268245us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:04.347324 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.347363 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:04.348198 (+   835us) log.cc:844] Serialized 52 byte log entry
0709 13:11:04.886196 (+537998us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:04.886233 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.886296 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.510432 (+624136us) raft_consensus.cc:1685] finished
0709 13:11:05.510452 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.794566 (+284114us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54003facd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:05.811826 (+ 17260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1545,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":616124800,"thread_start_us":537575,"threads_started":1,"wal-append.queue_time_us":1052022}
W20260709 13:11:05.813683 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.806886 21393 rpcz_store.cc:276] 0709 13:11:03.558396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.117417 (+559021us) service_pool.cc:224] Handling call
0709 13:11:04.118610 (+  1193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.770364 (+651754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.770406 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.795029 (+ 24623us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.232012 (+436983us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:05.235709 (+  3697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.265235 (+ 29526us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.750217 (+484982us) raft_consensus.cc:1685] finished
0709 13:11:05.750235 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.750352 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33411,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"thread_start_us":1059555,"threads_started":2,"wal-append.queue_time_us":926139}
I20260709 13:11:05.784650 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.815507 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.816146 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.816820 21394 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:05.774952 23943 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:05.787314 21463 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:11:05.787894 21466 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.821942 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:05.831055 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.786811 21470 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:05.798154 23833 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.001s	user 0.007s	sys 0.007s
W20260709 13:11:05.798985 24265 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.848s	user 0.006s	sys 0.004s
I20260709 13:11:05.845505 21388 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:05.801157 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.786989 21462 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
W20260709 13:11:05.846477 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 45196.4us
W20260709 13:11:05.801891 21396 rpcz_store.cc:269] 0709 13:11:03.910681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.176302 (+265621us) service_pool.cc:224] Handling call
0709 13:11:05.771298 (+1594996us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002cdb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:05.771441 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3043046784}
I20260709 13:11:05.847493 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:05.775103 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 98525.2us
I20260709 13:11:05.819130 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.848658 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:05.746434 24282 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:05.823371 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:05.855374 22035 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:05.833072 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:05.835712 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:05.836611 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:05.837412 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:05.838263 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:05.774868 24337 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.841010 21467 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:05.840719 21215 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 1 to 3, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 3 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.860281 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:05.842192 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:05.799466 24158 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.002s
I20260709 13:11:05.847618 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:05.885044 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:05.885592 21396 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:05.791786 21464 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:05.782819 24322 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:05.847091 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.854517 22042 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:05.801386 24266 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:05.896946 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48345.4us
I20260709 13:11:05.898486 24308 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.898947 24308 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:05.899029 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:05.899397 24308 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.901451 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.902190 21392 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:05.861938 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:05.806806 24332 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:05.811221 24343 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:05.846026 24109 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:05.848953 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46802.4us
I20260709 13:11:05.916831 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 904) took 1849 ms. Trace:
I20260709 13:11:05.886809 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:05.917958 21313 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:05.830950 24292 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.818516 24250 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:11:05.891390 21316 raft_consensus.cc:2393] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:05.917338 22031 rpcz_store.cc:276] 0709 13:11:04.067757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.091745 (+ 23988us) service_pool.cc:224] Handling call
0709 13:11:04.092023 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.808694 (+716671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.808741 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.819735 (+ 10994us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.113419 (+293684us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:05.113467 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.113535 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.916578 (+803043us) raft_consensus.cc:1685] finished
0709 13:11:05.916606 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.916760 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91622,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":15826,"thread_start_us":918725,"threads_started":2,"wal-append.queue_time_us":555610}
I20260709 13:11:05.916714 24109 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:05.910408 24274 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:11:05.945842 24109 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.891012 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:05.893095 24322 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.905325 21315 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:11:05.908773 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:05.791075 24044 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.948052 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2021) took 4540 ms. Trace:
I20260709 13:11:05.949061 24322 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.949208 21312 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.949712 24044 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.885720 21317 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:05.913478 24343 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:05.914513 24281 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.950659 24343 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.915132 24332 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.955750 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:05.956359 21319 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.900231 24158 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.890447 22040 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:05.947222 24109 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.948470 21321 rpcz_store.cc:276] 0709 13:11:01.407336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.567972 (+2160636us) service_pool.cc:224] Handling call
0709 13:11:03.568300 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.568675 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:03.875643 (+306968us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.530341 (+654698us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.530859 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.530983 (+   124us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:04.531014 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.531084 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.947829 (+1416745us) raft_consensus.cc:1685] finished
0709 13:11:05.947848 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.947973 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":671067,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":2078,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":27918,"thread_start_us":932690,"threads_started":2,"wal-append.queue_time_us":1865384}
W20260709 13:11:05.952425 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 164045us
I20260709 13:11:05.984798 24347 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:05.983855 21389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:05.985693 21997 leader_election.cc:400] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3.
I20260709 13:11:05.985956 21997 leader_election.cc:403] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:05.986024 21389 raft_consensus.cc:606] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:05.845765 23833 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:05.987090 21389 raft_consensus.cc:614] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:05.801254 24293 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.133s
W20260709 13:11:05.965960 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 73942.6us
I20260709 13:11:05.986074 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:05.950827 24281 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:05.987871 21321 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.955670 24266 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:05.986922 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:05.950488 24322 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:05.996008 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:05.996627 21314 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.915840 23990 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:05.916191 24280 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:11:05.999414 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:05.983742 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 136327us
I20260709 13:11:06.015594 21313 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.015890 21433 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:06.011258 21319 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:06.013005 21314 raft_consensus.cc:2410] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:11:05.988801 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 87708.6us
I20260709 13:11:05.990922 21387 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:05.984088 21436 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:05.800591 24329 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.863336 24265 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:05.993640 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:05.953367 24346 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:06.030380 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:06.001855 21312 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:05.987808 24332 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.985982 24250 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:06.036255 24250 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.036751 24250 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.019379 21319 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:06.041630 21319 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:05.987490 24333 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:06.044340 24333 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.044868 24333 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:06.018078 21314 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:11:06.047210 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.029858 24331 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:06.048560 24331 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.048995 24331 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:06.030031 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46029.8us
I20260709 13:11:06.052151 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:06.051479 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:06.053522 21436 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:05.987684 24345 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:06.059013 21390 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:06.089568 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:06.093025 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 271156us
I20260709 13:11:05.997522 24352 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:06.012554 24292 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:06.022341 24262 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.003s
W20260709 13:11:06.021871 24203 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.367s	user 0.009s	sys 0.004s
W20260709 13:11:06.105340 22002 leader_election.cc:336] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.824s (SENT)
I20260709 13:11:06.122316 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:06.158922 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.159718 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.160247 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.166742 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1804) took 2502 ms. Trace:
I20260709 13:11:06.167203 21387 rpcz_store.cc:276] 0709 13:11:03.664879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.269546 (+604667us) service_pool.cc:224] Handling call
0709 13:11:04.269956 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.017779 (+1747823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.166465 (+148686us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54003f4b54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:06.166676 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3935521024}
I20260709 13:11:06.168952 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:06.169543 24329 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:06.169636 21317 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:06.170570 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:06.171262 21391 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:05.997455 24281 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:06.174495 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:06.178438 21320 raft_consensus.cc:2410] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:06.091025 24345 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:06.116832 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.112079 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 59911.6us
I20260709 13:11:06.171185 21317 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:06.182823 21316 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:06.184494 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79180us
W20260709 13:11:06.200110 22002 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.840s (SENT)
I20260709 13:11:06.011931 24259 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:11:06.107677 21470 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
W20260709 13:11:06.216279 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 162834us
W20260709 13:11:06.205775 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.201949 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:05.999709 24344 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 2. Current term is 3.
I20260709 13:11:05.987414 23943 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:06.124243 24225 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.807s	user 0.005s	sys 0.005s
I20260709 13:11:06.106590 24322 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:06.242008 21464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:11:06.274526 21464 raft_consensus.cc:606] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:06.274922 21464 raft_consensus.cc:614] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:06.249261 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49210.2us
W20260709 13:11:06.251106 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 51668.2us
I20260709 13:11:06.150372 24365 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.269728 21321 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:06.254698 24347 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:06.173759 24340 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:11:06.173751 24281 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:06.099925 24275 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:11:06.283414 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:06.175120 24216 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:05.987604 24282 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:06.251446 21436 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:06.221519 24047 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:06.303682 21321 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:06.223755 24345 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.219206 24280 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.295022 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:06.331704 22042 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:11:06.154036 24203 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.303674 22031 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:06.322047 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 270970us
W20260709 13:11:06.317865 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 319570us
I20260709 13:11:06.321529 24364 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:06.293967 24347 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:06.339207 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:06.340708 24335 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:11:06.341895 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 390) took 1437 ms. Trace:
W20260709 13:11:06.342172 24291 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.008s
I20260709 13:11:06.342378 24294 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:06.342743 24365 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:06.343158 24365 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:06.343288 24294 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:06.343506 24365 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.344380 24364 raft_consensus.cc:993] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:11:06.344501 24216 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:06.344921 24216 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:06.345077 24364 raft_consensus.cc:1081] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
W20260709 13:11:06.345856 24191 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.735s	user 0.005s	sys 0.012s
I20260709 13:11:06.340376 24107 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:06.346307 24191 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.347040 24282 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.338187 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:06.342418 22034 rpcz_store.cc:276] 0709 13:11:04.904303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.904444 (+   141us) service_pool.cc:224] Handling call
0709 13:11:04.922119 (+ 17675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.922485 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.922511 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.954417 (+ 31906us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.533004 (+578587us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:05.533058 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.533157 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.341707 (+808550us) raft_consensus.cc:1685] finished
0709 13:11:06.341727 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.341841 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69642,"raft.queue_time_us":416426,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":41994,"thread_start_us":388640,"threads_started":1,"wal-append.queue_time_us":802785}
I20260709 13:11:06.349186 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:06.350482 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:06.339443 24347 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:06.370324 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.343860 24294 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:06.288447 24363 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:06.365252 24107 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:06.391913 24107 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:06.392632 24350 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 13:11:06.392838 24107 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:06.393515 24107 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:06.350797 24343 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.385370 21461 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:06.385792 22034 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:06.394030 22041 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:11:06.357177 24324 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:11:06.155172 24352 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.335325 24285 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:06.304890 24295 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.283313 24225 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.448355 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:06.449692 22002 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.540s (SENT)
W20260709 13:11:06.463456 21466 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.635s	user 0.001s	sys 0.009s
I20260709 13:11:06.464069 21466 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
W20260709 13:11:06.523483 22002 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.702s (SENT)
I20260709 13:11:06.524308 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:06.530339 24265 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:06.533617 24339 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:06.534224 24339 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:06.506376 24346 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:06.536509 24346 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.536954 24346 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.538146 23833 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:06.539918 24328 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:06.540485 24328 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:06.541519 24328 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.543107 24328 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.545486 24343 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:06.553633 24225 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:06.507455 24158 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:06.467650 24217 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:06.354776 23879 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:06.561261 23879 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:06.561295 22039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 386) took 1677 ms (client timeout 2030 ms). Trace:
W20260709 13:11:06.562052 22039 rpcz_store.cc:269] 0709 13:11:04.883992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.884173 (+   181us) service_pool.cc:224] Handling call
0709 13:11:06.561109 (+1676936us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003d18d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:06.561238 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3279220480}
I20260709 13:11:06.448997 24322 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.262491 24266 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:06.437536 24285 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:06.386791 24294 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:06.610224 24285 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:06.613946 24331 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
I20260709 13:11:06.607741 24334 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.535343 24339 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:06.606978 24332 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.002s
W20260709 13:11:06.636410 24333 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.002s
I20260709 13:11:06.629988 24352 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:06.637847 24333 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.643322 24333 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:06.639263 24330 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.010s
I20260709 13:11:06.657331 24330 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:06.660065 24330 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:06.640372 24337 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.003s
I20260709 13:11:06.638491 24339 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.668278 24337 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.671204 24337 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:06.621527 24331 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.678475 24331 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:06.710628 21215 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.009s	sys 0.012s
W20260709 13:11:06.711655 21215 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.010s	sys 0.013s
I20260709 13:11:06.291438 21317 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:11:06.716667 21318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.000s
W20260709 13:11:06.717321 21318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.000s
I20260709 13:11:06.718266 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:06.724429 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.724864 21395 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:06.725306 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.725991 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.727852 21393 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:06.728602 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:06.729765 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:06.729806 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 478266us
W20260709 13:11:06.733418 21394 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.916s	user 0.015s	sys 0.007s
I20260709 13:11:06.734032 21394 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:06.734650 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:06.737978 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 454492us
W20260709 13:11:06.743407 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.639369 24308 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.004s
W20260709 13:11:06.784345 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.786391 24254 consensus_meta.cc:287] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.005s	user 0.002s	sys 0.010s
I20260709 13:11:06.796339 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:06.798655 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.801204 24285 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.805233 24158 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:06.808303 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:06.809942 24367 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:06.573545 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50117.9us
I20260709 13:11:06.812718 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:06.345727 24216 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.481866 24203 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:06.822165 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:06.824818 24044 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:06.858946 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:06.864063 24044 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:06.878266 24044 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.879724 24044 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.876518 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 476) took 1078 ms. Trace:
I20260709 13:11:06.893558 21316 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.912385 24329 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.912779 24308 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:06.913316 24329 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.917732 24216 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.918455 21321 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:06.919252 24047 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.920011 24047 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:06.921221 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.921736 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.922722 24047 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:06.924113 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 141514us
I20260709 13:11:06.925225 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:06.927376 24366 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:06.927987 24339 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:06.935729 24366 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:06.936309 24366 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:06.937932 24366 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:06.938859 24310 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:11:06.890103 24107 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.880817 24367 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:06.920557 21317 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:06.895938 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:06.942129 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51205.9us
W20260709 13:11:06.955035 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.958811 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:06.950333 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:06.959187 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:06.963337 21394 raft_consensus.cc:2376] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7. Re-sending same reply.
I20260709 13:11:06.962284 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:06.993435 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.964352 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.958058 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:06.885576 21395 rpcz_store.cc:276] 0709 13:11:05.789757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.887969 (+ 98212us) service_pool.cc:224] Handling call
0709 13:11:05.888274 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.725483 (+837209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.826783 (+101300us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b540017ded4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:06.867671 (+ 40888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922174208}
I20260709 13:11:06.959800 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:06.960516 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:07.009362 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:07.010213 21390 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:07.011747 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53918.6us
I20260709 13:11:07.012647 22039 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:07.013753 24266 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.014168 24331 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.974579 24308 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:07.014881 24047 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:07.015010 24331 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:06.960701 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:07.016415 24332 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:07.017467 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:07.017740 24331 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:07.014250 24266 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.018698 24266 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.018873 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:07.024536 21387 raft_consensus.cc:2368] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
I20260709 13:11:07.025700 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:06.961086 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:07.027678 21392 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:07.028590 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:07.029755 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:07.030601 21392 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:07.026619 21387 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:11:07.040308 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46266.9us
I20260709 13:11:06.939993 24366 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:07.035959 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:06.973610 24248 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.172s	user 0.003s	sys 0.021s
W20260709 13:11:07.036137 24250 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.963s	user 0.009s	sys 0.009s
I20260709 13:11:06.875211 24254 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.018635 24334 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.004971 24329 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:07.116307 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:07.094764 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.004s	sys 0.017s
I20260709 13:11:07.124818 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:07.124966 21317 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:07.133837 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.196s	user 0.004s	sys 0.019s
I20260709 13:11:06.957172 24367 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.152108 21394 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:07.154922 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:07.170073 21388 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:07.174726 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:07.176262 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.177462 21392 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:07.180577 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:07.181324 22031 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:07.171523 21319 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.006s	sys 0.025s
W20260709 13:11:07.187345 21313 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.171s	user 0.012s	sys 0.004s
I20260709 13:11:07.188205 21313 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:07.188730 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2055) took 1354 ms. Trace:
I20260709 13:11:07.189015 21313 rpcz_store.cc:276] 0709 13:11:05.834217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.981997 (+147780us) service_pool.cc:224] Handling call
0709 13:11:07.188643 (+1206646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:07.190303 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:07.190655 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:07.191221 21313 raft_consensus.cc:2368] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
W20260709 13:11:07.192106 24109 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.060s	user 0.017s	sys 0.005s
I20260709 13:11:07.192811 24109 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:07.193497 21436 leader_election.cc:400] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:11:07.193840 21436 leader_election.cc:403] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:07.193970 21317 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
W20260709 13:11:07.194248 24282 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.847s	user 0.006s	sys 0.007s
I20260709 13:11:07.194465 24109 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.093761 24248 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:07.202278 24248 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:07.205395 24109 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 2. Current term is 3.
I20260709 13:11:07.207049 24266 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:07.207844 24365 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.864s	user 0.006s	sys 0.004s
I20260709 13:11:07.208357 24365 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.209438 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1992) took 1094 ms. Trace:
I20260709 13:11:07.211997 24254 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:07.212846 24365 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:07.210004 21320 rpcz_store.cc:276] 0709 13:11:06.114631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.825346 (+710715us) service_pool.cc:224] Handling call
0709 13:11:06.825906 (+   560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.912551 (+ 86645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.912597 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.913394 (+   797us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.147359 (+233965us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:07.147493 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.147714 (+   221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.208254 (+ 60540us) raft_consensus.cc:1685] finished
0709 13:11:07.208280 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.208456 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85994,"raft.queue_time_us":88171,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":227,"thread_start_us":233254,"threads_started":1,"wal-append.queue_time_us":292738}
I20260709 13:11:07.131716 24250 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:07.216566 24250 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:07.217613 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.218030 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.190502 24345 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.000s
I20260709 13:11:07.220395 24345 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:07.221416 21391 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:07.221266 23845 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:07.223202 24345 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:07.223701 23845 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:07.227890 22039 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:07.229432 21390 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
W20260709 13:11:07.232265 21319 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.006s	sys 0.027s
I20260709 13:11:07.234103 21316 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:07.241602 21393 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:11:07.243510 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.228853 23845 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:07.230767 24331 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.255230 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:07.251636 24346 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.006s
W20260709 13:11:07.249909 21285 connection.cc:256] RPC call timeout handler was delayed by -2.2759475010000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
I20260709 13:11:07.246585 24329 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:07.265731 21313 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:07.258555 24254 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 13:11:07.277241 21285 connection.cc:256] RPC call timeout handler was delayed by -2.2471475010000859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 13:11:07.280001 21285 connection.cc:256] RPC call timeout handler was delayed by -2.1040475010000819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:11:07.281076 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.930s (SENT)
I20260709 13:11:07.270394 24331 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:07.290658 24254 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.291512 24254 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:07.287786 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:07.298445 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0149475010000515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 13:11:07.300349 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:07.301407 21313 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 3: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:07.304430 22031 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:11:07.306355 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9771475010001041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260709 13:11:07.308171 24334 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.302064 23845 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.310374 24368 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:07.311976 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2061) took 1364 ms. Trace:
I20260709 13:11:07.312561 21314 rpcz_store.cc:276] 0709 13:11:05.947163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.049286 (+102123us) service_pool.cc:224] Handling call
0709 13:11:06.050899 (+  1613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.113143 (+ 62244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.113207 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.123521 (+ 10314us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.882419 (+758898us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:06.894687 (+ 12268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.924219 (+ 29532us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.311456 (+387237us) raft_consensus.cc:1685] finished
0709 13:11:07.311482 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.311711 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60918,"raft.queue_time_us":61245,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":73778,"thread_start_us":108070,"threads_started":1,"wal-append.queue_time_us":1013282}
I20260709 13:11:07.314627 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:07.314862 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1988) took 1209 ms. Trace:
I20260709 13:11:07.317107 24047 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:07.310432 24254 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:07.321090 24382 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.523s	user 0.005s	sys 0.000s
W20260709 13:11:07.310653 21285 connection.cc:256] RPC call timeout handler was delayed by -1.880847501000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:11:07.322621 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8070475010000564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 13:11:07.323093 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7818475010000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:11:07.323451 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6684475010000597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 13:11:07.324184 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6423475010000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:11:07.324597 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6387475010000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:11:07.324998 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6225475010000991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 13:11:07.325424 24355 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.985s	user 0.003s	sys 0.000s
W20260709 13:11:07.325482 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6126475010000831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
W20260709 13:11:07.331686 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6090475010000773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 13:11:07.334606 21394 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 2.
I20260709 13:11:07.314939 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:07.269577 24346 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.346385 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:07.347775 24331 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:07.348008 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:07.315210 21321 rpcz_store.cc:276] 0709 13:11:06.105590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.320324 (+214734us) service_pool.cc:224] Handling call
0709 13:11:06.374932 (+ 54608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.918941 (+544009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.314603 (+395662us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54003ae3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:07.314804 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873371392}
I20260709 13:11:07.350389 24383 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:07.353940 24347 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.916s	user 0.003s	sys 0.014s
W20260709 13:11:07.357688 24349 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.904s	user 0.001s	sys 0.002s
W20260709 13:11:07.358583 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.360357 24380 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.543s	user 0.002s	sys 0.000s
W20260709 13:11:07.363730 24391 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:07.299466 24329 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:07.370184 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1982) took 1361 ms. Trace:
W20260709 13:11:07.377435 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 331499us
I20260709 13:11:07.373025 21312 rpcz_store.cc:276] 0709 13:11:05.981440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.183231 (+201791us) service_pool.cc:224] Handling call
0709 13:11:06.183648 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.206460 (+ 22812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.206504 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.246606 (+ 40102us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.889677 (+643071us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:06.930680 (+ 41003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.002539 (+ 71859us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.320075 (+317536us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:07.331652 (+ 11577us) raft_consensus.cc:1685] finished
0709 13:11:07.331683 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.342536 (+ 10853us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40486,"raft.queue_time_us":22984,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":24395,"spinlock_wait_cycles":281898880,"thread_start_us":61532,"threads_started":1,"wal-append.queue_time_us":83499}
I20260709 13:11:07.385488 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1557) took 1578 ms. Trace:
I20260709 13:11:07.386991 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:07.354451 24347 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:07.387737 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 154754us
I20260709 13:11:07.369410 24266 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:07.384003 21312 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:07.394451 21321 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.368662 24345 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:11:07.398316 24313 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.002s	sys 0.004s
W20260709 13:11:07.400434 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 54304.3us
W20260709 13:11:07.388365 23879 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.718s	user 0.014s	sys 0.005s
W20260709 13:11:07.407297 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 99844.8us
I20260709 13:11:07.352227 21313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
W20260709 13:11:07.406486 24313 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.002s	sys 0.004s
I20260709 13:11:07.387646 21469 rpcz_store.cc:276] 0709 13:11:05.806500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.807849 (+  1349us) service_pool.cc:224] Handling call
0709 13:11:05.808266 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.819045 (+ 10779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.819074 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.819553 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.950952 (+131399us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:05.950998 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.951064 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.324339 (+1373275us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:07.384917 (+ 60578us) raft_consensus.cc:1685] finished
0709 13:11:07.384938 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.385215 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28572,"raft.queue_time_us":18986,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":13853,"spinlock_wait_cycles":241400064,"thread_start_us":61754,"threads_started":1,"wal-append.queue_time_us":498462}
I20260709 13:11:07.429533 21313 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:07.434253 21313 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:07.434901 22002 leader_election.cc:336] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.949s (SENT)
I20260709 13:11:07.435606 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:07.430935 24047 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:07.436829 24367 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:07.593603 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 157111us
W20260709 13:11:07.452013 24044 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.005s
I20260709 13:11:07.603895 24334 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.604234 24283 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.200s
W20260709 13:11:07.606220 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 131708us
I20260709 13:11:07.610105 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:07.610809 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:07.611150 22031 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:07.611901 22034 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:07.612294 24334 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:07.612704 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:07.613094 24334 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:07.613699 24047 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:07.615005 24366 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.003s
I20260709 13:11:07.615470 24334 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:07.613535 22041 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.617635 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:07.619169 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:07.619850 21470 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:07.620604 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:07.621078 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:07.621548 21464 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:07.622045 21470 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:07.623543 21467 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: [5.6-8.8]
W20260709 13:11:07.629561 24322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.004s	sys 0.007s
W20260709 13:11:07.630026 24322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.004s	sys 0.007s
I20260709 13:11:07.633378 22041 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:07.658332 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:07.658530 21316 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:07.664240 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 218303us
I20260709 13:11:07.665654 21466 raft_consensus.cc:2368] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9.
I20260709 13:11:07.438385 24345 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:07.641254 24216 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.000s
I20260709 13:11:07.670725 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:07.674515 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:07.675556 21470 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:07.642321 24347 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:07.636888 24346 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:07.677352 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:07.663196 24250 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.675850 21313 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.683683 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:07.687094 22039 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.690565 24329 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:07.691524 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:07.692404 21312 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.694554 21392 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:07.694931 21392 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:07.695633 21464 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:07.695798 21392 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.696921 21392 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.697854 22039 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:07.698083 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:07.698633 21390 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:07.700696 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 276281us
I20260709 13:11:07.706723 22042 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:07.665970 24366 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.707765 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:07.707864 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:07.700310 21462 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:07.642603 24367 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.710738 24347 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:07.718218 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 297954us
I20260709 13:11:07.720389 21312 raft_consensus.cc:2410] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:07.720571 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:07.708079 24334 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:07.738008 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.095s (SENT)
I20260709 13:11:07.732015 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:07.708961 24250 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:07.798362 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.798772 21316 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 13:11:07.798967 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.789824 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:07.790014 24347 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:07.785492 24294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.001s	sys 0.009s
I20260709 13:11:07.804625 21466 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:07.791199 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:07.799269 21316 pending_rounds.cc:85] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 7
I20260709 13:11:07.791169 21467 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:07.721580 24375 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 13:11:07.799559 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.800622 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:07.819094 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:07.824884 21464 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:07.808003 21316 pending_rounds.cc:107] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:11:07.826421 21316 raft_consensus.cc:2889] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:07.804950 24294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.002s	sys 0.010s
I20260709 13:11:07.728696 24216 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:11:07.836519 21470 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:07.800755 24401 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.804970 21390 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:07.782917 24366 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.732272 24331 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:11:07.841344 21395 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.848249 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:07.848634 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:07.840435 24411 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:07.858124 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.858791 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:07.797015 24365 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:11:07.860170 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:07.826349 24334 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:07.867045 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 143782us
W20260709 13:11:07.869451 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 78652.3us
I20260709 13:11:07.864702 24345 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:07.875838 24347 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:07.879941 21466 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:07.884356 21360 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.558s (SENT)
I20260709 13:11:07.885073 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:07.892155 21465 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:11:07.894341 21360 leader_election.cc:336] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.070s (SENT)
I20260709 13:11:07.894873 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:07.895556 24250 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:07.897078 24047 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.897634 24334 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:07.895637 24410 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.898659 21394 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:07.927033 21464 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:07.931692 21463 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:07.932452 21466 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:07.931679 21470 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:07.883693 24331 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:07.846082 24401 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:07.939749 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:07.941373 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:07.936990 24405 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.146s	user 0.002s	sys 0.000s
I20260709 13:11:07.948793 21467 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:11:07.955950 24370 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 1.060s	user 0.001s	sys 0.009s
I20260709 13:11:07.937412 24334 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:07.960368 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:07.952090 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:07.967279 21462 raft_consensus.cc:2376] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8. Re-sending same reply.
I20260709 13:11:07.979929 21463 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:07.981952 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1859) took 1019 ms. Trace:
W20260709 13:11:07.979972 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 60690.2us
I20260709 13:11:07.981935 22041 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:11:08.002183 21321 consensus_meta.cc:287] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.001s
I20260709 13:11:07.990864 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:08.004987 21321 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
W20260709 13:11:08.006423 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 64197.8us
W20260709 13:11:07.982188 24407 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 13:11:07.986652 24406 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:11:07.992547 21393 rpcz_store.cc:276] 0709 13:11:06.962776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.045822 (+ 83046us) service_pool.cc:224] Handling call
0709 13:11:07.152310 (+106488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.247035 (+ 94725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.981642 (+734607us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b54002cc754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:07.981890 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189394304}
I20260709 13:11:07.984198 24367 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:08.017201 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.018916 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:08.019938 24329 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:08.019965 24411 raft_consensus.cc:2764] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:08.021823 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.022082 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.022715 21467 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:08.022763 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.023144 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.023551 21316 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:08.024116 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.024801 21470 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:08.022786 21464 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.024842 21463 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:08.028162 24366 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:08.028713 21465 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:08.028913 22031 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:08.029064 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.029642 21463 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:11:08.029893 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.030515 21466 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.030561 21317 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:08.037009 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2065) took 1297 ms. Trace:
I20260709 13:11:08.037380 21317 rpcz_store.cc:276] 0709 13:11:06.739758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.030075 (+1290317us) service_pool.cc:224] Handling call
0709 13:11:08.030389 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.036707 (+  6318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.036930 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:08.040386 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1548) took 2344 ms (client timeout 2030 ms). Trace:
I20260709 13:11:08.037241 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:08.040926 21461 rpcz_store.cc:269] 0709 13:11:05.695738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.695867 (+   129us) service_pool.cc:224] Handling call
0709 13:11:08.039915 (+2344048us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54000b8954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:08.040129 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379287424}
I20260709 13:11:08.043752 21395 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:08.044284 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:08.050135 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.042850 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:08.096259 21464 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
W20260709 13:11:08.098488 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 55725.3us
I20260709 13:11:08.095381 21467 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:11:08.097116 21466 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:08.098841 21470 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:07.980242 24419 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:08.101127 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.096263 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:08.099457 21467 pending_rounds.cc:85] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 3
I20260709 13:11:08.107111 21467 pending_rounds.cc:107] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:08.107487 21467 raft_consensus.cc:2889] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.103619 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.110702 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.111320 21462 raft_consensus.cc:2376] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9. Re-sending same reply.
I20260709 13:11:08.104714 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.113683 21317 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:11:08.108523 24413 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.286s	user 0.001s	sys 0.002s
I20260709 13:11:08.120950 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:08.121517 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 102740us
I20260709 13:11:08.121798 21463 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:08.129666 24401 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:08.137722 24332 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:08.138326 24332 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:08.141795 24367 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:08.143189 24367 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:08.143733 24351 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.804s	user 0.012s	sys 0.000s
I20260709 13:11:08.146618 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:08.152513 24379 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.356s	user 0.003s	sys 0.028s
I20260709 13:11:08.147737 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 921) took 1114 ms. Trace:
I20260709 13:11:08.154333 22042 rpcz_store.cc:276] 0709 13:11:07.034894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.035457 (+   563us) service_pool.cc:224] Handling call
0709 13:11:08.147523 (+1112066us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54005c6554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:08.147645 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446413184}
I20260709 13:11:08.154887 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 475) took 2365 ms. Trace:
W20260709 13:11:08.156724 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51498.1us
W20260709 13:11:08.157941 22002 leader_election.cc:336] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.709s (SENT)
I20260709 13:11:08.106217 24366 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:08.160667 24366 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.161099 24366 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:08.162119 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.174549 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 159090us
W20260709 13:11:08.153980 24424 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:08.123572 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.143680 24367 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:08.205732 22031 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:11:08.147756 24347 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.155414 21396 rpcz_store.cc:276] 0709 13:11:05.789478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.900803 (+111325us) service_pool.cc:224] Handling call
0709 13:11:05.901116 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.952257 (+ 51141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.952286 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.952905 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.490645 (+537740us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:06.490705 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.490812 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.151547 (+1660735us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:08.154325 (+  2778us) raft_consensus.cc:1685] finished
0709 13:11:08.154351 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.154664 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57225,"raft.queue_time_us":57100,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":19871,"spinlock_wait_cycles":148524544,"thread_start_us":494392,"threads_started":1,"wal-append.queue_time_us":814276}
I20260709 13:11:08.209800 24347 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.210340 22042 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:11:08.209834 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.212425 24347 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:08.213950 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.214623 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:08.215492 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.216642 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.217337 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.217823 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.216640 24285 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:11:08.219677 21466 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:08.220260 24353 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.221299 21464 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:08.257608 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.221764 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:08.258510 21470 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:08.174223 24375 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:08.224561 21317 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:08.207850 21316 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:08.228256 21462 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:08.242437 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:08.242849 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:08.247998 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:08.259722 22042 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:08.139513 24332 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.251094 21434 leader_election.cc:400] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
I20260709 13:11:08.260792 21434 leader_election.cc:403] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:11:08.223258 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.251094 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1861) took 1287 ms. Trace:
I20260709 13:11:08.261253 21391 rpcz_store.cc:276] 0709 13:11:06.963456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.018575 (+ 55119us) service_pool.cc:224] Handling call
0709 13:11:08.250832 (+1232257us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54001ecb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:08.250993 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448540032}
I20260709 13:11:08.265854 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:08.267952 24286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.700s	user 0.015s	sys 0.043s
W20260709 13:11:08.268853 24286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.715s	user 0.015s	sys 0.044s
I20260709 13:11:08.267915 24328 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:08.269510 24328 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.269996 24328 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:08.270040 24375 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:08.248360 24254 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:08.267922 24332 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.275405 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:08.276952 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 153527us
I20260709 13:11:08.280460 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.287223 21466 raft_consensus.cc:2376] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7. Re-sending same reply.
I20260709 13:11:08.297288 22041 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:11:08.299989 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.301784 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.204370 24419 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:08.306479 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.250202 23879 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:11:08.303982 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:08.271467 24375 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.321908 21317 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:08.322852 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2009) took 1010 ms. Trace:
I20260709 13:11:08.323247 21317 rpcz_store.cc:276] 0709 13:11:07.312727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.272403 (+959676us) service_pool.cc:224] Handling call
0709 13:11:08.285749 (+ 13346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.322498 (+ 36749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.322775 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:08.327502 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.330315 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.331331 24353 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:08.284492 24254 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:08.297386 24347 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6.
I20260709 13:11:08.334864 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.340746 21466 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
W20260709 13:11:08.335736 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 75262.7us
I20260709 13:11:08.333170 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:08.351728 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 2001) took 1125 ms. Trace:
I20260709 13:11:08.355468 21320 rpcz_store.cc:276] 0709 13:11:07.226045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.332839 (+1106794us) service_pool.cc:224] Handling call
0709 13:11:08.351645 (+ 18806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:08.357787 24427 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.365809 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 114908us
W20260709 13:11:08.368686 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.380273 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.381460 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.383895 21466 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:08.350687 24401 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:08.387841 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.388659 21470 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:08.358611 24427 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:08.392243 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 62126.8us
I20260709 13:11:08.391690 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.380914 24411 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:08.396502 24422 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:08.399904 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.400982 21470 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:08.349721 24367 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.394518 24401 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:08.406930 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.409153 21466 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:08.410223 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.410838 21463 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:08.412464 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.413766 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.414319 21464 raft_consensus.cc:2376] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5. Re-sending same reply.
I20260709 13:11:08.415176 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:08.415753 21467 raft_consensus.cc:2376] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9. Re-sending same reply.
I20260709 13:11:08.417340 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:08.417701 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:08.417963 22038 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:08.418354 21463 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:08.419215 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:08.420073 22035 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:08.417975 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:08.424927 22041 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.426183 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.426685 21470 raft_consensus.cc:2376] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9. Re-sending same reply.
W20260709 13:11:08.429576 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.430575 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.406955 24347 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.449198 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:08.449357 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 178470us
W20260709 13:11:08.452723 22002 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.534s (SENT)
I20260709 13:11:08.453266 24275 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:11:08.454407 24275 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:08.454820 24275 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:08.464627 24401 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:08.473410 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 71223.1us
I20260709 13:11:08.481033 22041 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:08.433940 24353 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:08.435806 24419 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:08.474459 24346 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.482653 24367 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:08.491613 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 100008us
I20260709 13:11:08.491329 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:08.500360 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:08.500650 24427 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:08.501346 24421 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.502031 24421 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:08.427644 24254 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.489955 24347 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.522686 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2011) took 1200 ms. Trace:
I20260709 13:11:08.524092 21316 rpcz_store.cc:276] 0709 13:11:07.322147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.273158 (+951011us) service_pool.cc:224] Handling call
0709 13:11:08.273457 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.273621 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:08.426223 (+152602us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.522226 (+ 96003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:08.522299 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:08.522371 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.522452 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.522609 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10924,"prepare.queue_time_us":249669,"thread_start_us":224734,"threads_started":2}
I20260709 13:11:08.455818 24275 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.543227 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.526228 24353 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:08.521763 24329 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.526173 24347 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:08.554116 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.510021 24346 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.558243 22038 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:08.520720 24328 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.578557 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:08.581483 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 81196us
I20260709 13:11:08.577875 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:08.558300 24329 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:08.585386 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 60695.5us
I20260709 13:11:08.577451 24275 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.592856 24411 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:08.594009 24411 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:08.595623 24411 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.597595 24440 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:08.600286 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2005) took 1310 ms. Trace:
I20260709 13:11:08.600675 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.597998 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:08.600927 21321 rpcz_store.cc:276] 0709 13:11:07.296332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.109674 (+813342us) service_pool.cc:224] Handling call
0709 13:11:08.202617 (+ 92943us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:08.273240 (+ 70623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.273272 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:08.349744 (+ 76472us) log.cc:844] Serialized 52 byte log entry
0709 13:11:08.486597 (+136853us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:08.576664 (+ 90067us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.599869 (+ 23205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.599984 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.600055 (+    71us) raft_consensus.cc:1685] finished
0709 13:11:08.600076 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.600225 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61530,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1187,"raft.queue_time_us":28319,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":6977,"thread_start_us":183856,"threads_started":3,"wal-append.queue_time_us":144993}
I20260709 13:11:08.585775 24421 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:08.579860 24366 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.622004 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:08.601994 24411 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:08.625272 24366 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:08.626109 21469 raft_consensus.cc:2368] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9.
I20260709 13:11:08.600291 24353 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:08.639799 21313 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:08.639590 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 127886us
I20260709 13:11:08.641680 24446 raft_consensus.cc:2764] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:08.658286 24421 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:08.658993 24421 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:08.660229 24421 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.638695 24411 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:08.667812 24356 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 2.039s	user 0.003s	sys 0.009s
I20260709 13:11:08.670791 23845 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:08.674068 24398 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.865s	user 0.000s	sys 0.002s
I20260709 13:11:08.675942 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2062) took 2694 ms. Trace:
I20260709 13:11:08.676385 21315 rpcz_store.cc:276] 0709 13:11:05.981361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.176460 (+195099us) service_pool.cc:224] Handling call
0709 13:11:06.194438 (+ 17978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.194864 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.194903 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.195421 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.128388 (+932967us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:07.128483 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.128599 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.436894 (+308295us) raft_consensus.cc:1685] finished
0709 13:11:07.436927 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.675540 (+1238613us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b54003be7d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:08.675761 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":796,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":33948,"spinlock_wait_cycles":5575040,"thread_start_us":235933,"threads_started":1,"wal-append.queue_time_us":1001515,"wal-append.run_cpu_time_us":3493,"wal-append.run_wall_time_us":1186015}
I20260709 13:11:08.656860 24346 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:08.680585 24401 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:08.681178 24401 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:08.683104 24373 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.823s	user 0.004s	sys 0.009s
I20260709 13:11:08.684440 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:08.685844 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 953953us
I20260709 13:11:08.644800 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.650185 24328 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:08.656265 24444 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:08.686187 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.697491 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:08.699218 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.702435 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:08.714105 22035 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:08.718397 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.684926 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 1979) took 2723 ms. Trace:
I20260709 13:11:08.701471 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:08.720682 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45136 (request call id 2068) took 1853 ms. Trace:
I20260709 13:11:08.721114 21313 rpcz_store.cc:276] 0709 13:11:06.787182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.306255 (+519073us) service_pool.cc:224] Handling call
0709 13:11:08.632437 (+1326182us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400228654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf20fa3d 00007fc2c41dfcd0 00007fc2bd764254 00007fc2bd7641e2 00007fc2bd764111 00007fc2bd76408c 00007fc2bd763342 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:08.640495 (+  8058us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":463,"spinlock_wait_cycles":41919872}
I20260709 13:11:08.724850 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:08.726665 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:08.695029 24423 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.453s	user 0.001s	sys 0.000s
I20260709 13:11:08.736735 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:08.692842 24418 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:08.738066 24418 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:08.738233 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:08.723953 21314 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:08.730410 21316 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
W20260709 13:11:08.731631 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.732012 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2060) took 2827 ms. Trace:
I20260709 13:11:08.732707 24444 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:08.703619 24366 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.703480 24367 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:08.702735 24286 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.733469 24225 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.721081 24446 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.759022 24446 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.736472 21320 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:08.761202 24446 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:08.761426 21320 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:08.762042 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.747153 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1817) took 1084 ms. Trace:
I20260709 13:11:08.748818 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2070) took 1747 ms. Trace:
I20260709 13:11:08.764328 21312 rpcz_store.cc:276] 0709 13:11:07.001616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.788239 (+786623us) service_pool.cc:224] Handling call
0709 13:11:07.806296 (+ 18057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.847271 (+ 40975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.847299 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.884525 (+ 37226us) log.cc:844] Serialized 572 byte log entry
0709 13:11:07.957858 (+ 73333us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:07.957912 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.958009 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.694286 (+736277us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:08.739769 (+ 45483us) raft_consensus.cc:1685] finished
0709 13:11:08.739793 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.748743 (+  8950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25778944,"thread_start_us":72957,"threads_started":1,"wal-append.queue_time_us":214803}
I20260709 13:11:08.700498 24347 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:08.640846 24353 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:08.684011 24401 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:08.687704 24329 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:08.753357 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:08.754045 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 69747us
I20260709 13:11:08.753767 24366 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.754444 24419 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:08.748607 24216 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:08.754997 24444 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.755940 24286 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.749257 24367 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:08.719631 21318 rpcz_store.cc:276] 0709 13:11:05.961428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.092158 (+130730us) service_pool.cc:224] Handling call
0709 13:11:06.092475 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:06.113011 (+ 20536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.113041 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:06.121625 (+  8584us) log.cc:844] Serialized 52 byte log entry
0709 13:11:06.718295 (+596670us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.781409 (+ 63114us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.914168 (+132759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.914269 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.682405 (+1768136us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:08.684605 (+  2200us) raft_consensus.cc:1685] finished
0709 13:11:08.684709 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.684867 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143346,"prepare.queue_time_us":78248,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":57,"raft.queue_time_us":76449,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":74912,"spinlock_wait_cycles":232338688,"thread_start_us":601927,"threads_started":2,"wal-append.queue_time_us":624350}
I20260709 13:11:08.763610 21468 rpcz_store.cc:276] 0709 13:11:07.644405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.681718 (+ 37313us) service_pool.cc:224] Handling call
0709 13:11:08.701266 (+1019548us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3eee 0000000000375939 00007fc2c41671e0 00007fc2c42300c4 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:11:08.728885 (+ 27619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7979904}
I20260709 13:11:08.768869 21320 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:08.770655 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:08.777477 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.739158 24418 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.729414 24447 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.742079 21319 rpcz_store.cc:276] 0709 13:11:05.904771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.042387 (+137616us) service_pool.cc:224] Handling call
0709 13:11:06.042675 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.176316 (+133641us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:07.257173 (+1080857us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.780803 (+523630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.790992 (+ 10189us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:07.791054 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.673451 (+882397us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:08.721770 (+ 48319us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54004155d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:08.721821 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.731958 (+ 10137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":620233,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":125245,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":61207,"spinlock_wait_cycles":312946944,"thread_start_us":1428355,"threads_started":3,"wal-append.queue_time_us":452883}
I20260709 13:11:08.787657 21321 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:08.789618 24225 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:08.789355 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 103261us
I20260709 13:11:08.767573 23879 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.793748 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 149046us
I20260709 13:11:08.751899 24328 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:11:08.779193 24216 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:08.804952 22035 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:08.806980 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:08.795333 24347 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:08.807607 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:08.814220 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.789870 24286 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:08.822515 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1812) took 1187 ms. Trace:
I20260709 13:11:08.808583 24418 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.836760 24367 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.839787 24266 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:08.840155 24329 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:08.842763 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:08.814910 24332 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:08.848575 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:08.849164 24332 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:08.850380 24332 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.803117 23879 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:08.855844 23879 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:08.856504 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:08.859462 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.855476 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:08.862169 21312 raft_consensus.cc:2368] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
I20260709 13:11:08.863466 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:08.834059 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.864535 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.865276 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:08.827841 24286 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.808925 24216 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.867498 24286 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.870729 24286 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:08.872527 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:08.872609 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.873739 21317 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:08.874818 23845 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:08.875964 24368 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:08.822845 24448 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
I20260709 13:11:08.891520 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.892429 21321 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:08.822535 24328 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:11:08.832307 21469 rpcz_store.cc:276] 0709 13:11:07.635448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.644332 (+  8884us) service_pool.cc:224] Handling call
0709 13:11:08.146469 (+502137us) spinlock_profiling.cc:243] Waited 963 us on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3e9c 00007fc2bc0f3a5b 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:11:08.821747 (+675278us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54001a72d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:08.822431 (+   684us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090725376}
I20260709 13:11:08.910348 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:08.923012 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.924018 21321 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
W20260709 13:11:08.930485 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 356444us
I20260709 13:11:08.888697 24283 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:11:08.935907 22035 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:08.893225 24401 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 13:11:08.940181 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 339551us
I20260709 13:11:08.896123 24285 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:11:08.942551 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.948050 24465 raft_consensus.cc:2764] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:08.896306 24414 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:11:08.951844 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53838.7us
W20260709 13:11:08.947928 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 144920us
I20260709 13:11:08.954869 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:08.961629 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:08.964484 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:08.968830 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:08.971909 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.977761 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.960780 24328 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.999848 21321 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:09.001964 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.003248 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:08.957516 24411 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:08.999065 24366 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:09.030093 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 57730.3us
I20260709 13:11:09.030336 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:09.031095 21317 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:09.027426 24465 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:09.031081 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 155577us
I20260709 13:11:09.030318 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:09.040963 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:09.043542 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 303785us
W20260709 13:11:09.046849 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.057188 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:09.058138 21313 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:09.040959 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:09.049008 24375 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.064823 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:09.072573 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:09.079221 21321 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:09.059059 24217 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.043830 24453 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:09.060793 24366 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.062635 24465 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:09.062810 24440 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:09.094655 24452 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:11:09.095362 24399 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 13:11:09.116398 24366 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:09.116618 24275 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:09.117067 24366 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:09.096158 24468 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:11:09.118149 24366 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.099189 24447 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:09.119565 24447 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.119982 24447 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:09.120230 24346 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:09.096547 24427 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.101168 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:09.102651 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.123208 21469 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:09.104614 24367 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.107977 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:09.112476 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:09.112998 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 72184us
I20260709 13:11:09.034339 24450 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:11:09.117161 24275 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.120787 24353 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:09.100616 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:09.130057 21317 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:09.122382 24427 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:11:09.125188 24440 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.139986 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:09.164793 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 120288us
I20260709 13:11:09.166062 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:09.167729 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 105874us
I20260709 13:11:09.123492 24463 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:09.139914 24376 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:09.142637 24444 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:09.151316 24275 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:09.144204 23845 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:09.193879 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 146052us
I20260709 13:11:09.197453 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:09.199684 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:09.196385 24368 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:09.141638 24440 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:09.140241 24450 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:09.213683 24450 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:09.214571 24450 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.210805 21318 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:09.206966 21315 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:09.216841 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:09.216924 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:09.217507 21318 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:09.218214 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:09.218408 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:09.218856 21315 raft_consensus.cc:2376] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10. Re-sending same reply.
I20260709 13:11:09.198541 24463 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.220278 24463 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:09.219628 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:09.199424 24444 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:09.213109 24470 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:09.225700 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:09.224323 21318 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:09.215811 24450 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:09.224155 21436 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:09.163199 24283 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:09.245822 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:09.249625 21387 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.228802 21315 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:09.246202 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.247318 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:09.255024 24254 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:09.256629 24462 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:11:09.257272 24332 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:09.210625 23845 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:09.258447 24465 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.259742 24440 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:09.260603 24411 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:09.260958 24448 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:09.260845 24283 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:09.261590 24458 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:09.263365 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.368569 21391 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:09.369606 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.370174 21391 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:09.371480 21391 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:11:09.264109 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.265177 21470 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:09.373189 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:09.373559 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.265271 24447 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.374449 21470 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:09.267292 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.269498 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:09.270221 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.270422 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:09.377372 24447 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:09.271327 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.272143 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.273470 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:09.380252 21389 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:09.276464 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.276877 21320 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:09.277073 24368 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:09.195986 24376 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:09.398386 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:09.277451 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:09.243299 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:09.330006 24419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.013s	sys 0.021s
I20260709 13:11:09.279924 21388 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:11:09.257622 24459 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:09.302301 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.303829 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.303996 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.410777 21466 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:09.304220 24477 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:09.304667 24285 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.276584 24444 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.320271 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:09.325897 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:09.326198 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:09.329766 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:09.332724 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:09.413084 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0700400689999015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 13:11:09.413280 22031 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:11:09.413475 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0646400689998927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:11:09.413827 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0241400689999409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:11:09.333752 22042 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:09.342505 21469 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
W20260709 13:11:09.343262 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 266382us
I20260709 13:11:09.300302 24254 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:09.407660 24419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.013s	sys 0.022s
I20260709 13:11:09.373801 21465 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:09.268472 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.388152 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.456586 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:09.397122 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.248140 24399 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:11:09.278363 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:09.406723 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 163507us
W20260709 13:11:09.294637 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 98427.6us
W20260709 13:11:09.414170 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7775400689998833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
I20260709 13:11:09.415899 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:09.367151 24283 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:09.371941 24464 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.454653 21462 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:09.456775 21390 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
W20260709 13:11:09.330873 24473 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:09.368023 24458 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:09.459815 22041 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:09.460414 22035 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:11:09.465404 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7298400689999198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:11:09.480127 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7118400689998907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 13:11:09.480491 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5939400689999275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:11:09.297955 24470 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.483037 24470 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:09.461493 24419 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:09.485436 24419 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.486222 24464 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.488587 21464 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:09.489192 24464 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:09.468495 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 52706.2us
I20260709 13:11:09.491003 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:09.492645 24457 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:09.492398 23845 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.412742 24459 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.411733 24410 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:09.330649 24216 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.496186 24216 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:09.473296 21462 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:09.480768 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5651400689998809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 13:11:09.497114 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5336400689999437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 13:11:09.497769 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.493185 24457 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:09.498703 24457 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:09.499640 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.500929 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.493796 24459 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.504257 24482 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:11:09.497460 21462 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:09.506153 21462 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:09.470922 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:09.467473 21461 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:11:09.492424 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:11:09.520205 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 325472us
I20260709 13:11:09.520278 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:09.521092 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:09.521787 24375 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:09.521924 24225 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:09.522684 24375 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:09.523355 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:09.524158 24347 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:09.524634 24347 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.525027 24347 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.525383 24280 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:09.525884 24280 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.526324 24280 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:09.523874 24375 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:09.529892 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:09.531436 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 378720us
I20260709 13:11:09.475243 24367 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:09.536636 21465 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:09.466477 24477 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:09.543628 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:09.544693 22035 raft_consensus.cc:2410] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:09.451464 24285 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:09.563692 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 92891.6us
I20260709 13:11:09.478915 24421 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:09.542341 22031 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:09.546732 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:09.538293 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:09.493927 23845 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.578505 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:09.579856 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:09.580899 24328 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:09.569578 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:09.586381 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:09.590651 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.591610 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.592754 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.594877 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:09.493816 24464 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:11:09.606148 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:09.612234 21388 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:09.614812 21469 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:09.617074 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:09.617300 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.617654 22035 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:09.618279 21465 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:09.529609 24470 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:11:09.623593 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:09.624426 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.629927 21389 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:09.631317 21389 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:11:09.632634 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.640014 21463 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:09.640288 21468 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:09.644460 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.644809 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.644564 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.646689 21394 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:09.645339 21466 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:09.651778 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.652494 21388 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:09.563287 24225 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:11:09.606398 24216 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:09.659303 21392 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:09.658463 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 155978us
I20260709 13:11:09.619037 24421 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:09.686107 21389 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:11:09.691992 21389 pending_rounds.cc:85] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 6
I20260709 13:11:09.692323 21389 pending_rounds.cc:107] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:11:09.692592 21389 raft_consensus.cc:2889] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.702353 24411 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.703253 24411 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:09.713075 24410 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.713732 24410 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.718086 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.728421 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.740393 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:09.741251 21465 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.741191 22035 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:09.541394 24376 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:09.741053 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 109626us
I20260709 13:11:09.747387 24401 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.747387 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:09.819787 22035 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:09.790231 21392 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:09.608090 24254 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:09.825579 21997 connection.cc:256] RPC call timeout handler was delayed by -1.8559754210000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 13:11:09.826602 21997 connection.cc:256] RPC call timeout handler was delayed by -1.4463454140001204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:11:09.827023 21997 connection.cc:256] RPC call timeout handler was delayed by -1.0341454140000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 13:11:09.733577 24346 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:09.789701 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.808879 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.743093 24329 raft_consensus.cc:2764] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:09.745457 24367 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.858350 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.814703 24401 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.607540 24283 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:09.803061 24418 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.916s	user 0.010s	sys 0.007s
I20260709 13:11:09.858680 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:09.815320 24411 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.864678 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 284913us
I20260709 13:11:09.792588 21465 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:09.877189 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:09.872871 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.878496 22042 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
W20260709 13:11:09.871400 24463 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.003s
I20260709 13:11:09.904456 22035 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:09.895792 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:09.908346 21387 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.004s
I20260709 13:11:09.900833 24411 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:09.867697 24346 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:09.914662 21387 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
I20260709 13:11:09.657295 24458 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:09.506996 24414 consensus_queue.cc:1175] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "058db415e9884ea0ba23f1e1ff59127a" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:11:09.920658 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 62090.7us
I20260709 13:11:09.926645 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.895496 24491 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:09.929399 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:09.931435 21314 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:09.936787 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.940344 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.944861 21389 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:09.950440 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:09.920849 24254 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:09.876796 24367 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:09.974220 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:09.976884 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59145.4us
I20260709 13:11:09.978714 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:09.984313 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:09.990403 24512 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:09.991187 24512 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:09.992385 24512 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.929734 24482 raft_consensus.cc:2764] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:11:09.933626 24313 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:09.781529 24477 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:09.938392 24216 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:09.969511 24294 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:09.962111 24329 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:09.948140 24427 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:11:09.969316 24366 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.998135 24283 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:09.918586 24463 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:09.885106 24421 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:10.083232 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 147718us
I20260709 13:11:10.043273 24285 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:10.094619 21462 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:11:10.039549 24328 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:09.951529 24453 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:11:10.041764 24470 raft_consensus.cc:2764] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:11:10.134179 21462 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
W20260709 13:11:10.135962 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 346085us
W20260709 13:11:10.156842 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.157258 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 171528us
I20260709 13:11:10.156538 24285 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:11:10.044724 24225 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:11:10.170171 21467 raft_consensus.cc:2368] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:11:10.102217 24313 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:10.083138 24329 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.214686 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:10.170593 24479 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:10.212862 21318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.039s	sys 0.056s
I20260709 13:11:10.169878 24516 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:10.169067 24452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.014s	sys 0.018s
W20260709 13:11:10.232087 21318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.040s	sys 0.056s
W20260709 13:11:10.231513 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 61364.6us
I20260709 13:11:10.278259 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2024) took 1069 ms. Trace:
I20260709 13:11:10.283293 21318 rpcz_store.cc:276] 0709 13:11:09.209013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.247118 (+ 38105us) service_pool.cc:224] Handling call
0709 13:11:09.247490 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.247730 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:09.509637 (+261907us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.277813 (+768176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.277881 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:10.277935 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.278031 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.278186 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5640,"prepare.queue_time_us":480511,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4350,"thread_start_us":1023869,"threads_started":2}
W20260709 13:11:10.220197 24275 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.008s	user 0.010s	sys 0.001s
I20260709 13:11:10.208114 24285 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:10.290261 21321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.002s	sys 0.019s
W20260709 13:11:10.317610 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 144765us
W20260709 13:11:10.319736 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 105141us
W20260709 13:11:10.329876 21321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.006s	sys 0.022s
W20260709 13:11:10.245060 24452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.015s	sys 0.019s
W20260709 13:11:10.285460 24489 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:11:10.212195 24498 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:10.171034 24294 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:11:10.294059 24459 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.792s	user 0.012s	sys 0.000s
I20260709 13:11:10.378978 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:10.378798 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:10.294536 24447 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:10.269953 24479 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:10.289144 24516 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:10.290760 24449 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:10.389549 23845 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.003s
W20260709 13:11:10.399354 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 122224us
I20260709 13:11:10.372905 24411 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:10.402438 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:10.407112 21320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.002s	sys 0.002s
W20260709 13:11:10.407500 21320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.002s	sys 0.002s
I20260709 13:11:10.383839 24401 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:10.411667 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:10.380548 24498 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:10.233834 24216 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.415571 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2088) took 1136 ms. Trace:
I20260709 13:11:10.417038 21320 rpcz_store.cc:276] 0709 13:11:09.279395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.410977 (+131582us) service_pool.cc:224] Handling call
0709 13:11:09.411278 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.411453 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:09.650794 (+239341us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.415218 (+764424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.415274 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:10.415317 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.415385 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.415506 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43351,"prepare.queue_time_us":324011,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":938934,"threads_started":2}
W20260709 13:11:10.426673 24517 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
W20260709 13:11:10.428917 24488 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.440s	user 0.000s	sys 0.002s
I20260709 13:11:10.430148 24497 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:10.431167 24503 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.474s	user 0.000s	sys 0.001s
W20260709 13:11:10.432384 24527 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:11:10.433409 24463 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:10.434563 24513 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:11:10.436506 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2022) took 1228 ms. Trace:
I20260709 13:11:10.436889 24329 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:10.436859 21317 rpcz_store.cc:276] 0709 13:11:09.208412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.222048 (+ 13636us) service_pool.cc:224] Handling call
0709 13:11:09.222448 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.222916 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:09.622678 (+399762us) log.cc:844] Serialized 14 byte log entry
0709 13:11:09.859811 (+237133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.860592 (+   781us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.860765 (+   173us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:09.872677 (+ 11912us) log.cc:844] Serialized 14 byte log entry
0709 13:11:09.872883 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.872968 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.436298 (+563330us) raft_consensus.cc:1685] finished
0709 13:11:10.436317 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.436447 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60838,"prepare.queue_time_us":428490,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":6695,"raft.queue_time_us":41004,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":48251,"spinlock_wait_cycles":61659136,"thread_start_us":597345,"threads_started":2,"wal-append.queue_time_us":358853}
W20260709 13:11:10.439600 24450 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.145s	user 0.009s	sys 0.000s
I20260709 13:11:10.393549 24346 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:10.440470 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 946) took 1296 ms. Trace:
W20260709 13:11:10.442253 24347 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.917s	user 0.009s	sys 0.001s
I20260709 13:11:10.440956 22039 rpcz_store.cc:276] 0709 13:11:09.143939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.144452 (+   513us) service_pool.cc:224] Handling call
0709 13:11:09.189685 (+ 45233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.196273 (+  6588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.196318 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.213693 (+ 17375us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.451922 (+238229us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:09.451959 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.452043 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.440154 (+988111us) raft_consensus.cc:1685] finished
0709 13:11:10.440184 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.440367 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113878,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":237796,"threads_started":1,"wal-append.queue_time_us":404822}
I20260709 13:11:10.442713 24347 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:10.444698 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44422.3us
I20260709 13:11:10.420828 24470 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:10.446151 21360 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:10.446530 24470 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:10.447001 24470 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:10.447808 24528 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:10.449395 24528 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:10.449965 23845 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:10.450381 23845 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:10.450743 23845 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.378059 24493 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.412s
I20260709 13:11:10.389987 24328 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.365288 24275 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.418741 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:10.399674 24367 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:10.507031 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2033) took 1039 ms. Trace:
I20260709 13:11:10.510232 21318 rpcz_store.cc:276] 0709 13:11:09.467566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.285809 (+818243us) service_pool.cc:224] Handling call
0709 13:11:10.286144 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.286358 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:10.286621 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.506682 (+220061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.506737 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:10.506780 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.506842 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.506963 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4443,"prepare.queue_time_us":5788,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"thread_start_us":219674,"threads_started":1}
W20260709 13:11:10.452845 24494 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.466s	user 0.000s	sys 0.001s
I20260709 13:11:10.375134 24469 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.457s
I20260709 13:11:10.447309 24225 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:10.453989 24496 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
W20260709 13:11:10.453864 24529 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:10.451846 24353 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.451771 24514 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:10.494831 24410 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.775s	user 0.001s	sys 0.011s
I20260709 13:11:10.453653 24506 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.387741 24459 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.410276 24449 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.421515 24419 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:11:10.452221 24460 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 13:11:10.452445 24508 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:10.555841 22032 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:10.423230 24498 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:10.556329 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.615393 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 208554us
I20260709 13:11:10.414091 24452 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:10.553947 24502 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.505s	user 0.000s	sys 0.001s
I20260709 13:11:10.629956 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:10.628379 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 182297us
I20260709 13:11:10.631211 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:10.633756 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2025) took 1424 ms. Trace:
W20260709 13:11:10.648164 24495 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:11:10.653425 24457 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.154s	user 0.006s	sys 0.005s
I20260709 13:11:10.653908 24457 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.654546 24347 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:10.634191 21313 rpcz_store.cc:276] 0709 13:11:09.209293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.255863 (+ 46570us) service_pool.cc:224] Handling call
0709 13:11:09.256320 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.299483 (+ 43163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.299514 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.316393 (+ 16879us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.562989 (+246596us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:09.563093 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.563165 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.633547 (+1070382us) raft_consensus.cc:1685] finished
0709 13:11:10.633573 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.633699 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24730,"raft.queue_time_us":108205,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":42412,"thread_start_us":225173,"threads_started":1,"wal-append.queue_time_us":505241}
I20260709 13:11:10.553720 24516 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:10.679275 24283 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.542s	user 0.005s	sys 0.004s
I20260709 13:11:10.681118 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:10.681607 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:10.682209 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:10.669561 24254 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
I20260709 13:11:10.684015 21465 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:10.684815 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:10.687546 24475 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:10.691392 24280 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.165s	user 0.006s	sys 0.007s
I20260709 13:11:10.691946 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 772) took 1360 ms. Trace:
I20260709 13:11:10.697039 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2026) took 1487 ms. Trace:
I20260709 13:11:10.705950 21462 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:10.707553 21466 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:10.696511 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 768) took 1383 ms. Trace:
W20260709 13:11:10.717650 21468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.008s	sys 0.011s
I20260709 13:11:10.728233 24542 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.659008 24457 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:10.733421 21468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.010s	sys 0.012s
I20260709 13:11:10.664170 24285 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.659833 24522 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:10.615949 24410 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.730373 21396 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:10.737808 21395 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:10.730782 21312 rpcz_store.cc:276] 0709 13:11:09.209584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.272838 (+ 63254us) service_pool.cc:224] Handling call
0709 13:11:09.273197 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:09.589593 (+316396us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:09.696599 (+107006us) log.cc:844] Serialized 14 byte log entry
0709 13:11:09.702024 (+  5425us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b4800380358. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:11:09.939949 (+237925us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:09.964772 (+ 24823us) log.cc:844] Serialized 52 byte log entry
0709 13:11:09.964961 (+   189us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:09.965009 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.965116 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.696692 (+731576us) raft_consensus.cc:1685] finished
0709 13:11:10.696802 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.696979 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60620,"prepare.queue_time_us":182844,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6660,"raft.queue_time_us":150775,"raft.run_cpu_time_us":2022,"raft.run_wall_time_us":333021,"spinlock_wait_cycles":13797632,"thread_start_us":571797,"threads_started":3,"wal-append.queue_time_us":835385}
W20260709 13:11:10.697749 24510 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:11:10.729871 22040 rpcz_store.cc:276] 0709 13:11:09.331160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.331960 (+   800us) service_pool.cc:224] Handling call
0709 13:11:09.332296 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.481443 (+149147us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:09.481791 (+   348us) log.cc:844] Serialized 14 byte log entry
0709 13:11:09.752768 (+270977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.753845 (+  1077us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:09.760527 (+  6682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.691633 (+931106us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540069dcd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:10.691700 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.691868 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6508,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":179910,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8753,"spinlock_wait_cycles":346620160,"thread_start_us":212287,"threads_started":1,"wal-append.queue_time_us":487038}
W20260709 13:11:10.741573 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 362885us
I20260709 13:11:10.732949 22034 rpcz_store.cc:276] 0709 13:11:09.313335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.313519 (+   184us) service_pool.cc:224] Handling call
0709 13:11:09.314302 (+   783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.314802 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.314841 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.316665 (+  1824us) log.cc:844] Serialized 572 byte log entry
0709 13:11:09.543540 (+226875us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:09.543576 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.543638 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.696203 (+1152565us) raft_consensus.cc:1685] finished
0709 13:11:10.696230 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.696436 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":226361,"threads_started":1,"wal-append.queue_time_us":1226183}
I20260709 13:11:10.671718 24508 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.717806 24475 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:10.716498 24477 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:10.755649 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:10.767405 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:10.629406 24506 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.670032 24452 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:10.725363 24464 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:10.750442 24465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.002s	sys 0.026s
I20260709 13:11:10.724846 24419 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:10.743417 24368 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.767915 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:10.495309 24313 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.804189 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2036) took 1283 ms. Trace:
I20260709 13:11:10.763007 24469 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:11:10.801151 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:10.629631 24514 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.582453 24479 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.811414 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1880) took 1243 ms. Trace:
W20260709 13:11:10.810565 24483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.009s	sys 0.011s
I20260709 13:11:10.753278 24254 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.832749 21318 rpcz_store.cc:276] 0709 13:11:09.521032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.511708 (+990676us) service_pool.cc:224] Handling call
0709 13:11:10.512229 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.512618 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.512645 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.526000 (+ 13355us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.754676 (+228676us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:10.754719 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.754795 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.803726 (+ 48931us) raft_consensus.cc:1685] finished
0709 13:11:10.803748 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.803919 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"spinlock_wait_cycles":17525504,"thread_start_us":170627,"threads_started":1,"wal-append.queue_time_us":246527}
W20260709 13:11:10.809536 24465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.003s	sys 0.026s
I20260709 13:11:10.806051 24283 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:10.845695 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 78378.2us
I20260709 13:11:10.805656 24275 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:10.843323 21396 rpcz_store.cc:276] 0709 13:11:09.568496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.620941 (+ 52445us) service_pool.cc:224] Handling call
0709 13:11:10.811242 (+1190301us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000f1ed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:10.811358 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495099264}
I20260709 13:11:10.766820 24477 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:10.745512 24280 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.810844 24285 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.760543 23845 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.856736 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2034) took 1377 ms. Trace:
I20260709 13:11:10.859131 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:10.855206 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:10.847675 24483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.009s	sys 0.012s
I20260709 13:11:10.834332 24419 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:10.868817 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 408) took 1239 ms. Trace:
I20260709 13:11:10.867632 21465 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
W20260709 13:11:10.871305 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70236.9us
I20260709 13:11:10.867367 21317 rpcz_store.cc:276] 0709 13:11:09.479770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.438786 (+959016us) service_pool.cc:224] Handling call
0709 13:11:10.439139 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.439355 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:10.457696 (+ 18341us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.856392 (+398696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.856444 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:10.856490 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.856565 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.856678 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7667,"prepare.queue_time_us":17758,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":4144,"raft.queue_time_us":10898,"thread_start_us":390505,"threads_started":1}
I20260709 13:11:10.870333 22038 rpcz_store.cc:276] 0709 13:11:09.629305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.632144 (+  2839us) service_pool.cc:224] Handling call
0709 13:11:09.632485 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.632730 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.632768 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.633327 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.880528 (+247201us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:09.880576 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.913204 (+ 32628us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.868596 (+955392us) raft_consensus.cc:1685] finished
0709 13:11:10.868616 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.868758 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":246748,"threads_started":1,"wal-append.queue_time_us":777645}
I20260709 13:11:10.751497 24542 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.875411 21465 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:10.874811 24509 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:10.879194 24509 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:10.880065 24533 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:11:10.881434 24530 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:11:10.882066 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2029) took 1669 ms. Trace:
I20260709 13:11:10.882452 21321 rpcz_store.cc:276] 0709 13:11:09.213026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.301192 (+ 88166us) service_pool.cc:224] Handling call
0709 13:11:09.301613 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.624386 (+322773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.624427 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.639947 (+ 15520us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.330478 (+690531us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:10.330546 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.330640 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.881845 (+551205us) raft_consensus.cc:1685] finished
0709 13:11:10.881866 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.882006 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22506,"raft.queue_time_us":112454,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6392,"thread_start_us":901142,"threads_started":2,"wal-append.queue_time_us":969948}
I20260709 13:11:10.874872 24521 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:10.884644 24521 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.886181 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2014) took 2179 ms. Trace:
I20260709 13:11:10.886834 24521 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:10.889000 21461 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:10.886569 21316 rpcz_store.cc:276] 0709 13:11:08.706464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.749643 (+ 43179us) service_pool.cc:224] Handling call
0709 13:11:08.749963 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.885335 (+2135372us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:10.885364 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.885405 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:10.885434 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.885969 (+   535us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54003f5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:10.886021 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.886127 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1907,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":4910216448}
I20260709 13:11:10.892484 24459 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:10.894001 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1877) took 1326 ms. Trace:
I20260709 13:11:10.894407 21395 rpcz_store.cc:276] 0709 13:11:09.567256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.567372 (+   116us) service_pool.cc:224] Handling call
0709 13:11:10.893826 (+1326454us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000ac3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:10.893941 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631772416}
I20260709 13:11:10.860560 24475 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.824167 24464 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.766613 24508 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.841828 24368 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.873245 24538 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:10.857074 24254 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:10.927016 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.930099 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 404) took 1390 ms. Trace:
I20260709 13:11:10.930646 22042 rpcz_store.cc:276] 0709 13:11:09.539681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.539827 (+   146us) service_pool.cc:224] Handling call
0709 13:11:10.929871 (+1390044us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400613ad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:10.930024 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681960832}
I20260709 13:11:10.916410 24516 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.919328 24285 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.921069 24280 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:10.942406 24509 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:10.933516 24515 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.916818 24493 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:10.878278 24498 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.949623 24516 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:10.959704 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:10.961724 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:10.962301 21387 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:10.963303 21390 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:11:10.965142 24532 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:11:10.968355 21394 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:11:10.969552 24544 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:10.969722 21387 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:10.971999 24353 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:10.973860 24545 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:11:10.973755 24353 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.981871 23845 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:10.972563 21389 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:10.972775 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:10.973177 21395 pending_rounds.cc:85] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 4
I20260709 13:11:10.986616 21395 pending_rounds.cc:107] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:11:10.986886 21395 raft_consensus.cc:2889] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.993654 21320 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:10.995756 24506 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:10.997454 24547 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:10.953733 24477 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:10.999387 24477 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:11.004798 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.005267 24470 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 13:11:10.973212 24539 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:11.005717 24470 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.006652 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:11.007730 24216 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:10.959234 24515 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.008605 24514 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:11.007755 24470 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:11.009832 24515 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:11.010280 24254 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:11.011224 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:11.011843 21391 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.008087 24464 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:10.975849 24353 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:11.020058 21396 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:11.007164 24508 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:10.973134 24444 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.023375 24516 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:11.024318 24472 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.024902 24472 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.027724 24542 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:11.027894 24472 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:11.036276 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.859s (SENT) [suppressed 38 similar messages]
I20260709 13:11:11.036675 21396 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:11.037670 24498 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:10.920297 24452 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:11.038339 24470 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:11.038843 24470 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.035709 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:11.034065 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:10.957285 24419 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.046857 21314 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:11:11.053012 21314 pending_rounds.cc:85] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 9
I20260709 13:11:11.054749 24470 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:11.045717 21394 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:11.053274 21314 pending_rounds.cc:107] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:11:11.055759 24368 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:10.932629 24538 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:11.040802 24472 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.055941 21314 raft_consensus.cc:2889] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.065003 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:11.048722 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.065944 22035 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:11.046221 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:11.052440 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.070283 21387 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:11.070605 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.073215 21391 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:11.032812 24410 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:11.081966 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.047506 24514 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:11.086583 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:11.088876 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.089212 24514 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.137341 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.085942 24472 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.086236 24216 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:11:11.130503 24514 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.121402 24427 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:11:11.157177 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.178305 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.179137 22031 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:11.180521 24483 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:11.188089 24499 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.188825 24499 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.186049 24483 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:11.235864 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.238214 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.239118 22038 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:11.257419 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.260914 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.248644 24472 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:11.270210 24556 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:11:11.275848 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:11.279436 24447 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:11.279981 24447 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.283857 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:11.292207 24332 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:11.292659 24332 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.292986 24332 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.288352 24493 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:11.257937 24538 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:11.298087 22042 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:11.298867 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:11.290524 22002 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.075s (SENT)
W20260709 13:11:11.300454 21284 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 2.030s (SENT)
I20260709 13:11:11.300895 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:11.302906 24368 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:11.303447 24368 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.303865 24368 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:11.303973 24565 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:11:11.299248 24493 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.311349 24493 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.307780 24427 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:11.313156 24427 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:11.316411 24501 log.cc:927] Time spent T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 1.319s	user 0.005s	sys 0.000s
W20260709 13:11:11.320422 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1564) took 2045 ms (client timeout 2205 ms). Trace:
I20260709 13:11:11.320578 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:11.321147 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:11.321448 21317 raft_consensus.cc:2410] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:11:11.321511 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:11.322058 21312 raft_consensus.cc:2410] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:11.322161 21318 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.322391 21316 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:11.322618 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:11.322897 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:11.323228 21317 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:11.324496 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:11.325060 21321 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.326143 24538 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:11.262048 24483 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:11.328418 24486 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.573s	user 0.008s	sys 0.007s
I20260709 13:11:11.331089 22035 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:11.331445 24411 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:11.324716 21465 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 10. Ops: []
I20260709 13:11:11.360457 21396 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:11.333546 21391 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:11.334368 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43876.1us
W20260709 13:11:11.320887 21467 rpcz_store.cc:269] 0709 13:11:09.274989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.277146 (+  2157us) service_pool.cc:224] Handling call
0709 13:11:11.320222 (+2043076us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400070154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:11.320365 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754213248}
I20260709 13:11:11.337886 24472 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.337893 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:11.342150 24469 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:11.386916 21318 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
W20260709 13:11:11.347574 24531 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.503s	user 0.000s	sys 0.002s
I20260709 13:11:11.351347 21321 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:11.389775 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:11.352924 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:11.354321 21387 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:11.354456 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 426) took 1739 ms. Trace:
I20260709 13:11:11.391403 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:11.357053 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:11.359156 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.371459 22002 leader_election.cc:336] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 3.327s (SENT)
I20260709 13:11:11.360679 24411 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:11.377480 24514 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.379347 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:11.383637 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.344451 24376 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.388398 21312 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:11.390453 21318 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.392019 22042 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:11:11.541581 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:11.689064 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1863) took 1006 ms. Trace:
W20260709 13:11:11.707289 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.711059 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:11.640463 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2035) took 2127 ms. Trace:
I20260709 13:11:11.468416 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:11.712285 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 355309us
I20260709 13:11:11.631860 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:11.705461 21465 rpcz_store.cc:276] 0709 13:11:10.682298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.887453 (+205155us) service_pool.cc:224] Handling call
0709 13:11:11.324551 (+437098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.360785 (+ 36234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.688730 (+327945us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400070150. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:11.688928 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004481408}
I20260709 13:11:11.441407 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:11.433705 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:11.497160 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.397540 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.717214 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:11.467900 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:11.706075 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:11.426899 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:11.733992 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 354687us
I20260709 13:11:11.391098 21468 rpcz_store.cc:276] 0709 13:11:09.615323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.719494 (+104171us) service_pool.cc:224] Handling call
0709 13:11:09.719893 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.743210 (+ 23317us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:09.981453 (+238243us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.751615 (+770162us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.354003 (+602388us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b1800301ea0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:11:11.354146 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:11.354195 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:11.354239 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.354298 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.354404 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577966,"prepare.queue_time_us":838793,"prepare.run_cpu_time_us":2706,"prepare.run_wall_time_us":29222,"raft.queue_time_us":616513,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":10019,"spinlock_wait_cycles":108939520,"thread_start_us":867370,"threads_started":2,"wal-append.queue_time_us":816708}
W20260709 13:11:11.517292 24488 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:11:11.704623 24483 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.388878 24472 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.466300 24505 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:12.087216 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 405) took 3054 ms. Trace:
I20260709 13:11:12.087826 21319 rpcz_store.cc:276] 0709 13:11:09.032747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.041368 (+  8621us) service_pool.cc:224] Handling call
0709 13:11:09.059631 (+ 18263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.083070 (+ 23439us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:09.083094 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.092869 (+  9775us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.319458 (+226589us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:09.319781 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.319880 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.328169 (+2008289us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b20001bbe78. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bedc6b91 00007fc2bede8a19 00007fc2bedb38c3 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169 00007fc2bedbc131 00007fc2bedbb42d 000000000038f354
0709 13:11:11.517073 (+188904us) raft_consensus.cc:1685] finished
0709 13:11:11.517104 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.087137 (+570033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93516672,"thread_start_us":180552,"threads_started":1,"wal-append.queue_time_us":484410}
I20260709 13:11:11.514313 24332 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:11.853863 21395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.009s
I20260709 13:11:12.104794 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:12.105154 21395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.007s	sys 0.009s
I20260709 13:11:12.105336 21469 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:12.105463 21463 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.441824 24446 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:11.389791 24280 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.540789 24440 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.998016 21321 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.434077 24444 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.349s
I20260709 13:11:11.405267 24538 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:11.998456 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.589390 24399 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:11.999794 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.004372 21394 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:11.388109 24346 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.712947 21320 rpcz_store.cc:276] 0709 13:11:09.513318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.489361 (+976043us) service_pool.cc:224] Handling call
0709 13:11:10.505502 (+ 16141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.994937 (+489435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.640153 (+645216us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54000fd554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:11.640386 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122243456}
I20260709 13:11:12.136600 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:11.441716 24452 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.139604 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:11.390892 24479 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.010587 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:11.533586 24459 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.011282 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.005s
I20260709 13:11:11.515671 24465 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.998718 21390 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:12.017236 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:12.023458 21318 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:12.121223 24446 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.135363 24399 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:12.111287 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:12.112540 21467 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:11.995007 24521 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:11.978413 24275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.018s	sys 0.019s
I20260709 13:11:11.996560 24450 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.017709 24535 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.125437 24280 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.125537 24411 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.126286 24514 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.126713 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:12.127233 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:12.181310 21463 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:09.453122 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:12.127657 24505 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.129220 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:12.126394 24440 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.182355 22031 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:12.129894 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.129973 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:12.130503 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:12.079324 24313 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:11:12.003404 24522 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:11.996546 24353 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:12.078644 24508 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:12.199939 22031 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:11.996721 24453 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.131150 22032 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:12.107895 23879 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:12.002687 24491 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:11:12.158896 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:12.206436 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:12.206885 21320 raft_consensus.cc:2410] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:12.207350 21467 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:12.146559 21321 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:12.157428 24452 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.162336 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:12.163189 24465 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:11.993922 24328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.011s	sys 0.007s
I20260709 13:11:12.114463 24410 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:11:12.166769 24275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.034s	sys 0.027s
I20260709 13:11:12.183270 22034 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.174598 24450 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.137532 24538 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:11.705892 24480 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 5 to 8, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:12.174985 24578 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:12.166715 24521 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:12.195333 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.198340 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:12.142531 24346 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.175081 24472 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.146091 24479 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.209141 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:12.160379 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.007s	sys 0.006s
W20260709 13:11:12.079130 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 707670us
I20260709 13:11:12.215677 24522 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:12.215967 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:12.269800 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:12.218532 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:12.270915 21320 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
W20260709 13:11:12.225915 24536 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.471s	user 0.000s	sys 0.001s
W20260709 13:11:12.224756 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.032s	sys 0.077s
W20260709 13:11:12.272056 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.032s	sys 0.078s
W20260709 13:11:12.272444 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 737532us
I20260709 13:11:12.273824 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:12.275473 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:12.227849 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:12.186841 24506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.016s	sys 0.040s
I20260709 13:11:12.209254 24411 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:12.199180 24514 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:12.222265 24328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.015s	sys 0.016s
I20260709 13:11:12.246620 21469 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:11:12.241458 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:12.180140 24535 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:12.243811 23845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.031s	sys 0.063s
I20260709 13:11:12.264070 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:12.265899 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:12.164496 24459 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.267189 22032 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:12.175015 24399 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.277380 21320 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:12.278389 21462 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
W20260709 13:11:12.261485 21464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.048s
I20260709 13:11:12.310999 24332 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.312069 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:12.260264 24521 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.212723 24353 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.208086 24508 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.341566 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:12.342336 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 76543.3us
I20260709 13:11:12.342547 21320 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:11:12.319856 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.277765 24506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.017s	sys 0.041s
I20260709 13:11:12.220767 24453 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:12.333930 21464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.013s	sys 0.048s
I20260709 13:11:12.278882 24522 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.311630 24499 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.343387 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2103) took 1003 ms. Trace:
I20260709 13:11:12.314657 22042 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:12.341638 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:12.264909 24578 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.360697 21320 rpcz_store.cc:276] 0709 13:11:11.340566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.336159 (+995593us) service_pool.cc:224] Handling call
0709 13:11:12.343307 (+  7148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:12.330900 23845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.031s	sys 0.064s
W20260709 13:11:12.264017 24569 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:11:12.357513 24353 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.350818 21312 raft_consensus.cc:2410] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:12.359810 24508 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:12.361788 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 363938us
I20260709 13:11:12.362695 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:12.370054 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.362617 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2101) took 1022 ms. Trace:
I20260709 13:11:12.373559 21321 rpcz_store.cc:276] 0709 13:11:11.339885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.330373 (+990488us) service_pool.cc:224] Handling call
0709 13:11:12.362531 (+ 32158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5504}
I20260709 13:11:12.320870 24514 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.367586 24499 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:12.404348 24280 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.360702 24579 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.407121 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2095) took 1074 ms. Trace:
I20260709 13:11:12.407634 21320 rpcz_store.cc:276] 0709 13:11:11.332949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.370776 (+1037827us) service_pool.cc:224] Handling call
0709 13:11:12.406017 (+ 35241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.406204 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.406242 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:12.406297 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:12.406341 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.406414 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.407045 (+   631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:12.386612 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:12.369966 21467 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:11:12.350767 24399 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:12.409548 21321 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:11:12.362300 24446 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:12.410348 21321 pending_rounds.cc:85] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 2
I20260709 13:11:12.410676 21321 pending_rounds.cc:107] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 13:11:12.409168 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 674192us
I20260709 13:11:12.404781 24499 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:12.415879 24576 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:11:12.416610 24453 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.416728 24482 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:12.417392 24574 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:11:12.418537 24508 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:12.420315 21319 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:12.420454 24465 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:12.417233 24453 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.421085 24465 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:12.421482 24465 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.421356 24453 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.421862 24465 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:12.423547 24453 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.417291 24482 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:12.424679 24346 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:12.425125 24482 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.426039 24578 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.426410 24535 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.426465 24482 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.427161 24479 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:12.427431 24458 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:12.417239 24499 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:12.432291 24572 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:11:12.433234 24522 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:12.412739 24505 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:12.433920 24368 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.130s	user 0.010s	sys 0.000s
I20260709 13:11:12.434201 24538 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.434880 24440 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:12.435693 24450 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:12.436383 24452 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:12.438099 24493 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.126s	user 0.000s	sys 0.010s
I20260709 13:11:12.438506 24493 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.439247 24446 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:12.439826 21317 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:11:12.432379 24447 consensus_meta.cc:287] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.152s	user 0.012s	sys 0.000s
I20260709 13:11:12.440718 24447 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.442945 24447 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:12.443518 24447 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:12.410979 21321 raft_consensus.cc:2889] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.444352 21316 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:12.414747 21362 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:12.446249 21320 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:12.448400 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:12.449744 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:12.405035 24280 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.451151 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:12.476271 21466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.006s	sys 0.041s
I20260709 13:11:12.476554 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2098) took 1137 ms. Trace:
I20260709 13:11:12.476966 21321 rpcz_store.cc:276] 0709 13:11:11.339116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.374771 (+1035655us) service_pool.cc:224] Handling call
0709 13:11:12.404116 (+ 29345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.476279 (+ 72163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.476494 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:12.475831 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:12.416874 24577 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:12.477852 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:12.478328 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:12.476701 21466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.006s	sys 0.041s
I20260709 13:11:12.435732 24514 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.478756 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:12.452514 24506 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:12.452060 24499 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:12.515771 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.452705 24505 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:12.431828 24521 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.454882 24482 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:12.504577 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.475575 24479 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.495322 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 484852us
I20260709 13:11:12.498317 22032 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:12.478816 24440 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.496281 22038 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.015s	sys 0.007s
I20260709 13:11:12.481031 24332 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:12.521361 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.526000 22042 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:12.434403 24368 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.444001 24447 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:12.527817 22038 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.015s	sys 0.008s
I20260709 13:11:12.478040 24280 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.528743 24582 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.529047 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:12.529924 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.529785 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.523238 24275 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:12.531596 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.532125 24514 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:12.533092 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.536242 24440 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:12.537456 21391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3784e213304c30beba718dd813ab39"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:12.538995 24521 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.540267 24584 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:12.541222 24580 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:12.550706 21318 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:12.551992 22041 raft_consensus.cc:2410] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:12.413184 24579 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.491910 24491 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:12.522223 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:12.647974 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1868) took 1930 ms. Trace:
I20260709 13:11:12.768690 21466 rpcz_store.cc:276] 0709 13:11:10.718017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.892698 (+174681us) service_pool.cc:224] Handling call
0709 13:11:10.893006 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.382381 (+489375us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:11.382425 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.382865 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.482850 (+1099985us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:12.482905 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.482990 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.647631 (+164641us) raft_consensus.cc:1685] finished
0709 13:11:12.647666 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.647874 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":593162,"raft.queue_time_us":490010,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":3014,"thread_start_us":983358,"threads_started":1,"wal-append.queue_time_us":1154577}
I20260709 13:11:12.768374 22036 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:12.515977 24585 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.770900 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:12.771454 24585 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.772475 24275 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:12.772823 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:12.773689 21467 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.773775 24589 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.775545 24447 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:12.773319 24368 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.526706 24499 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.568266 24508 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.554878 24332 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.775267 24516 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:12.490929 24522 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.563537 22034 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:12.649765 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1871) took 1923 ms. Trace:
I20260709 13:11:12.669683 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2032) took 3204 ms. Trace:
W20260709 13:11:12.749648 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 471034us
I20260709 13:11:12.809736 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.809252 21314 rpcz_store.cc:276] 0709 13:11:09.465054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.044882 (+579828us) service_pool.cc:224] Handling call
0709 13:11:10.077428 (+ 32546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.068813 (+991385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.669365 (+1600552us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b540032afd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:12.669607 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228632320}
W20260709 13:11:12.775694 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 253543us
I20260709 13:11:12.811208 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:12.779086 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:12.496881 24535 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.670758 21998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.008s	sys 0.009s
W20260709 13:11:12.814327 21998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.009s	sys 0.009s
W20260709 13:11:12.775986 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 157657us
W20260709 13:11:12.704293 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.767834 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 494058us
W20260709 13:11:12.671206 24444 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.016s
I20260709 13:11:12.614827 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:12.817786 21468 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:12.564699 24376 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.002s
I20260709 13:11:12.614051 24411 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.774569 24578 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:11:12.803565 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:12.558988 24493 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.775548 24440 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.779698 24509 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.810603 22039 raft_consensus.cc:2410] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:11:12.812139 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.885063 22031 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:12.812770 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:12.820729 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:12.808008 21461 rpcz_store.cc:276] 0709 13:11:10.726735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.998717 (+271982us) service_pool.cc:224] Handling call
0709 13:11:10.999085 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.420286 (+421201us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:11.420328 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.089790 (+669462us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.480243 (+390453us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:12.480299 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.482698 (+  2399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.649530 (+166832us) raft_consensus.cc:1685] finished
0709 13:11:12.649551 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.649692 (+   141us) inbound_call.cc:177] Queueing success response
0709 13:11:12.770578 (+120886us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b48001e0258. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
Metrics: {"mutex_wait_us":391458,"raft.queue_time_us":441407,"raft.run_cpu_time_us":3681,"raft.run_wall_time_us":1302915,"spinlock_wait_cycles":60999040,"thread_start_us":369054,"threads_started":1,"wal-append.queue_time_us":516033}
I20260709 13:11:12.824327 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:12.784710 24446 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:12.784205 24491 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:12.556528 24472 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.250s
W20260709 13:11:12.829835 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.877724 21466 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.809413 24332 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:12.556313 24505 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:12.834507 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.837132 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:12.569864 24479 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:12.821144 24444 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.000s	sys 0.018s
I20260709 13:11:12.887910 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:12.813136 24516 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.890369 21463 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:12.873309 24514 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:12.798838 24589 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:12.984941 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 175099us
I20260709 13:11:12.781773 24582 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.873525 24447 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:11:12.880699 24459 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:12.896240 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:12.896967 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 85824.7us
I20260709 13:11:12.812779 24522 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:12.900607 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:12.888336 22042 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
W20260709 13:11:12.902688 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 74866.8us
I20260709 13:11:12.826385 24535 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:12.957996 22002 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.506s (SENT)
W20260709 13:11:13.026250 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 68319.1us
W20260709 13:11:13.027148 22002 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.659s (SENT)
W20260709 13:11:13.029012 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.992s (SENT)
I20260709 13:11:12.884063 24599 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.984427 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 167206us
I20260709 13:11:13.032433 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:12.782706 24584 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:12.986234 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:12.990407 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:13.061483 21463 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:12.885442 24587 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.064934 24599 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:13.065291 24459 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:13.065500 24587 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.067581 24599 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:12.898772 24596 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:13.068387 24596 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:13.069654 24584 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:13.069540 24596 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.070482 24594 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:11:12.904238 22036 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.029583 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:13.071905 24594 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:12.879187 24411 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:13.072431 24594 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:13.073320 24594 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:13.057021 22039 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.812573 24508 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:12.994607 24580 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:11:12.899504 24509 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.064670 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:13.073863 24411 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:13.051923 21466 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:13.073091 24587 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:12.979962 24368 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.077333 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 45906.3us
W20260709 13:11:13.095192 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66215.5us
I20260709 13:11:12.985728 24516 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.994715 24375 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:12.987936 24399 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:12.899125 24440 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 13:11:12.980329 24376 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:11:13.025882 24522 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.093611 21466 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:13.099684 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:13.100927 22040 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:13.109434 22039 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:13.102691 24459 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:13.092932 24590 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:13.118865 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.120229 21466 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:13.023993 24275 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:13.105201 24457 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:13.100634 24449 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:13.101907 24399 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:13.113273 24608 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:13.131170 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 66598.9us
I20260709 13:11:13.132550 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1867) took 2442 ms. Trace:
W20260709 13:11:13.132906 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.859s (SENT)
I20260709 13:11:13.146178 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:13.099787 24368 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:13.138460 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 152308us
I20260709 13:11:13.103358 24464 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:11:13.149539 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:13.153504 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:13.154464 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:13.155176 21396 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.155567 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:13.144218 21464 rpcz_store.cc:276] 0709 13:11:10.683245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.891563 (+208318us) service_pool.cc:224] Handling call
0709 13:11:10.891856 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.383062 (+491206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.383090 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.690782 (+307692us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b2c0002f1a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:11.691307 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.351171 (+659864us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:12.367962 (+ 16791us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.671035 (+303073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.671120 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.113085 (+441965us) raft_consensus.cc:1685] finished
0709 13:11:13.125567 (+ 12482us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.125736 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":486011,"prepare.queue_time_us":17194,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1766,"raft.queue_time_us":544065,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":12571264,"thread_start_us":962164,"threads_started":2,"wal-append.queue_time_us":707976}
I20260709 13:11:13.126407 24280 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:13.096513 24491 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:13.133186 24587 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.129428 24585 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:13.131966 24595 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.139139 24459 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:13.139947 24499 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:13.178817 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 104127us
I20260709 13:11:13.180658 21390 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:13.185349 21360 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:13.189958 21467 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:13.195315 21468 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:13.196528 21463 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.131764 24590 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.176816 24607 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:13.210796 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:13.213632 21468 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:13.185226 24579 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:13.157644 24608 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:13.210786 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 56755.4us
I20260709 13:11:13.204708 24505 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:13.219166 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:13.224364 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.208448 24593 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.173457 24587 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.231426 21468 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:13.236537 24619 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:13.237350 24617 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:13.237778 24617 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.238070 24617 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.238240 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 974) took 1870 ms. Trace:
I20260709 13:11:13.238847 22038 rpcz_store.cc:276] 0709 13:11:11.368226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.368356 (+   130us) service_pool.cc:224] Handling call
0709 13:11:11.368682 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.368923 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:12.772941 (+1404018us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.987207 (+214266us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.237738 (+250531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.237815 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:13.237886 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.237987 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.238161 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":799905,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":368263,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":19521,"thread_start_us":1845930,"threads_started":4,"wal-append.queue_time_us":327440}
W20260709 13:11:13.243142 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.177676 24595 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.245537 21461 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.245805 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:13.204281 24585 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:11:13.225507 24521 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:13.229389 24479 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:13.231384 24607 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.232235 24593 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:13.249897 24603 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:11:13.244484 24611 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:13.275187 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46124.7us
I20260709 13:11:13.251627 24521 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:13.279835 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 129322us
I20260709 13:11:13.283542 22036 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:11:13.285279 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:13.271274 24605 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:11:13.290529 24375 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.294487 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:13.295691 21396 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:13.296273 24597 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.290244 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:13.325241 22041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 403) took 3763 ms (client timeout 2030 ms). Trace:
I20260709 13:11:13.270479 24593 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:13.325863 22041 rpcz_store.cc:269] 0709 13:11:09.539212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.546484 (+  7272us) service_pool.cc:224] Handling call
0709 13:11:13.297243 (+3750759us) spinlock_profiling.cc:243] Waited 2.98 s on lock 0x7b54003d18d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:13.297398 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6846484224}
W20260709 13:11:13.371536 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.278280 24611 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.247944 24459 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.413113 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:13.510720 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:13.526973 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.287364 24521 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.260080 24613 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.169s
W20260709 13:11:13.417771 24603 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:11:13.714751 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.436861 22036 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 5 to 8, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:13.448094 24368 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:13.507596 24585 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:13.436164 24627 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:13.437342 24523 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.320s
I20260709 13:11:13.286351 24617 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:13.348532 24597 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:13.762387 22002 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.141s (SENT)
I20260709 13:11:13.720953 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:14.096700 21468 raft_consensus.cc:2376] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9. Re-sending same reply.
I20260709 13:11:14.097905 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:14.098587 21468 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:14.099506 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:14.082216 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.100108 21468 raft_consensus.cc:2376] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6. Re-sending same reply.
I20260709 13:11:13.732120 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2091) took 3574 ms. Trace:
I20260709 13:11:14.101020 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:13.702673 24475 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.101866 21313 rpcz_store.cc:276] 0709 13:11:10.157750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.658098 (+500348us) service_pool.cc:224] Handling call
0709 13:11:10.676073 (+ 17975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.846284 (+170211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:10.846316 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.846359 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:10.846392 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.731809 (+2885417us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400228154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:13.731862 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.732054 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390951168}
W20260709 13:11:14.194682 21359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.000s	sys 0.013s
W20260709 13:11:13.716236 24457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.001s	sys 0.025s
W20260709 13:11:13.982462 24615 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.736s	user 0.001s	sys 0.000s
W20260709 13:11:14.214767 21359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.000s	sys 0.014s
W20260709 13:11:14.196966 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1572) took 2190 ms (client timeout 1759 ms). Trace:
W20260709 13:11:14.218139 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.731413 24524 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 3.498s	user 0.012s	sys 0.013s
W20260709 13:11:14.172821 24332 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.192s	user 0.006s	sys 0.006s
I20260709 13:11:14.274842 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1875) took 1940 ms. Trace:
I20260709 13:11:14.274830 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:14.275715 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 1.0032e+06us
W20260709 13:11:14.276152 21462 rpcz_store.cc:269] 0709 13:11:12.007000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.007123 (+   123us) service_pool.cc:224] Handling call
0709 13:11:13.738390 (+1731267us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540025dd54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:14.196853 (+458463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259357440}
I20260709 13:11:13.952123 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1573) took 1944 ms. Trace:
W20260709 13:11:14.022469 24465 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.600s	user 0.015s	sys 0.000s
W20260709 13:11:13.737442 24610 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:11:14.353547 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:14.354770 21313 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:14.355518 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2106) took 1191 ms. Trace:
I20260709 13:11:14.272212 24585 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:14.269496 24457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.014s	sys 0.080s
I20260709 13:11:13.807411 24280 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.102267 24590 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:13.803789 24587 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:14.336689 21461 rpcz_store.cc:276] 0709 13:11:12.007423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.060649 (+1053226us) service_pool.cc:224] Handling call
0709 13:11:13.064685 (+  4036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.246891 (+182206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.951695 (+704804us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001edcd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:13.951998 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412763008}
I20260709 13:11:14.335700 21466 rpcz_store.cc:276] 0709 13:11:12.334454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.130171 (+795717us) service_pool.cc:224] Handling call
0709 13:11:13.151960 (+ 21789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.228385 (+ 76425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.228411 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.228964 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.710748 (+481784us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:13.710796 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.710874 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.274617 (+563743us) raft_consensus.cc:1685] finished
0709 13:11:14.274637 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.274781 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17102,"raft.queue_time_us":57998,"spinlock_wait_cycles":8628608,"thread_start_us":508594,"threads_started":2,"wal-append.queue_time_us":862686}
I20260709 13:11:14.355921 21313 rpcz_store.cc:276] 0709 13:11:13.164283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.328861 (+1164578us) service_pool.cc:224] Handling call
0709 13:11:14.355367 (+ 26506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:14.370106 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:14.371397 21313 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:14.364830 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:14.361434 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 434) took 1124 ms. Trace:
I20260709 13:11:14.372308 21468 rpcz_store.cc:276] 0709 13:11:13.237284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.100893 (+863609us) service_pool.cc:224] Handling call
0709 13:11:14.361312 (+260419us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:14.382844 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.032s	sys 0.017s
W20260709 13:11:14.383406 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.032s	sys 0.017s
W20260709 13:11:14.383764 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 1.13609e+06us
I20260709 13:11:14.390614 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2112) took 1209 ms. Trace:
I20260709 13:11:14.391402 21313 rpcz_store.cc:276] 0709 13:11:13.181680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.369761 (+1188081us) service_pool.cc:224] Handling call
0709 13:11:14.390531 (+ 20770us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:14.396225 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:14.397305 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:14.401448 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2028) took 5176 ms. Trace:
I20260709 13:11:14.481846 21468 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:14.410404 24353 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.407902 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:14.483863 21461 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:11:14.334714 24626 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:11:14.356334 24465 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.325562 24627 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:14.478186 21466 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
W20260709 13:11:14.431711 24630 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
W20260709 13:11:14.434468 22031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.029s	sys 0.039s
W20260709 13:11:14.491189 22031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.029s	sys 0.040s
W20260709 13:11:14.428594 24516 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.324s	user 0.013s	sys 0.000s
I20260709 13:11:14.422813 24632 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.362787 24457 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:14.479182 21315 rpcz_store.cc:276] 0709 13:11:09.212718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.295937 (+ 83219us) service_pool.cc:224] Handling call
0709 13:11:09.296428 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.621242 (+324814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.621279 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.658163 (+ 36884us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.896317 (+238154us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:09.896481 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.896771 (+   290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.010325 (+1113554us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:13.710223 (+2699898us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b2400135c38. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc16a09d 00007fc2bed9c10e 00007fc2bedb388c 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221
0709 13:11:14.388274 (+678051us) raft_consensus.cc:1685] finished
0709 13:11:14.388306 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.388521 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27529,"raft.queue_time_us":107723,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":3641,"spinlock_wait_cycles":83005184,"thread_start_us":437638,"threads_started":2,"wal-append.queue_time_us":441146}
W20260709 13:11:14.486351 24521 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.767s	user 0.007s	sys 0.007s
I20260709 13:11:14.375195 24280 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:14.489467 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1891) took 1254 ms. Trace:
W20260709 13:11:14.490355 21434 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.062s	sys 0.120s
W20260709 13:11:14.572933 21434 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.063s	sys 0.121s
I20260709 13:11:14.572854 21466 rpcz_store.cc:276] 0709 13:11:13.235357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.368976 (+1133619us) service_pool.cc:224] Handling call
0709 13:11:14.489368 (+120392us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:14.573371 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.07243e+06us
I20260709 13:11:14.486047 24353 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:14.509001 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:14.452972 24636 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.579703 24636 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.509214 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:14.581276 21468 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:14.498821 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:14.507758 24516 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.512761 24457 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:14.517035 24635 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:11:14.519312 24637 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:14.527148 24427 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:14.529928 24465 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:14.531548 24595 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:14.533985 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1873) took 2213 ms (client timeout 1737 ms). Trace:
W20260709 13:11:14.615485 21467 rpcz_store.cc:269] 0709 13:11:12.320510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.414967 (+ 94457us) service_pool.cc:224] Handling call
0709 13:11:14.533707 (+2118740us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540025ab54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:14.533877 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740877184}
I20260709 13:11:14.535313 24440 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:14.538812 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:14.619058 22034 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
W20260709 13:11:14.619722 22034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 421) took 1806 ms (client timeout 2056 ms). Trace:
W20260709 13:11:14.620196 22034 rpcz_store.cc:269] 0709 13:11:12.812840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.538328 (+1725488us) service_pool.cc:224] Handling call
0709 13:11:14.619648 (+ 81320us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:14.540082 22035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 967) took 3401 ms (client timeout 2715 ms). Trace:
I20260709 13:11:14.541813 24217 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.542321 24625 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:14.545128 24589 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:14.545593 24627 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:14.546583 24582 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:14.549944 24522 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.431s	user 0.008s	sys 0.004s
I20260709 13:11:14.554307 24585 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:14.554822 24617 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:14.555401 24509 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:14.556775 24581 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:14.558316 21318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 424) took 2850 ms (client timeout 2141 ms). Trace:
I20260709 13:11:14.564595 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:14.490099 24368 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.376286 24332 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:14.583951 22041 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.004s	sys 0.008s
I20260709 13:11:14.584066 21313 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:14.579025 21315 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
W20260709 13:11:14.583657 22036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.004s	sys 0.008s
I20260709 13:11:14.594610 24629 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:14.596839 24453 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:14.598088 24353 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:14.603229 21462 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:14.579090 24593 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.111s	user 0.006s	sys 0.006s
I20260709 13:11:14.627115 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2093) took 3294 ms. Trace:
W20260709 13:11:14.621351 22035 rpcz_store.cc:269] 0709 13:11:11.138514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.138677 (+   163us) service_pool.cc:224] Handling call
0709 13:11:14.539773 (+3401096us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540048b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:14.539948 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359425792}
I20260709 13:11:14.638334 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.574584 24521 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:14.661363 21390 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.661132 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.639755 24217 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.662209 21461 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:14.618566 24440 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:14.663723 21998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.004s	sys 0.029s
W20260709 13:11:14.739571 21998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.004s	sys 0.029s
W20260709 13:11:14.725250 22040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 788) took 2196 ms (client timeout 1742 ms). Trace:
I20260709 13:11:14.740528 21317 rpcz_store.cc:276] 0709 13:11:11.332343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.333090 (+   747us) service_pool.cc:224] Handling call
0709 13:11:11.338114 (+  5024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.440264 (+1102150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.626742 (+2186478us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000be5d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:14.627035 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533172992}
W20260709 13:11:14.741127 22040 rpcz_store.cc:269] 0709 13:11:12.528964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.531361 (+  2397us) service_pool.cc:224] Handling call
0709 13:11:14.724216 (+2192855us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b540045c254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:14.725170 (+   954us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":751131520}
I20260709 13:11:14.741909 24608 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:14.743037 22040 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:14.743934 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 797) took 1487 ms. Trace:
I20260709 13:11:14.699252 21468 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:14.744380 22040 rpcz_store.cc:276] 0709 13:11:13.256217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.742400 (+1486183us) service_pool.cc:224] Handling call
0709 13:11:14.742789 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.743666 (+   877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.743880 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:14.746340 22036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.009s	sys 0.012s
I20260709 13:11:14.641675 24638 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:14.682636 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.756361 21395 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:14.747246 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 795) took 1550 ms. Trace:
I20260709 13:11:14.643054 24625 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.772964 22036 rpcz_store.cc:276] 0709 13:11:13.197007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.436155 (+239148us) service_pool.cc:224] Handling call
0709 13:11:13.436535 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.436748 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:14.070257 (+633509us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.746922 (+676665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.746973 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:14.747012 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.747086 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.747194 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13063,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":676241,"threads_started":1,"wal-append.queue_time_us":509393}
W20260709 13:11:14.643038 24471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.441s	user 0.056s	sys 0.145s
W20260709 13:11:14.758424 22041 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.006s	sys 0.018s
W20260709 13:11:14.758234 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 995830us
W20260709 13:11:14.747385 21318 rpcz_store.cc:269] 0709 13:11:11.708015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.269568 (+561553us) service_pool.cc:224] Handling call
0709 13:11:14.558096 (+2288528us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400088254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:14.558214 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644205440}
I20260709 13:11:14.760669 24636 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:14.791558 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 794) took 1607 ms. Trace:
I20260709 13:11:14.761519 24217 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:14.761673 24280 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:14.759598 21315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2105) took 1595 ms (client timeout 1787 ms). Trace:
I20260709 13:11:14.761574 24516 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:14.765094 24631 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.752s	user 0.004s	sys 0.000s
I20260709 13:11:14.640056 24414 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:14.768419 21313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2108) took 1603 ms (client timeout 1742 ms). Trace:
W20260709 13:11:14.911662 21315 rpcz_store.cc:269] 0709 13:11:13.163967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.508703 (+1344736us) service_pool.cc:224] Handling call
0709 13:11:14.759504 (+250801us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:14.912681 21313 rpcz_store.cc:269] 0709 13:11:13.164802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.498397 (+1333595us) service_pool.cc:224] Handling call
0709 13:11:14.768357 (+269960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:14.777688 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.661478 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.781872 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.815210 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.914433 21394 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:14.914597 21392 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:14.780740 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.896353 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:14.920110 21396 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:14.791512 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:14.912709 21462 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:14.911819 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.724917 24507 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.914314 21389 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:11:14.770088 24459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.021s	sys 0.071s
I20260709 13:11:14.917467 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.895337 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.920279 21317 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:14.661624 24581 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:14.921716 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:14.922972 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:14.920910 21318 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:14.910132 24643 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:14.790616 24471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.599s	user 0.057s	sys 0.146s
I20260709 13:11:14.663537 24522 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:14.789599 24647 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.921046 22041 rpcz_store.cc:276] 0709 13:11:13.187090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.417094 (+230004us) service_pool.cc:224] Handling call
0709 13:11:13.417439 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.417676 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:13.506729 (+ 89053us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.572438 (+1065709us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b18003e04a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:11:14.790993 (+218555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.791121 (+   128us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:14.791192 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.791302 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.791482 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15489,"prepare.queue_time_us":89101,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":568112,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":14404,"spinlock_wait_cycles":418239744,"thread_start_us":1283347,"threads_started":2,"wal-append.queue_time_us":939144}
I20260709 13:11:14.973935 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:14.965090 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1579) took 2836 ms. Trace:
I20260709 13:11:14.776101 24599 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.746189 24593 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:14.952114 21390 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:14.789654 24254 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.953342 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:14.960357 21317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2116) took 1684 ms (client timeout 1760 ms). Trace:
I20260709 13:11:14.982242 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:14.982821 21317 rpcz_store.cc:269] 0709 13:11:13.277276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.773748 (+1496472us) service_pool.cc:224] Handling call
0709 13:11:14.960272 (+186524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:14.952811 21313 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:14.984298 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2109) took 1819 ms. Trace:
I20260709 13:11:14.984715 21313 rpcz_store.cc:276] 0709 13:11:13.165074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.922662 (+1757588us) service_pool.cc:224] Handling call
0709 13:11:14.984224 (+ 61562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:14.985893 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:14.961438 21318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2115) took 1700 ms (client timeout 2209 ms). Trace:
I20260709 13:11:14.665758 24368 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.918893 24353 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.972138 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:14.922127 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:14.997247 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:14.960587 24459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.029s	sys 0.085s
I20260709 13:11:14.813843 24608 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:15.000084 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 793) took 1838 ms. Trace:
I20260709 13:11:14.966284 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:14.979380 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.000732 21395 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:15.001076 21392 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:15.003048 24521 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:14.975930 21463 rpcz_store.cc:276] 0709 13:11:12.128875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.064900 (+936025us) service_pool.cc:224] Handling call
0709 13:11:13.196259 (+131359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.197140 (+   881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.964775 (+1767635us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400216e50. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:14.965008 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301296896}
I20260709 13:11:15.000475 22038 rpcz_store.cc:276] 0709 13:11:13.161814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.241536 (+ 79722us) service_pool.cc:224] Handling call
0709 13:11:13.241974 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.242377 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.242406 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.242952 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.693561 (+450609us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:13.693601 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.693665 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.764460 (+1070795us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:14.999753 (+235293us) raft_consensus.cc:1685] finished
0709 13:11:14.999780 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.000003 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46880,"raft.queue_time_us":32360,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":10785,"spinlock_wait_cycles":5339392,"thread_start_us":450058,"threads_started":1,"wal-append.queue_time_us":517898}
I20260709 13:11:15.008441 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1887) took 2563 ms. Trace:
I20260709 13:11:15.008882 21466 rpcz_store.cc:276] 0709 13:11:12.444842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.586537 (+2141695us) service_pool.cc:224] Handling call
0709 13:11:14.617104 (+ 30567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.624121 (+  7017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.624177 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.642308 (+ 18131us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.918217 (+275909us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:14.918259 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.918326 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.008176 (+ 89850us) raft_consensus.cc:1685] finished
0709 13:11:15.008198 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.008365 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18817,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4066,"thread_start_us":204539,"threads_started":1,"wal-append.queue_time_us":299222}
I20260709 13:11:14.814630 24578 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.166s
I20260709 13:11:14.989711 21391 raft_consensus.cc:606] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:14.990322 21313 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:14.966703 24507 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.963349 24440 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.921666 24414 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.994305 22039 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:11:14.994385 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 100186us
I20260709 13:11:14.995409 24522 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:14.996090 24475 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.722s	user 0.014s	sys 0.000s
I20260709 13:11:14.964566 24596 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:14.776657 24453 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:14.998800 21315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2110) took 1829 ms (client timeout 2432 ms). Trace:
I20260709 13:11:14.999742 24608 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:14.986965 21318 rpcz_store.cc:269] 0709 13:11:13.261262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.791261 (+1529999us) service_pool.cc:224] Handling call
0709 13:11:14.961359 (+170098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:14.987823 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:14.771731 24629 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:14.966809 24476 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:11:14.973023 24643 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.016204 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:15.301819 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.104329 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:15.186703 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 796) took 1941 ms. Trace:
W20260709 13:11:15.132930 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 176199us
I20260709 13:11:15.164433 21388 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.789599 24638 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.210247 21393 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:15.449329 22034 rpcz_store.cc:276] 0709 13:11:13.245724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.638331 (+1392607us) service_pool.cc:224] Handling call
0709 13:11:14.642195 (+  3864us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.642737 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.642765 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.663311 (+ 20546us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.971498 (+308187us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:14.971548 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.972216 (+   668us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.186351 (+214135us) raft_consensus.cc:1685] finished
0709 13:11:15.186385 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.186592 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":213,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":18166,"thread_start_us":256685,"threads_started":1,"wal-append.queue_time_us":357735}
W20260709 13:11:15.451123 22002 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.935s (SENT)
I20260709 13:11:15.448045 21390 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:11:15.445274 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.448923 21466 raft_consensus.cc:2410] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:15.445190 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:15.451915 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:15.453294 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2107) took 2288 ms. Trace:
W20260709 13:11:15.446859 21315 rpcz_store.cc:269] 0709 13:11:13.169288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.921837 (+1752549us) service_pool.cc:224] Handling call
0709 13:11:14.998739 (+ 76902us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.453748 21313 rpcz_store.cc:276] 0709 13:11:13.164553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.985585 (+1821032us) service_pool.cc:224] Handling call
0709 13:11:15.453235 (+467650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.447052 21317 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:15.454617 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2114) took 2220 ms. Trace:
I20260709 13:11:15.454996 21317 rpcz_store.cc:276] 0709 13:11:13.234414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.983778 (+1749364us) service_pool.cc:224] Handling call
0709 13:11:15.454550 (+470772us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:14.997571 24254 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:15.057561 24581 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.456956 24617 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.457588 24581 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.457504 24617 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:15.458158 24254 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:15.459640 24617 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:14.985211 24647 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:15.449271 21360 leader_election.cc:336] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.803s (SENT)
I20260709 13:11:15.461056 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:15.461966 24647 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:15.074082 24648 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:11:15.462594 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2051) took 2939 ms. Trace:
I20260709 13:11:15.463008 21318 rpcz_store.cc:276] 0709 13:11:12.523029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.461829 (+2938800us) service_pool.cc:224] Handling call
0709 13:11:15.462134 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.462308 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.462332 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.462372 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:15.462399 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.462449 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.462542 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.463915 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:14.992259 24599 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.464264 21318 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:15.465019 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:15.468214 21466 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.472262 24332 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:15.473750 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1870) took 4747 ms. Trace:
I20260709 13:11:15.474197 21470 rpcz_store.cc:276] 0709 13:11:10.726449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.928705 (+202256us) service_pool.cc:224] Handling call
0709 13:11:10.942580 (+ 13875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.390924 (+448344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.390960 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.724586 (+3333626us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b2c0002f1a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:14.729772 (+  5186us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.964275 (+234503us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:14.964315 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.964386 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.473401 (+509015us) raft_consensus.cc:1685] finished
0709 13:11:15.473425 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.473667 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":500665,"raft.queue_time_us":483401,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":71295,"spinlock_wait_cycles":1374151040,"thread_start_us":216317,"threads_started":1,"wal-append.queue_time_us":395624}
I20260709 13:11:15.477591 24535 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:15.479391 21316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2096) took 4140 ms (client timeout 1913 ms). Trace:
W20260709 13:11:15.479861 21316 rpcz_store.cc:269] 0709 13:11:11.338486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.405395 (+ 66909us) service_pool.cc:224] Handling call
0709 13:11:15.479160 (+4073765us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400088c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:15.479311 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020711296}
I20260709 13:11:15.480647 21395 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.482483 22032 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:15.482800 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:15.483280 21466 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:15.466006 24599 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:15.467129 21360 leader_election.cc:336] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.818s (SENT)
I20260709 13:11:15.465888 21318 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:15.483997 21315 raft_consensus.cc:2410] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:11:15.186501 24641 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.466s	user 0.001s	sys 0.001s
I20260709 13:11:15.484930 21466 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:11:15.489347 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2113) took 2281 ms. Trace:
I20260709 13:11:15.490640 21396 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:15.491088 21315 rpcz_store.cc:276] 0709 13:11:13.212093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.482551 (+2270458us) service_pool.cc:224] Handling call
0709 13:11:15.489291 (+  6740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.492713 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:15.496865 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:15.497035 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2111) took 2318 ms. Trace:
I20260709 13:11:15.497525 21316 rpcz_store.cc:276] 0709 13:11:13.178427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.481217 (+2302790us) service_pool.cc:224] Handling call
0709 13:11:15.489865 (+  8648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.496727 (+  6862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.496752 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.496791 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:15.496819 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.496873 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.496983 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.497892 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.498905 21388 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:15.499482 21466 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:15.498759 21387 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 5 to 8, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:15.499958 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.500562 21388 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:15.500495 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:15.501497 21466 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:15.501595 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.502305 21388 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:15.503379 21388 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:15.483060 24606 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.504678 24606 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.505743 21395 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:15.189486 24593 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:15.188012 24368 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:15.515553 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.487412 21318 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:15.522701 21318 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.490083 24440 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:15.488106 24475 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.533412 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:15.527432 24636 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.541527 24332 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.543722 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:15.521860 21317 pending_rounds.cc:85] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 3
I20260709 13:11:15.544994 21317 pending_rounds.cc:107] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:15.544972 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:15.545650 21317 raft_consensus.cc:2889] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.546003 21393 raft_consensus.cc:2376] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6. Re-sending same reply.
I20260709 13:11:15.550853 21318 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:11:15.551292 21318 pending_rounds.cc:85] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 6
I20260709 13:11:15.551507 21318 pending_rounds.cc:107] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:11:15.551715 21318 raft_consensus.cc:2889] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.552374 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2104) took 2391 ms. Trace:
I20260709 13:11:15.552778 21318 rpcz_store.cc:276] 0709 13:11:13.161465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.463895 (+2302430us) service_pool.cc:224] Handling call
0709 13:11:15.464164 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.552126 (+ 87962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.552322 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:15.554795 21312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 423) took 3847 ms (client timeout 1859 ms). Trace:
W20260709 13:11:15.555358 21312 rpcz_store.cc:269] 0709 13:11:11.707816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.227513 (+519697us) service_pool.cc:224] Handling call
0709 13:11:15.551087 (+3323574us) spinlock_profiling.cc:243] Waited 73.5 ms on lock 0x7b54003becd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:15.554692 (+  3605us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168981888}
I20260709 13:11:15.551918 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:15.560875 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 109770us
W20260709 13:11:15.561630 22002 leader_election.cc:336] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.746s (SENT)
I20260709 13:11:15.562146 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:15.563896 22002 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.836s (SENT)
I20260709 13:11:15.528048 24368 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:15.560623 24254 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:15.561753 24617 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:15.568164 24475 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:15.567953 24507 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:15.553402 24332 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.601227 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:15.603492 22034 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.568886 24368 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.593133 24647 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.614486 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.619637 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.625705 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:15.624904 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:15.628530 24657 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:11:15.624722 24507 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:15.648667 22034 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:15.636816 24599 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:15.657975 22002 leader_election.cc:336] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.075s (SENT)
I20260709 13:11:15.660612 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:15.662351 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:15.663020 24475 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.641796 24453 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:15.663991 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:15.662669 24660 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:11:15.668809 21319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 418) took 3962 ms (client timeout 1992 ms). Trace:
I20260709 13:11:15.642355 24617 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:15.669397 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:15.672350 22034 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:11:15.664654 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.670311 21319 rpcz_store.cc:269] 0709 13:11:11.706770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.262959 (+556189us) service_pool.cc:224] Handling call
0709 13:11:15.668593 (+3405634us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b540021b1d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:15.668735 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175330688}
I20260709 13:11:15.653818 24414 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:15.676817 24414 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:15.654105 24507 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.683811 22034 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:15.688875 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.655230 24643 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:15.659464 24599 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.659226 24629 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:15.701903 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:15.693601 24353 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.001s
I20260709 13:11:15.706418 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:15.692476 24507 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.708067 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:15.707582 22034 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:15.713008 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.713843 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:15.713843 23845 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:15.714816 22034 raft_consensus.cc:2376] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7. Re-sending same reply.
I20260709 13:11:15.715022 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2050) took 3192 ms. Trace:
W20260709 13:11:15.715591 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 86914.6us
I20260709 13:11:15.715430 21317 rpcz_store.cc:276] 0709 13:11:12.522797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.486701 (+2963904us) service_pool.cc:224] Handling call
0709 13:11:15.521614 (+ 34913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.562921 (+ 41307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.562959 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.569398 (+  6439us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.681887 (+112489us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:15.682117 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.682391 (+   274us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.714821 (+ 32430us) raft_consensus.cc:1685] finished
0709 13:11:15.714844 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.714969 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":86142,"threads_started":1,"wal-append.queue_time_us":115501}
I20260709 13:11:15.695389 24275 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:15.700762 24599 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.700429 24608 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:15.723564 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49116 (request call id 23) took 3182 ms. Trace:
I20260709 13:11:15.723997 21391 rpcz_store.cc:276] 0709 13:11:12.537153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.537314 (+   161us) service_pool.cc:224] Handling call
0709 13:11:15.719331 (+3182017us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54001c4654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf212853 00007fc2c41e060a 00007fc2bd7667d4 00007fc2bd766762 00007fc2bd766691 00007fc2bd76660c 00007fc2bd7658c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:15.719416 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5088482688}
I20260709 13:11:15.717749 21360 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:15.663021 24399 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:15.721807 24617 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:15.738835 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1888) took 3293 ms. Trace:
I20260709 13:11:15.734148 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.717008 23845 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.740373 21470 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:11:15.743906 21470 pending_rounds.cc:85] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 3
I20260709 13:11:15.744204 21470 pending_rounds.cc:107] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:15.744436 21470 raft_consensus.cc:2889] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.740760 24399 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.746809 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:15.747629 22034 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
W20260709 13:11:15.734591 24661 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:11:15.751534 24672 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:15.752239 24332 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:15.740383 24217 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:15.745697 23845 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.734858 24638 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:15.762522 24217 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:15.764048 24368 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:15.766492 24332 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:11:15.776119 24217 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.778735 24217 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:15.780552 24666 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:15.777096 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1904) took 1046 ms. Trace:
W20260709 13:11:15.785494 24665 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:15.794288 24275 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:15.795653 24275 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.785140 21466 rpcz_store.cc:276] 0709 13:11:14.731208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.503403 (+772195us) service_pool.cc:224] Handling call
0709 13:11:15.503733 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.503933 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:15.642959 (+139026us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.775974 (+133015us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.776616 (+   642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.776685 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:15.776749 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.776844 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.777021 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53708,"prepare.queue_time_us":61484,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":13019,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":170,"thread_start_us":200878,"threads_started":2,"wal-append.queue_time_us":144195}
I20260709 13:11:15.788254 24368 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:15.833343 22039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 791) took 2678 ms (client timeout 1964 ms). Trace:
W20260709 13:11:15.833802 22039 rpcz_store.cc:269] 0709 13:11:13.155115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.155241 (+   126us) service_pool.cc:224] Handling call
0709 13:11:15.833085 (+2677844us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54005c6554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:15.833255 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4226717568}
I20260709 13:11:15.836319 22041 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:15.805784 24368 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:15.843966 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1576) took 3765 ms (client timeout 3208 ms). Trace:
I20260709 13:11:15.846257 21464 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:11:15.845975 21469 rpcz_store.cc:269] 0709 13:11:12.078549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.116234 (+ 37685us) service_pool.cc:224] Handling call
0709 13:11:15.843689 (+3727455us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540025bf54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:15.843859 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244547328}
W20260709 13:11:15.836555 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.074s (SENT)
I20260709 13:11:15.848145 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:15.787410 24617 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:15.851092 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 116862us
I20260709 13:11:15.848927 24368 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.843521 24672 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:15.865921 21390 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:15.866688 24507 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:15.854877 24619 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:15.870766 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:15.835904 23845 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.870158 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:15.871698 22039 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
W20260709 13:11:15.873517 24472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.783s	user 0.012s	sys 0.056s
W20260709 13:11:15.876260 24472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.791s	user 0.013s	sys 0.056s
I20260709 13:11:15.879745 24597 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:15.881191 24507 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:15.881932 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 792) took 2720 ms. Trace:
I20260709 13:11:15.882371 22031 rpcz_store.cc:276] 0709 13:11:13.161525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.161643 (+   118us) service_pool.cc:224] Handling call
0709 13:11:13.161971 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:13.445383 (+283412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.445412 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:13.713146 (+267734us) log.cc:844] Serialized 52 byte log entry
0709 13:11:15.881265 (+2168119us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b18001c3a20. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1
0709 13:11:15.881438 (+   173us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:15.881481 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.881567 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.881613 (+    46us) raft_consensus.cc:1685] finished
0709 13:11:15.881629 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.881847 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80336,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":12216064,"thread_start_us":997112,"threads_started":2,"wal-append.queue_time_us":766859,"wal-append.run_cpu_time_us":2120,"wal-append.run_wall_time_us":1063789}
W20260709 13:11:15.887158 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.887491 24623 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:15.891321 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.891767 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.906504 23845 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:15.915465 24611 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:15.918375 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:15.941800 22031 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.921034 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2047) took 3399 ms. Trace:
I20260709 13:11:15.923055 21466 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:11:15.924631 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.925726 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:15.926626 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:15.929914 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 3.04188e+06us
I20260709 13:11:15.934023 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.934932 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.958189 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2046) took 3436 ms. Trace:
I20260709 13:11:15.958659 21321 rpcz_store.cc:276] 0709 13:11:12.521633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.523133 (+  1500us) service_pool.cc:224] Handling call
0709 13:11:12.523439 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.523695 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:12.813501 (+289806us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.957840 (+3144339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.957892 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:15.957943 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.958022 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.958133 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2980241,"prepare.queue_time_us":353747,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"thread_start_us":449769,"threads_started":2,"wal-append.queue_time_us":290812,"wal-append.run_cpu_time_us":2424,"wal-append.run_wall_time_us":1305457}
I20260709 13:11:15.960083 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.958290 21465 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:15.969774 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.969835 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.949885 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:15.972805 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.973865 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:15.974515 22040 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:15.975270 22031 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:15.977742 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:15.978789 21393 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:15.980233 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.956166 24446 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:15.982628 21997 connection.cc:256] RPC call timeout handler was delayed by -1.5507634739999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 13:11:15.983857 21997 connection.cc:256] RPC call timeout handler was delayed by -1.5507634739999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 13:11:15.984213 21997 connection.cc:256] RPC call timeout handler was delayed by -1.1451868410000543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:11:15.984630 21997 connection.cc:256] RPC call timeout handler was delayed by -1.0336505420000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 13:11:15.986410 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.977783 24682 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:15.987028 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 2.88724e+06us
I20260709 13:11:15.985749 24446 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:15.987684 24625 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:15.987761 24446 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.988157 24411 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.988920 24280 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:15.989162 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2048) took 3466 ms. Trace:
I20260709 13:11:15.989349 24280 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.989816 24280 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:15.990481 24581 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:15.990989 24581 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.991328 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:15.980443 24672 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.993067 24581 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:15.994000 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2049) took 3471 ms. Trace:
I20260709 13:11:15.994324 21313 rpcz_store.cc:276] 0709 13:11:12.522551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.484278 (+2961727us) service_pool.cc:224] Handling call
0709 13:11:15.484692 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.484959 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:15.600836 (+115877us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.851799 (+250963us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180036e320. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a
0709 13:11:15.993679 (+141880us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.993726 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:15.993768 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.993828 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.993948 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141635,"prepare.queue_time_us":180309,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"spinlock_wait_cycles":25230208,"thread_start_us":185816,"threads_started":2,"wal-append.queue_time_us":100714}
I20260709 13:11:15.995615 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:15.904908 24623 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:15.992990 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:15.985237 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:16.021418 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:15.995900 23845 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:16.029765 24375 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:16.030195 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:16.030514 23845 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:16.028266 21321 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:16.031313 21317 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:16.009824 24625 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:11:16.007885 24280 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:15.998696 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.034588 21315 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:11:16.034847 21312 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:16.008729 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1905) took 1119 ms. Trace:
I20260709 13:11:16.032505 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.032991 22040 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:16.035607 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:16.020889 21284 connection.cc:256] RPC call timeout handler was delayed by -1.9660338630000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:11:16.035090 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.013252 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1882) took 3627 ms. Trace:
I20260709 13:11:16.013067 22039 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:15.995972 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:16.036500 21284 connection.cc:256] RPC call timeout handler was delayed by -1.8805338629999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 13:11:16.037071 22039 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:11:16.037241 21284 connection.cc:256] RPC call timeout handler was delayed by -1.6456338629999436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 13:11:16.036742 21464 rpcz_store.cc:276] 0709 13:11:12.385820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.162002 (+776182us) service_pool.cc:224] Handling call
0709 13:11:15.844150 (+2682148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.847409 (+  3259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.012983 (+165574us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b540025bf50. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:16.013167 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6121801472}
I20260709 13:11:15.742507 21467 rpcz_store.cc:276] 0709 13:11:12.445139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.616663 (+2171524us) service_pool.cc:224] Handling call
0709 13:11:14.617131 (+   468us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:11:14.642414 (+ 25283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.642442 (+    28us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:11:14.643143 (+   701us) log.cc:844] Serialized 104 byte log entry
0709 13:11:14.738655 (+ 95512us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b180035db80. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:11:14.954799 (+216144us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:14.995979 (+ 41180us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.010780 (+ 14801us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.737695 (+726915us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b180035db80. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:11:15.738082 (+   387us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.738375 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.738513 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.738587 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.738630 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:15.738644 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.738778 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67603,"prepare.queue_time_us":67859,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":134,"raft.queue_time_us":764579,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":2497,"spinlock_wait_cycles":75832960,"thread_start_us":221693,"threads_started":2,"wal-append.queue_time_us":440856}
I20260709 13:11:15.989558 21314 rpcz_store.cc:276] 0709 13:11:12.522267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.878514 (+356247us) service_pool.cc:224] Handling call
0709 13:11:12.901687 (+ 23173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.901872 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:13.115207 (+213335us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.988824 (+2873617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.988879 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:15.988930 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.989008 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.989111 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2807582,"prepare.queue_time_us":132071,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":2812597,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":193506,"threads_started":2,"wal-append.queue_time_us":95147,"wal-append.run_cpu_time_us":13330,"wal-append.run_wall_time_us":2140155}
W20260709 13:11:16.032740 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 298639us
I20260709 13:11:16.014319 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 983) took 1196 ms. Trace:
I20260709 13:11:16.038058 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:15.999936 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.013509 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:16.022310 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.036280 21315 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.012524 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:15.999492 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.035979 21321 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:16.000728 21316 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:11:16.047561 21316 pending_rounds.cc:85] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 3
I20260709 13:11:15.980325 24650 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:16.039356 22041 rpcz_store.cc:276] 0709 13:11:14.817670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.463234 (+645564us) service_pool.cc:224] Handling call
0709 13:11:15.836122 (+372888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.847709 (+ 11587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.014077 (+166368us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54005c6550. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:16.014250 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856853248}
I20260709 13:11:15.981886 24447 consensus_queue.cc:1243] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:16.041807 22034 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.049245 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.041322 21318 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:16.041855 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:16.050452 21313 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.040849 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.035528 21387 rpcz_store.cc:276] 0709 13:11:14.889775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.922150 (+ 32375us) service_pool.cc:224] Handling call
0709 13:11:14.922454 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.498655 (+576201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:15.540168 (+ 41513us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.628105 (+ 87937us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.628155 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:15.628200 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.008404 (+380204us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54000f19d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:16.008466 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.008627 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1087,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":1029,"spinlock_wait_cycles":1324688128,"thread_start_us":87548,"threads_started":1,"wal-append.queue_time_us":146012}
I20260709 13:11:15.996276 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:16.052209 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:16.032428 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 47273.5us
I20260709 13:11:16.047487 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.038080 22039 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.053464 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.054206 22039 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:16.054308 21466 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:11:16.055729 21466 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:16.046017 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.051470 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.047998 21316 pending_rounds.cc:107] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:11:16.046749 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:16.003247 24376 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.031632 24411 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.059346 21312 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:16.072218 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:16.072935 22040 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:16.040916 24611 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:16.038898 24375 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:16.062013 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.048327 24476 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:16.063033 21318 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 3.
I20260709 13:11:16.063423 21316 raft_consensus.cc:2889] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:16.050627 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.078236 21314 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:16.064853 21317 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:15.982707 24599 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.065219 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.060365 24449 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:16.067000 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.070289 22034 raft_consensus.cc:2410] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:16.053198 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:16.071306 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.044384 24581 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:16.002487 24493 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.048404 24514 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:16.073658 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.088060 21321 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:16.088287 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:16.073726 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.075137 24447 raft_consensus.cc:2764] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:16.074481 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:16.048838 24650 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.090425 21464 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:16.079510 24476 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.090936 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:16.089483 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.089143 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.103148 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:16.091602 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.092685 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.103111 21321 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:16.075034 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:16.076968 24375 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.096365 22040 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:16.097142 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.098234 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.059959 24328 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:11:16.104255 21316 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:16.108578 21313 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:11:16.127588 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 52630.6us
I20260709 13:11:16.127831 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.093210 22039 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:16.059486 23845 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.080348 24611 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:16.128906 24592 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:16.093912 24516 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:16.144375 24516 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:16.144915 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:16.144840 24593 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:16.145694 21387 raft_consensus.cc:606] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:16.146087 24440 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:16.105119 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.131908 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.130841 21312 raft_consensus.cc:2410] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:11:16.111300 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.129453 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:16.148510 21464 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.084142 24677 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:16.096993 24650 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.077553 24217 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:11:16.074980 24376 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.097738 24449 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:16.135635 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.136134 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1908) took 1217 ms. Trace:
I20260709 13:11:16.090694 24514 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:16.090101 24578 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:16.077322 24411 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.133333 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:16.187604 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 54328.2us
W20260709 13:11:16.141520 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 67110.2us
I20260709 13:11:16.126775 24499 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:16.107713 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:16.095597 24353 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:16.197101 24353 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:11:16.197443 24679 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:11:16.197685 24685 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:11:16.198140 24353 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.132696 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.106530 24476 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:16.168716 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61283.7us
I20260709 13:11:16.204610 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.090960 24410 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:11:16.208470 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:16.172376 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.209554 21314 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:16.210815 21314 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:16.127635 24581 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:16.212132 24581 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:16.212559 24581 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:16.213384 24376 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:16.213666 24583 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:16.213881 24508 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:16.214177 24583 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:16.214874 24376 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:16.215031 24583 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.216566 24623 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:16.178009 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.217228 21313 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:16.218530 21318 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:11:16.218978 22032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 787) took 3690 ms (client timeout 3298 ms). Trace:
I20260709 13:11:16.219722 21318 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:16.094063 24493 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.135223 24375 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.222774 24493 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:16.137065 24597 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:16.223387 24597 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.223816 24597 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.225263 24581 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.226099 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.226722 21465 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:16.227406 24581 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:16.227578 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.177421 21389 rpcz_store.cc:276] 0709 13:11:14.918745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.963440 (+ 44695us) service_pool.cc:224] Handling call
0709 13:11:14.963883 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.494902 (+531019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.494949 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.495545 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.606092 (+110547us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:15.606128 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.131160 (+525032us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540039e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:16.131226 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.131285 (+    59us) raft_consensus.cc:1685] finished
0709 13:11:16.131315 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.136046 (+  4731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7639,"raft.queue_time_us":98,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":99,"spinlock_wait_cycles":1220187392,"thread_start_us":61512,"threads_started":1,"wal-append.queue_time_us":178331}
I20260709 13:11:16.144992 24516 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:16.191150 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.138545 24453 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:16.139133 24592 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:16.180505 24514 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.201725 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:16.205084 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.220438 22038 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:11:16.219412 22032 rpcz_store.cc:269] 0709 13:11:12.528596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.532854 (+  4258us) service_pool.cc:224] Handling call
0709 13:11:16.218758 (+3685904us) spinlock_profiling.cc:243] Waited 2.7 s on lock 0x7b5400647654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:16.218892 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6218942208}
I20260709 13:11:16.189067 21464 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:16.201673 24619 raft_consensus.cc:2764] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:16.219972 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "849cad40897e412da9a737986240fc35"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:16.245054 21387 raft_consensus.cc:606] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:16.245537 21387 raft_consensus.cc:614] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:16.231738 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:16.231734 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:16.246567 22034 raft_consensus.cc:2410] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:16.222793 24414 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:16.236485 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.254222 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.255302 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.236296 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:16.199699 21321 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:16.170305 24629 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:16.247835 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 46165.1us
W20260709 13:11:16.248631 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43615.3us
I20260709 13:11:16.176474 24447 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:16.258427 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.229545 24499 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:16.260732 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.265233 21321 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:16.242798 24581 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:16.229763 24522 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:11:16.245860 24583 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.267282 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.242771 24592 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.253070 24617 raft_consensus.cc:2764] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:16.257143 24623 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:16.279762 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.252887 24414 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:16.262699 24444 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:16.297998 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.267413 24493 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:16.270707 24505 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:16.273205 24280 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:16.270431 24629 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:16.272866 24328 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:16.314162 21315 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:16.309599 21362 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.295323 23845 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:16.299194 24623 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:16.323523 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 134711us
I20260709 13:11:16.301498 24410 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:16.297381 24599 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:16.255007 24449 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.301514 24598 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:16.255686 24611 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.301613 24472 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:11:16.326097 24623 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:16.326260 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1889) took 3092 ms (client timeout 2499 ms). Trace:
W20260709 13:11:16.352274 21462 rpcz_store.cc:269] 0709 13:11:13.233821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.364431 (+1130610us) service_pool.cc:224] Handling call
0709 13:11:16.326054 (+1961623us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400249ad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:16.326172 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531596544}
I20260709 13:11:16.327042 21468 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:16.330081 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:16.313066 24677 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:16.334916 24598 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.372378 24598 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.372893 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:16.373492 22039 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:16.374125 24597 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.374712 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:16.375530 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.375975 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.352790 24328 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:16.376530 24328 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:16.376756 24444 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:16.376914 24328 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:16.377277 24444 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.377698 24444 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.332312 24410 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.379244 24410 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.386601 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 980) took 1569 ms. Trace:
I20260709 13:11:16.387055 22038 rpcz_store.cc:276] 0709 13:11:14.816824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.025258 (+208434us) service_pool.cc:224] Handling call
0709 13:11:16.220109 (+1194851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.240344 (+ 20235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.386376 (+146032us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400647650. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:16.386535 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2746874624}
I20260709 13:11:16.367033 24368 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.358251 24677 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.397071 24677 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:16.405752 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 433) took 3168 ms. Trace:
I20260709 13:11:16.406294 21468 rpcz_store.cc:276] 0709 13:11:13.236923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.746413 (+1509490us) service_pool.cc:224] Handling call
0709 13:11:16.326800 (+1580387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.354209 (+ 27409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.405363 (+ 51154us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400249ad0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:16.405552 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3633841920}
I20260709 13:11:16.415417 21216 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 2 to 4, term changed from 4 to 5, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193), VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194), VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195), VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 5 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.355757 21387 raft_consensus.cc:606] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:16.360343 24687 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:11:16.453683 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1908) took 1005 ms. Trace:
W20260709 13:11:16.360436 24689 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:11:16.364456 24463 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:16.364173 24629 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.365532 24346 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:16.366349 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1899) took 1972 ms. Trace:
I20260709 13:11:16.472113 21461 rpcz_store.cc:276] 0709 13:11:14.394405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.771124 (+376719us) service_pool.cc:224] Handling call
0709 13:11:14.967837 (+196713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.492543 (+524706us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:15.524127 (+ 31584us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.769585 (+245458us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.769766 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.769821 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:15.769876 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.366114 (+596238us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b5400217354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:16.366156 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.366278 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":153393,"prepare.queue_time_us":72188,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":159838,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":129,"spinlock_wait_cycles":1206214528,"thread_start_us":91462,"threads_started":1,"wal-append.queue_time_us":148529}
I20260709 13:11:16.338231 24414 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.367005 24446 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.367609 24642 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:16.368383 24411 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:16.371155 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:16.371233 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:16.325829 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 152159us
I20260709 13:11:16.480063 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.328940 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:16.442680 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 184685us
I20260709 13:11:16.446350 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 982) took 1629 ms. Trace:
I20260709 13:11:16.484091 22035 rpcz_store.cc:276] 0709 13:11:14.817383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.038412 (+221029us) service_pool.cc:224] Handling call
0709 13:11:15.038638 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.516565 (+477927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.516610 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.516673 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:15.516721 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.419410 (+902689us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54004cac54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:16.446144 (+ 26734us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.446287 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098465536}
W20260709 13:11:16.451076 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.484225 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.450958 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1901) took 1855 ms. Trace:
I20260709 13:11:16.489221 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.451514 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1915) took 1404 ms. Trace:
I20260709 13:11:16.489840 21395 rpcz_store.cc:276] 0709 13:11:15.047704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.047847 (+   143us) service_pool.cc:224] Handling call
0709 13:11:16.382932 (+1335085us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54000ac3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:16.451457 (+ 68525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62598912}
I20260709 13:11:16.456143 21387 raft_consensus.cc:614] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:16.468675 24463 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:16.351495 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.336908 24499 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.460604 21470 rpcz_store.cc:276] 0709 13:11:15.448254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.508632 (+ 60378us) service_pool.cc:224] Handling call
0709 13:11:15.534316 (+ 25684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.744819 (+210503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.383846 (+639027us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540029a4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:16.453614 (+ 69768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473091968}
I20260709 13:11:16.471938 24346 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:16.460021 24606 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:16.477712 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.944893 21320 rpcz_store.cc:276] 0709 13:11:12.521958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.522072 (+   114us) service_pool.cc:224] Handling call
0709 13:11:12.530498 (+  8426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.530684 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:12.783022 (+252338us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.887392 (+104370us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.765744 (+1878352us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b18003f5620. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:11:15.920372 (+1154628us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b18003f5620. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:11:15.920561 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.920630 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:15.920691 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.920803 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.920956 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2973476,"prepare.queue_time_us":679102,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":3041447,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":83590,"spinlock_wait_cycles":20999424,"thread_start_us":346130,"threads_started":2,"wal-append.queue_time_us":196869,"wal-append.run_cpu_time_us":1286,"wal-append.run_wall_time_us":1002895}
I20260709 13:11:16.544144 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.545826 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.478212 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.547981 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.469137 24476 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.487026 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.498201 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:16.489859 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 160998us
I20260709 13:11:16.499893 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:16.504492 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.711s (SENT) [suppressed 36 similar messages]
W20260709 13:11:16.467317 21436 connection.cc:256] RPC call timeout handler was delayed by -1.2321828460000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 13:11:16.557205 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.546672 21320 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:16.471709 24650 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.491206 24414 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:16.517177 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 258819us
I20260709 13:11:16.478225 24597 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:16.495342 24421 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:16.487900 21463 rpcz_store.cc:276] 0709 13:11:14.595374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.101989 (+506615us) service_pool.cc:224] Handling call
0709 13:11:15.184722 (+ 82733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.495867 (+311145us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:15.549567 (+ 53700us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.768984 (+219417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.769038 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:15.769084 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.383230 (+614146us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540029b8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:16.450750 (+ 67520us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.450882 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186590,"prepare.queue_time_us":66847,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":158265,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":714940800,"thread_start_us":63481,"threads_started":1,"wal-append.queue_time_us":143558}
I20260709 13:11:16.551306 22042 pending_rounds.cc:85] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 7
I20260709 13:11:16.562501 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.491189 24447 raft_consensus.cc:697] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:16.549027 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.580291 21315 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
W20260709 13:11:16.566208 21436 connection.cc:256] RPC call timeout handler was delayed by -1.0314828460000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2432s for a response
I20260709 13:11:16.578541 22042 pending_rounds.cc:107] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:11:16.581589 22042 raft_consensus.cc:2889] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:16.563925 24693 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:11:16.558614 24606 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:16.592228 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:16.603169 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.600303 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.492563 24617 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:11:16.603874 21463 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:16.607801 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.595019 21216 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.603971 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.577651 24472 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:16.611162 21465 raft_consensus.cc:2368] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:11:16.607419 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.610755 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:16.612495 21464 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:16.581317 24421 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:16.622138 21285 connection.cc:256] RPC call timeout handler was delayed by -5.6621201320000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
I20260709 13:11:16.623095 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.581918 24522 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:16.626456 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.584414 24597 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:16.628338 21285 connection.cc:256] RPC call timeout handler was delayed by -5.5829201320000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
I20260709 13:11:16.628577 22031 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:11:16.629555 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.644162 21285 connection.cc:256] RPC call timeout handler was delayed by -5.5820201320000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
I20260709 13:11:16.581049 24636 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:16.630847 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 150886us
I20260709 13:11:16.626307 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:16.641510 21464 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:11:16.643678 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.642920 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.651665 21319 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
W20260709 13:11:16.644640 21285 connection.cc:256] RPC call timeout handler was delayed by -5.5100201320000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 13:11:16.634512 21317 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:16.652931 21360 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.601954 24606 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:16.656268 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.617728 24280 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:16.631567 24421 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.611538 24699 raft_consensus.cc:2764] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:16.596619 24463 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.630692 24453 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:16.667337 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:16.691787 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.692121 21319 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.671351 21315 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:16.677062 24606 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.678644 21317 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:16.633638 24522 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:16.685851 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 334279us
I20260709 13:11:16.663645 23845 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:16.698194 21320 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:16.655251 24507 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.662382 24680 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:16.663934 24616 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:16.710428 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.711526 21464 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:16.705552 24522 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.709352 23845 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.728818 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:16.642866 24346 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.709023 24368 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:16.741982 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 88115.7us
I20260709 13:11:16.734084 21317 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:16.691293 24592 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.691630 24625 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:11:16.731057 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 241872us
W20260709 13:11:16.737396 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 232937us
I20260709 13:11:16.748764 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.709841 24410 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.720320 24606 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:16.749593 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.750349 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:16.712783 24617 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:11:16.749995 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 87778.7us
I20260709 13:11:16.734642 24446 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:16.756745 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.710909 24598 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.712644 24507 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.739804 24616 raft_consensus.cc:697] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:16.758781 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:16.759747 21285 connection.cc:256] RPC call timeout handler was delayed by -5.41102013200009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2315s for a response
I20260709 13:11:16.740617 23845 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.760674 21314 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:16.749442 24593 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:16.761720 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:16.772344 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.758291 24346 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.766912 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:16.768208 24711 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:16.758780 24516 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
I20260709 13:11:16.780431 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:16.779598 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:16.710747 24375 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.781395 21387 raft_consensus.cc:606] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:16.702993 24447 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.716598 24328 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.771423 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.761169 24703 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:16.779501 21285 connection.cc:256] RPC call timeout handler was delayed by -4.2009334450000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:11:16.769258 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:16.826336 21285 connection.cc:256] RPC call timeout handler was delayed by -4.0929334450000852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:11:16.826864 21285 connection.cc:256] RPC call timeout handler was delayed by -3.9165334450000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:11:16.781873 21387 raft_consensus.cc:614] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:16.827234 21285 connection.cc:256] RPC call timeout handler was delayed by -3.9075334450000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 13:11:16.775005 24449 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:16.783612 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:16.842876 21468 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.783257 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:16.806476 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 104145us
I20260709 13:11:16.844079 21470 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:16.844297 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:16.764690 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:16.810896 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.780437 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:16.832516 21285 connection.cc:256] RPC call timeout handler was delayed by -3.2469334450000815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2699s for a response
I20260709 13:11:16.840641 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:16.772738 24476 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:16.845824 21285 connection.cc:256] RPC call timeout handler was delayed by -3.0075334450000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2965s for a response
W20260709 13:11:16.847863 21285 connection.cc:256] RPC call timeout handler was delayed by -2.7888334450000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32080000000000003s for a response
I20260709 13:11:16.850235 24616 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.775624 24650 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:16.856925 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.857434 21469 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:16.865718 22038 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: [6.7-10.9]
I20260709 13:11:16.866329 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.866711 21285 leader_election.cc:400] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:11:16.867025 21285 leader_election.cc:403] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:11:16.923418 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79206.9us
I20260709 13:11:16.784300 24699 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.937162 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.926335 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 60068.1us
I20260709 13:11:16.943089 21468 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:16.944684 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:16.946939 22002 leader_election.cc:336] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.973s (SENT)
I20260709 13:11:16.947398 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:16.947621 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 460011us
W20260709 13:11:16.947119 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 324099us
I20260709 13:11:16.954035 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:16.778548 24593 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:16.846859 24690 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:16.809957 24516 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:16.966769 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:16.928449 24217 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:17.003674 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:16.929319 24619 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:16.939182 24514 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.001s
I20260709 13:11:16.929188 24611 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:17.000713 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:16.847164 24607 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:11:17.003684 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:17.034534 21468 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:16.959636 24583 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:11:16.863613 24449 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.004185 24217 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:17.057834 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:17.058486 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 113925us
I20260709 13:11:17.033771 24650 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:17.070590 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:17.071327 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.006798 24535 raft_consensus.cc:2764] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:17.076669 21468 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:16.943830 24699 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.040771 24476 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:16.997422 24599 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:11:17.083629 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 136723us
I20260709 13:11:17.073561 24619 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:17.071529 24611 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:17.085469 24702 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 13:11:17.013095 24729 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:11:17.056648 24514 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.055004 24731 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:11:17.096354 24410 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.096676 24592 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.097980 24476 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:17.127687 24707 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.280s	user 0.000s	sys 0.000s
W20260709 13:11:17.131273 24623 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.001s
I20260709 13:11:17.106684 24619 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:11:17.120692 24708 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:11:17.086870 24734 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:17.136071 24476 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:17.137346 24717 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
W20260709 13:11:17.138458 24716 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:11:17.140903 24619 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.147045 24516 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.143786 24623 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.152015 24623 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.153450 24650 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:17.154786 24598 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:17.158048 24727 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:11:17.158667 24699 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:17.159590 24706 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.427s	user 0.000s	sys 0.001s
W20260709 13:11:17.159545 24730 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
W20260709 13:11:17.162256 24677 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.000s
W20260709 13:11:17.216638 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.217011 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.220953 21313 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:17.221827 21315 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.018s
W20260709 13:11:17.215446 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 348599us
W20260709 13:11:17.232054 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 293067us
I20260709 13:11:17.234674 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2079) took 1137 ms. Trace:
I20260709 13:11:17.249120 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:17.279485 21467 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:17.281934 21468 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:17.283996 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:17.292200 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.283735 21319 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.591s	user 0.015s	sys 0.008s
I20260709 13:11:17.297755 22032 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:17.097115 24217 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.318977 24411 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.322602 24328 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:17.325017 24414 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.008s
I20260709 13:11:17.328851 24375 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:17.365998 24411 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.368575 21463 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:17.369670 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:17.371238 24734 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:17.338707 24583 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.375520 24583 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.340260 24593 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.342185 24597 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:17.377190 24411 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.378772 24597 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:17.379673 24472 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.000s
I20260709 13:11:17.342681 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:17.356817 22032 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:11:17.360234 24743 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:11:17.361757 22042 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:17.361939 22034 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:11:17.364545 21315 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.012s	sys 0.019s
W20260709 13:11:17.336119 24444 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.958s	user 0.009s	sys 0.009s
W20260709 13:11:17.372792 24741 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:11:17.372654 24740 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:17.397478 24740 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:17.398089 24740 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:17.400538 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.402048 21462 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:17.408950 24217 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:17.409482 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.409823 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 402849us
I20260709 13:11:17.411028 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:17.411712 24599 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:17.412552 24507 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.415910 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:17.355866 21321 rpcz_store.cc:276] 0709 13:11:16.097356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.672518 (+575162us) service_pool.cc:224] Handling call
0709 13:11:16.672927 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.673392 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:17.000420 (+327028us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.226145 (+225725us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.226449 (+   304us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.227668 (+  1219us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.227859 (+   191us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:17.228117 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.228345 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.228519 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.234164 (+  5645us) raft_consensus.cc:1685] finished
0709 13:11:17.234188 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.234434 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":684065,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":141,"raft.queue_time_us":336249,"raft.run_cpu_time_us":878,"raft.run_wall_time_us":12326,"spinlock_wait_cycles":967680,"thread_start_us":308264,"threads_started":2,"wal-append.queue_time_us":7899}
I20260709 13:11:17.407745 24734 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.418879 24280 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:17.419632 24734 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.422509 24734 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.390877 24444 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.412572 24599 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.426571 24599 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.392773 24583 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.428702 24444 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.429683 24712 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:17.430495 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44624us
I20260709 13:11:17.430565 24712 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.433254 24712 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.388969 21319 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:17.434002 21389 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:17.434173 24508 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:17.435293 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:17.436749 22032 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.438000 22032 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:17.442657 24411 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.443393 24411 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.444011 24740 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.446029 24411 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.446717 24411 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:17.447175 24740 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.448693 24699 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:17.450106 24699 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:17.450649 24699 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:17.395217 24677 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:17.456218 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63030.2us
I20260709 13:11:17.456671 24677 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.395810 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2064) took 1401 ms. Trace:
I20260709 13:11:17.419960 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:17.459551 21314 rpcz_store.cc:276] 0709 13:11:15.993931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.211511 (+217580us) service_pool.cc:224] Handling call
0709 13:11:16.211826 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.768940 (+557114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.395368 (+626428us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54003c8cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:17.395627 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261791488}
I20260709 13:11:17.459627 21319 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.477542 24636 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.477954 21390 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:17.478432 24636 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.473973 24677 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:11:17.481221 24677 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:17.481474 24346 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.009s
I20260709 13:11:17.481657 24677 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:17.483444 24421 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.005s
I20260709 13:11:17.484059 24421 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.465963 24280 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:11:17.482906 24677 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.486581 24421 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:17.488935 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:17.489048 21321 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:17.499681 22032 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:17.506208 21314 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:17.463505 24449 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.468230 24472 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:17.501996 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.649s (SENT)
I20260709 13:11:17.513392 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:17.516209 24713 raft_consensus.cc:993] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 33be1cb5cfc143fc90e164888c96cc6f to start an election
W20260709 13:11:17.516433 21396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.030s	sys 0.034s
I20260709 13:11:17.516849 24713 raft_consensus.cc:1081] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Signalling peer 33be1cb5cfc143fc90e164888c96cc6f to start an election
I20260709 13:11:17.517277 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2080) took 1388 ms. Trace:
I20260709 13:11:17.520864 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 508) took 1152 ms. Trace:
I20260709 13:11:17.521296 21389 rpcz_store.cc:276] 0709 13:11:16.368853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.370874 (+  2021us) service_pool.cc:224] Handling call
0709 13:11:17.520605 (+1149731us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54003435d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:17.520767 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039516416}
I20260709 13:11:17.523332 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:17.525189 24508 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:17.525849 24508 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:17.525074 21216 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 5 to 6, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 6 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:17.526432 24514 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.527863 21319 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:17.526960 24508 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.528214 24724 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:17.531339 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:17.520759 21315 rpcz_store.cc:276] 0709 13:11:16.128484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.693284 (+564800us) service_pool.cc:224] Handling call
0709 13:11:16.693546 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.693720 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:17.433309 (+739589us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.516758 (+ 83449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.516855 (+    97us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:17.516969 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.517069 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.517215 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5793,"prepare.queue_time_us":418839,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":99,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"thread_start_us":744630,"threads_started":2}
I20260709 13:11:17.534552 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:17.546864 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:17.547319 21317 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
W20260709 13:11:17.549772 24697 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:11:17.550239 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:17.550688 24713 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:17.527071 21216 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 7, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 7 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.464834 24699 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.563922 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:17.572360 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.573930 24636 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:17.577471 24711 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.766s	user 0.005s	sys 0.008s
I20260709 13:11:17.581481 24254 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:17.581970 24254 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:17.582933 24254 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.584220 24704 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:17.585747 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 2083) took 1404 ms. Trace:
I20260709 13:11:17.586164 21312 rpcz_store.cc:276] 0709 13:11:16.180909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.208196 (+ 27287us) service_pool.cc:224] Handling call
0709 13:11:17.585347 (+1377151us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540022d3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:17.585533 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3067496832}
I20260709 13:11:17.587436 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:17.589900 24719 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.748s	user 0.003s	sys 0.000s
I20260709 13:11:17.590085 22031 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:17.591048 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:17.591766 21317 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:17.594841 24704 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:17.598197 24332 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.595757 24704 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.601418 24711 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:17.599210 24332 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.611233 21320 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:17.613158 24332 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.614188 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2065) took 1620 ms. Trace:
I20260709 13:11:17.614578 21313 rpcz_store.cc:276] 0709 13:11:15.994166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.217852 (+223686us) service_pool.cc:224] Handling call
0709 13:11:16.218133 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.359453 (+1141320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.613913 (+254460us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003becd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:17.614126 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304570112}
I20260709 13:11:17.621631 24724 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:17.622216 24724 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:17.601596 24597 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:17.602378 24522 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.856s	user 0.011s	sys 0.006s
I20260709 13:11:17.607587 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2119) took 1610 ms. Trace:
I20260709 13:11:17.631048 21463 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:17.634150 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:17.636056 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 176786us
W20260709 13:11:17.626901 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 63351.5us
I20260709 13:11:17.563357 24713 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:17.603778 24704 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:17.643231 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.643662 21396 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 7. Ops: []
I20260709 13:11:17.629617 24677 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:17.644994 21389 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:11:17.630021 24254 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:17.646728 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:17.648650 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:17.660856 24606 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.900s	user 0.016s	sys 0.000s
I20260709 13:11:17.645778 24332 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.661963 21319 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:17.661011 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:17.664659 23845 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.885s	user 0.013s	sys 0.005s
I20260709 13:11:17.665171 23845 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.666733 21395 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:17.662989 24332 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.672340 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:17.677254 24606 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:17.679765 21314 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:17.632023 21318 rpcz_store.cc:276] 0709 13:11:15.996899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.237696 (+240797us) service_pool.cc:224] Handling call
0709 13:11:16.257004 (+ 19308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.268141 (+ 11137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.268171 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.268670 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.560241 (+291571us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:16.560299 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.560406 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.213999 (+653593us) raft_consensus.cc:1685] finished
0709 13:11:17.214096 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.607141 (+393045us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5400089650. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:17.607385 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10755,"raft.queue_time_us":10934,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4939,"spinlock_wait_cycles":43507968,"thread_start_us":247048,"threads_started":1,"wal-append.queue_time_us":372258}
W20260709 13:11:17.728117 24499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.002s	sys 0.018s
W20260709 13:11:17.728628 24499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.003s	sys 0.018s
I20260709 13:11:17.729707 24619 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:17.730412 24619 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:17.732322 24718 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.842s	user 0.000s	sys 0.003s
I20260709 13:11:17.735013 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 2078) took 1645 ms. Trace:
I20260709 13:11:17.735438 21316 rpcz_store.cc:276] 0709 13:11:16.089944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.127580 (+ 37636us) service_pool.cc:224] Handling call
0709 13:11:17.734680 (+1607100us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400228654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:17.734846 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3679724416}
I20260709 13:11:17.736956 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:17.738796 24713 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:17.740980 24757 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:17.741962 21315 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:17.746963 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 97411.1us
I20260709 13:11:17.762177 21317 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:17.771173 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:17.737007 24699 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:17.642167 24522 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.777835 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:17.779513 21317 raft_consensus.cc:3055] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:17.779752 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:17.779985 21317 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:11:17.782222 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 117021us
I20260709 13:11:17.767480 24499 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:17.784109 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:17.754628 24606 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:17.785229 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.790481 21314 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:17.791059 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.794404 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 321143us
I20260709 13:11:17.798166 21462 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:11:17.798928 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.800254 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:17.800254 22035 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:17.798610 21462 pending_rounds.cc:85] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 8
I20260709 13:11:17.788097 24217 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:17.794013 24332 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.803723 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:17.809768 21463 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:17.804665 21462 pending_rounds.cc:107] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:11:17.811228 21462 raft_consensus.cc:2889] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:17.813602 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:17.813786 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:17.807772 21317 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.806874 24463 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:17.817138 22032 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:17.817507 24714 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.852s	user 0.004s	sys 0.001s
I20260709 13:11:17.817821 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.818529 21387 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:17.818897 24217 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:17.820909 21465 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:17.821798 24368 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:17.821902 24217 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:17.822310 24368 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.822674 24737 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.823091 23845 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:17.822753 24368 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.824689 22032 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:17.828882 24596 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:17.831058 24722 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:17.831326 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 511) took 1052 ms. Trace:
I20260709 13:11:17.831641 24722 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.832186 24722 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:17.831940 21395 rpcz_store.cc:276] 0709 13:11:16.778699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.780134 (+  1435us) service_pool.cc:224] Handling call
0709 13:11:17.831076 (+1050942us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54002e3bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:17.831263 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887450752}
I20260709 13:11:17.834940 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:17.823350 24737 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.837677 24704 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:17.851233 24522 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:17.859198 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.861531 24704 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.862490 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.863377 21395 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:17.863770 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.864015 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.863818 24704 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:17.865221 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.866969 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:17.869573 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.872599 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.873644 21396 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:17.879606 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.844566 24619 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:17.889823 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 103888us
I20260709 13:11:17.901131 22032 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:17.902885 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 106134us
I20260709 13:11:17.901188 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:17.912930 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:17.913647 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.913985 22032 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:17.926807 21316 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:17.927469 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53641.5us
W20260709 13:11:17.940356 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 105965us
I20260709 13:11:17.943173 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:17.944268 24636 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:17.948778 24764 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:11:17.950717 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.956665 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:17.965335 24731 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:17.968225 24731 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.970755 24731 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:17.972137 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63008.6us
I20260709 13:11:17.976126 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:17.977458 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:17.978230 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:17.978415 24619 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:17.973824 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:17.983006 22032 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:17.988324 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:17.988593 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67229.1us
I20260709 13:11:17.847980 24606 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:17.914732 24699 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.978982 24619 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:17.991315 24332 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:17.991724 21216 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 3 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 4 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.982611 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:17.992575 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.993314 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.994151 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.996479 23845 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.997020 24731 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:17.997521 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:17.999660 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:18.003545 21215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 278) took 24229 ms (client timeout 15000 ms). Trace:
W20260709 13:11:18.000205 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.004757 24740 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:18.006965 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:18.016362 24737 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:18.021535 21468 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:18.022301 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:18.024449 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:18.025260 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:18.026309 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:18.032447 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.039500 24619 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.052712 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:17.978677 24636 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:18.044389 21436 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:17.988617 24734 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:18.054723 21390 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:18.061183 21393 raft_consensus.cc:2368] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7.
I20260709 13:11:18.062077 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.040167 24421 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.062677 21462 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:11:18.062798 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 140109us
I20260709 13:11:18.064395 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.062301 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 813) took 1202 ms. Trace:
I20260709 13:11:18.067898 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.050742 24499 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:18.069942 21317 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.050313 24740 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.069759 24421 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.072397 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:18.067907 22035 rpcz_store.cc:276] 0709 13:11:16.855505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.856108 (+   603us) service_pool.cc:224] Handling call
0709 13:11:16.856352 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.803220 (+946868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.038054 (+234834us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b540057dd54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:18.057684 (+ 19630us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146605312}
I20260709 13:11:18.084232 21396 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.072870 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:18.085168 21468 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:18.086035 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:18.057101 24332 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:18.072428 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.069854 21216 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 4 to 7, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 7 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:11:18.074060 21392 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:18.072917 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.090440 21393 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:18.092240 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:18.092383 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.092520 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.093115 21470 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:18.093544 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.093659 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.094607 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:18.095177 21392 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:18.069828 24737 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.052883 24699 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:18.096181 24737 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.097994 24699 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:18.098418 24737 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:18.098635 24699 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:18.099272 21468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c3784e213304c30beba718dd813ab39"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:56746
I20260709 13:11:18.099617 24699 consensus_queue.cc:1243] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:18.068148 23845 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.102002 24722 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:18.102350 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:18.128970 21466 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:11:18.133574 21388 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:18.102761 24759 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.188s	user 0.005s	sys 0.000s
W20260709 13:11:18.048619 21215 rpcz_store.cc:269] 0709 13:10:53.774561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.788274 (+ 13713us) service_pool.cc:224] Handling call
0709 13:11:18.003294 (+24215020us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:07.129799 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:07.130793 (+   994us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:07.130863 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:11:07.130902 (+    39us) tablet.cc:662] Decoding operations
0709 13:11:07.345824 (+214922us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:07.345954 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:07.346009 (+    55us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:11:07.348825 (+  2816us) tablet.cc:701] Row locks acquired
0709 13:11:07.348893 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:11:07.349193 (+   300us) write_op.cc:270] Start()
0709 13:11:07.349413 (+   220us) write_op.cc:276] Timestamp: P: 1783602667349110 usec, L: 0
0709 13:11:07.349483 (+    70us) op_driver.cc:348] REPLICATION: starting
0709 13:11:07.603878 (+254395us) log.cc:844] Serialized 9808 byte log entry
0709 13:11:08.398006 (+794128us) op_driver.cc:464] REPLICATION: finished
0709 13:11:08.508396 (+110390us) write_op.cc:301] APPLY: starting
0709 13:11:08.508490 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:08.508950 (+   460us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:08.509082 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:08.643167 (+134085us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:08.643463 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:11:08.643494 (+    31us) write_op.cc:312] APPLY: finished
0709 13:11:08.643875 (+   381us) log.cc:844] Serialized 164 byte log entry
0709 13:11:08.648248 (+  4373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:08.648480 (+   232us) write_op.cc:454] Released schema lock
0709 13:11:08.648557 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:08.649022 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:08.649057 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21067,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":105102,"apply.run_cpu_time_us":10195,"apply.run_wall_time_us":140588,"num_ops":24,"prepare.queue_time_us":1134612,"prepare.run_cpu_time_us":22579,"prepare.run_wall_time_us":655085,"raft.queue_time_us":236943,"raft.run_cpu_time_us":6862,"raft.run_wall_time_us":136400,"replication_time_us":1037372,"thread_start_us":1086502,"threads_started":4,"wal-append.queue_time_us":201566,"wal-append.run_cpu_time_us":14680,"wal-append.run_wall_time_us":1851365}]]}
I20260709 13:11:18.108376 21468 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.135476 21468 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:18.107374 21216 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:18.112215 21464 raft_consensus.cc:2410] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:18.112772 21396 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:18.069167 24736 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:18.136426 21317 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:11:18.136855 21317 pending_rounds.cc:85] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 1
I20260709 13:11:18.082994 24740 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:18.116245 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 142575us
I20260709 13:11:18.138134 21395 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:18.117398 21393 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:11:18.121490 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:18.138521 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.141976 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:18.144583 21387 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:18.117754 24421 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:18.085706 24463 raft_consensus.cc:2764] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:18.074643 24499 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:18.152446 21389 raft_consensus.cc:2368] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
W20260709 13:11:18.132884 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.133944 21391 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:18.137079 21317 pending_rounds.cc:107] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:11:18.093734 24459 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.145761 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:18.160188 21392 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:18.157157 21317 raft_consensus.cc:2889] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.165812 21285 leader_election.cc:400] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:11:18.166213 21285 leader_election.cc:403] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:18.166677 21395 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:18.169488 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:18.170496 21396 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:18.171722 21396 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:18.172768 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:18.172500 21216 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 3 to 5, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 5 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:18.173414 21466 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:18.174881 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:18.158702 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67398.2us
I20260709 13:11:18.174192 21216 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 1 to 2, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.176234 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:18.195019 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.193600 24368 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.199316 24734 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:11:18.204893 21462 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.176995 24522 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:18.206193 24619 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.219568 21389 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:18.205695 21216 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 5 to 8, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 8 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.177767 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:18.225613 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:18.157184 24499 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.207952 24368 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:18.240764 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 251304us
W20260709 13:11:18.224557 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 226460us
I20260709 13:11:18.271677 21389 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:18.189489 24459 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.275463 21393 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:18.240049 24724 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.003s
W20260709 13:11:18.281311 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66455us
W20260709 13:11:18.285655 22002 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.009s (SENT)
I20260709 13:11:18.279650 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1589) took 1527 ms. Trace:
I20260709 13:11:18.286477 21464 rpcz_store.cc:276] 0709 13:11:16.749719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.750107 (+   388us) service_pool.cc:224] Handling call
0709 13:11:18.230592 (+1480485us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003539d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:18.277362 (+ 46770us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116306688}
I20260709 13:11:18.289764 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:18.294736 21463 raft_consensus.cc:2410] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:18.239100 24332 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:18.299849 21388 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:18.304991 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:18.288296 24724 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.312438 24254 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:18.312737 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:18.299655 24596 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:18.324656 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.328222 21394 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:18.330487 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44900.3us
I20260709 13:11:18.318168 21216 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 3 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:18.239049 24734 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:11:18.336591 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.323765 24596 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.323824 24722 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:18.341867 24717 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:11:18.342979 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 62489.6us
I20260709 13:11:18.343382 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:18.343873 24629 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:11:18.345508 23845 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:18.331733 24696 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:18.379530 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 297806us
I20260709 13:11:18.381217 21392 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:18.349591 24619 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:18.381775 24734 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:18.365983 24596 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:18.397445 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:18.401502 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 293256us
I20260709 13:11:18.387830 24696 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:18.416983 21434 leader_election.cc:336] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.690s (SENT)
I20260709 13:11:18.417696 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:18.425244 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:18.401273 24736 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:18.431849 21388 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:18.417833 24696 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.438619 24606 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:18.439366 24606 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.413780 24619 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:11:18.481119 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 311946us
I20260709 13:11:18.452535 24629 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:18.459362 24724 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:18.492182 24463 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:18.497443 24606 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:18.498565 24629 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:18.491190 24699 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:18.542591 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.528859 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 363200us
I20260709 13:11:18.568666 21468 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:18.569622 21462 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:18.611847 21468 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:18.486078 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:18.578912 24629 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:18.618286 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 132289us
W20260709 13:11:18.625061 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 335392us
I20260709 13:11:18.578377 24606 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:18.585127 24459 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:18.578497 24699 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:18.640745 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:18.625898 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 332869us
W20260709 13:11:18.627048 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.641275 21216 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.652355 21387 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:11:18.655009 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.634665 24421 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:18.638715 24713 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:18.668274 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 300466us
I20260709 13:11:18.671818 21216 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 5 to 8, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 8 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:11:18.661464 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 270042us
I20260709 13:11:18.664963 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:18.676661 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:18.676959 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:18.677479 21321 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.678280 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:18.679037 21317 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.661942 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:18.683647 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:18.684389 21319 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:18.688362 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:18.689291 21388 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
I20260709 13:11:18.616567 24736 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.687114 24771 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:18.717919 24782 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:18.718492 24782 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:18.718878 24782 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:18.640942 24606 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.643776 24368 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:11:18.666242 24421 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:18.666674 24713 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:18.651190 24778 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:18.730278 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 313342us
I20260709 13:11:18.687916 24783 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.655385 24332 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:11:18.737893 21319 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:18.669643 24734 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:18.739426 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 100128us
W20260709 13:11:18.670888 24740 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.005s
W20260709 13:11:18.745708 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50656.6us
W20260709 13:11:18.744603 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 61792.4us
I20260709 13:11:18.749969 21434 leader_election.cc:400] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7.
I20260709 13:11:18.745568 21216 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 3 to 4, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 4 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.653093 24522 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:11:18.760877 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 336589us
I20260709 13:11:18.761360 21462 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:18.762108 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:18.767737 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 112484us
I20260709 13:11:18.762952 22031 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:18.785017 21317 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:18.787982 21463 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:18.755234 24677 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:18.789343 24776 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:18.790930 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2103) took 1363 ms. Trace:
I20260709 13:11:18.793874 21318 rpcz_store.cc:276] 0709 13:11:17.427592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.968237 (+540645us) service_pool.cc:224] Handling call
0709 13:11:17.968762 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.047460 (+ 78698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.047498 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.090663 (+ 43165us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.458828 (+368165us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:18.458883 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.458969 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.790687 (+331718us) raft_consensus.cc:1685] finished
0709 13:11:18.790709 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.790866 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15533,"raft.queue_time_us":66105,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5426,"thread_start_us":315059,"threads_started":1,"wal-append.queue_time_us":584471}
I20260709 13:11:18.795239 24781 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.764396 24699 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.795809 24781 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.797052 24699 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:18.734560 24737 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:18.753460 24740 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:18.783921 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:18.813359 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 68075.9us
W20260709 13:11:18.817044 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 56216.5us
I20260709 13:11:18.768764 24775 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:18.791442 24596 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:18.830991 21393 raft_consensus.cc:2368] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8.
I20260709 13:11:18.744336 24783 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:18.840757 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 69961.8us
W20260709 13:11:18.840885 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 57067us
I20260709 13:11:18.817382 24781 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:18.838338 24737 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:18.837229 24522 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.848635 24783 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:18.853243 24596 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:18.826426 24368 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:11:18.866212 24737 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:18.861567 24459 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:18.878199 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 60560.3us
I20260709 13:11:18.811414 24421 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.869436 24790 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.892107 24596 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:11:18.900697 21462 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:11:18.895845 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 168469us
W20260709 13:11:18.896575 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 175482us
I20260709 13:11:18.886715 24459 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.921352 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:18.934028 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:18.867936 24791 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:18.943961 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:18.946659 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 202808us
I20260709 13:11:18.949090 21464 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:18.897801 24778 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:18.931993 24459 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.932231 24596 consensus_queue.cc:1243] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:18.959524 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:18.960302 21468 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:18.959112 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:18.942471 24606 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:18.956103 24368 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:18.939349 24783 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:18.966151 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:18.968185 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:18.972383 21362 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:19.000334 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.010293 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 65111us
I20260709 13:11:18.953935 24784 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:19.014068 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 88683.8us
I20260709 13:11:18.953552 24792 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:18.976960 24783 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.904127 24790 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:18.951443 24794 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:11:19.016855 24421 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.967461 24704 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:11:19.028319 24795 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:11:19.046074 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:19.011649 24606 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:11:19.025858 24736 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:19.041101 24740 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:19.051860 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 118318us
W20260709 13:11:19.049080 24797 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:11:19.075307 24812 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.078231 24812 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.080780 24596 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:19.082813 24368 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:19.083061 24771 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.083379 24368 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:19.083593 24771 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.084385 24368 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.085886 24771 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:19.067991 21469 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:19.042001 24783 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.070084 24629 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.027897 24784 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.089624 21321 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:18.971415 24737 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.097584 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:19.099268 24737 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.099551 21392 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:19.104413 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:19.105701 24629 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:19.098223 21997 leader_election.cc:400] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
I20260709 13:11:19.073190 24736 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.106335 24629 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:19.106689 24736 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.112059 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:19.113200 24790 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:19.081420 24596 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:19.114507 24596 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.116014 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.116480 21997 leader_election.cc:403] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:19.116765 21314 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
I20260709 13:11:19.117694 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.117791 24704 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:19.117861 24736 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.118466 21315 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:19.118551 24704 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.120244 24736 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:19.121394 24790 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.121330 24713 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.122258 24812 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:19.122550 24713 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:19.121675 24704 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:19.159860 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.164840 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:19.165923 21392 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:11:19.166445 24499 consensus_meta.cc:287] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.894s	user 0.005s	sys 0.005s
I20260709 13:11:19.166894 24499 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.080448 24786 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:19.169237 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:19.087060 24778 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.170351 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:19.169466 24784 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:19.170925 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:19.173511 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:19.176307 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.176913 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 130914us
I20260709 13:11:19.195858 21314 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:19.204371 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 232099us
I20260709 13:11:19.158385 24736 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:19.214447 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:19.214643 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.215827 21321 raft_consensus.cc:2410] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:11:19.174527 24332 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.195294 24784 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:19.231556 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.236999 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:19.236497 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 278811us
I20260709 13:11:19.240302 21312 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:19.231815 24784 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:19.236909 24782 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.002s
I20260709 13:11:19.230792 24786 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:19.253645 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1941) took 1154 ms. Trace:
I20260709 13:11:19.257123 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:19.240834 24619 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:19.264549 22036 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:19.264354 24619 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.266760 24619 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:19.267120 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.267936 21314 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:19.268810 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:19.273430 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.254596 21390 rpcz_store.cc:276] 0709 13:11:18.093954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.165563 (+ 71609us) service_pool.cc:224] Handling call
0709 13:11:18.165950 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.166225 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:18.414145 (+247920us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.198062 (+783917us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.248316 (+ 50254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.248367 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:19.248419 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.248464 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.248556 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100393,"prepare.queue_time_us":456112,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":108,"raft.queue_time_us":127130,"raft.run_wall_time_us":7887,"spinlock_wait_cycles":10370944,"thread_start_us":929706,"threads_started":3,"wal-append.queue_time_us":386235}
I20260709 13:11:19.285807 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.285967 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.286669 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.287387 21320 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:19.287850 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.288262 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.289186 21320 raft_consensus.cc:2410] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:11:19.289784 21317 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:19.290428 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.291195 21319 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:19.291330 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.292300 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.292943 21316 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
W20260709 13:11:19.300052 24819 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.003s
I20260709 13:11:19.310945 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:19.312254 22035 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:19.312363 24825 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:19.315586 21316 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:19.315728 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:19.316596 24690 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:19.316991 24690 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:19.317757 24690 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.318954 24690 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.319922 24825 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.320442 24825 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.320920 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:19.321486 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.322646 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.288360 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.324265 21315 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:19.337734 21321 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:19.339075 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.229471 24332 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.251255 24784 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.355392 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:19.356055 22042 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.356436 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.357051 21317 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.357573 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.358260 21315 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:19.359066 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.359344 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.360010 21319 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:19.360322 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.361112 21316 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:19.361882 21319 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:11:19.364171 24817 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:19.364775 24817 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:19.365734 24817 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.366468 24463 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:19.322633 24825 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:19.344156 24778 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:19.371356 24778 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.356473 22036 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:19.373165 24788 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:19.374446 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.374634 24788 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:19.375339 21312 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:19.375801 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.376494 21320 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.361927 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:19.357121 24696 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.910s	user 0.006s	sys 0.004s
I20260709 13:11:19.381718 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:19.382102 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.383081 21315 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:19.392620 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.394230 21314 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:11:19.395757 21436 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:19.371724 24463 consensus_queue.cc:1243] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:11:19.404584 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.400556 24794 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:19.429946 24790 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
I20260709 13:11:19.435439 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:19.393745 24696 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.436875 24778 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:19.436993 21463 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:19.438081 24696 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:19.436246 22035 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:19.444871 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:19.448442 21312 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:19.457557 21320 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:19.463395 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:19.463937 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.464474 21321 raft_consensus.cc:2410] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:19.465668 22035 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:19.446987 22034 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:19.468142 21317 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:19.406205 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:19.470654 22036 raft_consensus.cc:2410] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:19.474241 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:19.475627 24796 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.476434 21466 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:19.476159 24796 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.476766 21466 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:19.477109 21312 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:19.477551 21466 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.478253 21312 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:19.478405 24796 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:19.478806 21466 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.478941 24734 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:19.479643 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 84020us
I20260709 13:11:19.480392 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:19.480860 24734 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:19.481208 24734 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:19.483198 24816 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:19.484421 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:19.485224 21467 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:19.485386 24816 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:19.485790 24816 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:19.486245 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:19.486974 21469 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.260514 24782 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.471840 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:19.490412 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.491149 21315 raft_consensus.cc:2410] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:11:19.496430 21316 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:19.497941 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.494560 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:19.505376 21315 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:11:19.506757 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:19.515980 22042 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:19.520628 21320 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:19.466441 24463 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:19.472898 24825 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:19.523996 22031 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:19.494418 24696 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:19.511369 24775 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.001s
I20260709 13:11:19.488162 24499 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:19.569914 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:19.535461 21467 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:19.536917 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48791.9us
I20260709 13:11:19.570866 22038 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:19.571156 21467 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:19.574148 21315 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:19.580152 21465 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:19.606035 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.606364 21316 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:19.509732 24794 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 13:11:19.625749 24421 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.003s
I20260709 13:11:19.629395 24783 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.632369 22040 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:19.633970 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:19.582417 24775 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:11:19.639043 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:19.645748 21316 raft_consensus.cc:2410] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:11:19.605563 24819 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:19.572736 24823 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:19.534984 24825 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.609807 24844 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:11:19.653493 21469 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:19.647291 21467 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:19.654536 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 82566.3us
I20260709 13:11:19.591747 24629 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:11:19.573336 24816 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.605612 24636 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:11:19.537467 24734 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:19.534343 24788 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.530694 24786 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:19.720841 21465 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:19.790978 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:19.996120 21315 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:19.996512 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:19.995540 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:19.999128 21316 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:20.000350 22035 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
W20260709 13:11:19.866478 24832 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:11:20.004050 24734 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:19.725102 24790 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:19.724712 24823 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:19.811223 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 69181.4us
I20260709 13:11:20.036857 24790 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.037631 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:20.037428 24823 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.038893 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:20.005450 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.743819 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.040673 24844 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.041380 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:20.042544 24459 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.074s	user 0.007s	sys 0.002s
I20260709 13:11:20.042865 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.043044 24459 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.043769 21469 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:19.868247 24737 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:19.903548 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:19.864754 24794 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.146s
W20260709 13:11:19.905082 24779 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:11:20.011379 24814 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:19.916224 22038 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:19.779255 21467 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.012250 24804 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.012945 24788 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:20.053105 24834 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
W20260709 13:11:19.864671 24839 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:11:20.020430 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.020771 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:20.021656 24791 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.023031 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:20.023885 24830 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.503s	user 0.000s	sys 0.001s
W20260709 13:11:20.023973 24838 log.cc:927] Time spent T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:11:19.780803 24254 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.029877 24782 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:20.031436 24825 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:20.017978 24833 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:11:20.034744 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.075832 21316 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
W20260709 13:11:20.035665 24713 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.913s	user 0.008s	sys 0.008s
I20260709 13:11:20.083559 24794 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:20.084095 24794 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.084511 24794 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:20.059274 24737 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.087270 24459 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:20.087726 24737 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:20.078027 24254 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.094862 24254 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:20.097381 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.035938 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.100481 21315 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:20.101600 21315 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:11:20.101913 21315 pending_rounds.cc:85] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 6
I20260709 13:11:20.102154 21315 pending_rounds.cc:107] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:11:20.102380 21315 raft_consensus.cc:2889] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:20.103389 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.104396 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.105520 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.106503 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:20.107146 21316 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:20.064672 24804 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.038993 24790 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:20.039770 24696 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:19.786170 24792 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:20.056339 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1965) took 1100 ms. Trace:
I20260709 13:11:20.057823 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:20.060614 21466 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.000s
I20260709 13:11:20.115700 21466 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:11:20.116178 21466 pending_rounds.cc:85] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 6
I20260709 13:11:20.116446 21466 pending_rounds.cc:107] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:11:20.116736 21466 raft_consensus.cc:2889] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:19.784703 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:20.053234 24690 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.734s	user 0.015s	sys 0.000s
W20260709 13:11:20.054075 22002 connection.cc:256] RPC call timeout handler was delayed by -1.1648948360000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 13:11:20.066408 21320 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:20.124629 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:20.126591 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:20.068266 21461 raft_consensus.cc:2368] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11.
I20260709 13:11:20.065881 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.128278 24696 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:20.129055 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.129308 24696 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.130188 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.071471 24791 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.130976 21319 raft_consensus.cc:2410] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:20.131824 21320 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:20.132555 22035 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:20.132748 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:20.133121 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 93084us
I20260709 13:11:20.133477 21320 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
I20260709 13:11:20.069120 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.065119 21465 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:20.111737 21470 rpcz_store.cc:276] 0709 13:11:18.947937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.948086 (+   149us) service_pool.cc:224] Handling call
0709 13:11:18.966090 (+ 18004us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:19.020234 (+ 54144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.020276 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:19.062583 (+ 42307us) log.cc:844] Serialized 52 byte log entry
0709 13:11:19.216709 (+154126us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:19.520159 (+303450us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.016337 (+496178us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b18002e1b60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287
0709 13:11:20.016622 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.018741 (+  2119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.018827 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.048019 (+ 29192us) raft_consensus.cc:1685] finished
0709 13:11:20.048062 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.048222 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63810,"prepare.queue_time_us":400347,"raft.queue_time_us":125550,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":34944,"spinlock_wait_cycles":43168256,"thread_start_us":448666,"threads_started":3,"wal-append.queue_time_us":125905}
I20260709 13:11:20.131726 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:20.107081 24784 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.001s
I20260709 13:11:20.119066 21313 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:20.119695 21315 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:20.107986 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.177681 21316 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:20.178996 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:20.182842 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 162146us
I20260709 13:11:20.186316 21320 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:11:20.186687 21320 pending_rounds.cc:85] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 6
I20260709 13:11:20.138680 24844 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:20.132550 24791 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:20.114408 24792 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:20.188728 21434 leader_election.cc:400] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8.
I20260709 13:11:20.192991 21434 leader_election.cc:403] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.190991 21320 pending_rounds.cc:107] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:11:20.191516 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:20.194770 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:20.196722 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:20.197856 21320 raft_consensus.cc:2889] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:20.184325 24774 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.002s	sys 0.020s
I20260709 13:11:20.205437 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:20.138823 24845 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:11:20.211834 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:20.216830 21467 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:11:20.217336 21467 pending_rounds.cc:85] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 7
I20260709 13:11:20.217617 21467 pending_rounds.cc:107] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:11:20.217931 21467 raft_consensus.cc:2889] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:20.218793 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1957) took 1277 ms. Trace:
I20260709 13:11:20.219005 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:20.219699 22034 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.185685 24784 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:20.207087 24774 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.002s	sys 0.020s
I20260709 13:11:20.219233 21462 rpcz_store.cc:276] 0709 13:11:18.941119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.941313 (+   194us) service_pool.cc:224] Handling call
0709 13:11:18.960505 (+ 19192us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:19.182958 (+222453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.183003 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:19.406158 (+223155us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b2c0002f1a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:19.471448 (+ 65290us) log.cc:844] Serialized 52 byte log entry
0709 13:11:19.651088 (+179640us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:19.651132 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.218365 (+567233us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b5400249fd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:20.218443 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.218506 (+    63us) raft_consensus.cc:1685] finished
0709 13:11:20.218527 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.218737 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10062,"raft.queue_time_us":45005,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":20073,"spinlock_wait_cycles":241267328,"thread_start_us":237045,"threads_started":2,"wal-append.queue_time_us":287714}
I20260709 13:11:20.223551 22038 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:20.195492 24844 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:20.251573 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 380413us
W20260709 13:11:20.252678 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 99290.4us
I20260709 13:11:20.259370 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:20.265626 22038 pending_rounds.cc:85] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 8
I20260709 13:11:20.266695 22038 pending_rounds.cc:107] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:11:20.266957 22038 raft_consensus.cc:2889] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:20.267282 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.181914 24775 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:11:20.208858 24782 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.209054 24737 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.209290 24704 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:20.192023 24790 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:11:20.281800 22041 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:11:20.277932 22002 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.711s (SENT)
I20260709 13:11:20.262151 24792 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.269451 24791 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8.
W20260709 13:11:20.277055 24851 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:11:20.285298 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:20.274564 24713 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.277191 24786 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.276369 24824 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:20.304598 24737 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:20.315977 24784 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:20.324515 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53529.4us
W20260709 13:11:20.328527 22002 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.031s (SENT)
I20260709 13:11:20.300468 24713 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.314517 24804 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:20.354287 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 67030.4us
I20260709 13:11:20.333773 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:20.337764 24850 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:11:20.338510 24856 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:20.345521 24792 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:20.350469 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.358603 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.352128 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1013) took 1107 ms. Trace:
I20260709 13:11:20.305624 24786 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.360029 22040 rpcz_store.cc:276] 0709 13:11:19.244859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.245000 (+   141us) service_pool.cc:224] Handling call
0709 13:11:19.258311 (+ 13311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.632897 (+374586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.351814 (+718917us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b540048b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:20.352063 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859505920}
I20260709 13:11:20.361040 22034 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:20.331168 24472 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:20.363504 24368 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.377733 21314 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:20.357836 24731 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:20.372838 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44351.7us
I20260709 13:11:20.450228 24824 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:20.450732 24824 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:20.450836 22002 leader_election.cc:336] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.048s (SENT)
I20260709 13:11:20.450632 24731 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.407444 24332 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:20.378983 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1019) took 1067 ms. Trace:
I20260709 13:11:20.383251 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:20.383560 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.453293 21466 raft_consensus.cc:2368] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 7.
W20260709 13:11:20.425144 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 114182us
I20260709 13:11:20.383838 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.384472 21462 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:20.384727 21313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 2116) took 1735 ms (client timeout 1641 ms). Trace:
I20260709 13:11:20.403115 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:20.404222 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:20.454916 21313 rpcz_store.cc:269] 0709 13:11:18.649300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.650110 (+   810us) service_pool.cc:224] Handling call
0709 13:11:20.384547 (+1734437us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54003ae8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:20.384657 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240262016}
I20260709 13:11:20.404583 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:20.456353 21393 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:20.405500 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.456744 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:20.410142 21469 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:20.410953 21315 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:11:20.414953 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.416280 22035 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:20.419377 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:20.320494 24844 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.403815 21388 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:20.461321 21470 raft_consensus.cc:2368] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9.
I20260709 13:11:20.376977 21320 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:20.461488 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.404912 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:20.421753 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.388334 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:20.399886 24713 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:20.443572 24368 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.385263 24421 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:20.372314 24459 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:11:20.435081 24817 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:20.409596 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 526) took 1318 ms. Trace:
I20260709 13:11:20.473393 21461 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:20.458086 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.452060 22031 rpcz_store.cc:276] 0709 13:11:19.311679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.311808 (+   129us) service_pool.cc:224] Handling call
0709 13:11:19.312112 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.527621 (+215509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.378648 (+851027us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540053cfd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:20.378903 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486739840}
I20260709 13:11:20.460237 21316 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
W20260709 13:11:20.460263 22002 leader_election.cc:336] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.190s (SENT)
I20260709 13:11:20.460661 21312 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:20.474888 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:20.455989 24845 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.462551 21394 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.411484 24775 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.463893 21997 leader_election.cc:400] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11.
I20260709 13:11:20.476927 21317 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:20.466147 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.404145 24784 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:20.368005 24788 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:20.469009 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:20.386581 24786 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:20.467748 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.471525 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:20.464608 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:20.381008 24815 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:11:20.472879 21387 rpcz_store.cc:276] 0709 13:11:19.091392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.091589 (+   197us) service_pool.cc:224] Handling call
0709 13:11:19.157590 (+ 66001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.227164 (+ 69574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.227208 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.369690 (+142482us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b1800330640. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a
0709 13:11:19.437680 (+ 67990us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:19.438204 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.409122 (+970918us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54000346a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf182090 00007fc2bf18f6b8 00007fc2bf21892b 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c
0709 13:11:20.409185 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:20.409249 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.409328 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.409375 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:20.409390 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.409536 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92106,"raft.queue_time_us":70527,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2461,"spinlock_wait_cycles":62396928,"thread_start_us":173661,"threads_started":1,"wal-append.queue_time_us":172296}
I20260709 13:11:20.477017 21997 leader_election.cc:403] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.466107 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.480597 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:20.465615 24332 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:11:20.471926 24867 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
W20260709 13:11:20.483549 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0334462590000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260709 13:11:20.484251 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.609483 21313 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:20.538381 21394 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
W20260709 13:11:20.556674 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.610520 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 146738us
I20260709 13:11:20.488302 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:20.539415 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 70453.5us
I20260709 13:11:20.483536 21392 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:20.546659 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:20.561473 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 101230us
I20260709 13:11:20.538578 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.615175 21462 raft_consensus.cc:2410] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:20.489660 21315 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:20.545099 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:20.609458 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0262462590000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:11:20.488502 21466 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
W20260709 13:11:20.620407 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0154462589999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
I20260709 13:11:20.471783 24859 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:20.615780 21315 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:11:20.621116 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9866462590000538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:11:20.472473 24421 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:20.622967 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9407462589999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:11:20.626521 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9398462589999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:11:20.538236 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54281.9us
W20260709 13:11:20.561333 24734 consensus_meta.cc:287] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.002s
I20260709 13:11:20.623952 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:20.626966 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9218462590000627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:11:20.629983 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8966462590000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:11:20.630366 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8813462589999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
I20260709 13:11:20.630486 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:20.631314 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 166801us
W20260709 13:11:20.630719 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7967462589999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:11:20.632512 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7454462590000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 13:11:20.632360 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:20.633030 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7121462590000647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:11:20.633337 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6689462589999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 13:11:20.633623 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6662462589999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:11:20.633880 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.634063 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6428462590000663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 13:11:20.622632 24794 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.002s
I20260709 13:11:20.637131 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:20.637162 22032 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:20.481238 24737 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.549983 24472 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:20.627816 24596 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:20.640561 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5861462589999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 13:11:20.633457 22040 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:20.642666 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:20.613507 24704 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11.
I20260709 13:11:20.560894 24463 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:20.648785 21359 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:20.488961 24731 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:20.654654 21285 connection.cc:256] RPC call timeout handler was delayed by -1.522246258999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:11:20.481390 24845 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.539100 24788 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.658160 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:20.640735 24815 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:11:20.482398 24817 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.666621 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:20.668243 24874 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:11:20.671283 24799 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:20.637485 24867 raft_consensus.cc:2764] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:20.674093 21465 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.641681 24859 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:20.688827 21313 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:20.675773 21315 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.693133 21464 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:20.655428 24596 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:20.696260 24722 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:20.697256 24332 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:20.697820 24783 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:20.688233 24799 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:20.685595 24825 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:20.700001 24878 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:20.490720 24775 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.643847 24844 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:20.718314 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:20.722926 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:20.700455 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:20.729126 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 264229us
I20260709 13:11:20.675858 24731 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:11:20.677492 24463 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.712818 24596 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.705560 24472 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.651669 24794 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.733582 21468 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:20.735911 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:20.705909 24786 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.742435 21314 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:20.744261 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:20.743291 22002 leader_election.cc:400] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
I20260709 13:11:20.729946 24799 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:20.719278 24804 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:11:20.713835 24629 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:11:20.733302 24784 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:11:20.740728 24722 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:20.756413 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.758390 24775 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:20.749157 24790 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:20.760619 24790 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:20.761571 24790 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.738770 24825 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.715960 24421 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.747289 24783 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:11:20.765170 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:20.767854 21465 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:20.768849 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.770383 24788 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:20.770488 24421 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:20.770733 21465 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:20.771266 24871 log.cc:927] Time spent T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:11:20.772418 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2126) took 1448 ms. Trace:
I20260709 13:11:20.772782 21321 rpcz_store.cc:276] 0709 13:11:19.323553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.493227 (+169674us) service_pool.cc:224] Handling call
0709 13:11:19.512205 (+ 18978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.512878 (+   673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.512914 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:20.381725 (+868811us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b2c00014818. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:20.382267 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.467331 (+ 85064us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:20.467362 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.467422 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.772139 (+304717us) raft_consensus.cc:1685] finished
0709 13:11:20.772158 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.772353 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":18430208,"thread_start_us":84745,"threads_started":1,"wal-append.queue_time_us":259376}
I20260709 13:11:20.771976 21465 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:20.775569 21465 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:11:20.776013 21465 pending_rounds.cc:85] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 6
I20260709 13:11:20.776254 21465 pending_rounds.cc:107] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:11:20.776494 21465 raft_consensus.cc:2889] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:20.775264 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:20.774884 24722 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:20.777997 24804 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.778353 24463 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:20.780977 24817 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:20.776378 21463 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:20.767299 24859 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.752918 24879 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:20.784840 24794 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:20.792306 24818 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:20.792915 24818 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:20.793730 24818 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.794579 24818 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:20.759915 24775 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:20.749483 24786 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:20.800504 24775 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:20.808925 24775 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:20.810211 24596 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:20.812496 24881 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:11:20.814199 21315 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:20.817692 24696 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:20.818145 24696 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:20.818773 24879 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:20.819063 24696 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:20.833940 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 73549.4us
W20260709 13:11:20.960464 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 161166us
I20260709 13:11:20.961676 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:20.968462 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 286891us
I20260709 13:11:21.015317 24867 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:21.015858 24867 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:21.016858 24867 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.018208 24867 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:21.022869 24799 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.024560 24459 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.025278 24459 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:21.034579 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.035259 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.035673 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 66247.1us
I20260709 13:11:21.039314 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:21.053746 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.062533 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:21.070560 22031 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:21.062805 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:21.062814 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:21.072687 22040 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.073896 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:21.027869 24459 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:21.075070 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 426390us
I20260709 13:11:21.075626 21315 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:11:21.078488 21315 pending_rounds.cc:85] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 4
I20260709 13:11:21.078725 21315 pending_rounds.cc:107] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:11:21.078984 21315 raft_consensus.cc:2889] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.078857 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:20.782791 24885 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.309s
W20260709 13:11:21.116865 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.080687 24824 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 13:11:21.078302 24844 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.102465 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:21.075423 24794 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:21.056054 24887 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.135239 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1031) took 1298 ms. Trace:
W20260709 13:11:21.155578 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 82053.9us
I20260709 13:11:21.095029 24629 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:21.164716 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 62393.6us
I20260709 13:11:20.820770 24879 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.171903 22041 rpcz_store.cc:276] 0709 13:11:19.806886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.807056 (+   170us) service_pool.cc:224] Handling call
0709 13:11:21.104982 (+1297926us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:21.105133 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521432960}
I20260709 13:11:21.108259 24784 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.183859 24882 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.184531 24827 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.157153 24782 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.157274 24804 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.177572 24463 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:21.198838 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 452803us
I20260709 13:11:21.175037 24878 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:21.208480 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:21.191229 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.177327 24629 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.185995 24690 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:21.214952 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 72645.2us
I20260709 13:11:21.216408 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:21.225466 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 263901us
I20260709 13:11:21.201217 24888 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:21.168040 24844 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.210963 24817 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:21.166224 24824 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.215538 24629 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.237203 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:21.240420 21313 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:21.217828 24786 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:21.191896 24784 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.213232 24463 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.241422 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:21.241834 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:21.282423 21313 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:21.242635 24886 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:21.283826 24886 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:21.180311 24887 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.284783 24886 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.285877 24886 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:21.286327 24884 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:21.286976 24887 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:21.287158 24884 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:21.287592 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.288002 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.288326 21393 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:21.223618 24690 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.288714 21387 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:21.288214 21319 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:21.289932 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:21.290630 21313 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:21.249084 24799 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:21.249991 24883 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.446s	user 0.000s	sys 0.002s
I20260709 13:11:21.298055 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.252046 24844 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:21.252839 24827 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:21.256261 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.319253 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.199345 24882 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.259035 24368 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:21.240590 24790 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:21.263221 24845 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:21.264400 24713 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:21.222383 24804 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.207747 24782 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:21.275710 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 84596.7us
I20260709 13:11:21.223888 24825 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:21.241766 24892 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:11:21.369858 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:21.377090 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.419755 21387 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.380961 24734 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:21.387033 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.421497 21391 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:21.395671 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.384914 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.403137 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.370472 24809 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.406476 21395 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:21.407274 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.427611 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.410120 22040 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
W20260709 13:11:21.410804 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.422626 21396 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:21.399184 24713 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:21.403566 24459 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.438877 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.414682 24596 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.424437 24421 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.425148 24845 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.457119 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.472546 21392 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:21.474407 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.475208 21393 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.424206 24734 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:21.480516 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 403761us
I20260709 13:11:21.465400 21387 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:11:21.440066 24887 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.492053 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:21.493162 21470 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:21.498610 21389 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:21.449707 24794 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:21.510864 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:21.512756 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 85250.5us
I20260709 13:11:21.507840 21396 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:21.513572 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.434396 24809 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.500558 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.500002 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.501201 21391 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:21.504355 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:21.454425 24459 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.518903 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.521196 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.522733 21396 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:21.523603 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 307241us
I20260709 13:11:21.528872 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.467744 24596 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.535423 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:21.532323 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.536167 22040 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:21.536228 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:21.481436 24421 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.568478 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:21.567670 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:21.520920 24887 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:21.489080 24845 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.593628 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:21.597231 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.598186 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.599231 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.600593 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:21.609373 22035 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:11:21.619594 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.636507 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 68952.1us
I20260709 13:11:21.638111 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:21.608428 21390 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:21.528970 24690 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:21.649539 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:21.655880 21467 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:21.650624 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:21.519666 24875 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:11:21.660437 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.661214 21389 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:21.544150 24896 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:21.669826 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.658865 24825 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:21.524209 24713 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.718247 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.671430 24815 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:21.742676 21466 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:21.671290 24896 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.744093 21464 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:21.536530 24734 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:21.748788 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 214041us
I20260709 13:11:21.743605 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:21.750207 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:21.751700 21391 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:21.777719 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:21.713580 24888 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:21.778339 21391 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.746500 24784 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:21.785545 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.786090 21389 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:21.788708 24887 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.793236 24596 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:21.793936 24734 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:21.794797 24809 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:21.795748 24459 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:21.796640 24888 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:21.797350 24818 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.002s	user 0.014s	sys 0.000s
I20260709 13:11:21.797676 24713 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.800109 24867 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:21.784389 24782 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:21.698529 24794 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:21.785780 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 272270us
I20260709 13:11:21.845763 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.847597 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.801842 24816 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:21.857096 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.803352 21470 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
W20260709 13:11:21.860312 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1611) took 1370 ms (client timeout 1720 ms). Trace:
W20260709 13:11:21.860682 21470 rpcz_store.cc:269] 0709 13:11:20.489580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.639474 (+149894us) service_pool.cc:224] Handling call
0709 13:11:21.491879 (+852405us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:11:21.860247 (+368368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4973440}
I20260709 13:11:21.805377 24421 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:21.806676 24845 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:21.863544 21462 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:11:21.822576 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.865061 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.742735 24804 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:21.748462 24815 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.866183 24815 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:21.741633 24463 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:21.756554 24896 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:21.789376 24825 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:21.874233 24894 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260709 13:11:21.839877 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.828574 24887 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.848265 24913 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:21.849006 24902 log.cc:927] Time spent T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:11:21.849982 21393 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
W20260709 13:11:21.851050 24629 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 13:11:21.851471 24882 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:21.851859 24886 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:11:21.921339 24886 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:21.921893 24886 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.922382 24886 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:21.852764 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.924669 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.843135 24867 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.926877 24867 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:21.795663 24786 consensus_queue.cc:1175] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33be1cb5cfc143fc90e164888c96cc6f" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
W20260709 13:11:21.832136 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57774.4us
I20260709 13:11:21.932885 22002 leader_election.cc:400] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 4. Current term is 5.
I20260709 13:11:21.906050 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.933807 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.934279 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:21.934504 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:21.934955 21469 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:21.935052 22002 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.936271 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.937064 24704 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.937739 24704 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:21.938381 24704 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:21.938656 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:21.938401 24868 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.939657 24868 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.940402 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:21.940693 22035 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:21.941001 22032 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
W20260709 13:11:21.941840 22002 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.956s (SENT)
I20260709 13:11:21.942278 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:21.942354 24868 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:21.944396 24696 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.944594 24886 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:21.944756 21388 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:11:21.946151 21388 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:21.946532 24844 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.946993 24844 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:21.935931 21394 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:21.947988 21388 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:21.910724 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.882999 24891 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260709 13:11:21.915304 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:21.887826 24905 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:11:21.920102 24890 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.693s	user 0.004s	sys 0.000s
I20260709 13:11:21.920372 24629 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:21.910393 24804 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:21.916774 24775 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.105s	user 0.013s	sys 0.002s
W20260709 13:11:21.957674 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 110163us
I20260709 13:11:21.959196 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:21.964593 21391 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
W20260709 13:11:21.911019 24792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.008s	sys 0.025s
I20260709 13:11:21.955600 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:21.972175 21394 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:21.983464 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:21.987103 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:21.979576 22031 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
W20260709 13:11:21.990132 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48320.7us
I20260709 13:11:21.949115 24421 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.011260 21466 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:21.992674 21315 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:21.993839 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:22.005735 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.014153 21464 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:22.014554 22035 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:21.986738 24775 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.006949 22034 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:21.984200 24459 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:21.948984 24844 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:22.023581 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:21.984439 24792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.008s	sys 0.025s
I20260709 13:11:22.024873 21320 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:22.029150 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 73626.9us
I20260709 13:11:22.021556 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.037679 21312 raft_consensus.cc:2410] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:21.969002 24881 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:22.034883 21318 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
W20260709 13:11:22.039558 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.048080 21469 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:22.049070 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:22.049724 21468 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:22.050876 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2162) took 1421 ms. Trace:
I20260709 13:11:22.051237 21314 rpcz_store.cc:276] 0709 13:11:20.629535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.629713 (+   178us) service_pool.cc:224] Handling call
0709 13:11:20.646315 (+ 16602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.747475 (+101160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.050660 (+1303185us) spinlock_profiling.cc:243] Waited 95.9 ms on lock 0x7b5400228154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:22.050827 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220468608}
I20260709 13:11:22.054040 22032 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:22.042624 21434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.517s (SENT) [suppressed 18 similar messages]
I20260709 13:11:21.990856 24596 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:22.057883 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 74503.4us
I20260709 13:11:22.021160 24804 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:22.062264 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.007808 24867 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.041026 24782 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:22.039463 24845 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:22.071472 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:22.081702 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:22.052767 24913 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.082847 21314 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:22.071238 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:22.084386 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.084833 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.086874 21388 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:22.031729 24421 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.091375 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.058084 24879 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:22.092022 21468 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:22.098609 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.098169 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.096936 22036 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:22.085048 21315 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:22.101441 21394 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:22.097700 21314 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:22.102604 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.039129 24459 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.043884 24818 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:22.108793 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.107091 21312 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:22.103996 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.010558 24825 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.112900 21391 raft_consensus.cc:2368] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8.
I20260709 13:11:22.110646 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.109174 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.085954 24886 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.123072 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:22.123417 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.062306 24596 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.094524 24782 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:22.144973 21393 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:11:22.158157 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 62645.1us
W20260709 13:11:22.163152 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.186015 24459 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:22.187609 22041 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:22.117866 24804 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:22.188860 24897 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:22.190500 24782 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.113476 24909 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:11:22.118247 24731 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:22.128567 24892 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:22.108577 24879 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:22.201644 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 109312us
I20260709 13:11:22.094647 24845 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.204248 21387 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:11:22.207360 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 84359.4us
I20260709 13:11:22.091703 24913 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:22.194195 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 151592us
W20260709 13:11:22.252624 21434 leader_election.cc:336] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.527s (SENT)
I20260709 13:11:22.253082 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:22.210687 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:22.124476 24722 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.079s
W20260709 13:11:22.229835 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.124467 24790 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:11:22.133292 24886 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.244063 24881 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:22.244472 24915 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:11:22.244838 24917 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:11:22.254329 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:22.219328 24897 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.257993 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:22.259084 21461 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:22.242100 24892 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:22.242856 24887 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:22.263005 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52452.2us
I20260709 13:11:22.209810 24896 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:22.241559 24912 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:11:22.268846 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:22.263446 24459 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:22.264958 24875 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:11:22.269855 24878 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:22.277796 24897 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.261427 24629 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:22.285290 21389 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:22.285950 24867 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:22.289083 24913 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:22.263144 24818 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.255069 24368 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.263530 24925 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:22.238119 24731 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:22.285038 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.269131 24775 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:22.524696 24818 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.525725 24368 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:22.341392 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 72644.7us
I20260709 13:11:22.545902 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:22.548056 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:22.396198 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 141924us
W20260709 13:11:22.341264 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 243237us
W20260709 13:11:22.393631 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 305759us
I20260709 13:11:22.402675 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:22.454912 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.343950 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.552887 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.553362 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:22.551815 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:22.492115 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.295179 24696 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:22.302582 24892 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.571044 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.330247 24794 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.577909 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:22.422894 24879 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:22.454403 24815 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
W20260709 13:11:22.414904 24915 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:11:22.345956 24878 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.401413 24898 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:22.392763 24792 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:22.545032 24731 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.581640 24938 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.568650 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:22.568136 21464 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.002s
I20260709 13:11:22.610047 21464 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
W20260709 13:11:22.589206 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 451865us
I20260709 13:11:22.563694 24421 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:22.565562 24868 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:22.588721 24472 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:22.584139 24794 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.614364 24332 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:22.615011 24332 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.615381 24332 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.615703 24794 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:22.596944 24824 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:22.597040 24870 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:22.598016 24788 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:22.574988 24913 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:22.599354 24941 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:11:22.576795 24629 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:22.637333 24629 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:22.638305 24629 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:22.639691 24918 log.cc:927] Time spent T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.778s	user 0.005s	sys 0.000s
I20260709 13:11:22.617540 24938 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:22.640700 24927 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:22.570154 24906 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:11:22.303403 24804 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.642503 24938 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:22.642688 24867 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:22.644244 24804 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:22.575199 24818 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:22.545550 24784 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.645637 24784 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.605873 24786 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.646937 24786 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.601514 24934 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:11:22.647753 24784 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:22.649036 24786 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:22.608176 24774 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.588687 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 249866us
W20260709 13:11:22.610152 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56855us
I20260709 13:11:22.654959 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:22.594609 24945 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.591460 24815 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.616501 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:22.595628 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.611361 24459 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:22.592978 24596 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:22.643811 24867 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:22.625033 24845 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:22.626309 24928 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:11:22.628896 24788 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:22.636540 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.669093 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.687366 21316 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:22.672963 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.689064 21464 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:22.690920 21467 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:22.688697 21314 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:22.692225 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.693197 21316 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
W20260709 13:11:22.693873 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.673790 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57340.9us
W20260709 13:11:22.619514 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.579s (SENT)
I20260709 13:11:22.682083 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.696619 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:22.682385 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:22.693346 21319 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:22.696998 21313 raft_consensus.cc:2410] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:22.680392 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:22.682474 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:22.693782 21316 pending_rounds.cc:85] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 4
W20260709 13:11:22.698779 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79300.7us
I20260709 13:11:22.725291 21316 pending_rounds.cc:107] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:11:22.706028 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.726219 21316 raft_consensus.cc:2889] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:22.726513 21314 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:22.726912 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:22.725284 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 45016.8us
I20260709 13:11:22.671692 24818 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:22.729203 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.684465 24941 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:22.730006 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47707.8us
W20260709 13:11:22.690141 24926 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
I20260709 13:11:22.733551 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.741571 22041 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:22.741673 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:22.742311 21468 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.742564 21285 leader_election.cc:400] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
W20260709 13:11:22.728983 24940 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:11:22.715334 24713 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.863s	user 0.010s	sys 0.000s
I20260709 13:11:22.747915 22038 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:22.739130 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.747988 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:22.714597 24933 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:11:22.749660 21434 leader_election.cc:400] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8.
I20260709 13:11:22.749980 21434 leader_election.cc:403] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:22.741688 21314 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:22.684886 24867 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:22.742594 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.678355 24421 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:11:22.746402 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.714892 24784 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:22.755336 22041 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:22.740947 24629 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:22.740443 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.738692 24804 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:22.748667 21313 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:22.724999 24368 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:22.729120 24896 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:22.757819 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.765686 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.748612 22040 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:11:22.696888 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:22.745050 24886 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:22.758873 21319 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:22.769227 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:22.769372 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.744617 24906 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:22.772941 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:22.774001 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.775223 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.764165 21396 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:22.776393 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:22.767645 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.761106 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.672076 24774 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.792829 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.793102 24906 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:11:22.770413 22039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.004s	sys 0.027s
I20260709 13:11:22.793569 21316 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:11:22.771153 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74364.7us
I20260709 13:11:22.778107 21314 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:22.779469 21393 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:11:22.678692 24945 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:22.782603 24921 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.439s	user 0.001s	sys 0.001s
I20260709 13:11:22.782449 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.783150 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:22.776832 24868 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.784636 24949 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:22.771963 24808 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:11:22.770956 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:22.793664 22039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.004s	sys 0.028s
I20260709 13:11:22.758527 24629 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:22.799081 21395 raft_consensus.cc:2376] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11. Re-sending same reply.
I20260709 13:11:22.757577 24818 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:11:22.865598 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 70987.7us
W20260709 13:11:22.819938 22002 leader_election.cc:336] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.808s (SENT)
I20260709 13:11:22.893642 24945 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:22.893932 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74068.4us
I20260709 13:11:22.866250 24887 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.894605 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.880s (SENT)
I20260709 13:11:22.830992 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:22.815994 21468 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:22.831552 24944 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:22.813866 21319 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:22.868203 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:22.893081 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1966) took 1252 ms. Trace:
I20260709 13:11:22.895768 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:22.826983 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53873.6us
I20260709 13:11:22.775417 24368 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:22.872385 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62865.4us
I20260709 13:11:22.917009 24784 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:22.926400 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:22.916072 21390 rpcz_store.cc:276] 0709 13:11:21.640533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.740862 (+100329us) service_pool.cc:224] Handling call
0709 13:11:21.787535 (+ 46673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.818882 (+ 31347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.818922 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.819418 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:11:22.092293 (+272875us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:22.092359 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.092450 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.892855 (+800405us) raft_consensus.cc:1685] finished
0709 13:11:22.892878 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.893024 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":792,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9375,"thread_start_us":247812,"threads_started":1,"wal-append.queue_time_us":379402}
I20260709 13:11:22.918010 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:22.897056 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:22.919946 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 1989) took 1354 ms (client timeout 1654 ms). Trace:
W20260709 13:11:22.921777 21392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1957) took 1471 ms (client timeout 1527 ms). Trace:
I20260709 13:11:22.925983 24808 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:22.937239 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:22.938145 21314 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.938575 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:22.917198 22002 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.062s (SENT)
I20260709 13:11:22.928133 24818 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:22.929127 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:22.929276 24878 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.886729 24774 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:22.883824 24332 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.865465 24906 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:22.896556 24704 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.957s	user 0.012s	sys 0.001s
I20260709 13:11:22.797257 24804 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:22.932560 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:22.896422 24792 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8.
W20260709 13:11:22.937065 21392 rpcz_store.cc:269] 0709 13:11:21.450071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.473600 (+ 23529us) service_pool.cc:224] Handling call
0709 13:11:22.921536 (+1447936us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54002cd154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:22.921693 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895947008}
I20260709 13:11:22.966802 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.943532 24896 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:22.939173 21316 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:22.970425 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:22.971315 21316 raft_consensus.cc:2410] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:11:22.936440 21461 rpcz_store.cc:269] 0709 13:11:21.565870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.566096 (+   226us) service_pool.cc:224] Handling call
0709 13:11:22.919765 (+1353669us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54002f3354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:22.919882 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114087168}
I20260709 13:11:22.945356 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:22.946624 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 173760us
I20260709 13:11:22.947270 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:22.888882 24897 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:22.832808 24933 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:22.792855 24815 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:22.831871 24788 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:22.954172 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:22.894611 24629 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:22.957998 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 158793us
I20260709 13:11:22.865113 24947 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:22.964851 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:22.944335 24782 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.895319 24887 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.935596 24944 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:22.833524 24713 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.146s
I20260709 13:11:22.871206 24731 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.832969 24868 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.794077 24867 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:22.832562 24892 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:22.973074 21388 raft_consensus.cc:2393] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:22.948698 24913 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:23.065574 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:22.970762 24704 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.102770 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:23.103539 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.058122 24332 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.122170 21468 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:22.971465 24896 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.100536 21463 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:23.119947 21313 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:23.112125 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:23.106930 24893 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:23.122217 21387 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:23.112484 21314 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:23.125782 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:23.098961 24947 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.114177 24913 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.128835 21463 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:23.131297 22034 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:23.112959 24845 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:23.133558 21463 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:23.174445 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48745us
I20260709 13:11:23.176301 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:23.108831 24782 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.126593 24896 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:23.231536 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64334.6us
W20260709 13:11:23.195333 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.131726 24947 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:23.134191 24913 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.235417 21468 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:23.146453 24731 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:23.132669 24421 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:23.151542 24925 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:23.149338 24892 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.256697 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:23.134060 24794 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:11:23.187001 24845 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.153016 24944 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:23.274881 24960 log.cc:927] Time spent T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:11:23.275519 24845 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:23.135879 24893 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.277585 24868 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:23.278470 24897 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.123416 24804 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.281255 21316 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.283576 24925 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:23.287104 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2157) took 1624 ms. Trace:
I20260709 13:11:23.287652 21317 rpcz_store.cc:276] 0709 13:11:21.662713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.662939 (+   226us) service_pool.cc:224] Handling call
0709 13:11:21.663386 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:21.694557 (+ 31171us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:22.059080 (+364523us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.602457 (+543377us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:22.650345 (+ 47888us) log.cc:844] Serialized 52 byte log entry
0709 13:11:22.650537 (+   192us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:22.650877 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.651173 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.651277 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.061730 (+410453us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b180036e140. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:11:23.286876 (+225146us) raft_consensus.cc:1685] finished
0709 13:11:23.286904 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.287048 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53338,"prepare.queue_time_us":435419,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":14499,"raft.queue_time_us":30129,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":56064,"spinlock_wait_cycles":8622464,"thread_start_us":815949,"threads_started":3,"wal-append.queue_time_us":438375}
I20260709 13:11:23.333487 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:23.334205 21317 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:23.339371 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:23.348198 21316 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:11:23.345589 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 113262us
W20260709 13:11:23.349401 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 173191us
I20260709 13:11:23.349707 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:23.350785 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:23.355149 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 133515us
I20260709 13:11:23.369647 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:23.375669 24713 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:23.379396 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:23.388607 21317 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:23.390036 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:23.390936 21317 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:23.350487 24878 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.392087 24713 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:23.359795 24774 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:23.397617 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:23.403834 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:23.410465 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:23.413228 22032 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:23.416288 22041 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:23.416546 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:23.398658 24925 raft_consensus.cc:2764] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:11:23.398722 24774 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.418643 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:23.397547 24967 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:23.417729 24722 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.409142 24815 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:23.440984 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:23.466928 21396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1962) took 1871 ms (client timeout 1742 ms). Trace:
I20260709 13:11:23.474953 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:23.477510 24955 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:23.478024 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:23.480362 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:23.606812 21396 rpcz_store.cc:269] 0709 13:11:21.595185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.596883 (+  1698us) service_pool.cc:224] Handling call
0709 13:11:23.466636 (+1869753us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540020e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:23.466799 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2627814656}
I20260709 13:11:23.614626 21466 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:23.488705 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1996) took 1559 ms. Trace:
I20260709 13:11:23.615487 21470 rpcz_store.cc:276] 0709 13:11:21.929491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.956009 (+ 26518us) service_pool.cc:224] Handling call
0709 13:11:21.956443 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.956874 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:21.988947 (+ 32073us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.282717 (+293770us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b1800115e40. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:11:22.587893 (+305176us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:23.484470 (+896577us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b2c0002f1a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:23.484815 (+   345us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.484958 (+   143us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:23.484993 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.485062 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.488447 (+  3385us) raft_consensus.cc:1685] finished
0709 13:11:23.488472 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.488632 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32033,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":5553,"raft.queue_time_us":26339,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":9483,"spinlock_wait_cycles":42810112,"thread_start_us":303074,"threads_started":1,"wal-append.queue_time_us":564775}
W20260709 13:11:23.621196 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 146323us
I20260709 13:11:23.493901 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:23.508136 21389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 1977) took 1684 ms (client timeout 1807 ms). Trace:
I20260709 13:11:23.509913 24459 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:23.632862 24459 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.421607 24969 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.215s
I20260709 13:11:23.635354 24969 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:23.635722 24969 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:23.526129 24878 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:23.636511 24878 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.637928 24969 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.638787 24878 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.531680 24596 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:23.639289 24969 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.641016 24867 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:23.436399 24967 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:23.643139 24967 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.541081 21463 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.545097 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 1993) took 1978 ms. Trace:
I20260709 13:11:23.644450 21467 rpcz_store.cc:276] 0709 13:11:21.567077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.656896 (+ 89819us) service_pool.cc:224] Handling call
0709 13:11:21.672796 (+ 15900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.691514 (+1018718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.544837 (+853323us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400249fd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:23.545031 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341133568}
I20260709 13:11:23.645164 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 477) took 3092 ms. Trace:
I20260709 13:11:23.546015 24775 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:23.548871 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1043) took 1518 ms. Trace:
I20260709 13:11:23.646667 21466 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:11:23.503479 24845 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:11:23.561295 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:23.562479 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 545) took 1012 ms. Trace:
W20260709 13:11:23.583063 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.603785 24782 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:23.604211 24963 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:11:23.416554 24887 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.426939 24636 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:23.427227 24774 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:23.614677 21321 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.481845 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:23.631043 21464 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.432689 24804 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:23.631052 21389 rpcz_store.cc:269] 0709 13:11:21.824235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.864805 (+ 40570us) service_pool.cc:224] Handling call
0709 13:11:23.507883 (+1643078us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54002ce054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:23.508055 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965086592}
I20260709 13:11:23.653578 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:23.645586 21465 rpcz_store.cc:276] 0709 13:11:20.552696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.780525 (+227829us) service_pool.cc:224] Handling call
0709 13:11:21.493972 (+713447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.508733 (+ 14761us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:21.520238 (+ 11505us) log.cc:844] Serialized 14 byte log entry
0709 13:11:21.874924 (+354686us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.875544 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.875719 (+   175us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:21.875767 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.875859 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.190224 (+314365us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b18003647e0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:11:22.600787 (+410563us) raft_consensus.cc:1685] finished
0709 13:11:22.605767 (+  4980us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.644953 (+1039186us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5400352fd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:23.645080 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11317,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":14928,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":10006,"spinlock_wait_cycles":1644415616,"thread_start_us":225546,"threads_started":1,"wal-append.queue_time_us":413614,"wal-append.run_cpu_time_us":9657,"wal-append.run_wall_time_us":1614723}
I20260709 13:11:23.687531 21469 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:23.673091 24893 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.605166 24825 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:23.675879 21387 rpcz_store.cc:276] 0709 13:11:22.550215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.550776 (+   561us) service_pool.cc:224] Handling call
0709 13:11:22.551061 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.129564 (+578503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.562217 (+432653us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54002ccc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:23.562416 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313025792}
I20260709 13:11:23.614349 24955 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:23.646509 22034 rpcz_store.cc:276] 0709 13:11:22.030823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.049381 (+ 18558us) service_pool.cc:224] Handling call
0709 13:11:23.548713 (+1499332us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400648554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:23.548816 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2456528768}
W20260709 13:11:23.690042 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 292513us
W20260709 13:11:23.648581 24965 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:11:23.675076 24786 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.705932 21464 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:23.680353 24459 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:23.438542 24713 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.629966 24870 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:23.650193 24792 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:11:23.716136 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:23.702469 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48978.7us
I20260709 13:11:23.720492 21318 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:23.732434 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:23.681855 24636 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.731770 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:23.670562 24775 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.733424 21321 raft_consensus.cc:2410] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:23.734153 21469 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:11:23.739023 21467 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:23.731770 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:23.736045 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1039) took 1730 ms. Trace:
I20260709 13:11:23.620012 24815 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.721330 24882 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:23.721215 24731 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.764740 24731 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.766742 24731 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.743929 21465 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:23.741809 24870 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:23.768469 24870 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.721012 24804 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:23.772317 24804 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.740404 24934 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:23.775892 24934 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.764182 24815 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:23.727766 24893 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:23.741314 24636 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.786538 24882 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:23.743705 24629 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.003s
I20260709 13:11:23.787703 24629 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.787554 24882 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:23.789858 24629 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:23.757527 22039 rpcz_store.cc:276] 0709 13:11:22.005642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.008774 (+  3132us) service_pool.cc:224] Handling call
0709 13:11:22.039633 (+ 30859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.058388 (+ 18755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.058420 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.068740 (+ 10320us) log.cc:844] Serialized 26 byte log entry
0709 13:11:22.814875 (+746135us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:23.735343 (+920468us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.735623 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.735724 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.735789 (+    65us) raft_consensus.cc:1685] finished
0709 13:11:23.735806 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.735954 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":904450,"prepare.queue_time_us":937097,"raft.queue_time_us":20374,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":15827,"spinlock_wait_cycles":86912,"thread_start_us":696626,"threads_started":1,"wal-append.queue_time_us":773126}
I20260709 13:11:23.747316 24792 consensus_queue.cc:1243] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:23.804757 24892 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:23.805927 24948 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 1.054s	user 0.005s	sys 0.000s
I20260709 13:11:23.805147 24775 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:23.729339 24786 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:23.826046 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.837128 21314 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:23.840770 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:23.841463 21321 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
W20260709 13:11:23.887012 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 278208us
I20260709 13:11:23.751547 24955 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:23.940446 21314 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:23.940991 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:23.941862 21315 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:11:23.972553 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 497634us
I20260709 13:11:23.798331 24893 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:24.016330 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.028656 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55130.5us
I20260709 13:11:24.029719 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1038) took 2037 ms. Trace:
I20260709 13:11:24.032226 21321 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:24.026868 21316 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 5 to 8, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:11:24.055605 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.048965 21361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.004s	sys 0.015s
W20260709 13:11:24.062273 21361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.004s	sys 0.015s
I20260709 13:11:24.030239 22042 rpcz_store.cc:276] 0709 13:11:21.991817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.991954 (+   137us) service_pool.cc:224] Handling call
0709 13:11:21.992341 (+   387us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:22.050902 (+ 58561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.050934 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:22.068525 (+ 17591us) log.cc:844] Serialized 78 byte log entry
0709 13:11:22.206808 (+138283us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:22.232069 (+ 25261us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.634705 (+1402636us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b48000b0ad8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:11:23.691073 (+ 56368us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800410680. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2c2c103c7 00007fc2bf2229a7 00007fc2bf2320bf 00007fc2bf232038
0709 13:11:23.691267 (+   194us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.029089 (+337822us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.029300 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.029401 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.029455 (+    54us) raft_consensus.cc:1685] finished
0709 13:11:24.029473 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.029648 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1474478,"prepare.queue_time_us":1489212,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":83,"raft.queue_time_us":64681,"raft.run_cpu_time_us":14388,"raft.run_wall_time_us":1403300,"spinlock_wait_cycles":10696832,"thread_start_us":432437,"threads_started":2,"wal-append.queue_time_us":198646,"wal-append.run_cpu_time_us":2257,"wal-append.run_wall_time_us":1046561}
I20260709 13:11:24.030357 24790 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:24.073122 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.053536 24955 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:24.108506 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:24.109560 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:24.110582 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:24.111833 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:24.112447 21392 raft_consensus.cc:2376] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7. Re-sending same reply.
W20260709 13:11:24.107394 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48434.4us
I20260709 13:11:24.074709 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.114018 21396 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:24.115962 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.116276 21314 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:24.087291 21388 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:24.121531 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:24.122135 22042 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.124961 21390 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:24.126014 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.126721 21391 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:11:24.131783 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.102929 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:24.132638 21285 connection.cc:256] RPC call timeout handler was delayed by -2.2186630979999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 13:11:24.144485 21285 connection.cc:256] RPC call timeout handler was delayed by -2.1619630980000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 13:11:24.144929 21285 connection.cc:256] RPC call timeout handler was delayed by -2.1502630979999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:11:24.145275 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0899630979999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:11:24.145686 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0791630979999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:11:24.146361 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0557630979999431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:11:24.146804 21285 connection.cc:256] RPC call timeout handler was delayed by -2.045863097999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:11:24.147065 21436 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.120630 24731 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.151561 21469 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:24.153292 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:24.154147 21466 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
W20260709 13:11:24.159931 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 57104.1us
W20260709 13:11:24.147231 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0341630979999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:11:24.166649 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0098630979999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:11:24.167124 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9945630979999578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 13:11:24.167503 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9666630979999127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:11:24.167872 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9153630979999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:11:24.168248 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8919630979999056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 13:11:24.168605 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8217630979999058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 13:11:24.169013 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6723630979998916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 13:11:24.088120 24946 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:24.128096 24815 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:24.181316 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:24.182284 21466 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:24.184762 21467 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:24.206744 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.207692 21391 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:24.214488 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:24.215520 21467 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:24.127561 24845 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:11:24.216424 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 69422.3us
I20260709 13:11:24.108297 24790 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.217864 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:24.169385 21285 connection.cc:256] RPC call timeout handler was delayed by -1.591363097999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:11:24.113935 24782 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:11:24.228456 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46550.5us
I20260709 13:11:24.156556 24696 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:11:24.206529 24946 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.234557 22038 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:24.234905 24696 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.235707 24946 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:24.235908 24459 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:24.276783 22042 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:24.277263 24878 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.277691 24878 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.235015 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:24.280170 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45232.2us
I20260709 13:11:24.281038 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.282238 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:24.283326 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.286180 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.291579 24845 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:24.291978 24845 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:24.292390 24845 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:24.292829 24955 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:24.293258 24955 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.293694 24955 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.294919 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:24.239719 21285 leader_election.cc:400] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 7.
I20260709 13:11:24.174449 24875 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:24.296679 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 67448.1us
I20260709 13:11:24.171736 24629 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:24.298062 24629 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:24.298619 24629 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:24.298691 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.304782 21436 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:24.246248 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2183) took 1079 ms. Trace:
I20260709 13:11:24.248148 24967 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:24.249788 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2180) took 1083 ms. Trace:
I20260709 13:11:24.250149 24786 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:24.216444 24947 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.962s	user 0.005s	sys 0.007s
I20260709 13:11:24.251963 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:24.179903 24731 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.254232 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:24.254781 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46450.1us
I20260709 13:11:24.259199 24893 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:24.187580 24815 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:24.230854 24969 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.007s
I20260709 13:11:24.264752 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:24.270586 24867 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:11:24.271406 24782 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:24.272800 24913 consensus_meta.cc:287] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.021s	user 0.010s	sys 0.002s
I20260709 13:11:24.362319 21321 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:24.286422 24459 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:24.362685 24913 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:24.238018 24896 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.000s	user 0.005s	sys 0.005s
I20260709 13:11:24.286981 24946 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:24.363685 24459 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:24.366568 24459 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:24.289588 24734 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.367761 24734 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:24.280174 24774 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:11:24.305259 24775 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.245425 21461 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:24.368618 21390 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:24.363935 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.369799 21391 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:24.370378 21313 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:24.371151 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:24.306370 21285 leader_election.cc:400] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9.
I20260709 13:11:24.243271 24636 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.313297 21317 rpcz_store.cc:276] 0709 13:11:23.166321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.427630 (+261309us) service_pool.cc:224] Handling call
0709 13:11:23.606462 (+178832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.650576 (+ 44114us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:23.650609 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:23.651040 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.054871 (+403831us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:24.054910 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.054977 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.249597 (+194620us) raft_consensus.cc:1685] finished
0709 13:11:24.249616 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.249737 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52712,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":352987,"threads_started":1,"wal-append.queue_time_us":565169}
I20260709 13:11:24.307546 21320 rpcz_store.cc:276] 0709 13:11:23.167204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.494883 (+327679us) service_pool.cc:224] Handling call
0709 13:11:23.495261 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.495690 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:23.495747 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:23.529570 (+ 33823us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.832193 (+302623us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:23.832244 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.832306 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.246016 (+413710us) raft_consensus.cc:1685] finished
0709 13:11:24.246036 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.246187 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32754,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":302194,"threads_started":1,"wal-append.queue_time_us":714712}
I20260709 13:11:24.319727 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:24.330775 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:24.345785 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 452) took 1395 ms. Trace:
W20260709 13:11:24.374183 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 54550.9us
W20260709 13:11:24.378053 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 47400.3us
I20260709 13:11:24.343135 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:24.380728 24808 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.381430 24808 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.382953 21396 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:24.355265 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.385190 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.386633 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:24.361471 24782 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.394985 24782 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:24.378221 24969 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:24.396070 24969 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:24.397286 24969 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.404290 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:24.405500 24875 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.407123 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:24.373890 22031 rpcz_store.cc:276] 0709 13:11:22.950393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.950523 (+   130us) service_pool.cc:224] Handling call
0709 13:11:22.950811 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.951011 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:24.070070 (+1119059us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.343776 (+273706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:24.343828 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:24.343875 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.345542 (+  1667us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.345712 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":777489,"prepare.queue_time_us":863607,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":1376,"thread_start_us":614034,"threads_started":2}
I20260709 13:11:24.383363 24991 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:24.387970 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.417289 21394 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:24.418718 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.420444 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.421420 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:24.332638 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.424626 24875 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:24.426873 24786 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:24.432937 24786 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:24.434113 24786 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.436363 24875 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:24.437661 24875 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.427546 24885 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:24.441250 24885 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:24.441617 24885 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:24.443008 24885 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.445704 24885 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.435834 24786 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.430042 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:24.458933 24987 raft_consensus.cc:2764] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:24.460440 24987 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:24.329612 24825 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:24.469502 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:24.470381 22042 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:24.335346 24978 raft_consensus.cc:2764] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:24.468122 24896 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.365600 24913 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:24.346336 24815 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:24.344547 24881 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:24.473457 22042 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:24.478376 21392 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [7.8-11.10]
W20260709 13:11:24.488909 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 188980us
I20260709 13:11:24.476552 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:24.521638 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 189095us
I20260709 13:11:24.522696 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:24.523384 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.478082 24636 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:24.476336 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.482384 24459 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:24.528146 21287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.014s	sys 0.020s
W20260709 13:11:24.528503 21287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.014s	sys 0.020s
I20260709 13:11:24.532325 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:24.526643 21387 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:24.537973 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:24.533174 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:24.343605 24947 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.508460 24854 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.472587 24983 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:24.490554 24731 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:24.560127 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:24.525913 24881 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.472095 24774 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.564822 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:24.528002 24978 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:24.588147 24978 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:24.588670 24978 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.591220 24934 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:24.592409 24629 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.566490 24854 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.594529 24629 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:24.596100 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 80364.6us
I20260709 13:11:24.596438 24854 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:24.596911 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:24.598563 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:24.599284 24887 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:24.599610 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.505918 24845 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.571978 22031 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:24.580739 24790 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:24.547432 24884 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:24.584867 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:24.603519 21469 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:24.560240 24696 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:24.622498 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.624302 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:24.636385 22042 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.635983 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.640409 21359 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:24.632817 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.018s	sys 0.051s
I20260709 13:11:24.587281 24459 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:24.613420 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.645558 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.018s	sys 0.051s
I20260709 13:11:24.624336 21388 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:11:24.645911 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 536793us
I20260709 13:11:24.626080 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:24.633204 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.605115 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2014) took 1185 ms. Trace:
I20260709 13:11:24.612689 21393 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:24.632014 21320 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.648409 21319 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.646858 21462 rpcz_store.cc:276] 0709 13:11:23.419388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.515394 (+ 96006us) service_pool.cc:224] Handling call
0709 13:11:23.515705 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.777089 (+261384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:23.777122 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:23.777159 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:23.777189 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.604899 (+827710us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540025b054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:24.604945 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.605062 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578665728}
I20260709 13:11:24.652940 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:24.651695 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:24.652964 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1058) took 1091 ms. Trace:
W20260709 13:11:24.656627 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.674335 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 74782.6us
I20260709 13:11:24.656168 22041 rpcz_store.cc:276] 0709 13:11:23.561320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.562881 (+  1561us) service_pool.cc:224] Handling call
0709 13:11:23.563189 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.563421 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:24.186605 (+623184us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.651817 (+465212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:24.651887 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:24.651946 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.652014 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.652909 (+   895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165363,"prepare.queue_time_us":251420,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"thread_start_us":903361,"threads_started":2}
I20260709 13:11:24.675231 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:24.675256 21467 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:24.674384 21387 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:11:24.677551 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43972.6us
I20260709 13:11:24.679139 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:24.602921 24896 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:24.609186 24878 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:24.602175 24947 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:24.635070 24884 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.647127 24854 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.599901 24887 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.682757 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.685392 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:24.686831 24913 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.638116 24775 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.634876 24774 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:24.714021 22040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.015s	sys 0.049s
I20260709 13:11:24.680645 24459 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:24.727134 22002 leader_election.cc:336] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.974s (SENT)
I20260709 13:11:24.725713 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:24.727777 22040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.015s	sys 0.050s
I20260709 13:11:24.726148 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:24.637923 24696 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.746774 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.747814 21394 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:24.749117 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.729692 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:24.730080 21389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.016s	sys 0.011s
W20260709 13:11:24.750088 21389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.016s	sys 0.011s
I20260709 13:11:24.746960 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.706000 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:24.751799 21464 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:24.687886 24991 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:24.692269 24884 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:24.695154 24472 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:24.777571 24472 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.777856 24734 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:24.752727 24696 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.780054 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:24.781708 25013 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:24.783046 24459 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:24.783607 24459 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:24.784489 24459 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.760406 24991 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.786486 24991 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.787369 24815 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:24.773360 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 67545.5us
I20260709 13:11:24.778131 24472 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:24.788317 24887 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:24.696620 24854 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.771692 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:24.791353 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:24.775600 24629 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:24.794668 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:24.693739 24895 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:11:24.798302 24945 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 13:11:24.805990 25014 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:24.805105 22042 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:24.692409 24955 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:24.790738 24987 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.783875 24636 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:11:24.831259 21319 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:24.828778 21462 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:24.825994 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:24.823968 21320 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
W20260709 13:11:24.841384 21465 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.009s	sys 0.013s
W20260709 13:11:24.853601 21465 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.009s	sys 0.014s
W20260709 13:11:24.854128 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59520.5us
W20260709 13:11:24.842454 24713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.012s	sys 0.024s
I20260709 13:11:24.857156 21468 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:11:24.800673 24878 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:11:24.892582 21470 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:24.882117 24713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.012s	sys 0.024s
I20260709 13:11:24.806353 24792 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:11:24.953936 21998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.018s	sys 0.009s
I20260709 13:11:24.870599 24967 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:24.971668 21998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.019s	sys 0.010s
I20260709 13:11:24.873554 24790 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:24.990478 24629 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.002926 22036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.022s	sys 0.037s
W20260709 13:11:25.006071 22036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.022s	sys 0.038s
I20260709 13:11:24.977998 24945 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:24.865443 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:25.022552 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 157228us
I20260709 13:11:24.969798 24854 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:25.024379 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:25.025028 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 169821us
I20260709 13:11:24.871261 24987 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:24.984345 24845 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:25.052862 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:24.838711 24804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.061s	user 0.007s	sys 0.033s
W20260709 13:11:24.964332 24786 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.002s
I20260709 13:11:25.022876 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1057) took 1461 ms. Trace:
W20260709 13:11:25.029706 24870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.005s	sys 0.018s
W20260709 13:11:25.115428 24870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.005s	sys 0.019s
I20260709 13:11:25.115618 24893 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:25.116330 24893 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.117563 24737 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:25.118084 24737 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:25.119347 24893 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:25.033215 24983 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:25.121583 24983 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.122394 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2179) took 1956 ms. Trace:
I20260709 13:11:25.122925 21313 rpcz_store.cc:276] 0709 13:11:23.166035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.345078 (+179043us) service_pool.cc:224] Handling call
0709 13:11:23.345367 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.466397 (+1121030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.122160 (+655763us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540022ddd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:25.122334 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2356794624}
I20260709 13:11:25.124289 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2197) took 1301 ms. Trace:
I20260709 13:11:24.993603 24790 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:25.124663 21316 rpcz_store.cc:276] 0709 13:11:23.822702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.822854 (+   152us) service_pool.cc:224] Handling call
0709 13:11:23.844365 (+ 21511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.850134 (+  5769us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:24.117482 (+267348us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.638940 (+521458us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.639440 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.639590 (+   150us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:24.639630 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.639709 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.124081 (+484372us) raft_consensus.cc:1685] finished
0709 13:11:25.124108 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.124237 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18878,"raft.queue_time_us":323,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":36961,"thread_start_us":490382,"threads_started":1,"wal-append.queue_time_us":866434}
I20260709 13:11:25.119182 24737 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.054593 24887 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:25.057886 24967 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:25.113718 25016 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:25.143059 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 118748us
I20260709 13:11:25.130858 24790 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.119941 24893 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:25.056258 24913 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:11:25.020877 24945 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:25.010936 24629 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:25.154349 24804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.008s	sys 0.039s
I20260709 13:11:25.146521 24925 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:25.132649 24696 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.152709 25016 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:25.181123 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.021s	sys 0.042s
W20260709 13:11:25.181932 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.021s	sys 0.042s
W20260709 13:11:25.182926 22038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.031s	sys 0.077s
W20260709 13:11:25.183272 22038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.032s	sys 0.078s
I20260709 13:11:25.183753 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 864) took 1112 ms. Trace:
W20260709 13:11:25.177842 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 482052us
W20260709 13:11:25.178555 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 428232us
I20260709 13:11:25.184204 22039 rpcz_store.cc:276] 0709 13:11:24.071849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.107277 (+ 35428us) service_pool.cc:224] Handling call
0709 13:11:24.109211 (+  1934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.312378 (+203167us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:24.312407 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.341467 (+ 29060us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.886634 (+545167us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:24.886681 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.886789 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.183540 (+296751us) raft_consensus.cc:1685] finished
0709 13:11:25.183559 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.183696 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139532,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":585377,"threads_started":2,"wal-append.queue_time_us":785777}
W20260709 13:11:25.186403 21395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.057s	sys 0.056s
W20260709 13:11:25.186810 21395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.057s	sys 0.056s
I20260709 13:11:25.149039 24887 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:25.192955 24978 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.000s
I20260709 13:11:25.194048 24978 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.151513 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:25.216599 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:25.222188 24808 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:25.223536 24987 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:25.229596 24696 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:25.240810 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:25.245499 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 94096.4us
I20260709 13:11:25.182140 25016 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.247874 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:25.234499 24881 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 13:11:25.257340 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:25.261736 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:25.263029 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:25.263880 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2021) took 1112 ms. Trace:
I20260709 13:11:25.233134 24925 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:25.264325 21465 rpcz_store.cc:276] 0709 13:11:24.151297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.151405 (+   108us) service_pool.cc:224] Handling call
0709 13:11:24.185954 (+ 34549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.186170 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:24.854067 (+667897us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.263499 (+409432us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:25.263556 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:25.263616 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.263691 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.263821 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11686,"prepare.queue_time_us":70343,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":1018157,"threads_started":2}
W20260709 13:11:25.262127 25020 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:11:25.256733 24804 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:25.278247 24925 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:25.281718 25026 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:11:25.265698 24886 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:25.263412 24967 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:25.268462 24964 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:25.266191 24978 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:25.264272 24815 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:25.265733 24845 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.267009 25035 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:25.315791 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 52731.6us
I20260709 13:11:25.317371 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 553) took 1066 ms. Trace:
I20260709 13:11:25.321346 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:25.322291 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.282629 24804 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.322971 21315 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:25.319536 21391 rpcz_store.cc:276] 0709 13:11:24.251242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.264482 (+ 13240us) service_pool.cc:224] Handling call
0709 13:11:25.317178 (+1052696us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b54002ce054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:25.317318 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56266112}
I20260709 13:11:25.256953 24945 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.289377 24887 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:25.296885 24886 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:25.300233 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 186033us
W20260709 13:11:25.326524 25023 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:11:25.323261 24815 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.291283 24786 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:11:25.325713 24885 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.877s	user 0.012s	sys 0.000s
I20260709 13:11:25.330549 24804 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:25.279454 25032 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:11:25.318830 25033 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:25.335791 24332 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.336124 24967 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:25.365294 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 101070us
I20260709 13:11:25.323549 24845 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.342317 24886 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.346720 24887 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:25.381641 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 867) took 1266 ms. Trace:
I20260709 13:11:25.383296 22040 rpcz_store.cc:276] 0709 13:11:24.114786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.114930 (+   144us) service_pool.cc:224] Handling call
0709 13:11:24.121982 (+  7052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.127240 (+  5258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.127284 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.142515 (+ 15231us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.751085 (+608570us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:24.751120 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.751191 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.381314 (+630123us) raft_consensus.cc:1685] finished
0709 13:11:25.381337 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.381553 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4855,"raft.queue_time_us":127013,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":53,"thread_start_us":566681,"threads_started":1,"wal-append.queue_time_us":828469}
I20260709 13:11:25.388422 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.389389 21465 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:25.390273 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.391135 21461 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:25.391770 24629 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:25.264896 24881 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.370872 24332 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.346100 24774 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:11:25.393668 24774 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:25.394073 24774 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:25.395910 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 1997) took 1314 ms. Trace:
I20260709 13:11:25.396597 21389 rpcz_store.cc:276] 0709 13:11:24.081636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.082862 (+  1226us) service_pool.cc:224] Handling call
0709 13:11:24.112389 (+ 29527us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:24.112742 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.112770 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:24.124520 (+ 11750us) log.cc:844] Serialized 52 byte log entry
0709 13:11:24.750440 (+625920us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:24.771047 (+ 20607us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.793899 (+ 22852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.793972 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.395603 (+601631us) raft_consensus.cc:1685] finished
0709 13:11:25.395633 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.395832 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22608,"prepare.queue_time_us":20420,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":26078,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":14613,"thread_start_us":566313,"threads_started":1,"wal-append.queue_time_us":864298}
I20260709 13:11:25.399349 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2001) took 1300 ms. Trace:
I20260709 13:11:25.399794 21395 rpcz_store.cc:276] 0709 13:11:24.098962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.099107 (+   145us) service_pool.cc:224] Handling call
0709 13:11:24.121483 (+ 22376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.129945 (+  8462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.129978 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.606150 (+476172us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b180033e020. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a
0709 13:11:24.606566 (+   416us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:24.607026 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:11:25.187227 (+580201us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:25.187271 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.187335 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.399075 (+211740us) raft_consensus.cc:1685] finished
0709 13:11:25.399103 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.399279 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":602,"raft.queue_time_us":1157,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":4974,"spinlock_wait_cycles":31616128,"thread_start_us":579865,"threads_started":1,"wal-append.queue_time_us":716753}
I20260709 13:11:25.409034 24734 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:25.409543 24734 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:25.413141 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2004) took 1311 ms. Trace:
I20260709 13:11:25.413589 21393 rpcz_store.cc:276] 0709 13:11:24.102085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.102219 (+   134us) service_pool.cc:224] Handling call
0709 13:11:24.102497 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.649264 (+546767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.412923 (+763659us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54001c4654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:25.413083 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172771072}
I20260709 13:11:25.425328 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.441602 21318 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:25.442122 21318 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:25.355085 24815 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.449788 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:25.443089 21318 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.450804 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:25.454631 21318 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.424649 24887 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:25.457268 24786 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:25.479928 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.005s	sys 0.027s
W20260709 13:11:25.480458 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.005s	sys 0.027s
W20260709 13:11:25.480803 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 926577us
I20260709 13:11:25.481648 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:25.488781 24713 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:25.494277 24734 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.495071 25039 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:25.495577 24713 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:25.496161 24885 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:25.496557 24885 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:25.496829 24774 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.497390 24885 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.497901 24825 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:25.498521 24825 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.496570 24713 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.266702 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:25.518635 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.521325 24887 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.495769 24734 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:25.472371 24786 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:25.539188 24786 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.125883 22036 rpcz_store.cc:276] 0709 13:11:23.561019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.563523 (+  2504us) service_pool.cc:224] Handling call
0709 13:11:23.563826 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.564046 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:24.142776 (+578730us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.021200 (+878424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:25.021288 (+    88us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:25.021351 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.022629 (+  1278us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.022797 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182625,"prepare.queue_time_us":251017,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":28,"raft.queue_time_us":11630,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":86008,"thread_start_us":1255406,"threads_started":2}
I20260709 13:11:25.604899 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:25.608212 25045 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:25.609006 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 287707us
I20260709 13:11:25.611553 21317 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:11:25.612058 21317 pending_rounds.cc:85] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 4
I20260709 13:11:25.612331 21317 pending_rounds.cc:107] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:11:25.612563 21317 raft_consensus.cc:2889] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:25.614769 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:25.616319 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.617008 21321 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:25.608817 25045 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.622145 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.622833 21317 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:25.623507 25045 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:25.625182 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.627471 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.627691 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:25.629370 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:25.629989 21461 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.630843 24881 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:25.632501 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.623816 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.635102 21388 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:25.635665 21316 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:25.636664 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:25.637682 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.639340 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.612815 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:25.642149 21318 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:11:25.642562 21318 pending_rounds.cc:85] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 5
I20260709 13:11:25.642768 21318 pending_rounds.cc:107] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:11:25.639987 21321 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:25.642978 21318 raft_consensus.cc:2889] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:25.643702 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:25.644448 21321 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:25.645149 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.646118 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.633960 24885 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:25.647277 25045 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:25.647868 25045 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.648368 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.649112 21464 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:25.649957 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.650691 21464 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:25.651494 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.652107 21466 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:11:25.652516 21466 pending_rounds.cc:85] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 4
I20260709 13:11:25.652783 21466 pending_rounds.cc:107] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:11:25.652633 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.653136 21466 raft_consensus.cc:2889] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:25.653862 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.654578 21466 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:25.656893 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 175365us
I20260709 13:11:25.657363 24986 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:25.657696 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:25.659228 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:25.655947 21466 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:25.664259 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.657878 24986 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:25.669898 21467 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:25.666570 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.667186 21321 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:25.669145 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:25.605154 24774 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.668779 21360 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:25.667109 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54372.5us
I20260709 13:11:25.672238 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:25.672827 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:25.677138 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:25.677480 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.678260 21318 raft_consensus.cc:2368] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10.
I20260709 13:11:25.674809 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:25.680470 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.682925 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:25.682336 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.656912 24786 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.687469 21466 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:25.683598 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 78793.3us
I20260709 13:11:25.665997 24983 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:25.613283 24934 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:11:25.674443 24816 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:25.673730 24986 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:25.692169 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:25.674839 24629 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:25.690006 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:25.692977 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.693725 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.693845 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.686540 25047 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.676411 24731 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:25.705433 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.693985 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:25.690562 24966 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:25.713634 21466 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:25.692674 24878 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:25.763713 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:25.673869 24977 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:25.698069 24816 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.691421 25049 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:25.694650 24947 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:25.778844 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 84925.6us
I20260709 13:11:25.801539 21461 raft_consensus.cc:2410] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:25.802018 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:25.683928 24854 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:11:25.696655 24909 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:11:25.694510 24870 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:11:25.803737 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:25.849325 22038 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:25.755263 24867 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:25.792192 24816 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:25.834885 24934 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:25.835285 25065 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.832984 25071 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:25.692601 24786 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.735288 24629 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:25.698182 25039 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:11:25.782794 24966 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.738372 24814 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:11:25.882594 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:25.785580 24925 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:25.792312 24845 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:25.832923 21314 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:25.801026 24808 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:25.894279 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:25.702696 24910 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:11:25.850375 25048 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:25.913096 24946 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:25.939272 24946 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:25.925417 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.668s (SENT)
I20260709 13:11:25.947566 24875 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:25.947932 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:25.949762 24934 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:25.886575 24815 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:25.890650 24713 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:25.948679 24817 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:25.776415 25047 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:25.951524 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 57339us
I20260709 13:11:25.922962 24966 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:25.953516 24991 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.167s	user 0.014s	sys 0.005s
I20260709 13:11:25.898509 25045 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:25.956319 21469 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:11:25.925266 24884 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.127s	user 0.009s	sys 0.014s
W20260709 13:11:25.920962 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 248196us
I20260709 13:11:25.913380 24629 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:25.954265 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:25.936991 24472 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.090s	user 0.015s	sys 0.002s
I20260709 13:11:25.884922 24867 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:25.899679 24881 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:25.948117 24875 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:25.990258 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.990232 24878 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:25.961743 24845 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.019311 24881 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:26.022125 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 220171us
I20260709 13:11:26.024101 24881 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:26.011890 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.964568 24817 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:26.025354 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.983057 24991 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.957942 25048 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:26.034534 25051 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:11:26.034621 24991 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.036798 24786 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.040957 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:25.959986 24808 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.976756 24925 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:25.957746 24713 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.067236 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.069905 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:26.072075 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.072870 21314 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:11:26.078945 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 409839us
I20260709 13:11:26.039680 24946 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:25.990785 24472 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.087218 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.047077 24845 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.094203 25077 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.094786 25077 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:25.989168 24884 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.097223 25077 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:26.097782 24825 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.010s
I20260709 13:11:26.098421 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:26.098238 24825 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.062481 24881 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:11:26.101143 21465 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:26.102197 25054 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:11:26.103056 24825 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:26.104523 25073 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.103662 24884 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.105129 25047 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.053236 25058 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:11:26.106536 25058 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:26.106896 25058 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:26.080224 24878 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:26.081655 24886 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.011s
I20260709 13:11:26.112480 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.069015 24925 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:26.125768 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.075395 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:26.133145 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 57824us
I20260709 13:11:26.119824 21314 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:26.128298 21315 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:26.136209 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.144912 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.146140 24887 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:26.147928 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.151576 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.155041 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.157128 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.157667 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:26.158802 21315 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:26.159830 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:26.163717 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:26.168285 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.169971 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.184859 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.130170 25045 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:26.150162 24925 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.187515 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:26.150487 25077 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:26.159871 25071 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:26.186391 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.162225 24775 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:26.211155 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.213366 21393 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:26.183261 24938 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.107597 25058 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.217656 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.218493 21391 raft_consensus.cc:2410] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:26.183432 24814 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.197505 24910 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.224817 24910 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.227000 25062 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.227521 25062 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.228762 24808 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.229938 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.231061 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.231559 21396 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:26.232717 24734 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.687s	user 0.003s	sys 0.008s
I20260709 13:11:26.233691 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.236624 24934 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:26.236989 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.237777 24713 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.238358 24814 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.091665 24875 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.149405 24886 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.246799 24886 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.247589 21316 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:26.217103 24885 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:26.248719 24885 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.215103 21394 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:26.251462 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.252471 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.180356 24881 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:26.253404 24881 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:26.253796 24881 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:26.219179 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.256641 21390 raft_consensus.cc:2368] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:11:26.256672 21389 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:26.257473 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.220487 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.221122 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.257962 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.258769 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.224257 25015 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.259646 21395 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:26.217296 24817 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.261487 21396 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:26.258015 21390 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.287243 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:26.272960 24774 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.588s	user 0.002s	sys 0.007s
W20260709 13:11:26.278807 25059 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:11:26.227650 24629 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.317410 21395 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:26.318014 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.318136 25062 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:26.215009 21314 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:26.325587 21394 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:26.373329 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.373476 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.193039 25045 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.377764 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.378964 21389 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:26.382145 21396 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:26.383306 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.289130 25058 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.291836 24886 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:26.307780 25015 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:26.391678 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:26.392483 21388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2008) took 1770 ms (client timeout 1855 ms). Trace:
I20260709 13:11:26.395541 24845 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.396284 24955 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.403365 25043 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:26.272640 24816 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.401047 21394 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:26.380403 25065 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:26.308216 24775 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:26.418550 25016 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.151s	user 0.006s	sys 0.011s
W20260709 13:11:26.460261 21388 rpcz_store.cc:269] 0709 13:11:24.622347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.651373 (+ 29026us) service_pool.cc:224] Handling call
0709 13:11:26.392265 (+1740892us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54000ac8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:26.392411 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651039616}
I20260709 13:11:26.276103 24966 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.476213 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:26.491319 22038 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.477135 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:26.492388 22036 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:26.493570 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:26.495301 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:26.478979 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:26.481582 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:26.497256 22039 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:26.487102 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.498144 21395 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:26.499662 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.488497 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.502707 21388 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:26.315809 24938 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:11:26.489905 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:26.503827 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.506100 21391 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:26.511942 21285 leader_election.cc:400] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:11:26.461840 25043 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:26.517784 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.525367 21392 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:26.516425 21285 leader_election.cc:403] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:26.520888 25035 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.183s	user 0.011s	sys 0.007s
W20260709 13:11:26.527791 24986 consensus_meta.cc:287] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.000s
I20260709 13:11:26.532509 21313 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:26.511202 25073 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:26.535064 21314 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:26.474396 24886 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.543416 21312 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:26.507078 25016 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:26.539769 24804 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.167s	user 0.011s	sys 0.007s
W20260709 13:11:26.547084 25074 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:26.491125 24775 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.554306 24886 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.556305 25011 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:26.556716 25069 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.178s
I20260709 13:11:26.558593 25072 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:26.559231 25043 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.561295 24966 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.566406 21390 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:26.529095 25035 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:26.538173 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.587333 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.619879 22040 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:26.619800 21463 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:26.567108 25045 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.636934 21395 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:26.541422 24986 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.638141 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 482) took 1020 ms. Trace:
I20260709 13:11:26.638250 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.641079 21388 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
W20260709 13:11:26.643481 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56273.4us
I20260709 13:11:26.646683 21470 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:26.638653 21321 rpcz_store.cc:276] 0709 13:11:25.617942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.789311 (+171369us) service_pool.cc:224] Handling call
0709 13:11:25.789724 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.186497 (+396773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.188313 (+  1816us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.190022 (+  1709us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.314962 (+124940us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:26.381178 (+ 66216us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.381517 (+   339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.381597 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.637939 (+256342us) raft_consensus.cc:1685] finished
0709 13:11:26.637958 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.638083 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138687,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":1229,"raft.queue_time_us":132724,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":29385,"spinlock_wait_cycles":3328,"thread_start_us":507203,"threads_started":2,"wal-append.queue_time_us":293690}
I20260709 13:11:26.649780 22038 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
W20260709 13:11:26.650274 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 196043us
W20260709 13:11:26.651466 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.529327 25070 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:11:26.652261 22039 raft_consensus.cc:2410] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:26.652177 21463 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:26.654098 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.660537 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 492) took 3858 ms. Trace:
I20260709 13:11:26.667816 21463 rpcz_store.cc:276] 0709 13:11:22.802474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.127513 (+325039us) service_pool.cc:224] Handling call
0709 13:11:23.128668 (+  1155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.540671 (+412003us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b4c001302c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bd4e4a20 00007fc2bd4f5a29 00007fc2bd4bb644 00007fc2bd4e2f2d 00007fc2bd4e2b93 00007fc2bf21318b 00007fc2bf213cb5 00007fc2bf20ef30 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416
0709 13:11:24.600948 (+1060277us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b58008a4dd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4
0709 13:11:26.619434 (+2018486us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b58008a50d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4
0709 13:11:26.660280 (+ 40846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.660473 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449370112}
I20260709 13:11:26.661245 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:26.645833 25043 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.578943 24804 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.672941 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.678648 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 479) took 1061 ms. Trace:
I20260709 13:11:26.679212 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 478) took 1062 ms. Trace:
W20260709 13:11:26.672117 24844 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:11:26.681409 21318 rpcz_store.cc:276] 0709 13:11:25.616923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.764595 (+147672us) service_pool.cc:224] Handling call
0709 13:11:25.800306 (+ 35711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.044381 (+244075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.044430 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.045015 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.525985 (+480970us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:26.530744 (+  4759us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.538999 (+  8255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.539071 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.679002 (+139931us) raft_consensus.cc:1685] finished
0709 13:11:26.679022 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.679141 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17,"raft.queue_time_us":144051,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":21276,"thread_start_us":692095,"threads_started":2,"wal-append.queue_time_us":578545}
I20260709 13:11:26.651472 24967 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:26.680764 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.685263 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.644212 25069 consensus_queue.cc:1243] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:26.683425 21320 rpcz_store.cc:276] 0709 13:11:25.617147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.776293 (+159146us) service_pool.cc:224] Handling call
0709 13:11:25.800931 (+ 24638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.045342 (+244411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.045391 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.059268 (+ 13877us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.315220 (+255952us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:26.678122 (+362902us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.678347 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.678419 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.678457 (+    38us) raft_consensus.cc:1685] finished
0709 13:11:26.678470 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.678591 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66685,"prepare.queue_time_us":191534,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":150240,"spinlock_wait_cycles":10164224,"thread_start_us":689002,"threads_started":3,"wal-append.queue_time_us":451435}
I20260709 13:11:26.688361 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.658836 25045 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:26.657783 25080 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:11:26.690491 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.673019 24629 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.706809 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.679248 25035 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:26.709278 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1633) took 1064 ms. Trace:
I20260709 13:11:26.710976 21317 raft_consensus.cc:2368] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8.
I20260709 13:11:26.680528 24472 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:26.713819 21388 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:26.717367 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:26.717964 21388 raft_consensus.cc:2376] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11. Re-sending same reply.
I20260709 13:11:26.684670 24983 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.699074 25086 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:11:26.698006 24790 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.520s	user 0.013s	sys 0.005s
I20260709 13:11:26.658039 25078 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:11:26.698231 24845 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:26.697288 24986 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.690876 24955 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:26.696847 24867 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:26.713407 21467 rpcz_store.cc:276] 0709 13:11:25.645278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.690794 (+ 45516us) service_pool.cc:224] Handling call
0709 13:11:25.697997 (+  7203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.758046 (+ 60049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.758096 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.758677 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.001232 (+242555us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:26.071447 (+ 70215us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.071663 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.071740 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.708985 (+637245us) raft_consensus.cc:1685] finished
0709 13:11:26.709013 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.709195 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72793,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":7117,"raft.queue_time_us":88641,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":19511,"thread_start_us":143998,"threads_started":1,"wal-append.queue_time_us":514718}
I20260709 13:11:26.691125 24459 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:26.680222 24964 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:26.715466 24816 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:26.689198 25032 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:26.721618 24925 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:11:26.715142 25033 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:26.718961 24792 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:26.715018 24967 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:26.698122 25077 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:11:26.711963 25045 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.760874 24893 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:26.762625 24955 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:26.737506 24845 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.764052 24459 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.773909 25033 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.769002 24964 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:26.721323 25062 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:11:26.776666 25085 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:11:26.734794 24790 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.773502 25032 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:26.899756 24955 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.735049 24983 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.888461 24967 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:26.905119 25033 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:26.917415 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1634) took 1271 ms. Trace:
I20260709 13:11:26.917711 25045 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:26.919426 24881 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.000s
I20260709 13:11:26.920483 21461 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:26.922163 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.776399 24925 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.892669 24792 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:26.925717 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.736905 24875 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:26.929872 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.903134 24459 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:26.899300 24893 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.913429 25049 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:26.902966 25016 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:26.902530 24845 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:26.932307 24629 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:26.939874 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:26.944494 21359 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:26.951366 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2041) took 1322 ms. Trace:
I20260709 13:11:26.938122 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:26.962533 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.968160 21318 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:11:27.043262 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.939361 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:26.938685 24878 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:26.961261 24629 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:26.941093 24967 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.050876 24629 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.050716 24967 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.051182 24814 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:27.042168 25100 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:26.959173 25049 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.052793 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2232) took 1085 ms. Trace:
I20260709 13:11:27.053234 21312 rpcz_store.cc:276] 0709 13:11:25.967536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.193406 (+225870us) service_pool.cc:224] Handling call
0709 13:11:26.543233 (+349827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.543810 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.052549 (+508739us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54003c91d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.052726 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685651712}
I20260709 13:11:27.054631 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:26.957463 25101 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:26.940635 24925 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:26.941284 24792 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.945405 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:27.060956 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 115617us
I20260709 13:11:26.969132 21320 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.950462 25032 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:26.956688 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:26.937696 21466 rpcz_store.cc:276] 0709 13:11:25.645822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.689535 (+ 43713us) service_pool.cc:224] Handling call
0709 13:11:25.689813 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.781621 (+ 91808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.917118 (+1135497us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b540042fed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:26.917348 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54317824}
I20260709 13:11:27.065351 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.066619 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:26.968924 21465 rpcz_store.cc:276] 0709 13:11:25.628906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.633758 (+  4852us) service_pool.cc:224] Handling call
0709 13:11:25.634058 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.101512 (+467454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.951116 (+849604us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b5400217d54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:26.951303 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073654528}
I20260709 13:11:27.075212 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.037706 24816 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:27.086901 21320 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:11:26.954562 25071 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.000s
I20260709 13:11:27.044962 25073 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:26.954589 24870 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:26.955916 24737 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:26.947233 24804 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.091771 24870 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.097750 24870 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.100956 24844 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:27.101727 25071 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:27.105966 25058 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.000s
I20260709 13:11:27.106513 24696 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.106698 21321 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:27.107025 24696 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.109020 24790 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.109105 22041 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:27.109870 22041 pending_rounds.cc:85] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 8
I20260709 13:11:27.110148 22041 pending_rounds.cc:107] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:27.110656 22041 raft_consensus.cc:2889] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.067896 25101 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.111336 25068 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.071766 25011 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:11:27.137074 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:27.070854 24629 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:26.954082 24893 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.145861 21313 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:27.101737 24844 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:26.946518 24881 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.151928 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2042) took 1502 ms. Trace:
I20260709 13:11:27.152403 21461 rpcz_store.cc:276] 0709 13:11:25.649721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.804276 (+154555us) service_pool.cc:224] Handling call
0709 13:11:26.920145 (+1115869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.937276 (+ 17131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.151725 (+214449us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540042fed0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.151868 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565677824}
I20260709 13:11:27.163193 24332 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.163784 24885 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.137883 25073 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.165189 24893 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:27.143589 25068 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.173920 24893 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.176340 24893 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.178361 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:27.179201 21465 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:27.178278 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:27.180696 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 105562us
I20260709 13:11:27.176832 25101 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.181664 25101 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.182137 24910 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.183739 25101 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.179857 25058 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.184301 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:27.185047 21461 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:27.184690 25058 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.185706 25048 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.186826 25058 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.187213 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 875) took 1505 ms. Trace:
I20260709 13:11:27.192498 22040 rpcz_store.cc:276] 0709 13:11:25.681744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.681894 (+   150us) service_pool.cc:224] Handling call
0709 13:11:27.187042 (+1505148us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54006c5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.187156 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2095750016}
I20260709 13:11:27.187595 25073 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.187578 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.176687 24844 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.195559 24844 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.196533 24978 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:27.196946 24978 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:27.197574 24870 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.198053 24844 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.197795 24978 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.199023 24978 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.173380 24845 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:27.201444 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2035) took 1574 ms (client timeout 2098 ms). Trace:
W20260709 13:11:27.201857 21470 rpcz_store.cc:269] 0709 13:11:25.627046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.627189 (+   143us) service_pool.cc:224] Handling call
0709 13:11:27.201264 (+1574075us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001a7cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.201381 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342396288}
I20260709 13:11:27.204316 24845 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.205570 21387 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:27.194674 21436 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.207299 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.209534 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.214003 22039 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:27.215471 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.199791 24870 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.222472 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.216115 22031 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:27.223402 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:27.219236 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.221691 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.225687 21284 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.223438 22040 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.215420 24845 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:27.232175 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.235001 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.235773 22039 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:11:27.211328 24893 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:27.233371 25071 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:27.221756 24844 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:27.221485 25048 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:27.244506 21284 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:27.244685 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:27.238380 25011 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:27.245520 21312 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:27.245746 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:27.248267 24844 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:27.249264 24844 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.253604 24955 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.254593 25033 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.235061 25101 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:27.256328 25101 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.256688 25101 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:27.259712 24893 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.261727 24977 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.240123 25062 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:27.261883 24893 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.262483 25062 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:27.262238 24977 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.260845 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2013) took 1039 ms. Trace:
I20260709 13:11:27.264190 24945 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.261037 25048 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.241533 24804 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:11:27.267489 24804 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:27.267601 24816 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:27.267868 24804 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:27.260907 25095 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:27.268545 25095 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.268687 24816 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.263424 25062 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.271018 25095 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.272172 25048 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:27.273325 21360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.098s (SENT) [suppressed 12 similar messages]
I20260709 13:11:27.274112 21393 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:27.245859 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:27.266417 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 297672us
I20260709 13:11:27.266491 25071 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:27.268805 24804 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.276230 21388 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [7.8-11.10]
I20260709 13:11:27.259895 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1624) took 1046 ms. Trace:
I20260709 13:11:27.280820 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:27.264192 21392 rpcz_store.cc:276] 0709 13:11:26.220995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.258533 (+ 37538us) service_pool.cc:224] Handling call
0709 13:11:27.260587 (+1002054us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540017ded4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.260774 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611163520}
I20260709 13:11:27.278914 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:27.286518 21320 raft_consensus.cc:2410] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:27.287281 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:27.287871 21320 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:27.288720 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:27.291358 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.285331 21387 rpcz_store.cc:276] 0709 13:11:26.213768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.213887 (+   119us) service_pool.cc:224] Handling call
0709 13:11:27.259715 (+1045828us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54003f5054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.259836 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233636096}
I20260709 13:11:27.288832 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:27.292778 22036 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:27.293044 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:27.255784 24955 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.294188 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:27.228657 24459 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.298494 24804 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:27.264694 24893 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.300304 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:27.281154 25058 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:27.287760 24885 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.306092 24881 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.285284 24845 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.306257 25011 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:27.307870 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.285403 24792 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:27.349366 22038 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.308322 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:27.310851 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:27.347805 22040 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:27.332832 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:27.294425 24977 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.338063 22036 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:27.284409 21436 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:27.338830 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.356438 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 72142.2us
I20260709 13:11:27.348664 21392 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:27.352449 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:27.360939 21387 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:27.281407 25071 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:27.357249 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:27.353343 25011 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:27.375195 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.355142 24955 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.357501 24792 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.355134 25103 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:27.370252 24977 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:27.373317 25032 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:27.370437 25071 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.349865 24885 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.354053 25058 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.366362 22038 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:27.373989 25011 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.355963 24845 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.382658 25033 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:27.477548 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.720841 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.590111 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 316782us
I20260709 13:11:27.384431 25103 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.385946 25032 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.384928 24881 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:27.732688 24881 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.734530 25011 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.373239 24964 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.696286 25077 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:27.698544 25101 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.736457 25077 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.701715 24955 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:27.705459 24845 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.706629 24986 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.708076 25058 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.711287 24885 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.712505 24459 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:27.703109 25049 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.650s	user 0.018s	sys 0.022s
I20260709 13:11:27.697664 24792 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.388150 24977 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:27.737823 25101 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.735882 24881 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.738220 25032 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:27.745250 24986 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.746063 25077 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.747037 25011 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.749367 25049 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.758188 25049 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.760447 24977 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.747308 25103 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.748777 25071 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.768455 24964 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:27.787712 24978 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.010s
I20260709 13:11:27.789671 25071 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.746685 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:27.831230 21318 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:27.712989 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:27.831307 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 84561.4us
I20260709 13:11:27.834630 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:27.839565 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.841325 24854 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:27.732865 21390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:27.849287 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.849897 25011 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:27.850577 22036 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.851122 25011 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:27.854315 25049 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.855269 25049 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.859439 25011 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:27.860870 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.870579 25049 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.872093 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:27.874290 21317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 477) took 2257 ms (client timeout 2062 ms). Trace:
W20260709 13:11:27.874781 21317 rpcz_store.cc:269] 0709 13:11:25.616685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.673551 (+ 56866us) service_pool.cc:224] Handling call
0709 13:11:27.873820 (+2200269us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b540022d8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.874072 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175477120}
I20260709 13:11:27.877905 21315 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:27.877693 25032 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.878324 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2025) took 1559 ms. Trace:
W20260709 13:11:27.878501 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.878871 21394 rpcz_store.cc:276] 0709 13:11:26.318721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.375928 (+ 57207us) service_pool.cc:224] Handling call
0709 13:11:26.400657 (+ 24729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.472457 (+ 71800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.877758 (+1405301us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54000ac8d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.878004 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55169920}
I20260709 13:11:27.880940 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 490) took 2259 ms. Trace:
I20260709 13:11:27.881379 24977 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:27.882675 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:27.882929 24977 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.884647 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:27.885599 21317 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:27.885818 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2215) took 1876 ms. Trace:
I20260709 13:11:27.886291 21313 rpcz_store.cc:276] 0709 13:11:26.009754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.669815 (+660061us) service_pool.cc:224] Handling call
0709 13:11:26.674141 (+  4326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.146293 (+472152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.885168 (+738875us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400229054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:27.885648 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084320640}
I20260709 13:11:27.887027 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:27.888535 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:27.888010 21317 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:27.890002 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1080) took 1999 ms. Trace:
I20260709 13:11:27.893973 21313 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:27.881497 21315 rpcz_store.cc:276] 0709 13:11:25.621195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.164576 (+543381us) service_pool.cc:224] Handling call
0709 13:11:27.877286 (+1712710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.878394 (+  1108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.880634 (+  2240us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540022d8d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:27.880834 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644876160}
I20260709 13:11:27.904901 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.904919 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.906292 22032 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:27.906376 21313 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:27.903417 22041 rpcz_store.cc:276] 0709 13:11:25.889998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.890117 (+   119us) service_pool.cc:224] Handling call
0709 13:11:25.899416 (+  9299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.111145 (+1211729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.889355 (+778210us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540053cfd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:27.889764 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781214592}
I20260709 13:11:27.925024 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.926005 22042 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:27.927534 24986 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.934886 22036 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:27.938285 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:27.935695 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.941329 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.931833 24977 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:27.942268 25010 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:27.944962 25010 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:27.946417 25010 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:27.957301 25035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.007s	sys 0.004s
I20260709 13:11:27.961239 22034 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:27.950215 25032 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:27.968351 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.984556 22041 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:27.971851 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.975101 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.985678 22031 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.976444 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:27.977252 21313 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.977690 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:27.982954 25035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.008s	sys 0.004s
I20260709 13:11:27.973546 24986 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:27.988168 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.991736 24986 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:27.995761 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:27.996788 22042 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.000118 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2234) took 2030 ms. Trace:
I20260709 13:11:28.000644 21319 rpcz_store.cc:276] 0709 13:11:25.969092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.394342 (+425250us) service_pool.cc:224] Handling call
0709 13:11:26.394720 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.405257 (+ 10537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.405318 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:26.405376 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:26.405421 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.999605 (+1594184us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b54000fc654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:27.999698 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.999897 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23694592}
I20260709 13:11:28.002803 21319 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:27.973577 24983 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.005939 21314 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:28.006060 22039 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:28.005914 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:28.014125 21314 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:28.005599 22035 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:28.004498 22034 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:28.020308 25035 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:28.024938 21319 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:28.028505 24737 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:28.030426 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:28.031332 21314 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.033130 21314 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.027241 25035 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:28.034891 25096 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.130s	user 0.001s	sys 0.000s
I20260709 13:11:28.037492 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2022) took 1719 ms. Trace:
I20260709 13:11:28.040105 21319 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.013245 25068 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:28.053241 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47691.4us
I20260709 13:11:28.054144 24737 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:28.055186 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:28.051108 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:28.058247 25032 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:28.058730 25032 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:28.059125 25032 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.060495 25118 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:28.061007 25118 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.061473 25118 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.061681 21464 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:28.063814 21470 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:28.064232 24983 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:28.064517 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2199) took 2087 ms. Trace:
I20260709 13:11:28.065073 24983 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.064976 21316 rpcz_store.cc:276] 0709 13:11:25.977396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.565736 (+588340us) service_pool.cc:224] Handling call
0709 13:11:26.566053 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.566434 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.566469 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.566938 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.733011 (+166073us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:26.733049 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.733121 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.033917 (+1300796us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:28.056241 (+ 22324us) raft_consensus.cc:1685] finished
0709 13:11:28.056266 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.064356 (+  8090us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1310,"spinlock_wait_cycles":8829184,"thread_start_us":110794,"threads_started":1,"wal-append.queue_time_us":192933}
I20260709 13:11:28.066771 24737 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:28.067191 24737 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:28.067404 24629 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.067610 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.068161 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:28.068689 21461 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:28.068450 24737 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.070086 24737 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:28.070200 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.070719 24775 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:28.071007 21466 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.044634 21391 rpcz_store.cc:276] 0709 13:11:26.317754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.318460 (+   706us) service_pool.cc:224] Handling call
0709 13:11:26.318760 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.515604 (+196844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.036818 (+1521214us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540020e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:28.037233 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430401920}
I20260709 13:11:28.065328 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.068944 21316 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:28.074994 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.075799 21462 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:28.079759 22031 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:28.083027 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.087649 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.088425 21465 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:28.090420 21467 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:28.091105 21390 raft_consensus.cc:606] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:28.091526 21390 raft_consensus.cc:614] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:28.091972 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2211) took 2107 ms. Trace:
I20260709 13:11:28.092397 21321 rpcz_store.cc:276] 0709 13:11:25.984169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.657962 (+673793us) service_pool.cc:224] Handling call
0709 13:11:26.658287 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.107264 (+448977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.091547 (+984283us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54000fb754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:28.091784 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030101760}
I20260709 13:11:28.094801 22042 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:28.094972 24986 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.071959 24629 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:28.096817 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 775550us
W20260709 13:11:28.100622 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 770554us
I20260709 13:11:28.101692 21320 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.105926 21467 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:11:28.106400 21467 pending_rounds.cc:85] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 4
I20260709 13:11:28.106670 21467 pending_rounds.cc:107] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:11:28.106956 21467 raft_consensus.cc:2889] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:28.108397 24788 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:28.112988 24816 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:28.113493 24816 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:28.114569 24816 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.117213 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.117801 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.118615 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.119082 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.119567 21463 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:28.119650 21468 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:28.121220 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.125217 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.128978 21470 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:28.130348 24910 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.118629 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.135285 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.136329 25125 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:28.136482 24983 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.131807 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.147156 24636 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:28.150384 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:28.152089 25062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.000s	sys 0.011s
I20260709 13:11:28.120496 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:28.154289 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.137403 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:28.179369 21319 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:28.106684 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:28.111630 24786 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:11:28.202310 21464 raft_consensus.cc:2410] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:28.203526 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.204133 21465 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:28.177624 25062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.001s	sys 0.011s
I20260709 13:11:28.204916 21466 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:28.212296 21470 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:28.234814 21320 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:28.240794 21469 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:28.236819 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.213860 25068 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.245137 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.246838 21315 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:28.199334 25118 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:28.252441 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 145956us
I20260709 13:11:28.243407 24816 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.249159 21390 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:28.254932 21318 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:28.251971 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:28.211927 24636 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.266768 21465 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.273454 21470 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:28.274981 24696 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.275350 24775 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.275043 24788 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:28.276304 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.276018 24775 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:28.277581 21216 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 184) took 26636 ms (client timeout 15000 ms). Trace:
I20260709 13:11:28.278379 24775 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:28.280218 24814 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:28.284240 21463 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:28.259337 25068 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.257715 25125 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.290609 25125 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.291481 25068 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:28.295198 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.296104 21470 raft_consensus.cc:2368] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:11:28.296501 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.296752 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.297039 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.297610 21470 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:28.297789 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.297940 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.298837 21470 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:28.299645 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.305481 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.305634 24636 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:28.307484 25118 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.243155 24910 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:28.275074 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 100553us
W20260709 13:11:28.314064 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46142.2us
I20260709 13:11:28.317931 24788 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:28.318739 24910 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.319435 24910 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:28.320220 21469 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 13. Ops: []
I20260709 13:11:28.319810 24910 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:28.334024 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:28.328760 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 122245us
I20260709 13:11:28.329876 24731 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:28.332301 24893 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.332935 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:28.333122 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.340523 21469 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:28.337996 21468 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:28.333732 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:28.322597 24814 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:28.346493 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.347383 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.346895 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.352582 21463 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:11:28.353449 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.358331 21470 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:28.358893 21465 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:28.344424 24893 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.362188 21462 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:28.343819 25125 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.356652 25077 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.377312 21466 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:28.377636 25077 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.380239 24893 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:28.380335 25077 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.381223 25125 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.382411 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:28.383450 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:28.383692 25125 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.387121 21314 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:11:28.389487 21314 pending_rounds.cc:85] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 4
I20260709 13:11:28.387384 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:28.344415 24910 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:28.396440 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50370.9us
I20260709 13:11:28.398613 24893 raft_consensus.cc:2764] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:11:28.277967 21216 rpcz_store.cc:269] 0709 13:11:01.641449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.643820 (+  2371us) service_pool.cc:224] Handling call
0709 13:11:28.277319 (+26633499us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:19.101169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:19.101875 (+   706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:19.101925 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:11:19.101943 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:19.103278 (+  1335us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:19.103364 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:19.103392 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:11:19.124660 (+ 21268us) tablet.cc:701] Row locks acquired
0709 13:11:19.124712 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:11:19.124881 (+   169us) write_op.cc:270] Start()
0709 13:11:19.125165 (+   284us) write_op.cc:276] Timestamp: P: 1783602679124815 usec, L: 0
0709 13:11:19.125184 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:19.125888 (+   704us) log.cc:844] Serialized 5682 byte log entry
0709 13:11:20.308138 (+1182250us) op_driver.cc:464] REPLICATION: finished
0709 13:11:20.484269 (+176131us) write_op.cc:301] APPLY: starting
0709 13:11:20.484371 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:20.484675 (+   304us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:20.484810 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:20.486484 (+  1674us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:20.486817 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:11:20.486859 (+    42us) write_op.cc:312] APPLY: finished
0709 13:11:20.487224 (+   365us) log.cc:844] Serialized 101 byte log entry
0709 13:11:20.552100 (+ 64876us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:20.557422 (+  5322us) write_op.cc:454] Released schema lock
0709 13:11:20.568129 (+ 10707us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:20.625912 (+ 57783us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:20.627483 (+  1571us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3147247,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":169092,"apply.run_cpu_time_us":4273,"apply.run_wall_time_us":104449,"num_ops":14,"prepare.queue_time_us":238637,"prepare.run_cpu_time_us":92283,"prepare.run_wall_time_us":404258,"raft.queue_time_us":199308,"raft.run_cpu_time_us":10551,"raft.run_wall_time_us":189204,"replication_time_us":1170410,"thread_start_us":742139,"threads_started":4,"wal-append.queue_time_us":456040,"wal-append.run_cpu_time_us":27594,"wal-append.run_wall_time_us":1901038}]]}
I20260709 13:11:28.405225 21314 pending_rounds.cc:107] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:11:28.403607 24910 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.399731 24731 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:28.412675 24731 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.412997 25133 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:28.412753 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:28.413532 25133 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.413300 24896 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:28.414003 25133 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.414178 24885 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:28.414520 24896 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:28.416329 24786 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:28.416663 24885 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:28.416779 24786 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:28.417127 24885 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:28.418046 24786 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.418321 24885 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.419508 24786 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:28.420174 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51895.1us
I20260709 13:11:28.422744 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:28.405959 21314 raft_consensus.cc:2889] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:28.408939 24814 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.403607 24969 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:28.425426 21470 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [5.4-8.5]
I20260709 13:11:28.412606 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.447698 24885 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:28.462410 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61333.3us
I20260709 13:11:28.413313 24731 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:28.472357 25136 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:11:28.461707 25049 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.474659 24629 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.406930 25032 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:28.618863 24886 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:11:28.624557 21316 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:28.621668 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:28.626530 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:28.626853 22040 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:28.627815 24875 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:28.628263 24875 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:28.628633 24875 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.629472 25032 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.630295 21467 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:28.415904 24896 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.638293 24636 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:11:28.645576 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 238019us
I20260709 13:11:28.646350 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:28.646553 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:28.646679 25133 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.647980 22032 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:28.649169 25133 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.649892 25133 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:28.650264 25133 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.650646 25133 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.652273 25073 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.646382 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:28.654044 25032 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:11:28.654312 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.655704 22040 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:28.656247 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.656622 24893 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.657274 21396 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:28.657318 24893 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:28.655746 25121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.005s	sys 0.010s
W20260709 13:11:28.660343 25121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.005s	sys 0.011s
I20260709 13:11:28.664131 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.664455 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:28.665191 21396 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:28.665859 24910 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.668023 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:28.669165 21314 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:28.647624 24875 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.675112 24875 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.679270 25049 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.708887 25118 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:28.710114 25035 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:11:28.717934 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.718623 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.739349 21463 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:28.739394 21470 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:28.719224 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.719313 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.740722 25035 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:28.719588 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:28.741577 21466 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:28.761849 25035 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:28.764967 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.783841 21396 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:28.789876 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 166541us
W20260709 13:11:28.792883 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 141333us
W20260709 13:11:28.794270 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 141991us
W20260709 13:11:28.796766 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.796806 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:28.797345 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.797719 21316 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:28.802416 21467 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:28.804634 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.805388 21461 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
W20260709 13:11:28.807837 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 161548us
I20260709 13:11:28.788805 24893 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.763844 25035 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.796981 24886 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.820091 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.820801 21467 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:28.781045 25073 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.824553 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:28.829252 21316 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:28.819063 25139 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.835870 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:28.822515 25077 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:28.838260 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:28.843447 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:28.827870 25010 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.832962 24881 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:28.844894 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:28.845711 22002 leader_election.cc:336] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.770s (SENT)
I20260709 13:11:28.824146 24886 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.848194 25068 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:28.854825 25068 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:28.854737 25010 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.854880 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:28.856020 25068 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.836829 24893 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.857316 25010 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:28.858047 25010 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.857779 24893 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.857352 25068 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.861614 24886 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.862219 24886 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.862751 24886 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.858621 25010 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.865602 25010 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:28.868307 25035 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.873899 25073 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.833285 25139 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.878609 25139 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.846065 25077 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.880972 24731 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.883234 24731 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:28.883929 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.884578 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:28.884971 24737 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.814s	user 0.015s	sys 0.010s
I20260709 13:11:28.885313 21312 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:28.885985 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:28.885555 21218 catalog_manager.cc:5697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.886528 21314 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.886655 21316 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:28.888423 21313 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:28.888779 21317 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:11:28.889431 24910 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:28.890022 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 58174.6us
I20260709 13:11:28.890837 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:28.891518 25125 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:28.891842 24875 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.892436 24875 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.894402 24875 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:28.895004 24731 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:28.897312 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.897461 24910 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:28.898154 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:28.899907 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:28.900921 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:28.901707 21396 raft_consensus.cc:606] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:28.901947 25118 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.902112 21396 raft_consensus.cc:614] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:28.902417 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64966.9us
I20260709 13:11:28.902465 25118 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:28.903162 25118 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.902537 24629 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:28.903923 24629 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:28.853984 21466 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
W20260709 13:11:28.905354 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.907061 24629 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.910848 24731 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.916755 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:28.917405 21396 raft_consensus.cc:606] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:28.920136 21314 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:28.887858 21218 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 5, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 5 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.912410 24893 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:28.929998 22041 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:28.930823 22032 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:28.916818 25032 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 13:11:28.938374 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 135337us
I20260709 13:11:28.926901 25049 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.941008 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.943468 21391 raft_consensus.cc:2368] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:11:28.941736 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:28.944377 22041 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:28.948331 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.949019 21396 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:28.950161 21394 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:11:28.950703 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 141920us
I20260709 13:11:28.945724 24731 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:11:28.961885 21997 leader_election.cc:400] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:11:28.961575 24737 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:28.963366 24737 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:28.963749 24737 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:28.964023 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:28.964377 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.964766 21394 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.964690 24737 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.974737 21391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:28.975358 21391 raft_consensus.cc:606] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:28.975795 21391 raft_consensus.cc:614] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:28.977316 24737 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:28.978504 24896 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:28.983106 25133 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.985737 25077 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:28.939945 25032 consensus_queue.cc:1243] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:28.988214 24731 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:28.989055 24731 consensus_queue.cc:1243] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:28.990772 24875 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:28.991178 24875 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:28.992240 24875 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:28.993551 24875 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.993885 21393 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:28.995359 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.997579 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.998155 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:28.985577 21218 catalog_manager.cc:5697] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:28.998823 21393 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:11:28.923390 25035 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:11:29.010566 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.011430 24886 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:29.011982 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.012324 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.012809 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.013734 21392 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [5.4-8.5]
I20260709 13:11:29.014009 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.014374 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.016944 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:28.975063 25118 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:28.937628 24910 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:11:29.058030 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:29.023700 21390 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:11:29.026701 21395 raft_consensus.cc:606] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:29.058749 22032 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:29.035051 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.036948 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.037657 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.038661 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.059785 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:29.040880 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.060544 22042 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:29.042353 24886 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:29.043064 25133 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:29.070364 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.043107 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:29.043529 21396 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:29.054098 25118 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:29.054975 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 103586us
I20260709 13:11:29.058876 21395 raft_consensus.cc:614] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:29.082005 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:29.036217 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.009549 21394 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:29.064811 22040 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:29.060133 21388 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:29.056459 21218 catalog_manager.cc:5697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 6, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 6 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.080704 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:29.084519 24886 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.085516 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.086730 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.087147 24886 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:29.082741 21392 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:29.087735 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.088649 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:29.094185 24786 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.094812 24786 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.096441 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.097105 24786 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:29.097276 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.097944 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:29.098857 25032 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:29.099347 25032 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:29.101487 24731 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:29.101930 24731 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:29.102813 24731 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.104727 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:29.106770 25139 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:29.107190 25139 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.107533 25139 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.088066 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.101516 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:29.108440 21389 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.110416 24816 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:29.111894 24867 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:29.136933 24867 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:29.131516 25032 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.111966 24969 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:29.138164 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.138527 24969 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.138959 24969 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.139398 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.117684 25125 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:29.141041 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:29.141718 22038 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:29.134472 21394 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:29.112219 25133 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:11:29.087774 24886 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:29.143924 24731 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.144021 25133 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:29.136503 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 54623.1us
I20260709 13:11:29.144742 25133 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:29.145346 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:29.145936 25133 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.147169 25133 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:29.137482 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:29.143348 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.148209 25118 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.148689 24737 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:29.148921 25118 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:29.149209 24737 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:29.149245 21218 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 5, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 5 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.150502 25118 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:29.150362 24737 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.127664 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:29.151134 25118 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:29.137928 24867 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.126156 21388 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.157542 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:29.144003 24886 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.171193 21393 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
W20260709 13:11:29.182476 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.197099 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.197407 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.198832 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:29.203630 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 71189.7us
I20260709 13:11:29.150455 25139 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.206489 21389 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:29.206699 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.211057 21396 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:29.207340 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:29.211220 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.208689 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:29.212634 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55167.1us
I20260709 13:11:29.215627 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.195569 24886 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.219933 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.235368 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.236466 21393 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:29.237506 21394 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:29.220793 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:29.224234 25125 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:29.224961 24629 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:29.204401 25062 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.226118 21391 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:29.226542 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.227466 21218 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 8, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 8 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.228780 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:29.245750 21319 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:29.229274 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:29.245887 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:29.229851 24867 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.241302 21321 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:29.243816 21392 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:29.248970 21316 raft_consensus.cc:2410] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:29.251478 21218 catalog_manager.cc:5697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:29.249600 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 345553us
I20260709 13:11:29.206355 24786 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:29.259292 21394 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:29.261188 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.218677 25144 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:29.278909 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:29.280045 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:29.286598 21218 catalog_manager.cc:5697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.252130 25077 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:29.290930 21391 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:29.292661 21387 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:11:29.275699 25073 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.294757 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:29.299623 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 256647us
W20260709 13:11:29.293977 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46814.7us
I20260709 13:11:29.286161 25144 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:29.218079 25118 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.292775 25125 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:11:29.304278 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 83554.6us
W20260709 13:11:29.306349 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.274865 25146 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:29.293047 25077 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:29.306824 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45624.3us
I20260709 13:11:29.317170 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:29.276443 25049 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:11:29.324249 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.301566 25062 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.330536 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:29.294864 24786 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.310747 25144 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.317011 25077 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:29.352573 21319 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:29.355181 25161 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:29.355690 25161 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:29.356046 25161 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:29.356750 25118 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:29.357674 24786 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:29.313098 25125 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:29.353488 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:29.353111 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:29.361195 21218 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 7 to 8, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 8 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:29.304966 25073 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.330525 24629 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:29.327330 25148 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:29.373451 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:29.391173 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:29.330024 25010 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:11:29.347003 24896 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:11:29.384447 24629 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.385133 24875 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:29.340903 25062 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:29.418411 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 69605.9us
I20260709 13:11:29.419363 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:29.422062 25165 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:29.422606 25165 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.423007 25165 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:29.426256 25173 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.432646 25173 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:29.437132 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:29.370724 25146 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.438417 25149 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:29.397949 25160 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:29.442972 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:29.411911 24731 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.416144 25035 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:29.417387 24629 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:29.456540 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:29.459479 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.461755 25155 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:11:29.463407 25164 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:11:29.469987 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:29.485062 25062 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:29.438179 25174 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:11:29.485526 25032 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.485872 25062 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:29.486385 25062 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:29.489095 25149 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:29.489506 25149 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.489574 25073 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:29.489977 25149 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:29.490223 25073 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:29.491153 25158 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:29.491710 25158 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.493199 21218 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 3 to 4, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 4 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.494012 25146 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:29.448553 25125 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.494797 25146 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:29.495391 25125 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.450227 25035 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.496788 25035 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.446429 25139 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:29.501096 25139 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:29.501695 24875 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:29.502214 24875 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.503661 24816 raft_consensus.cc:993] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:11:29.504223 24816 raft_consensus.cc:1081] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:11:29.505311 25010 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:29.505851 25010 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.464780 24731 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.495110 21218 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 6 to 7, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 7 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:29.523495 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 84583.9us
W20260709 13:11:29.527742 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 197226us
I20260709 13:11:29.534606 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:29.535596 21390 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:29.536226 22034 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:11:29.524750 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 139497us
I20260709 13:11:29.537281 21388 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:29.495488 25146 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.458443 25160 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:29.487340 25062 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.494040 25158 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:29.548396 21218 catalog_manager.cc:5697] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 3, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 3 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.555018 22042 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:29.553766 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:29.542019 24737 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:29.564626 21317 pending_rounds.cc:85] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 3
I20260709 13:11:29.565476 21317 pending_rounds.cc:107] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:29.566572 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:29.570638 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:29.569144 21317 raft_consensus.cc:2889] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.549139 25148 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:29.574503 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.574764 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.575227 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.580402 21462 raft_consensus.cc:2376] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10. Re-sending same reply.
I20260709 13:11:29.580765 21465 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:29.575165 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.571283 22034 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:29.582515 25176 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.584486 25176 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.585136 25010 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:29.585457 25181 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.585973 25181 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.587499 25176 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:29.590016 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.590564 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.591974 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.564996 24737 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:29.595108 21466 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:29.592943 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.601460 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:29.603550 21463 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:11:29.604477 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 253748us
I20260709 13:11:29.590193 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.579972 24893 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:29.613828 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.607225 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:29.614774 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:29.615965 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.616241 21462 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:29.617319 25146 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:29.617836 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.630013 21461 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:29.618423 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.552762 25165 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:29.619796 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.634495 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:29.591080 25181 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:29.638751 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:29.639645 22042 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:29.639827 21320 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:29.641098 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.643649 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.578752 25161 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.641868 21463 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:29.644361 21464 raft_consensus.cc:2376] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10. Re-sending same reply.
I20260709 13:11:29.623363 24893 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:29.649011 21469 raft_consensus.cc:2368] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:29.638628 24816 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:29.649950 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.634356 24867 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:11:29.638435 25144 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.660130 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.657873 21463 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:29.695304 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:29.696259 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63028us
I20260709 13:11:29.654819 22034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42342
I20260709 13:11:29.710602 22034 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.711210 22034 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.639344 25118 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:11:29.656919 25181 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:29.660746 24816 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:29.658623 25176 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:29.715723 21318 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:11:29.697804 25151 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:29.724545 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.727487 21470 raft_consensus.cc:2376] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11. Re-sending same reply.
I20260709 13:11:29.730836 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:29.742162 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.693466 25148 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.644224 25160 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.753376 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:29.754952 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:29.755945 25171 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.713562 24731 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:29.743073 21470 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
W20260709 13:11:29.760597 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.726171 24816 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:29.756006 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:29.803583 21461 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:29.736508 24886 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.810446 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.662062 24737 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.804169 22034 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:29.784960 25184 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:11:29.834714 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 220001us
I20260709 13:11:29.769336 25165 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:29.793116 25118 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:29.862368 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.756639 25183 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:29.739058 25181 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.739467 25176 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.756536 25189 raft_consensus.cc:2764] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:11:29.888772 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 132874us
I20260709 13:11:29.851413 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:29.897876 22034 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:29.907126 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.911561 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:29.818794 25035 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:29.862147 25118 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:29.897436 25133 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.003s
I20260709 13:11:29.764408 24893 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:29.953630 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:29.891626 25169 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.954438 21466 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:29.959483 21465 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:11:29.960749 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:29.980669 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 85825.9us
I20260709 13:11:29.981679 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:29.965191 25146 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.993463 21470 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:11:29.998028 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.000938 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:30.001545 21390 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:29.962925 25169 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.001850 21390 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:30.002640 21390 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.003523 21390 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:30.003880 25169 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:29.940201 24875 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.010049 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:29.973132 25161 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:29.983021 24893 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:29.976918 25189 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:30.054927 25198 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.055187 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:30.055874 22031 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:30.031324 24867 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.056463 24867 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.058696 24867 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:30.063346 25191 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:11:30.042382 25144 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.065156 25181 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:30.066083 24629 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.002s
I20260709 13:11:30.066661 25176 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:30.066488 24629 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:30.069209 25077 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.677s	user 0.008s	sys 0.003s
I20260709 13:11:30.069754 25172 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:30.070569 25133 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.070305 25172 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.071020 25133 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.073045 25035 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:30.073645 25125 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 13:11:30.073982 21464 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:11:30.074208 25149 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.008s
I20260709 13:11:30.074589 25149 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.075261 21464 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:30.076103 25188 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:30.076646 25149 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:30.076712 25188 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.016563 25118 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.079687 25188 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.030700 25186 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:30.116407 25133 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.120880 24629 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:30.126164 24816 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.126597 22042 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:30.127416 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:30.092301 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 82356.9us
I20260709 13:11:30.017639 24885 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:29.959108 25171 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:11:30.095793 24969 consensus_meta.cc:287] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.956s	user 0.010s	sys 0.001s
I20260709 13:11:30.066085 24886 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:30.097745 21461 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:30.069114 25139 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.099848 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:30.071918 21462 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:30.147825 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:30.106348 21390 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:30.016180 25180 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.069764 25077 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:30.132934 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.133875 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:30.134162 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:30.160348 22034 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:30.160571 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:30.161964 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:30.162941 25199 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:30.163251 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:30.093081 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.135070 21467 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
W20260709 13:11:30.142732 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 288481us
W20260709 13:11:30.146675 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.164551 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:30.152740 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:30.166527 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:30.167193 24893 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.167316 25186 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:30.167696 24893 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.168499 25010 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:30.168944 25010 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:30.169114 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:30.169317 25010 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:30.169791 24893 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.170360 22040 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:30.170436 25181 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:30.171011 25181 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:30.158167 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 146556us
I20260709 13:11:30.163401 25199 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:30.172228 25183 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:30.172329 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.172559 25199 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:30.172797 25183 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:30.173041 21316 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:30.173997 22034 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:30.173797 25183 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.175719 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.176479 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.177035 21312 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:30.177909 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.005249 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.180172 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:30.181033 22041 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:30.185719 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:30.190845 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 91048.8us
I20260709 13:11:30.200014 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:30.201522 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 196360us
I20260709 13:11:30.202443 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:30.203810 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:30.178812 24814 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:30.280771 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.215741 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:30.244864 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:30.244717 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44812.3us
I20260709 13:11:30.245266 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:30.190045 24885 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:30.305199 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 89561us
I20260709 13:11:30.327282 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.306525 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.329227 21320 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:30.306037 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.204236 24893 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:30.192396 24629 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:30.159722 24969 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.309027 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.309428 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.333397 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.315415 21316 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:30.318699 24786 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:30.334218 21320 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:30.198264 25173 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:30.214972 25188 raft_consensus.cc:2764] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:11:30.340298 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47513.4us
I20260709 13:11:30.244072 25158 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:30.244134 24816 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:30.204871 25202 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:30.397775 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56006.7us
I20260709 13:11:30.289005 25165 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:30.183766 25139 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.418701 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.386878 25190 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:30.427541 21389 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
I20260709 13:11:30.513736 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 584) took 1358 ms. Trace:
I20260709 13:11:30.514252 25200 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:30.514324 21389 rpcz_store.cc:276] 0709 13:11:29.155413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.210914 (+ 55501us) service_pool.cc:224] Handling call
0709 13:11:30.513530 (+1302616us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002e40d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:30.513663 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795157760}
I20260709 13:11:30.515851 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.516687 21313 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:30.303903 25133 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.426415 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.335273 25068 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:30.332973 24629 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.335469 24814 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:30.435105 21315 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:30.438292 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:30.327100 25172 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:30.322959 25010 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:30.439934 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 250666us
I20260709 13:11:30.483862 24332 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:30.506194 21321 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:11:30.478219 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 233078us
I20260709 13:11:30.484357 25178 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:30.486878 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.534724 21320 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:30.478053 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.438287 25158 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:30.486965 24893 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:30.512285 24969 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:30.524610 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.437487 25202 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:30.426388 25188 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:11:30.535826 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:30.536051 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 97854us
I20260709 13:11:30.546186 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:30.546356 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:30.546558 25209 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:11:30.547672 25210 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:11:30.548153 24881 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:30.548754 24881 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:30.549145 24881 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:30.551097 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 124770us
I20260709 13:11:30.548091 25149 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:30.553617 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.538597 24885 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.554551 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2257) took 1005 ms. Trace:
I20260709 13:11:30.555109 21314 rpcz_store.cc:276] 0709 13:11:29.548903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.549044 (+   141us) service_pool.cc:224] Handling call
0709 13:11:29.556467 (+  7423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.901419 (+344952us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:29.962171 (+ 60752us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.179860 (+217689us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.180329 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.180447 (+   118us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:30.180477 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.180539 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.554361 (+373822us) raft_consensus.cc:1685] finished
0709 13:11:30.554382 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.554499 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9646,"prepare.queue_time_us":41033,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":79686,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":21830,"thread_start_us":486413,"threads_started":2,"wal-append.queue_time_us":351495}
I20260709 13:11:30.426265 25181 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.539211 21313 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:30.560070 25197 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:30.544934 24893 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.563187 24893 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:30.563313 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2256) took 1017 ms. Trace:
I20260709 13:11:30.543951 21316 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:30.563776 21319 rpcz_store.cc:276] 0709 13:11:29.547341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.551738 (+  4397us) service_pool.cc:224] Handling call
0709 13:11:29.552097 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.915609 (+363512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.915672 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.958599 (+ 42927us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.090684 (+132085us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b4800380358. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:11:30.174842 (+ 84158us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:30.174880 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.174938 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.562936 (+387998us) raft_consensus.cc:1685] finished
0709 13:11:30.562963 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.563251 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10579,"raft.queue_time_us":77298,"raft.run_cpu_time_us":5333,"raft.run_wall_time_us":461088,"spinlock_wait_cycles":3795200,"thread_start_us":544623,"threads_started":2,"wal-append.queue_time_us":318061}
I20260709 13:11:30.554023 25062 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:30.553776 25149 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:30.568974 25149 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.524374 25068 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.524164 24629 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:30.553192 25139 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:30.572350 21316 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:30.536520 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.576161 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.577636 21312 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:30.580308 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:30.540122 25204 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.588718 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 382388us
I20260709 13:11:30.594095 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:30.542639 25178 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:30.528512 25133 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.609369 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:30.612449 22034 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:30.548282 25125 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:11:30.572620 25202 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:30.610276 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 64009us
I20260709 13:11:30.621953 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:30.623569 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:30.615573 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.575280 25068 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:30.616088 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:30.616791 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.626433 21320 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:30.617784 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 82030.4us
I20260709 13:11:30.578709 25189 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:30.614706 25188 consensus_queue.cc:1243] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:30.621059 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:30.628599 22039 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:30.641891 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.629487 25212 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:30.639154 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:30.624954 24786 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.629880 25182 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:30.631249 25217 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:30.631625 24814 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:30.632438 22041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1109) took 1350 ms (client timeout 1583 ms). Trace:
W20260709 13:11:30.660418 22041 rpcz_store.cc:269] 0709 13:11:29.282451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.283185 (+   734us) service_pool.cc:224] Handling call
0709 13:11:30.632262 (+1349077us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54005055d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:30.632362 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516489600}
I20260709 13:11:30.660975 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.633877 25218 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.636430 25178 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.638028 25010 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.613713 25169 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:30.624581 22002 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.603s (SENT)
I20260709 13:11:30.645133 22034 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:30.639842 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:30.650311 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 76689.4us
W20260709 13:11:30.712908 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 88407.9us
I20260709 13:11:30.714190 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.648379 24893 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:30.650153 24896 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:30.650801 21321 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:30.622001 25077 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:30.556478 25158 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.633625 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 531) took 1039 ms. Trace:
I20260709 13:11:30.661773 21312 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:30.661895 21320 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:30.631276 25118 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:30.741200 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.741936 21320 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:30.646070 25212 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:30.659897 24786 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.716358 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.717511 25125 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.737275 21467 rpcz_store.cc:276] 0709 13:11:29.593813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.606852 (+ 13039us) service_pool.cc:224] Handling call
0709 13:11:30.633474 (+1026622us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54003f07d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:30.633559 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062774656}
I20260709 13:11:30.611008 25204 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.738175 25197 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.736230 24896 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.711371 25068 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.738099 25161 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.753558 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.757495 21320 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:30.746796 25186 consensus_meta.cc:287] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.577s	user 0.000s	sys 0.010s
I20260709 13:11:30.758456 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:30.735481 25035 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:11:30.745849 25212 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:30.746157 25169 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:30.751101 25173 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.738533 25176 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:11:30.766755 21359 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:30.749872 24893 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:30.771263 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.751662 25221 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.763855 25161 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.764249 25186 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:30.792161 25172 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:30.792887 21316 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:30.794250 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 166521us
I20260709 13:11:30.707844 25218 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.767326 24881 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.772871 25170 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.774364 25223 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.769874 24867 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:30.806420 24881 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:30.806831 24867 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:30.765586 25183 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:11:30.807797 24867 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.775508 24875 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:30.809772 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.810433 21320 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:11:30.764417 25197 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:30.812196 25213 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.267s	user 0.003s	sys 0.000s
I20260709 13:11:30.813233 25197 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.815181 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2251) took 1273 ms. Trace:
I20260709 13:11:30.815428 24786 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:30.761562 25190 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:11:30.776433 25133 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:30.776870 25169 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.755968 24896 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:30.781991 25068 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:30.786425 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.768976 25199 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.003s
I20260709 13:11:30.805151 25170 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.805893 25223 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.869511 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:30.870458 21390 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:30.870174 25199 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.871505 25223 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.872330 25199 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.873001 21319 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:30.873850 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 77800.7us
I20260709 13:11:30.873936 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:30.874285 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:30.869400 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:30.860842 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:30.861158 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:30.861515 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:30.862010 21997 leader_election.cc:336] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.623s (SENT)
I20260709 13:11:30.863336 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:30.877106 21395 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:30.869614 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:30.869386 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:30.875981 21387 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:30.828610 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.876474 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.889016 21360 leader_election.cc:400] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:30.889503 21360 leader_election.cc:403] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:11:30.815586 21317 rpcz_store.cc:276] 0709 13:11:29.541472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.550253 (+  8781us) service_pool.cc:224] Handling call
0709 13:11:29.564431 (+ 14178us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:30.081662 (+517231us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b1800032320. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf210bfb 00007fc2bf21b64b
0709 13:11:30.081794 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.081820 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:30.082377 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 13:11:30.154611 (+ 72234us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:30.154649 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.154736 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.811616 (+656880us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:30.814934 (+  3318us) raft_consensus.cc:1685] finished
0709 13:11:30.814956 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.815120 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16671,"raft.queue_time_us":75046,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12335,"spinlock_wait_cycles":102677120,"thread_start_us":137515,"threads_started":2,"wal-append.queue_time_us":395095}
I20260709 13:11:30.797539 25172 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:30.892092 21391 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:30.868796 21312 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:30.893148 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:30.895159 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:30.818549 25161 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:30.909394 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:30.912688 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:30.890044 24875 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:30.909394 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:30.909718 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:30.911213 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49255.6us
I20260709 13:11:30.912763 21465 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:30.918519 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:30.927837 22034 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:30.917870 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:30.897919 25148 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.933759 22035 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:30.933588 25148 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.934926 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:30.935369 21393 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:30.935689 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:30.917495 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:30.937566 21462 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:30.937659 24875 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.940889 24875 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:30.936147 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:30.944806 21393 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:30.936389 21394 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:30.949890 21394 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:11:30.955580 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 80537.9us
I20260709 13:11:30.956353 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:30.804452 25202 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.960629 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:30.961243 22034 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:30.961380 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:30.962031 21469 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:30.896853 25181 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.957399 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.973542 21315 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
I20260709 13:11:30.957525 21313 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:30.961541 21467 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:30.956945 21997 leader_election.cc:400] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
I20260709 13:11:30.975206 21997 leader_election.cc:403] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:30.815951 24629 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:30.966460 21463 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:30.955358 25223 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:30.962261 21462 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:30.974638 21313 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:30.969130 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.979773 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:30.956704 25161 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.991364 22036 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:30.994686 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:30.963750 25062 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:30.992686 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:31.040378 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53427.6us
I20260709 13:11:30.995333 21318 raft_consensus.cc:2376] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11. Re-sending same reply.
I20260709 13:11:30.989852 21313 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:31.051123 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:30.969709 24731 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 13:11:31.165037 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 113997us
I20260709 13:11:30.988591 25179 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
W20260709 13:11:31.255095 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.259416 21313 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:30.978528 25181 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:31.276296 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.289304 21395 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:30.975957 24885 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 13:11:31.050206 25149 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:31.303541 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:30.978893 24816 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.204s
I20260709 13:11:30.983587 24896 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:30.997344 25170 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:31.325467 21387 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:30.998087 25161 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:31.314949 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 421828us
I20260709 13:11:31.268800 25204 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:31.269213 25133 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:31.407891 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.408517 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:30.992671 24893 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:31.410174 25230 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:11:31.356668 25149 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.412541 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:31.412988 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.306151 24731 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:31.414369 21320 raft_consensus.cc:2376] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11. Re-sending same reply.
I20260709 13:11:31.432471 25245 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.408664 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:31.339897 25221 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:31.417932 21389 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:31.410926 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:31.419454 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:31.374729 24969 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
W20260709 13:11:31.436524 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.437718 22002 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.040s (SENT)
I20260709 13:11:31.423514 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:31.413806 25133 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.435647 25221 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:31.438364 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:31.435293 21387 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.163900 25172 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.415858 25170 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.424477 24731 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.427573 25188 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:31.439729 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 447093us
I20260709 13:11:31.426617 25149 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.435243 21395 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.452713 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.463277 21318 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:31.433382 25245 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:31.445797 25133 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.476575 21387 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:31.447571 25068 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:31.497861 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:31.461269 24731 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.493640 21395 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:31.509652 24731 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.511493 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.513988 21318 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:31.499014 24896 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:31.519642 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:31.498142 25068 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.463205 25188 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.453593 25179 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:11:31.530310 21313 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.462906 25170 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:31.520888 25203 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.180s	user 0.008s	sys 0.008s
W20260709 13:11:31.533267 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 123787us
I20260709 13:11:31.542201 21387 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:31.518514 25205 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:31.545253 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.546175 21318 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:31.536237 25068 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.537259 25188 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.540269 25223 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:31.544009 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:31.553752 25170 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:31.519357 25237 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.541s	user 0.001s	sys 0.000s
W20260709 13:11:31.548319 25243 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:11:31.540362 25202 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:31.559185 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:31.560014 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 122335us
I20260709 13:11:31.560791 25223 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:31.561601 25238 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:11:31.562083 25232 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:11:31.565265 25139 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:31.566850 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:31.568110 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:31.572194 21318 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
I20260709 13:11:31.577502 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:31.572365 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.521703 25221 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:31.557734 25218 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:31.601305 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:31.601794 21313 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:31.569096 25181 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:31.568627 25241 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.578071 21318 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:11:31.568964 25035 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:31.580971 25212 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
I20260709 13:11:31.613428 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:31.613770 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2078) took 2028 ms. Trace:
I20260709 13:11:31.617542 21396 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:31.614737 22035 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:31.618731 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.618916 21318 raft_consensus.cc:2376] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11. Re-sending same reply.
W20260709 13:11:31.620007 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 122246us
I20260709 13:11:31.620087 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.580319 25223 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:31.625170 21395 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:31.616613 21468 rpcz_store.cc:276] 0709 13:11:29.575575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.589349 (+ 13774us) service_pool.cc:224] Handling call
0709 13:11:29.604177 (+ 14828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.635675 (+ 31498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.635721 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.642918 (+  7197us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.006955 (+364037us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:30.007008 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.007095 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.402256 (+1395161us) spinlock_profiling.cc:243] Waited 85.4 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:31.601061 (+198805us) raft_consensus.cc:1685] finished
0709 13:11:31.601084 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.604194 (+  3110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9540,"raft.queue_time_us":16722,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2062,"spinlock_wait_cycles":196465920,"thread_start_us":290953,"threads_started":1,"wal-append.queue_time_us":523907}
W20260709 13:11:31.617651 25118 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.874s	user 0.011s	sys 0.000s
W20260709 13:11:31.627553 21394 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.003s	sys 0.004s
I20260709 13:11:31.575923 25139 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:11:31.628638 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.897s (SENT)
I20260709 13:11:31.615125 25169 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:31.614586 25181 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:31.628684 21394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.003s	sys 0.004s
I20260709 13:11:31.620426 25221 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.615943 25218 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.634635 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.635036 21395 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:31.640936 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:31.641495 22035 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.642949 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:31.643579 22034 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:31.620317 25212 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.639732 25218 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:31.646147 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:31.646950 21396 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
W20260709 13:11:31.648916 25248 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:31.652267 25223 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:31.654066 25224 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.886s	user 0.003s	sys 0.018s
I20260709 13:11:31.655097 25188 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.618273 25241 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.658679 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.659849 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.660548 21313 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:31.661383 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.661404 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:31.662166 21312 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
W20260709 13:11:31.662045 22002 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.968s (SENT)
I20260709 13:11:31.662776 21461 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:31.663326 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:31.633294 25242 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.009s
I20260709 13:11:31.665701 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:31.666407 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.638800 25202 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.671835 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.672295 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:31.672310 21318 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:31.674430 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:31.675098 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.675856 21313 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:31.676964 21312 raft_consensus.cc:2376] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6. Re-sending same reply.
I20260709 13:11:31.677438 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:31.677798 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:31.674521 22041 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:31.680975 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.703469 25161 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:31.705358 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 513) took 1039 ms. Trace:
I20260709 13:11:31.665907 25010 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:11:31.713444 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.723776 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.663972 25245 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:31.670977 25242 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.000s	sys 0.009s
I20260709 13:11:31.714691 21316 rpcz_store.cc:276] 0709 13:11:30.665519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.665695 (+   176us) service_pool.cc:224] Handling call
0709 13:11:30.665932 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.793376 (+127444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.705014 (+911638us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540015ccd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:31.705270 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291578240}
I20260709 13:11:31.665174 25252 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:31.724391 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.725329 21467 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:31.720463 25262 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:31.731285 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.731954 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.735922 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.736584 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.737304 21467 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:31.738015 22035 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:31.738201 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:31.738782 21467 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.741364 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.713063 24731 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:31.743490 25255 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:31.759025 25255 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.744522 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.759927 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.749046 25188 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:31.741400 25262 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:31.675679 25220 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:11:31.752624 25218 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:31.712388 25202 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.721532 24875 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:31.753791 24737 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.755298 25212 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:31.757524 25149 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.759562 25255 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.768689 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.762337 25010 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:31.769934 25262 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.772665 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:31.771732 25220 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:31.775091 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:31.779057 21467 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:31.761591 25161 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.784960 21468 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:31.785424 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:31.786211 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.736596 25068 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.790901 21467 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:31.790997 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.841387 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.842070 21467 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:11:31.787194 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0381948470001134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 13:11:31.846163 21285 connection.cc:256] RPC call timeout handler was delayed by -2.0156948470000771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 13:11:31.847601 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:31.848812 21392 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:31.848088 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9877948470001456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:11:31.837355 25252 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:31.852243 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8023948470000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:11:31.852663 21285 connection.cc:256] RPC call timeout handler was delayed by -1.786194847000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:11:31.853004 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7582948470001156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 13:11:31.853348 21285 connection.cc:256] RPC call timeout handler was delayed by -1.694394847000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:11:31.853686 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5593948470001351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 13:11:31.854014 21285 connection.cc:256] RPC call timeout handler was delayed by -1.4702948470001047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 13:11:31.854354 21285 connection.cc:256] RPC call timeout handler was delayed by -1.3064948470000672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.236s for a response
I20260709 13:11:31.854470 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:31.854697 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2893948470000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2379s for a response
I20260709 13:11:31.855041 25068 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:31.855237 21465 raft_consensus.cc:2368] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:11:31.855530 21285 leader_election.cc:400] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:11:31.856458 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.858029 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.784664 25220 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:31.860060 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:31.861220 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.864773 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.884334 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:31.887957 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.888434 21396 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.889031 21318 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:31.882122 21392 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:11:31.891431 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:31.891788 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:31.832913 25149 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:31.884490 25197 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:31.784117 25256 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 13:11:31.787576 25118 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.898821 25118 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.901144 25118 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:31.791787 25158 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.902529 25158 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:31.907197 25158 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:31.903023 21468 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:31.909749 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:31.910629 21468 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:31.903569 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:31.903991 25261 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:11:31.913929 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:31.915285 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.892819 21467 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:31.905277 21396 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:11:31.790828 25161 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:31.915975 25158 raft_consensus.cc:2764] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:31.785488 25010 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:31.760370 25139 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.047168 21468 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:32.040958 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2067) took 1181 ms. Trace:
I20260709 13:11:31.963282 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.048695 21389 rpcz_store.cc:276] 0709 13:11:30.859586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.859722 (+   136us) service_pool.cc:224] Handling call
0709 13:11:32.040682 (+1180960us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54003f5054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:32.040876 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246618496}
I20260709 13:11:32.021512 21469 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:32.041864 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2097) took 1068 ms. Trace:
I20260709 13:11:32.019307 21463 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:32.003862 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 492) took 1462 ms. Trace:
I20260709 13:11:31.986313 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.053671 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.053903 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:32.054253 21396 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:31.920640 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.050751 21461 rpcz_store.cc:276] 0709 13:11:30.973426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.566582 (+593156us) service_pool.cc:224] Handling call
0709 13:11:32.041675 (+475093us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b54001a77d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:32.041796 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122903296}
I20260709 13:11:32.056437 21461 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:32.052124 22036 rpcz_store.cc:276] 0709 13:11:30.541743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.541869 (+   126us) service_pool.cc:224] Handling call
0709 13:11:30.547413 (+  5544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.991790 (+444377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.003622 (+1011832us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54005c49d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:32.003801 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020558208}
I20260709 13:11:32.058022 21461 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:31.988687 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2082) took 1121 ms. Trace:
W20260709 13:11:32.060904 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.923725 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.068008 21313 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:32.074476 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:32.075745 21469 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:11:32.060776 21393 rpcz_store.cc:276] 0709 13:11:30.866846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.945450 (+ 78604us) service_pool.cc:224] Handling call
0709 13:11:30.945795 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:30.946185 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.946215 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:31.758737 (+812522us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:31.759315 (+   578us) log.cc:844] Serialized 52 byte log entry
0709 13:11:31.882930 (+123615us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:31.882974 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.883077 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.988403 (+105326us) raft_consensus.cc:1685] finished
0709 13:11:31.988420 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.988625 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"spinlock_wait_cycles":29724032,"thread_start_us":123201,"threads_started":1,"wal-append.queue_time_us":227099}
I20260709 13:11:32.074471 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:32.021528 25133 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.001s
I20260709 13:11:32.083637 21396 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:32.079416 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.989252 21316 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:32.077783 24893 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:32.081938 21317 raft_consensus.cc:2410] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:31.860086 25148 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.091991 21389 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:32.092849 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:31.943430 25165 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.093561 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:31.918608 25202 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:31.944120 25068 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:32.095808 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:31.919474 25073 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.100450 21316 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:32.106325 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:32.107084 21316 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.108693 21389 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:32.017951 25255 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.094259 25207 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:31.860719 25220 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.074219 24786 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:11:32.100656 25139 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.139920 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.106426 24893 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:32.144737 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.090976 25133 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.118135 25068 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:32.149034 21316 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:32.151916 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:32.104858 25165 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:32.153496 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 296737us
I20260709 13:11:32.155081 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:32.108798 25073 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.161245 21316 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:32.167768 25133 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:32.172398 25068 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.167320 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2099) took 1190 ms. Trace:
I20260709 13:11:32.180437 21467 rpcz_store.cc:276] 0709 13:11:30.977025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.919260 (+942235us) service_pool.cc:224] Handling call
0709 13:11:31.919608 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:31.920119 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.920144 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:31.946066 (+ 25922us) log.cc:844] Serialized 26 byte log entry
0709 13:11:32.144569 (+198503us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:32.144595 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.144640 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.167116 (+ 22476us) raft_consensus.cc:1685] finished
0709 13:11:32.167128 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.167259 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":26698,"thread_start_us":198098,"threads_started":1,"wal-append.queue_time_us":217143}
I20260709 13:11:32.155253 24731 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:11:32.184767 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:32.156781 25170 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:32.190454 22002 leader_election.cc:336] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.584s (SENT)
I20260709 13:11:32.191088 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.143813 25207 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.166491 24786 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:32.183522 25221 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.002s
W20260709 13:11:32.197551 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.199263 22002 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.064s (SENT)
I20260709 13:11:32.161435 25158 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:11:32.201471 21392 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
W20260709 13:11:32.201745 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46169.8us
I20260709 13:11:32.200613 24737 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.203603 25180 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:32.206202 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.188548 25170 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.201447 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:32.210178 25180 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:32.211221 25180 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.212491 25180 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:32.212980 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.213925 21395 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:32.214735 21315 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:32.216558 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 521) took 1223 ms. Trace:
I20260709 13:11:32.216921 21315 rpcz_store.cc:276] 0709 13:11:30.993432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.993738 (+   306us) service_pool.cc:224] Handling call
0709 13:11:32.214531 (+1220793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.215152 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.216370 (+  1218us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000bdbd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:32.216504 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2658576128}
I20260709 13:11:32.214028 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2274) took 1329 ms. Trace:
I20260709 13:11:32.219369 25165 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.226568 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.221330 21321 rpcz_store.cc:276] 0709 13:11:30.884652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.884791 (+   139us) service_pool.cc:224] Handling call
0709 13:11:30.902712 (+ 17921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.909963 (+  7251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.909990 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.910436 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.171506 (+261070us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:31.171567 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.171677 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.212254 (+1040577us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b2400135d58. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc169fb0 00007fc2bede0488 00007fc2bede0be8 00007fc2bedb8398 00007fc2bedb376a 00007fc2bedb2bb6
0709 13:11:32.213715 (+  1461us) raft_consensus.cc:1685] finished
0709 13:11:32.213736 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.213967 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41112,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":33474944,"thread_start_us":260638,"threads_started":1,"wal-append.queue_time_us":514877}
W20260709 13:11:32.235051 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48876us
I20260709 13:11:32.241048 25255 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:32.241801 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.228200 25160 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.242746 25160 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.206040 24786 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:32.241207 25265 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:32.225556 25170 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.208176 25161 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:32.256279 22035 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:32.258752 22002 leader_election.cc:400] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
I20260709 13:11:32.259845 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.244493 25262 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.263289 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.265196 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.266364 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.252655 25010 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.234830 25269 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:11:32.257946 25256 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.275786 25269 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:32.276325 25160 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.219791 24893 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.267798 25188 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.270816 25255 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:32.268009 24737 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:32.286119 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 80055us
I20260709 13:11:32.272912 25158 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.289378 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:32.289734 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.285234 25255 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:32.294046 25255 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.281150 25223 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:32.296299 25223 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:32.296685 25223 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:32.280728 25269 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:32.301182 25269 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.302630 25269 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.304288 24786 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.311952 25255 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.317610 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2095) took 1344 ms. Trace:
I20260709 13:11:32.318029 21468 rpcz_store.cc:276] 0709 13:11:30.972900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.911302 (+938402us) service_pool.cc:224] Handling call
0709 13:11:31.911649 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.048582 (+136933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.317361 (+268779us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540025b054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:32.317549 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311097088}
I20260709 13:11:32.319881 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:32.323354 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57037.1us
I20260709 13:11:32.324738 24629 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.324827 25160 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:32.325970 25160 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.274331 25202 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:11:32.335201 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 45979.3us
W20260709 13:11:32.336146 21434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.533s (SENT) [suppressed 29 similar messages]
I20260709 13:11:32.326933 25255 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:32.283767 25256 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.342079 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.334403 25010 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:32.349625 21395 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:11:32.350498 25275 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:32.364899 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:32.343135 25269 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.375408 25256 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.376154 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.376833 21321 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:32.345333 25010 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:32.380865 21321 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:32.381531 25010 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.380831 25158 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:32.383159 25277 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:32.383757 25277 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:32.384668 25277 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.386308 25277 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.388350 25255 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:32.388928 25255 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.390206 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 597) took 1297 ms. Trace:
I20260709 13:11:32.390585 21387 rpcz_store.cc:276] 0709 13:11:31.092902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.511214 (+418312us) service_pool.cc:224] Handling call
0709 13:11:32.389953 (+878739us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b54003426d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:32.390121 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32924416}
I20260709 13:11:32.392282 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2079) took 1528 ms. Trace:
I20260709 13:11:32.393180 25160 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:32.393700 25280 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.394188 25280 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.396106 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:32.396721 21396 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:32.397272 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.398536 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:32.392630 21388 rpcz_store.cc:276] 0709 13:11:30.865822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.875632 (+  9810us) service_pool.cc:224] Handling call
0709 13:11:30.902930 (+ 27298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.938852 (+ 35922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.938882 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.972557 (+ 33675us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:30.979120 (+  6563us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.442543 (+463423us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:31.442610 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.391962 (+949352us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b5400388e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:32.392007 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.392074 (+    67us) raft_consensus.cc:1685] finished
0709 13:11:32.392095 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.392229 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120387200,"thread_start_us":262914,"threads_started":1,"wal-append.queue_time_us":538099}
I20260709 13:11:32.403326 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.403569 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.403452 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.404603 21462 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:32.405675 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.406847 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.407583 21391 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:32.408389 21467 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:32.409322 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:32.410391 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:32.411854 24332 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:32.412274 24332 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:32.413172 24332 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.414237 24332 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:32.416443 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.417164 22041 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:32.417157 25160 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:32.417467 25256 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:32.418094 25256 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.419284 25274 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:32.419885 25274 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.419624 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.422327 25274 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:32.422399 25160 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.422967 25256 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:32.368527 25278 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:32.423727 25278 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:32.425407 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.428696 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.360059 25170 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.437840 21394 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:11:32.428982 21467 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:32.429322 21318 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:32.426323 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.413611 25241 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.426673 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.440904 21469 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:32.443122 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.455255 21469 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:32.459887 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:32.430371 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:32.431396 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.463439 21391 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:11:32.432152 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.431772 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.436522 21465 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:32.465898 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.466827 21466 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:32.426805 25278 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:32.470171 22038 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:32.474623 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.475576 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:32.477136 21464 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:32.478732 21393 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:32.479876 21360 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:32.481065 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:32.483807 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.425048 25277 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.513338 25277 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.506316 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:32.515139 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.515548 25277 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.515882 25068 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.516629 25068 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:32.484449 22032 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:32.517848 24814 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:32.518311 24814 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:32.405193 25223 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.519802 22036 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:32.520956 25223 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:32.477944 25179 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:32.521965 25179 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:32.436792 25279 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:11:32.524349 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.500519 22038 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
W20260709 13:11:32.525157 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45324.1us
I20260709 13:11:32.525967 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:32.524497 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.527005 21468 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:32.460340 25212 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:11:32.487705 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.488119 22042 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:11:32.427157 24885 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:32.488477 25241 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:32.488626 25217 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.489039 25176 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:32.489704 25188 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.471437 25280 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:32.457068 25252 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.490461 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:32.492333 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.477540 24737 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:32.552875 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.496325 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:32.496971 25282 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:32.498016 25202 raft_consensus.cc:2764] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:32.499996 21462 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:11:32.501032 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:32.501718 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:32.508355 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.561246 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.510685 24332 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.391094 25255 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:32.512701 25170 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:32.423033 25274 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:32.517773 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.570441 22032 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:32.485273 25133 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:32.528434 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:32.528612 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:32.571025 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:32.531708 22038 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:32.532688 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:32.544951 21393 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:32.553470 24737 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.558920 25179 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:32.561971 21320 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:11:32.572572 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.573653 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:32.563529 22034 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:32.563393 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 61758.9us
I20260709 13:11:32.561298 21470 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.565657 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.575259 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:32.566120 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.569234 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:32.530784 22042 pending_rounds.cc:85] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 7
I20260709 13:11:32.575904 21314 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:32.576186 22042 pending_rounds.cc:107] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:11:32.576473 22042 raft_consensus.cc:2889] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.573262 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:32.574580 22040 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:32.577994 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:32.534317 25262 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:11:32.547947 25241 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:32.584981 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.592689 21313 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:32.587620 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:32.588405 21320 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:32.594800 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:32.595572 21320 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:32.597437 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 107061us
I20260709 13:11:32.543294 24885 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.585115 25133 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.589910 25035 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:32.597966 25062 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:32.590667 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:32.605954 25062 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.572764 25274 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.606642 25062 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:32.607018 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.608305 25274 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.573303 25161 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:32.608932 25161 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.609297 25161 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.610821 25068 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.611614 22031 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:32.612689 25241 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.574014 25217 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.606614 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:32.617136 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.622812 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:32.628149 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59006.4us
I20260709 13:11:32.628491 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:32.599078 25172 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:32.633827 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.634523 21466 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:32.636673 22038 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:32.637254 22040 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:32.614463 24332 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:32.629755 22041 raft_consensus.cc:2410] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:11:32.631966 21285 leader_election.cc:400] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:11:32.632686 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:32.642838 21285 leader_election.cc:403] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:11:32.643406 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.643959 21462 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:32.638638 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.629106 21315 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.640708 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:32.649246 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 94624.7us
W20260709 13:11:32.640750 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 59344.6us
I20260709 13:11:32.653581 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.654459 22040 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:32.660903 25287 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:32.662153 25287 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:32.662642 25287 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:32.663758 25287 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.665046 22040 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:32.665432 25287 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.668614 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.678804 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:32.622089 25269 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:32.634665 25176 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.686012 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.679673 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2283) took 2055 ms. Trace:
I20260709 13:11:32.686796 21319 rpcz_store.cc:276] 0709 13:11:30.624010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.624256 (+   246us) service_pool.cc:224] Handling call
0709 13:11:30.629958 (+  5702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.873386 (+243428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.679414 (+1806028us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54003f5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:32.679613 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558568192}
I20260709 13:11:32.680694 21313 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
I20260709 13:11:32.598361 25253 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:11:32.626554 25035 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:32.684438 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:11:32.685359 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.639338 25277 raft_consensus.cc:2764] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:32.622494 25256 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:11:32.626715 25160 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:11:32.690302 21320 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:32.681129 25068 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:32.690941 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 89741.9us
I20260709 13:11:32.688627 25217 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.696420 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.671144 25288 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:11:32.682132 24332 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:32.699837 21319 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:32.697786 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.682593 25255 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:32.696272 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:32.701417 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.689132 25269 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.703025 25035 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.694554 25179 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:11:32.705909 25277 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:32.706845 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:32.735705 21462 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.707443 24969 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:32.642943 25290 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:11:32.710575 25207 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.712157 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:32.771358 22034 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:32.690690 25180 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:11:32.737179 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 86716.7us
I20260709 13:11:32.731416 21320 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:32.692193 25010 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.692018 25176 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.728193 25068 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:32.729915 25294 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:32.694800 25197 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:11:32.730126 25255 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.780354 21320 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:32.844599 21320 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:32.693290 25293 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:11:32.766044 24969 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:32.780313 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 94378.6us
I20260709 13:11:32.848481 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.849632 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.738124 25297 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.727059 25278 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.836835 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:32.842659 21318 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.731127 25062 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.851459 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.853044 24332 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.854377 25073 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:32.855690 25068 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.858181 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:32.859704 25158 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.860188 24737 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:32.860508 25298 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:11:32.860778 25133 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:32.861370 21313 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:32.863030 25176 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:32.864066 25285 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:11:32.787896 25294 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.870899 21462 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:32.880306 21320 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:32.871505 21319 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:32.837313 25255 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.882408 21315 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:11:32.885813 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 88877.6us
I20260709 13:11:32.874946 25277 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:32.852115 24969 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:32.890574 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.892828 21464 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:11:32.908874 21313 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:32.897817 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:32.896744 21320 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.912839 21315 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:32.914695 21315 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:32.917858 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.919107 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.893962 25161 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.900192 25297 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.923167 21315 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:11:32.896714 25288 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:32.926985 21315 pending_rounds.cc:85] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 4
I20260709 13:11:32.925740 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:32.927282 21315 pending_rounds.cc:107] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:11:32.927686 21315 raft_consensus.cc:2889] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.902601 24885 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:32.929972 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.934041 21470 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:32.935775 21466 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:32.936301 21320 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:32.900229 25294 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.921202 25218 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:32.941499 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.930285 25288 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.957520 25306 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:32.958484 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.936902 25252 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.937196 25277 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.959786 21313 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:32.945443 25172 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:32.972682 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.945073 25302 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.961534 25139 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:32.960419 25288 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.976044 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.958319 25218 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:32.981184 25296 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.962641 25269 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:32.992763 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:32.975381 25287 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.998587 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:32.983893 25296 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:33.005483 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.008628 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:33.005877 22035 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:32.981792 25218 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:32.999605 25139 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:33.007649 25133 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:33.016541 25278 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.027565 25161 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:33.000422 25302 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:33.020251 25312 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.021178 25269 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.036283 25269 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.037707 25301 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:33.038121 25220 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:33.038643 25269 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:33.035851 25312 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.041255 25312 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:33.042119 24969 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.024194 25252 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:33.025154 21318 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:33.025367 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:33.009459 22002 leader_election.cc:400] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7.
I20260709 13:11:33.049681 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:33.051656 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:33.016767 25062 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:33.034549 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:33.052474 22039 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:33.055729 25073 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:33.033761 25255 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.061829 25294 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.058368 24737 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:11:33.064375 25139 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.065407 25255 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.059276 25068 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:11:33.059437 25073 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:33.056754 25202 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:11:33.068831 25073 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.073961 25294 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:32.215719 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:33.093199 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1654) took 1400 ms. Trace:
I20260709 13:11:33.093647 21396 rpcz_store.cc:276] 0709 13:11:31.692516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.084693 (+392177us) service_pool.cc:224] Handling call
0709 13:11:32.396564 (+311871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.397099 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.092999 (+695900us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54003426d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:33.093139 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716483456}
I20260709 13:11:33.094643 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:33.044328 24969 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.095885 25244 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:33.096434 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 2292) took 1233 ms. Trace:
I20260709 13:11:33.096618 25197 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:33.096814 21317 rpcz_store.cc:276] 0709 13:11:31.863386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.888126 (+ 24740us) service_pool.cc:224] Handling call
0709 13:11:33.096203 (+1208077us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b54000fd554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:33.096352 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74684160}
I20260709 13:11:33.097149 25197 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:33.064800 25288 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.097860 25197 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.108510 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:33.108799 22039 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:33.113207 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:33.118815 21313 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:33.118582 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:33.117942 25170 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:33.124883 25170 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:33.125312 25170 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.121444 25278 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.128320 25278 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.122530 25301 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:33.132285 25301 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.134245 25301 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.120267 24969 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:33.121953 24885 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:33.104441 25172 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:11:33.141018 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:33.142335 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:33.142956 22036 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:33.143119 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:33.146190 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:33.149398 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:33.149518 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:33.149573 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:33.150655 22042 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:33.134251 25288 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:33.155540 21388 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:33.154485 21393 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:33.156528 25312 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:33.158388 25312 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.164820 25312 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:33.169273 24814 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.171458 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.172731 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.180289 25262 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:33.181888 25139 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:33.182236 25221 raft_consensus.cc:3055] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:33.182802 25221 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:33.189718 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.176422 25073 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:33.199954 25068 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:33.200323 22042 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:33.188990 24814 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:33.177094 25010 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.228677 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:33.226985 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.243260 21387 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:33.246959 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:33.244671 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:33.247860 24786 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.248342 24786 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.248814 25010 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.250581 24786 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.252813 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:33.258626 25010 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:33.245725 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:33.264945 21390 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:33.245982 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:33.266152 21394 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.247584 21396 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:11:33.259843 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.267802 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:33.240633 21395 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:33.260710 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:33.213392 25202 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:11:33.203820 25221 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.241289 25170 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.272689 21315 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:11:33.273813 25197 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.280103 21359 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:33.274094 25301 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:33.275709 22034 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:33.285076 21394 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:33.289413 21313 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:33.269495 25269 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:33.278241 25288 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:33.294544 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:33.300282 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:33.282133 24875 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:33.303365 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:33.289309 25218 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:11:33.310894 25322 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:33.311547 24875 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.337916 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:33.292779 25301 consensus_queue.cc:1243] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:33.342290 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:33.342517 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:33.343576 21394 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:33.300185 25288 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:33.312022 24875 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:33.339190 25221 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.325848 25160 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:33.353332 25160 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:33.354450 25160 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.342708 25302 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:33.357138 25302 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:33.358361 25302 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.291756 25190 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:11:33.340106 25269 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:33.360685 25269 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:33.361220 25269 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:33.311918 25312 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.364212 25312 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:33.364138 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.302556 25290 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:11:33.365345 25290 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:33.365496 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:33.365733 25290 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:33.366222 21466 raft_consensus.cc:2368] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:11:33.366909 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.366684 25290 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.302692 25244 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:11:33.316303 25068 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.304482 25296 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:33.346304 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:33.316160 25274 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:33.405484 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59295us
I20260709 13:11:33.368357 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.407418 21462 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:33.407511 21285 leader_election.cc:400] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:11:33.408131 21285 leader_election.cc:403] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:33.372099 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:33.409775 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.410641 21469 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:33.411753 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:33.372900 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 347577us
W20260709 13:11:33.373602 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 600055us
I20260709 13:11:33.321666 25197 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:33.438112 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:33.369482 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.371697 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.367848 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:33.420784 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:33.369040 21464 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:33.447424 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:33.435258 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 736046us
I20260709 13:11:33.367803 25290 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.453510 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:33.463761 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.373152 25062 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:33.368145 25288 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:33.372112 25160 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:33.487673 21395 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:33.490113 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:33.404973 25296 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:33.463682 21392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "624d76b3bc214b53b7565f644d236663"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:33.339785 24969 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:11:33.435212 25217 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:33.404625 25274 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:33.526577 22039 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:33.458500 25287 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:33.488710 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:33.497781 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43502.1us
W20260709 13:11:33.516172 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.453485 25312 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:33.435837 25301 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 5. Current term is 6.
I20260709 13:11:33.492774 21392 raft_consensus.cc:606] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:11:33.508463 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44787.8us
I20260709 13:11:33.499768 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:33.535959 22035 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:33.500653 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:33.509028 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.537554 21465 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:33.512837 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.538667 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:33.463441 25125 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:11:33.502395 25148 raft_consensus.cc:2764] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:33.516268 25246 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.498646 25280 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:11:33.516734 25180 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:33.464892 25303 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:33.505616 24737 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.544305 25330 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:33.544394 25246 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.546468 25218 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:33.546847 25246 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.488214 25062 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.550333 25062 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:33.552179 25323 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:33.552506 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.553031 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:33.554023 22041 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:33.539430 21467 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:33.556164 22036 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:33.557397 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:33.555773 21313 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:33.514055 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.496521 25296 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:33.547088 25218 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:33.459329 25277 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:33.574282 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:33.547933 25125 consensus_queue.cc:1243] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:33.498576 25291 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:11:33.548427 24737 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.435272 25068 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.586088 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.568300 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:33.570581 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:33.592341 21317 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.592417 21316 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:33.532919 25287 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.575098 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:33.576251 21465 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:33.466995 25176 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:11:33.543053 25035 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:11:33.578112 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:33.533154 25274 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.532466 25241 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:33.533942 25306 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:33.608619 25306 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.609150 25306 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:33.535076 25312 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.612320 25312 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:33.562461 22035 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:33.544047 25190 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:33.566097 22039 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:33.576469 25303 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:33.542006 25278 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.526981 25293 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:11:33.601218 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:33.634466 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.632759 22031 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:33.641532 25240 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:33.588843 25125 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:11:33.595176 25287 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.596755 25277 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.689996 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2112) took 1263 ms. Trace:
I20260709 13:11:33.690582 21461 rpcz_store.cc:276] 0709 13:11:32.427032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.427260 (+   228us) service_pool.cc:224] Handling call
0709 13:11:32.427558 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.430205 (+  2647us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:32.542121 (+111916us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.689146 (+147025us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.689302 (+   156us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.692930 (+  3628us) log.cc:844] Serialized 26 byte log entry
0709 13:11:32.693063 (+   133us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:32.693261 (+   198us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.286475 (+593214us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b1800115c60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:11:33.651995 (+365520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.689643 (+ 37648us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.689715 (+    72us) raft_consensus.cc:1685] finished
0709 13:11:33.689739 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.689921 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1275594,"prepare.queue_time_us":85588,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":108,"raft.queue_time_us":770099,"raft.run_cpu_time_us":683,"raft.run_wall_time_us":101804,"spinlock_wait_cycles":65685760,"thread_start_us":500187,"threads_started":3,"wal-append.queue_time_us":86022}
I20260709 13:11:33.694043 21461 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:33.633392 25170 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.729071 25269 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.734543 25010 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:33.645943 24332 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:33.668846 25291 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:33.721415 25218 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.723730 25274 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.646987 25294 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:11:33.725409 24875 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.772708 25291 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:33.784511 25291 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.786222 24875 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:33.788234 25202 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:33.788687 25202 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:33.789085 25202 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:33.734993 25010 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:33.792673 25195 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:33.793073 25010 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.794162 25010 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:33.794690 21464 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:11:33.795094 21464 pending_rounds.cc:85] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 9
I20260709 13:11:33.795320 21464 pending_rounds.cc:107] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:11:33.795550 21464 raft_consensus.cc:2889] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:33.731894 25269 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.714097 21462 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:33.796352 21462 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:33.796768 25068 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:33.797192 21462 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.798492 21462 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:33.800253 25197 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:33.800693 25197 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:33.801425 25197 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.802577 25197 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.803295 25306 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.805585 25306 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.811947 25190 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:33.812358 25190 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:33.813150 25190 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.814504 25190 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.817839 25274 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.795830 24737 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.739920 24332 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.835896 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:33.836853 21316 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:33.837836 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:33.838681 21318 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:33.840684 21462 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:11:33.841076 21462 pending_rounds.cc:85] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 10
I20260709 13:11:33.841341 21462 pending_rounds.cc:107] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:11:33.841631 21462 raft_consensus.cc:2889] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:33.721276 25277 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.793097 25195 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:33.802596 25312 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.851200 25195 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:33.848444 24969 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.852406 25312 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.852766 24969 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.854885 24969 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.855381 25306 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:33.846266 24332 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:33.855902 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:33.828575 21317 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:33.685618 25165 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:11:33.916455 21318 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
W20260709 13:11:33.922257 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.831333 25176 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:33.911273 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 411015us
I20260709 13:11:33.811739 25291 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.879205 24332 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:33.895442 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:33.928220 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 342203us
I20260709 13:11:33.920621 21316 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:33.930980 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:33.919126 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 341251us
I20260709 13:11:33.944918 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.927706 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:33.948385 24332 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:33.948484 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.949877 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:33.950618 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:33.862056 24629 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:11:33.950769 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 408618us
I20260709 13:11:33.952751 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:33.995287 21316 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:33.998103 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:33.999068 21316 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:33.918243 25277 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:34.001173 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48514.4us
W20260709 13:11:33.983125 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 87782.4us
I20260709 13:11:34.003475 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:34.004846 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:33.884178 25241 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:34.045326 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:34.048494 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:34.049396 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.011s
W20260709 13:11:34.049906 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.014s	sys 0.011s
W20260709 13:11:34.050273 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 538934us
I20260709 13:11:34.050834 21470 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:34.053609 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:34.054456 21462 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:34.055435 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:34.056221 21461 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:34.053570 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:34.057358 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.855093 25062 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.064579 25262 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:34.064921 21466 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:34.065043 25262 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:34.065802 25062 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:34.065917 25262 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.067015 25241 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.067507 25262 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.063141 21470 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:34.061486 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:34.005903 24969 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:34.040310 25280 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:34.005421 25221 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.947467 25176 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.083225 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:33.952329 25073 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:33.957198 25302 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:34.072212 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:34.091094 21316 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:33.952060 25161 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:34.083413 21463 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:34.104887 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:33.952639 25299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.020s
I20260709 13:11:33.951872 25290 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.954105 24737 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:33.953090 25328 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:34.120018 25299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.006s	sys 0.021s
I20260709 13:11:34.001966 25296 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.198769 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:34.199501 21318 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:34.200785 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:34.202114 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:34.203624 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:34.204120 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:34.129485 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.012s
I20260709 13:11:34.155388 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:34.204941 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.007s	sys 0.012s
I20260709 13:11:34.205021 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:34.055280 25139 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:11:34.163511 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:34.210888 21319 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:34.163550 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:34.211952 21317 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:34.164978 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:34.169734 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:34.213164 21394 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:34.215422 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:34.117673 25302 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:34.086737 25221 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.171785 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:34.172465 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:34.172595 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:34.174906 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.091513 25217 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.241133 21464 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:34.045634 25212 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:11:34.184338 21393 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:34.001648 25202 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.181849 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:34.106489 21316 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
W20260709 13:11:34.120152 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.193209 21465 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.003s	sys 0.020s
W20260709 13:11:34.261965 21465 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.004s	sys 0.020s
I20260709 13:11:34.261893 21318 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
W20260709 13:11:34.194734 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.107257 24969 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:34.205158 21463 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
W20260709 13:11:34.150619 22032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.020s	sys 0.001s
W20260709 13:11:34.263183 22032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.021s	sys 0.002s
I20260709 13:11:34.205858 21462 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:34.264020 21318 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:34.221100 21320 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:34.170507 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.170878 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 220728us
I20260709 13:11:34.266105 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:34.231400 21317 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:34.267757 21317 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:11:34.223888 24332 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:34.240549 21395 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.240833 21391 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:34.239101 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:34.273916 22040 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:34.210987 25329 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.459s	user 0.005s	sys 0.000s
W20260709 13:11:34.256249 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 52192.4us
I20260709 13:11:34.257863 21394 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:34.155269 25290 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.259714 22042 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:34.153018 24875 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:34.294056 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:34.294219 25148 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:34.294668 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55973.8us
I20260709 13:11:34.313102 25296 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.312803 25148 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:34.313292 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.315722 25291 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:34.316274 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:34.316687 21389 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:34.283367 21317 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:34.309540 25292 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.323719 25292 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.324625 21395 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:34.317338 25062 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:34.325452 25062 consensus_queue.cc:1243] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:34.325564 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:34.315158 25148 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:34.327147 21395 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:34.327457 25292 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:34.318037 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:34.293958 25269 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:34.318688 25240 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.233253 25339 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:34.329779 25240 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.330874 25176 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:34.319180 25160 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:34.332244 25160 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:34.332643 25160 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:34.332819 21394 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:11:34.334815 25356 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.335337 25356 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.241349 24885 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:34.332015 25240 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:34.336499 24885 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.337165 25176 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:34.310102 25328 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:34.338718 24885 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.233031 24786 consensus_queue.cc:1059] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:11:34.339996 24786 raft_consensus.cc:3055] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:34.340365 24786 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:34.341099 24786 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.342288 24786 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.342615 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:34.343251 22042 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:34.242965 24814 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:11:34.342288 25160 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.310832 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 627) took 1108 ms. Trace:
I20260709 13:11:34.346554 21388 rpcz_store.cc:276] 0709 13:11:33.202115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.202263 (+   148us) service_pool.cc:224] Handling call
0709 13:11:33.202591 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.227870 (+ 25279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.227918 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.264206 (+ 36288us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.493214 (+229008us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:33.493264 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.493323 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.082248 (+588925us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:34.310368 (+228120us) raft_consensus.cc:1685] finished
0709 13:11:34.310420 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.310720 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21676,"raft.queue_time_us":37923,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2678,"spinlock_wait_cycles":82145152,"thread_start_us":203514,"threads_started":1,"wal-append.queue_time_us":309669}
I20260709 13:11:34.352689 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:34.324470 24969 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.329253 25221 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.320533 25161 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:11:34.322789 25197 consensus_meta.cc:287] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.004s
W20260709 13:11:34.311532 25334 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
W20260709 13:11:34.416759 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.252980 24737 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:11:34.388953 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:34.440964 21387 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:34.441813 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:34.442406 21387 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 5.
I20260709 13:11:34.443212 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:34.272874 25274 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:34.396842 21395 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:34.282348 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:34.325392 24875 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:34.386726 25358 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.055s	user 0.000s	sys 0.005s
I20260709 13:11:34.252511 25255 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.135s
W20260709 13:11:34.387003 25362 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.053s	user 0.005s	sys 0.000s
I20260709 13:11:34.241133 25349 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.181s
I20260709 13:11:34.271463 25217 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.446676 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:34.389545 25348 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:34.459266 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 176972us
I20260709 13:11:34.494491 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:34.495489 21462 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:34.495925 21462 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:34.492725 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:34.387212 25353 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.207s	user 0.004s	sys 0.002s
I20260709 13:11:34.412830 25068 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.466348 21464 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:34.467264 21318 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:34.469470 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:34.532018 21395 raft_consensus.cc:2410] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:34.385025 21391 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:34.533211 21391 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:34.534616 21391 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:34.443799 21387 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:34.537706 21387 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:34.513458 21462 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.538638 21462 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.464401 25274 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:34.466179 25312 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:34.515057 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 251085us
I20260709 13:11:34.535980 21391 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:34.547878 22041 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:34.545003 21387 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:34.547163 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:34.482344 25202 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.560094 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:34.561419 21462 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:34.563678 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:34.564528 21388 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:11:34.565330 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 249122us
W20260709 13:11:34.564559 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 382789us
I20260709 13:11:34.569618 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:34.566885 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:34.572283 22031 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:34.532379 25197 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:34.575511 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:34.577277 21318 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:34.531991 25348 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.584713 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:34.586028 21321 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:34.545653 25312 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.572297 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:34.595204 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:34.554394 25212 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.458547 25302 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.610404 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:34.617051 21318 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:34.597865 25348 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:34.600986 25312 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:34.544201 24875 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.613026 25291 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:34.599808 25197 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:34.625074 25333 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.344s	user 0.005s	sys 0.000s
I20260709 13:11:34.614425 25328 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:11:34.615625 25240 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:11:34.635355 25290 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.635792 25291 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.614166 25212 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.630287 25366 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:34.674695 25341 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.675268 25195 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:34.675494 25341 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:34.677121 25367 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:34.678064 25341 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:34.684752 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.686143 25361 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:11:34.686851 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:34.688534 25288 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.161s	user 0.012s	sys 0.000s
I20260709 13:11:34.689133 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 630) took 1221 ms. Trace:
I20260709 13:11:34.688944 25288 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.689491 21396 rpcz_store.cc:276] 0709 13:11:33.468149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.491733 (+ 23584us) service_pool.cc:224] Handling call
0709 13:11:33.492166 (+   433us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:11:33.515905 (+ 23739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.515948 (+    43us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:11:33.824326 (+308378us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:33.825220 (+   894us) log.cc:844] Serialized 104 byte log entry
0709 13:11:34.253176 (+427956us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:34.253220 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.253289 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.688845 (+435556us) raft_consensus.cc:1685] finished
0709 13:11:34.688863 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.689077 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12429,"raft.queue_time_us":12667,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":9719680,"thread_start_us":350824,"threads_started":1,"wal-append.queue_time_us":581437}
W20260709 13:11:34.691876 25287 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.003s	user 0.004s	sys 0.005s
I20260709 13:11:34.692310 25287 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.693337 21318 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:34.694706 25356 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.695308 21390 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:34.696312 24885 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.696786 24885 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.698566 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:34.698803 24885 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:34.699899 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:34.700117 25338 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.700603 24814 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.701188 24814 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.701956 25342 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:34.702502 25342 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:34.703501 24814 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:34.701678 25357 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:34.704807 25342 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.706961 25217 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.665732 25359 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:34.712550 25359 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:34.675263 25364 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:34.673419 25291 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:34.727644 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48089.2us
I20260709 13:11:34.632262 25274 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:35.204768 22038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.023s	sys 0.026s
I20260709 13:11:34.745360 22039 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:11:35.340412 22038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.024s	sys 0.039s
I20260709 13:11:34.770187 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2121) took 1895 ms. Trace:
I20260709 13:11:35.139086 25068 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.342196 25068 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:34.727962 25328 consensus_queue.cc:1243] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:35.341651 21468 rpcz_store.cc:276] 0709 13:11:32.874757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.880636 (+  5879us) service_pool.cc:224] Handling call
0709 13:11:32.881125 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.358166 (+477041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.358203 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.358683 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.712876 (+354193us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:33.712915 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.712987 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.769948 (+1056961us) raft_consensus.cc:1685] finished
0709 13:11:34.769975 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.770123 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":476536,"raft.queue_time_us":477721,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":353801,"threads_started":1,"wal-append.queue_time_us":543702}
I20260709 13:11:34.753479 22040 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:34.846877 21315 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:35.344470 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 930) took 1106 ms. Trace:
I20260709 13:11:34.729552 25341 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.344843 22040 rpcz_store.cc:276] 0709 13:11:34.238097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.238814 (+   717us) service_pool.cc:224] Handling call
0709 13:11:35.344415 (+1105601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:34.746143 25287 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.345432 25341 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:35.346190 21469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.025s	sys 0.047s
W20260709 13:11:35.346582 21469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.025s	sys 0.047s
I20260709 13:11:35.347644 25341 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:34.769567 25197 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:35.185616 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.014s	sys 0.015s
W20260709 13:11:35.393375 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.017s	sys 0.018s
W20260709 13:11:35.393746 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 759954us
I20260709 13:11:34.727458 25277 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:35.353540 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:35.297102 25348 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
W20260709 13:11:35.355518 21396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.017s	sys 0.006s
W20260709 13:11:35.528879 21396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.018s	sys 0.006s
W20260709 13:11:35.177513 21464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.027s
W20260709 13:11:35.146852 25354 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
W20260709 13:11:35.372237 25139 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.006s	sys 0.004s
W20260709 13:11:35.146626 25376 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.377s	user 0.000s	sys 0.000s
W20260709 13:11:35.393298 24969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.014s	sys 0.033s
I20260709 13:11:35.145895 25346 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.349498 25262 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.266s	user 0.012s	sys 0.000s
I20260709 13:11:35.339103 25212 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:35.312505 25371 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:11:35.385128 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 667885us
I20260709 13:11:35.386940 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2097) took 1106 ms. Trace:
W20260709 13:11:35.387454 21465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.007s	sys 0.003s
W20260709 13:11:35.569705 21465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.008s	sys 0.003s
W20260709 13:11:35.064011 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.079335 21387 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.006s	sys 0.011s
W20260709 13:11:35.571127 21387 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.007s	sys 0.011s
I20260709 13:11:34.932237 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:35.569511 21394 rpcz_store.cc:276] 0709 13:11:34.280256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.284348 (+  4092us) service_pool.cc:224] Handling call
0709 13:11:34.332578 (+ 48230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.333214 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.386645 (+1053431us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b54000acdd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:35.386861 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110002048}
W20260709 13:11:35.338158 25337 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.951s	user 0.002s	sys 0.000s
I20260709 13:11:34.742745 25176 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.683s
I20260709 13:11:34.846740 25349 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.584s
I20260709 13:11:35.338953 25359 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.424486 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1674) took 1420 ms. Trace:
W20260709 13:11:35.425415 25383 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:11:35.391945 21461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.000s	sys 0.010s
I20260709 13:11:35.543488 25306 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:35.611021 21461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.003s	sys 0.017s
W20260709 13:11:35.391224 21462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.005s	sys 0.005s
I20260709 13:11:34.745368 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:35.611680 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 933) took 1265 ms. Trace:
W20260709 13:11:35.613216 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 867888us
W20260709 13:11:35.611830 21462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.010s	sys 0.010s
I20260709 13:11:35.615440 21317 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:11:35.572522 25391 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.186s	user 0.003s	sys 0.005s
I20260709 13:11:35.612972 22042 rpcz_store.cc:276] 0709 13:11:34.346569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.346724 (+   155us) service_pool.cc:224] Handling call
0709 13:11:34.347015 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.347305 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.347331 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.347734 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.608305 (+260571us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:34.608586 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.609864 (+  1278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.611385 (+1001521us) raft_consensus.cc:1685] finished
0709 13:11:35.611410 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.611603 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149873,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":24944,"thread_start_us":169221,"threads_started":1,"wal-append.queue_time_us":285429}
I20260709 13:11:35.531546 25062 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:11:35.529448 21464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.000s	sys 0.032s
I20260709 13:11:35.627625 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 574) took 1036 ms. Trace:
I20260709 13:11:34.771703 25010 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:34.700686 25338 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:35.526189 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 782388us
I20260709 13:11:35.542088 25348 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.543388 25328 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:35.635265 25328 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.636644 25348 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.543488 25344 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.637984 25344 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.638381 22042 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:11:35.543877 25139 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.006s	sys 0.004s
I20260709 13:11:35.545630 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:35.545540 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 562) took 2030 ms. Trace:
I20260709 13:11:35.643450 21467 rpcz_store.cc:276] 0709 13:11:33.515086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.556232 (+ 41146us) service_pool.cc:224] Handling call
0709 13:11:33.556679 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:33.580847 (+ 24168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.580895 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:33.581709 (+   814us) log.cc:844] Serialized 52 byte log entry
0709 13:11:34.088273 (+506564us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:34.088316 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.088386 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.545192 (+1456806us) raft_consensus.cc:1685] finished
0709 13:11:35.545237 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.545456 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8014,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":7387,"thread_start_us":399730,"threads_started":1,"wal-append.queue_time_us":972631}
I20260709 13:11:35.377738 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2108) took 1094 ms. Trace:
I20260709 13:11:35.645138 21391 rpcz_store.cc:276] 0709 13:11:34.283443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.548109 (+264666us) service_pool.cc:224] Handling call
0709 13:11:34.548350 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.548529 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:34.568074 (+ 19545us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.350051 (+781977us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.377253 (+ 27202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.377328 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:35.377395 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.377491 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.377658 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63769,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":105,"raft.queue_time_us":53552,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":206,"thread_start_us":174803,"threads_started":2,"wal-append.queue_time_us":1042462}
I20260709 13:11:35.546940 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:35.563352 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2111) took 1278 ms. Trace:
I20260709 13:11:35.648289 21396 rpcz_store.cc:276] 0709 13:11:34.285487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.690991 (+405504us) service_pool.cc:224] Handling call
0709 13:11:34.691291 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.691492 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:34.691817 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.562610 (+870793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.563047 (+   437us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.563094 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.563159 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.563289 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3393,"prepare.queue_time_us":887,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":80873,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":149,"thread_start_us":866918,"threads_started":2,"wal-append.queue_time_us":663820}
I20260709 13:11:34.925606 25342 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.650123 25342 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.599421 21393 rpcz_store.cc:276] 0709 13:11:34.003893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.004111 (+   218us) service_pool.cc:224] Handling call
0709 13:11:34.004541 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.278442 (+273901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.419760 (+1141318us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54003426d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:35.424402 (+  4642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412709120}
I20260709 13:11:35.652684 25342 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:35.552839 24969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.014s	sys 0.033s
W20260709 13:11:35.561970 24786 consensus_meta.cc:287] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.219s	user 0.016s	sys 0.004s
I20260709 13:11:35.527767 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:35.621152 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.624356 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:35.659826 21395 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:35.660305 21317 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 4.
I20260709 13:11:35.633167 25148 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:11:35.576406 25073 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.145604 25372 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.577726 25277 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.601089 25349 consensus_queue.cc:1243] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:35.697994 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 573) took 1123 ms. Trace:
I20260709 13:11:35.570891 25346 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.658015 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2109) took 1374 ms. Trace:
I20260709 13:11:35.599604 25288 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:35.698627 21462 rpcz_store.cc:276] 0709 13:11:34.574898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.579234 (+  4336us) service_pool.cc:224] Handling call
0709 13:11:34.580393 (+  1159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.580849 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:34.580890 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.581437 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.615468 (+1034031us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:35.615507 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.615587 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.697754 (+ 82167us) raft_consensus.cc:1685] finished
0709 13:11:35.697772 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.697927 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":16353,"thread_start_us":1033753,"threads_started":1,"wal-append.queue_time_us":791874}
I20260709 13:11:35.628407 21464 rpcz_store.cc:276] 0709 13:11:34.591068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.591231 (+   163us) service_pool.cc:224] Handling call
0709 13:11:34.613379 (+ 22148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.623668 (+ 10289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.623699 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.628753 (+  5054us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.627139 (+998386us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:35.627194 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.627292 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.627356 (+    64us) raft_consensus.cc:1685] finished
0709 13:11:35.627374 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.627548 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13366,"raft.queue_time_us":10138,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5450,"thread_start_us":972679,"threads_started":1,"wal-append.queue_time_us":737191}
W20260709 13:11:35.657644 25381 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:11:35.624375 25068 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:35.610625 25398 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.663731 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 136002us
I20260709 13:11:35.658401 25352 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.661280 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:35.705601 21387 rpcz_store.cc:276] 0709 13:11:34.283699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.549216 (+265517us) service_pool.cc:224] Handling call
0709 13:11:34.549534 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.549706 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:35.571449 (+1021743us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.657628 (+ 86179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.657688 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:35.657736 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.657819 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.657951 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18090,"prepare.queue_time_us":75955,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2296,"thread_start_us":1089158,"threads_started":2}
I20260709 13:11:35.637387 25328 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.641932 25344 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.631621 25306 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:35.714147 25374 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:11:35.714603 25277 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.715184 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2300) took 1549 ms. Trace:
I20260709 13:11:35.716020 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 559) took 1223 ms. Trace:
W20260709 13:11:35.773801 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.717765 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 555) took 2566 ms. Trace:
I20260709 13:11:35.776420 21314 rpcz_store.cc:276] 0709 13:11:33.141126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.143478 (+  2352us) service_pool.cc:224] Handling call
0709 13:11:33.143771 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.144120 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.144148 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.144554 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.488148 (+343594us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b1800343780. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:11:33.863235 (+375087us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.863272 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.863337 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.318257 (+1454920us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:35.707785 (+389528us) raft_consensus.cc:1685] finished
0709 13:11:35.707820 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.707946 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2781,"raft.queue_time_us":460,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":1590,"spinlock_wait_cycles":69475456,"thread_start_us":374880,"threads_started":1,"wal-append.queue_time_us":1183181}
I20260709 13:11:35.664199 24969 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.710790 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:35.705963 25397 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:35.773967 21318 rpcz_store.cc:276] 0709 13:11:34.492290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.625215 (+132925us) service_pool.cc:224] Handling call
0709 13:11:34.634797 (+  9582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.693689 (+ 58892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.715800 (+1022111us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b540021acd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:35.715965 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134243200}
I20260709 13:11:35.779770 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2315) took 1088 ms. Trace:
I20260709 13:11:35.773442 21320 rpcz_store.cc:276] 0709 13:11:34.165917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.166093 (+   176us) service_pool.cc:224] Handling call
0709 13:11:34.166491 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.264529 (+ 98038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.714951 (+1450422us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b5400227c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:35.715123 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124864896}
I20260709 13:11:35.780265 21321 rpcz_store.cc:276] 0709 13:11:34.691077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.668581 (+977504us) service_pool.cc:224] Handling call
0709 13:11:35.779713 (+111132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:35.708135 25240 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.781270 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2301) took 1614 ms. Trace:
I20260709 13:11:35.781793 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:35.782766 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 429306us
I20260709 13:11:35.789031 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:35.787559 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:35.791291 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:35.792251 21469 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 5: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:11:35.776115 25380 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:11:35.790705 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:35.786201 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1690) took 1291 ms. Trace:
I20260709 13:11:35.734555 25068 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.704685 25073 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.819263 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 575) took 1226 ms. Trace:
I20260709 13:11:35.799809 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:35.797987 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:35.819157 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:35.816884 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:35.823403 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 106498us
I20260709 13:11:35.886904 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:35.836668 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:35.887694 21467 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:35.819693 21465 rpcz_store.cc:276] 0709 13:11:34.592733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.592870 (+   137us) service_pool.cc:224] Handling call
0709 13:11:34.593184 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.598189 (+  5005us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:34.620284 (+ 22095us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.658046 (+1037762us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.662202 (+  4156us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.662376 (+   174us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:35.662414 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.662484 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.819063 (+156579us) raft_consensus.cc:1685] finished
0709 13:11:35.819081 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.819204 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96594,"prepare.queue_time_us":21894,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":93266,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":15229,"spinlock_wait_cycles":30464,"thread_start_us":949772,"threads_started":1,"wal-append.queue_time_us":733050}
I20260709 13:11:35.707237 25372 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.817770 21463 rpcz_store.cc:276] 0709 13:11:34.494835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.494948 (+   113us) service_pool.cc:224] Handling call
0709 13:11:34.495278 (+   330us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:34.513605 (+ 18327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.513645 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:34.537773 (+ 24128us) log.cc:844] Serialized 78 byte log entry
0709 13:11:34.727699 (+189926us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:34.925199 (+197500us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.571068 (+645869us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.571385 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.571530 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.571596 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.785925 (+214329us) raft_consensus.cc:1685] finished
0709 13:11:35.785954 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.786127 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":682003,"prepare.queue_time_us":182975,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":98,"raft.queue_time_us":680778,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":54366,"spinlock_wait_cycles":98703872,"thread_start_us":152327,"threads_started":1,"wal-append.queue_time_us":789337}
I20260709 13:11:35.893981 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:35.885782 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 66681.2us
I20260709 13:11:35.775748 24737 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.779742 25269 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.739043 25352 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.903182 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:35.780238 25287 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.895066 25190 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 2.080s	user 0.012s	sys 0.011s
I20260709 13:11:35.836187 25176 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.816071 25359 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:35.816257 25342 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.921667 25287 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.923230 24629 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.924178 25342 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:35.925194 25378 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:11:35.925004 24629 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.905151 25277 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.926196 25287 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:35.926570 25342 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.926728 25399 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:35.927225 25399 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.927335 21321 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:35.927600 25399 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:35.799450 25240 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.929095 25306 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.929724 25240 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:35.930253 25240 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:35.913985 25391 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:11:35.930696 25240 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.821306 25288 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.931939 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2303) took 1764 ms. Trace:
I20260709 13:11:35.932579 25062 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:35.933106 25062 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:35.933524 25400 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:11:35.934007 25062 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.936316 25413 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:35.932302 21316 rpcz_store.cc:276] 0709 13:11:34.167585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.261400 (+ 93815us) service_pool.cc:224] Handling call
0709 13:11:34.261813 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.262232 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:34.750031 (+487799us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.780305 (+1030274us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.780776 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.780929 (+   153us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:35.780984 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.781059 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.931723 (+150664us) raft_consensus.cc:1685] finished
0709 13:11:35.931744 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.931882 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":451601,"prepare.queue_time_us":677920,"prepare.run_cpu_time_us":9105,"prepare.run_wall_time_us":368444,"raft.queue_time_us":443741,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":41730,"thread_start_us":790356,"threads_started":2,"wal-append.queue_time_us":490409}
I20260709 13:11:35.936870 25413 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.937609 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:35.938330 25290 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.939138 25413 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.938877 25290 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.941882 25290 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.944245 25340 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:35.933069 25240 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.944859 25340 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.798790 25294 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.945914 25294 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.946905 21462 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:35.816380 25010 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:35.947165 25340 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:35.821319 25148 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.948143 25010 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.948107 25148 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.949097 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2106) took 1666 ms. Trace:
W20260709 13:11:35.912281 25312 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.275s	user 0.016s	sys 0.005s
I20260709 13:11:35.926378 25277 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.917627 25269 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.950894 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1154) took 1403 ms. Trace:
I20260709 13:11:35.951545 25277 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.945204 25160 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.932291 25288 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:35.952602 25387 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 13:11:35.952698 25148 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:35.951937 25269 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:35.953711 25288 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:35.953842 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 578) took 1319 ms. Trace:
I20260709 13:11:35.939735 25413 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:11:35.935591 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:35.912784 24737 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.954556 25312 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.906514 25397 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.930590 25373 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:35.909600 25349 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:35.821555 25328 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.885782 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 561) took 1392 ms. Trace:
I20260709 13:11:35.972790 21318 rpcz_store.cc:276] 0709 13:11:34.492966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.796825 (+1303859us) service_pool.cc:224] Handling call
0709 13:11:35.885211 (+ 88386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.885389 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.885414 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.885458 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:35.885488 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.885610 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.885720 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:35.974396 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:35.975097 21318 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:35.800233 21314 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:35.949474 21395 rpcz_store.cc:276] 0709 13:11:34.282986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.541942 (+258956us) service_pool.cc:224] Handling call
0709 13:11:34.542281 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.660295 (+1118014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.948858 (+288563us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002cc754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:35.949036 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569755008}
I20260709 13:11:35.782399 25341 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.978003 21317 raft_consensus.cc:2368] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10.
I20260709 13:11:35.954378 21461 rpcz_store.cc:276] 0709 13:11:34.634178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.634315 (+   137us) service_pool.cc:224] Handling call
0709 13:11:34.634674 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:34.657660 (+ 22986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.657692 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:34.665858 (+  8166us) log.cc:844] Serialized 52 byte log entry
0709 13:11:35.611452 (+945594us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:35.611504 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.611616 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.953633 (+342017us) raft_consensus.cc:1685] finished
0709 13:11:35.953651 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.953786 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46814,"raft.queue_time_us":15222,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5801,"thread_start_us":924448,"threads_started":1,"wal-append.queue_time_us":883647}
I20260709 13:11:35.924219 25344 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:35.918092 25301 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:35.977707 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2311) took 1287 ms. Trace:
I20260709 13:11:35.990573 21314 rpcz_store.cc:276] 0709 13:11:34.690205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.781530 (+1091325us) service_pool.cc:224] Handling call
0709 13:11:35.977651 (+196121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:35.991751 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:35.992563 21314 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:35.993655 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:35.994611 21436 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:35.951267 22038 rpcz_store.cc:276] 0709 13:11:34.547681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.548110 (+   429us) service_pool.cc:224] Handling call
0709 13:11:34.548483 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:34.564282 (+ 15799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.564312 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:34.596827 (+ 32515us) log.cc:844] Serialized 52 byte log entry
0709 13:11:35.341006 (+744179us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:35.341042 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.950505 (+609463us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54004696d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:35.950552 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.950599 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:35.950614 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.950836 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13920,"raft.queue_time_us":8844,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":20824,"spinlock_wait_cycles":36585216,"thread_start_us":741704,"threads_started":1,"wal-append.queue_time_us":754782}
I20260709 13:11:35.997154 25190 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:35.976871 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:35.739733 25398 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.997817 25190 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:35.998605 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:35.998760 25190 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:35.999599 25398 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:35.957494 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:35.980734 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 366067us
I20260709 13:11:35.889029 25068 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.782239 24969 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:36.001467 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44058.8us
I20260709 13:11:36.006562 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:35.989966 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1147) took 2469 ms. Trace:
I20260709 13:11:35.968186 25373 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:35.967701 25359 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:36.017513 25312 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.017273 25359 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.018661 25269 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:36.019623 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:35.989585 25341 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.003615 25148 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:11:36.023449 25341 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.005339 25301 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:35.959600 25176 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.027681 25301 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.032217 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:35.968396 25413 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:35.980656 25344 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.012274 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:36.012598 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:36.013530 25409 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:36.013826 25291 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.186s	user 0.010s	sys 0.000s
I20260709 13:11:36.014053 25396 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.056600 25269 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:36.015594 25372 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:35.921763 25401 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:11:36.016115 25294 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:35.970199 25397 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.020589 25373 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.027824 25176 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.028194 21316 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:36.009696 21314 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:36.031318 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:35.999501 21318 raft_consensus.cc:2410] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:36.033066 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:36.011539 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:36.007242 22032 rpcz_store.cc:276] 0709 13:11:33.509394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.509522 (+   128us) service_pool.cc:224] Handling call
0709 13:11:33.509920 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.263561 (+753641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.263591 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.276226 (+ 12635us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.647557 (+371331us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:34.647610 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.932728 (+1285118us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540046aad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:35.932773 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.932817 (+    44us) raft_consensus.cc:1685] finished
0709 13:11:35.932829 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.978582 (+ 45753us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153646,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":291006720,"thread_start_us":929455,"threads_started":2,"wal-append.queue_time_us":501798}
W20260709 13:11:36.048400 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 253072us
I20260709 13:11:36.004343 25287 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.004555 25288 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:36.015673 25399 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.056797 25396 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:36.129222 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.992229 25328 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.142939 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:36.052410 25344 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.141268 21467 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:36.132747 25148 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:36.142441 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:36.143833 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 240734us
I20260709 13:11:36.143152 21465 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:36.156219 21314 raft_consensus.cc:2410] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:11:36.167894 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:36.032871 25341 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:36.169780 25341 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.131541 25269 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:36.146733 25411 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:36.172116 21314 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:36.136894 25338 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:36.136711 25406 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:36.177035 21318 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:11:36.177977 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.177800 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:36.158597 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 126507us
I20260709 13:11:36.155740 25373 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.153973 25165 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:36.236720 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2354) took 1682 ms. Trace:
I20260709 13:11:36.237320 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:36.237540 21314 rpcz_store.cc:276] 0709 13:11:34.554329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.226467 (+1672138us) service_pool.cc:224] Handling call
0709 13:11:36.235812 (+  9345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.236130 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.236153 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.236247 (+    94us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:36.236277 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.236382 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.236588 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:36.068796 25291 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.159379 25346 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:36.162798 25148 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:36.069053 25409 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:36.239734 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 62067.3us
I20260709 13:11:36.241314 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2313) took 1550 ms. Trace:
I20260709 13:11:36.149242 25287 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.242530 21318 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:36.157146 25240 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:11:36.250473 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 86012.9us
I20260709 13:11:36.231505 25269 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.179939 25417 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:36.243284 25165 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.251509 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2310) took 1561 ms. Trace:
I20260709 13:11:36.255568 21318 rpcz_store.cc:276] 0709 13:11:34.689944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.235182 (+1545238us) service_pool.cc:224] Handling call
0709 13:11:36.235555 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.251141 (+ 15586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.251416 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:36.256937 21318 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:36.246902 21314 rpcz_store.cc:276] 0709 13:11:34.690634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.239115 (+1548481us) service_pool.cc:224] Handling call
0709 13:11:36.239792 (+   677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.240344 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.240421 (+    77us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.240561 (+   140us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:36.240692 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.240850 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.241191 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:36.235730 25338 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:36.168813 25255 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:11:36.257654 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2316) took 1566 ms. Trace:
W20260709 13:11:36.441862 21317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2318) took 1750 ms (client timeout 2181 ms). Trace:
I20260709 13:11:36.508569 21318 rpcz_store.cc:276] 0709 13:11:34.691312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.256377 (+1565065us) service_pool.cc:224] Handling call
0709 13:11:36.256648 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.257289 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.257601 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:36.508674 21317 rpcz_store.cc:269] 0709 13:11:34.691797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.661029 (+969232us) service_pool.cc:224] Handling call
0709 13:11:36.441614 (+780585us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54000be5d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:36.441790 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559558016}
I20260709 13:11:36.239573 25010 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:36.506836 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2317) took 1815 ms. Trace:
I20260709 13:11:36.245522 25274 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:36.442329 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 175229us
I20260709 13:11:36.519503 21314 rpcz_store.cc:276] 0709 13:11:34.691546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.506032 (+1814486us) service_pool.cc:224] Handling call
0709 13:11:36.506350 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.506535 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.506560 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.506600 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:36.506629 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.506681 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.506783 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:36.506826 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2350) took 1992 ms. Trace:
I20260709 13:11:36.523739 21321 rpcz_store.cc:276] 0709 13:11:34.514540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.797010 (+1282470us) service_pool.cc:224] Handling call
0709 13:11:35.836725 (+ 39715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.927729 (+ 91004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.448762 (+521033us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b540021b1d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:36.506755 (+ 57993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207636736}
I20260709 13:11:36.180936 25294 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:11:36.529170 25414 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:36.529574 25399 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:36.554030 21314 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:36.530906 25291 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:36.257149 25068 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:36.549377 25292 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:36.550626 25305 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:36.242245 25299 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.277s
I20260709 13:11:36.530221 25423 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:36.636546 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.256304 25352 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:36.446877 25400 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:11:36.556524 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:36.643294 21465 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
W20260709 13:11:36.558933 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 311999us
I20260709 13:11:36.521368 24969 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:36.523444 25274 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:36.236841 25406 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.241255 25411 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.566521 25414 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.572096 25291 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:36.703523 25291 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:36.704442 25291 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:36.758876 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 114280us
I20260709 13:11:36.523736 25338 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.527099 25010 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.445545 25417 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.643159 25356 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:36.767661 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:36.769308 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:36.700265 25408 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.574s	user 0.000s	sys 0.001s
I20260709 13:11:36.649626 21321 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:11:36.532872 25148 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.770613 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:36.695060 25274 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:36.693408 25292 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:36.803550 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.807199 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:36.700727 25290 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:36.565980 25305 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:36.785712 21321 pending_rounds.cc:85] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 5
I20260709 13:11:36.811887 22038 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:36.762832 25255 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:36.772123 25291 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:36.770444 25435 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:36.804011 21208 maintenance_manager.cc:419] P 5338d281947a4ef192ba752d67ec0067: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033391
I20260709 13:11:36.826100 25427 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:36.819599 25148 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:36.826781 25417 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.827183 25165 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.808503 25292 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.817628 25240 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:11:37.126065 25292 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:37.084517 25255 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.127223 25305 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.833870 25330 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:36.835426 25433 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.844630 25409 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:36.846627 25414 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:36.847589 25425 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:36.848078 25341 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.848129 25274 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:36.849166 25287 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.820843 25396 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:36.799280 25356 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:36.896360 25436 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:11:36.822010 25328 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:36.901904 25010 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:36.903906 21315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 2344) took 3048 ms (client timeout 2072 ms). Trace:
I20260709 13:11:35.782790 21319 rpcz_store.cc:276] 0709 13:11:34.166481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.231948 (+ 65467us) service_pool.cc:224] Handling call
0709 13:11:34.232355 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.232607 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:34.560695 (+328088us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.771580 (+1210885us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b1800332440. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:11:35.771800 (+   220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.771867 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:35.771930 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.781055 (+  9125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.781203 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174028,"prepare.queue_time_us":496694,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":26735,"raft.queue_time_us":1045473,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5196,"spinlock_wait_cycles":62596352,"thread_start_us":456751,"threads_started":2,"wal-append.queue_time_us":974682}
W20260709 13:11:36.912179 21389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2104) took 2629 ms (client timeout 1680 ms). Trace:
W20260709 13:11:37.237975 21389 rpcz_store.cc:269] 0709 13:11:34.282499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.317782 (+ 35283us) service_pool.cc:224] Handling call
0709 13:11:36.911816 (+2594034us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540020e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:36.912041 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3574485376}
W20260709 13:11:37.238788 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.915241 25073 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:36.924014 21312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2299) took 2759 ms (client timeout 2340 ms). Trace:
I20260709 13:11:36.890074 25241 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:36.926772 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2351) took 2388 ms. Trace:
W20260709 13:11:36.928246 25424 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:11:37.226455 25305 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:36.930192 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2349) took 2429 ms. Trace:
I20260709 13:11:36.932107 24737 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:36.937757 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 1.05033e+06us
I20260709 13:11:37.250603 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:36.942124 25406 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:36.942273 25407 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.856392 25294 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:36.939759 25400 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:11:36.967578 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 163284us
I20260709 13:11:36.971163 25398 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:36.971692 25399 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.972559 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.284482 21387 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
W20260709 13:11:37.247905 25301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.010s	sys 0.014s
I20260709 13:11:37.285861 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:36.972932 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:36.973798 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.006421 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:37.287593 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:37.287652 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.007580 25306 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:36.974058 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.288707 21388 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:36.974728 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:37.290561 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 315943us
I20260709 13:11:36.975489 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.292474 21391 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:37.295039 25395 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:37.035430 21392 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:37.051402 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 237970us
I20260709 13:11:37.300551 25010 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.301316 25010 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:37.033808 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 510467us
I20260709 13:11:37.303864 25010 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.306003 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:37.307359 24737 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:37.307756 24737 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.308627 24737 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:37.071038 21321 pending_rounds.cc:107] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:11:37.309139 21321 raft_consensus.cc:2889] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.310124 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2323) took 1301 ms. Trace:
I20260709 13:11:37.310551 21321 rpcz_store.cc:276] 0709 13:11:36.009107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.560411 (+551304us) service_pool.cc:224] Handling call
0709 13:11:36.638638 (+ 78227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.309778 (+671140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.310051 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:36.647408 25423 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.079363 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:37.312542 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 233299us
I20260709 13:11:37.313241 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:37.082129 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.315121 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.315456 21392 pending_rounds.cc:85] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 8
I20260709 13:11:37.315748 22038 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:37.316016 21392 pending_rounds.cc:107] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:11:37.078310 25170 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:37.088997 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:37.317142 22040 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:37.316910 25170 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.098402 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.318149 22042 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:37.083709 25345 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.319108 25170 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.318957 25345 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.319675 25170 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:37.078760 25435 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:37.320833 25435 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.321302 25345 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.322072 25435 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:37.316648 21392 raft_consensus.cc:2889] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:37.120239 25344 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.003s
I20260709 13:11:37.324291 25344 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.326812 25344 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:37.129056 25255 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.083866 25384 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:37.084326 24629 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:36.833418 25420 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:11:37.136107 22032 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:37.327775 25384 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.330406 25384 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.330999 25384 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:37.331324 25384 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:37.331678 25384 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:37.190766 22002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.006s	sys 0.011s
W20260709 13:11:37.332221 22002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.006s	sys 0.012s
W20260709 13:11:37.332576 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 1.19223e+06us
W20260709 13:11:37.215755 21287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.009s	sys 0.012s
W20260709 13:11:37.333220 21287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.009s	sys 0.012s
I20260709 13:11:37.073419 25290 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.228866 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.335888 22034 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:37.181183 25330 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:37.337141 25290 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:37.227192 21435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.011s	sys 0.014s
I20260709 13:11:37.337575 25330 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:37.338676 21435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.011s	sys 0.014s
I20260709 13:11:37.339268 25330 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:37.240810 21315 rpcz_store.cc:269] 0709 13:11:33.855247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.855584 (+   337us) service_pool.cc:224] Handling call
0709 13:11:36.903653 (+3048069us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b5400228654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:36.903810 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267838848}
I20260709 13:11:37.243145 21313 rpcz_store.cc:276] 0709 13:11:34.538071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.933799 (+1395728us) service_pool.cc:224] Handling call
0709 13:11:35.934111 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.960068 (+ 25957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.960112 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.960169 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:35.960214 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.926485 (+966271us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b54004150d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:36.926549 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.926712 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59111296}
I20260709 13:11:37.243659 21319 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:11:37.227679 25190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.003s	sys 0.018s
W20260709 13:11:37.341310 25190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.003s	sys 0.018s
I20260709 13:11:37.341473 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2325) took 1288 ms. Trace:
W20260709 13:11:37.242275 21312 rpcz_store.cc:269] 0709 13:11:34.164606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.164749 (+   143us) service_pool.cc:224] Handling call
0709 13:11:36.923708 (+2758959us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540015ccd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:36.923888 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3855512960}
W20260709 13:11:37.247973 21318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.005s	sys 0.025s
W20260709 13:11:37.342183 21318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.005s	sys 0.026s
I20260709 13:11:37.342541 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:37.249116 21320 rpcz_store.cc:276] 0709 13:11:34.500848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.795867 (+1295019us) service_pool.cc:224] Handling call
0709 13:11:35.796183 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.024540 (+228357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.024575 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.024625 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:36.024664 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.929939 (+905275us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400089154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:36.930011 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.930143 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524669184}
I20260709 13:11:37.255247 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.343189 21462 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:37.341907 21319 rpcz_store.cc:276] 0709 13:11:36.052856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.237099 (+1184243us) service_pool.cc:224] Handling call
0709 13:11:37.237540 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:37.341198 (+103658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.341420 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:36.929881 25411 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:37.272557 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1705) took 1232 ms. Trace:
I20260709 13:11:37.344333 21463 rpcz_store.cc:276] 0709 13:11:36.040471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.040617 (+   146us) service_pool.cc:224] Handling call
0709 13:11:36.040932 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.123937 (+ 83005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.123983 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:36.124579 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:11:36.253523 (+128944us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:36.253572 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.253638 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.272344 (+1018706us) raft_consensus.cc:1685] finished
0709 13:11:37.272364 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.272495 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67541,"raft.queue_time_us":69596,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8016,"thread_start_us":128568,"threads_started":1,"wal-append.queue_time_us":522005}
I20260709 13:11:37.273864 24332 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:37.346213 24332 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:37.251147 25373 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.016s	user 0.011s	sys 0.001s
I20260709 13:11:37.247674 25197 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.974282 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.348793 25197 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.275437 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:37.352478 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 77261.3us
I20260709 13:11:37.353305 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:37.354192 25435 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:37.354538 25435 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:37.354939 25190 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:37.355345 25190 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:37.355713 25190 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:37.327172 25328 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:37.356796 25328 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.359246 25328 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:37.355345 21436 leader_election.cc:400] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10.
I20260709 13:11:37.360471 21436 leader_election.cc:403] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:37.361231 24332 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.361500 25344 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:37.313936 25423 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.340731 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:37.267640 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.351948 25197 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.367219 25447 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:37.370189 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:37.370872 21319 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:37.376579 25344 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10.
I20260709 13:11:37.377096 21320 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:37.332234 25170 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.380404 25170 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:37.354923 25435 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:37.265230 25220 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:37.380991 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:37.383481 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:37.390671 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.409005 21320 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:37.409018 21387 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 2.
W20260709 13:11:37.381851 21284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.605s (SENT) [suppressed 2 similar messages]
I20260709 13:11:37.271337 24969 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.384135 21465 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
W20260709 13:11:37.396310 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 68441.6us
I20260709 13:11:37.397648 25328 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:37.398237 25241 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.196172 25433 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.273625 24816 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.400396 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.401829 25274 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.387849 25190 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.402635 24737 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.387300 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:37.359874 25373 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:11:37.384819 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:37.470202 21313 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:37.283726 25339 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:37.411266 25452 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:11:37.411643 25197 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:11:37.287119 25301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.010s	sys 0.014s
I20260709 13:11:37.424868 25220 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.476406 25197 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:37.477598 25197 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.478222 25220 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.391139 25399 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:37.420238 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.445749 25241 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.482225 21396 raft_consensus.cc:606] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:37.482702 21396 raft_consensus.cc:614] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:37.439256 25328 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.428547 24969 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.488691 22041 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:37.423207 22032 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:37.425940 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:37.473695 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:37.489725 21320 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:37.490056 21313 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:37.424371 25330 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:37.491009 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:37.494988 25339 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.502465 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.512472 21320 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:37.512895 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.514505 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.515419 21387 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:11:37.516678 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.445495 21393 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:37.392490 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.523818 21390 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 4.
I20260709 13:11:37.274560 25294 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.416473 25412 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:37.290561 25398 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.520262 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:37.399369 21319 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
W20260709 13:11:37.527133 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 146232us
I20260709 13:11:37.544751 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:37.271569 25407 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.599535 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:37.599466 21315 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:11:37.600489 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51879.3us
I20260709 13:11:37.616426 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:37.456606 24816 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.622419 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:37.518514 25262 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.545425 25190 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:37.636487 25439 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:37.557858 25339 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.521368 24969 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.566460 25197 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:37.701388 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:37.518846 25241 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:37.598682 25411 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.645305 25426 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:37.646003 25448 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:37.647405 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 127188us
I20260709 13:11:37.744230 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:37.721376 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.544868 25399 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.623307 25073 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:37.775175 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:37.775879 21393 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:37.661468 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2322) took 1654 ms. Trace:
W20260709 13:11:37.675669 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 362467us
I20260709 13:11:37.689208 22039 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:37.689416 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:37.633139 25221 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.017s	sys 0.021s
I20260709 13:11:37.697010 21313 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:37.701494 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.502532 25330 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.776876 21314 rpcz_store.cc:276] 0709 13:11:36.006848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.554912 (+548064us) service_pool.cc:224] Handling call
0709 13:11:36.561199 (+  6287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:36.766552 (+205353us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:37.087420 (+320868us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.426115 (+338695us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:37.453496 (+ 27381us) log.cc:844] Serialized 52 byte log entry
0709 13:11:37.453681 (+   185us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:37.453729 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.453819 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.661228 (+207409us) raft_consensus.cc:1685] finished
0709 13:11:37.661246 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.661402 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22103,"prepare.queue_time_us":505414,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":136810,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":18489,"thread_start_us":729083,"threads_started":3,"wal-append.queue_time_us":564362}
I20260709 13:11:37.790947 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.791602 22039 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:37.560577 25344 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:11:37.799621 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.557502 25170 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.803499 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.702883 25417 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:37.790382 25221 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.018s	sys 0.022s
I20260709 13:11:37.702200 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.811681 22042 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:37.740067 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.724174 21315 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:37.745124 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:37.779650 22038 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 3.
W20260709 13:11:37.757091 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 465614us
I20260709 13:11:37.800308 22035 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:37.793478 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:37.816116 22036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.007s	sys 0.007s
I20260709 13:11:37.810586 25417 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:37.799273 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:37.820163 21313 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
W20260709 13:11:37.819478 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74402.2us
I20260709 13:11:37.720875 25439 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:37.816608 22036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.007s	sys 0.007s
W20260709 13:11:37.816856 21395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.013s
W20260709 13:11:37.867853 21395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.014s
I20260709 13:11:37.868588 25190 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:37.869640 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.870610 24816 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.647116 25262 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.825264 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:37.826416 22035 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:37.782426 25073 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.825273 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:37.757046 25301 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:37.908354 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.826089 25456 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:37.780664 25448 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.738893 25411 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.870972 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.911162 21395 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:37.912271 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.913420 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:37.914057 21395 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:37.612746 25412 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:37.790563 25446 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:37.879689 21393 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
W20260709 13:11:37.885607 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 120298us
I20260709 13:11:37.943019 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:37.943709 21393 raft_consensus.cc:2368] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12.
W20260709 13:11:37.869688 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48023.7us
I20260709 13:11:37.944482 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.944896 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:37.945644 25447 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:37.945742 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:37.946053 25447 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:37.946441 25447 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:37.946599 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:37.947423 25190 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:37.947742 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:37.948195 25190 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:37.948493 21393 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:37.885131 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2328) took 1366 ms. Trace:
I20260709 13:11:37.949757 25241 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:37.950595 25241 raft_consensus.cc:697] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:37.951406 25436 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:37.951858 25436 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.952382 25436 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:37.952862 25446 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:37.953297 25446 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:37.903563 24332 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.827168 25417 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:37.754998 24737 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.909024 21394 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:11:37.829149 25330 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.834161 25160 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:37.954313 24332 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.963507 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.907006 25073 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:37.956820 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.885402 25328 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.844096 25439 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.949527 21321 rpcz_store.cc:276] 0709 13:11:36.518417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.311507 (+793090us) service_pool.cc:224] Handling call
0709 13:11:37.311924 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.315123 (+  3199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:37.390817 (+ 75694us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.884596 (+493779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:37.884672 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:37.884740 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.884837 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.885061 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75266,"prepare.queue_time_us":75414,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":116,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6168,"thread_start_us":493293,"threads_started":1}
I20260709 13:11:37.791123 25426 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:37.961570 21391 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.018s	sys 0.041s
I20260709 13:11:37.872946 25396 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:37.833344 24969 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:11:37.990697 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:37.991495 21315 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:37.992410 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.992821 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:37.993300 21394 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:37.833627 25435 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.916949 25456 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:37.955427 25466 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:11:37.983201 21318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.014s	sys 0.047s
W20260709 13:11:38.000386 21318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.015s	sys 0.047s
I20260709 13:11:37.985983 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.004614 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2355) took 2039 ms. Trace:
I20260709 13:11:37.989574 21395 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:37.938143 25448 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:37.990947 21391 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.019s	sys 0.041s
I20260709 13:11:37.972860 22042 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:38.007694 21284 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.038s	sys 0.094s
W20260709 13:11:38.008013 21284 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.038s	sys 0.094s
W20260709 13:11:38.008349 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 626490us
I20260709 13:11:38.011899 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:37.938925 25301 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.015436 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.016405 22040 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:37.998373 25433 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:37.982789 25349 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:38.021687 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.020169 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.022527 21321 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:37.997779 24969 consensus_queue.cc:1243] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:38.005728 25456 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:38.019157 21395 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:38.011126 25294 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:37.949492 25190 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:37.951674 25241 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.035789 22042 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:38.033536 25407 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.012260 25396 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:38.048489 25477 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:11:38.054165 25262 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:38.051775 25384 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.716s	user 0.004s	sys 0.007s
I20260709 13:11:38.055302 25426 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.055228 25384 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:38.049552 25474 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:11:38.057045 25463 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:11:38.051419 25293 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:38.204725 25301 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.180835 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.208772 21321 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:38.210465 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.180959 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.211524 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.183702 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.185070 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.196513 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.200171 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.203620 25293 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:38.211539 21321 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:38.217788 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.217743 25293 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.166021 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.048671 25170 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:38.204944 25269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.305s	user 0.008s	sys 0.003s
W20260709 13:11:38.220846 25269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.321s	user 0.008s	sys 0.003s
I20260709 13:11:38.223256 21312 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:11:38.225037 21313 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:11:38.219199 21321 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:38.226729 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.227550 21313 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:38.227578 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.235006 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.236070 21313 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:38.237736 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.219172 22031 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:11:38.233547 25293 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:38.067974 25384 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.251077 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.252736 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:38.263828 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.291226 25305 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.040s	user 0.010s	sys 0.006s
W20260709 13:11:38.064353 25402 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.143s	user 0.003s	sys 0.004s
I20260709 13:11:38.111585 25411 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.068555 25412 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:38.098929 25417 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.201045 25073 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.103685 25435 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.132583 25436 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.360695 25073 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.362023 22034 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:11:38.362329 25390 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 2.651s	user 0.000s	sys 0.013s
I20260709 13:11:38.363271 25436 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.126794 25439 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.366850 25439 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.117909 25446 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.370386 25446 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.110635 25447 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.133684 25448 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.121188 25456 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:38.067643 25469 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:11:38.235059 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.355690 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.385413 22039 raft_consensus.cc:2368] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8.
I20260709 13:11:38.447439 21389 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:38.446898 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:38.389402 25291 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.304s	user 0.013s	sys 0.006s
I20260709 13:11:38.384336 25396 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:38.501212 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.499435 21313 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:38.517313 21392 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:38.395110 25417 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.388624 25384 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.492985 21315 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:38.446327 25397 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.496994 21321 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:11:38.495687 25431 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.529s	user 0.008s	sys 0.035s
I20260709 13:11:38.391407 25415 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:38.501880 25461 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.634s	user 0.011s	sys 0.012s
I20260709 13:11:38.514572 25456 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.505658 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 642) took 1239 ms. Trace:
I20260709 13:11:38.496680 25447 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:38.509027 21316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 564) took 2574 ms (client timeout 1515 ms). Trace:
I20260709 13:11:38.387166 25448 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.511669 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2360) took 2478 ms. Trace:
W20260709 13:11:38.501212 25197 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.802s	user 0.005s	sys 0.019s
I20260709 13:11:38.539120 25415 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:38.541486 21317 rpcz_store.cc:276] 0709 13:11:36.033617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.929054 (+895437us) service_pool.cc:224] Handling call
0709 13:11:38.508809 (+1579755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.509239 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.509266 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.509307 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:38.509339 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.509423 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.511360 (+  1937us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003c8cd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:38.511482 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3632041728}
W20260709 13:11:38.540915 21316 rpcz_store.cc:269] 0709 13:11:35.934320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.937369 (+  3049us) service_pool.cc:224] Handling call
0709 13:11:38.508583 (+2571214us) spinlock_profiling.cc:243] Waited 89.9 ms on lock 0x7b54003c8cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:38.508764 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206870272}
I20260709 13:11:38.557708 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.559962 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.567226 22039 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:38.558533 25412 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:38.581740 25412 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.540400 21391 rpcz_store.cc:276] 0709 13:11:37.265683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.293356 (+ 27673us) service_pool.cc:224] Handling call
0709 13:11:37.293747 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.293997 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:38.006311 (+712314us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.504770 (+498459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.504907 (+   137us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:38.505103 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.505239 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.505447 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2810,"prepare.queue_time_us":210578,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":5277,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":190,"thread_start_us":1192374,"threads_started":2,"wal-append.queue_time_us":481137}
I20260709 13:11:38.559019 25384 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:38.566519 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 516670us
I20260709 13:11:38.612437 25338 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:38.617663 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.619926 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.615658 25412 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.623821 25348 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:38.624346 25348 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:38.626878 25384 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.628069 25348 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.632923 22035 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:38.635175 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.637423 25356 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.637689 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.639755 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:38.641067 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:38.647735 22032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 937) took 1941 ms (client timeout 2204 ms). Trace:
I20260709 13:11:38.647912 21465 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:11:38.648269 22032 rpcz_store.cc:269] 0709 13:11:36.705841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.769065 (+ 63224us) service_pool.cc:224] Handling call
0709 13:11:38.647187 (+1878122us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54004696d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:38.647528 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824883968}
I20260709 13:11:38.650309 21462 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:11:38.651835 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.652191 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2332) took 1268 ms. Trace:
I20260709 13:11:38.652613 25356 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:38.652582 21312 rpcz_store.cc:276] 0709 13:11:37.383848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.384060 (+   212us) service_pool.cc:224] Handling call
0709 13:11:37.384575 (+   515us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:38.224189 (+839614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.651840 (+427651us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b5400229054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:38.652130 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926110976}
I20260709 13:11:38.653728 25349 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:38.653520 25356 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.654270 25349 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:38.656478 25356 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.656440 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 950) took 1387 ms. Trace:
I20260709 13:11:38.657215 22041 rpcz_store.cc:276] 0709 13:11:37.269721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.270021 (+   300us) service_pool.cc:224] Handling call
0709 13:11:37.270388 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.489203 (+218815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.655907 (+1166704us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54007e0c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:38.656218 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470601984}
I20260709 13:11:38.660652 24332 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.671968 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.671288 21214 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 10, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 10 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:38.676909 25475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.040s	sys 0.058s
W20260709 13:11:38.678320 25475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.040s	sys 0.058s
I20260709 13:11:38.681192 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.681977 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.683848 25062 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.684589 25062 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.669813 25415 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.688512 25062 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:38.689414 21462 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:38.688771 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:38.689116 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:38.692571 25415 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.693235 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.695195 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49116 (request call id 34) took 1411 ms. Trace:
I20260709 13:11:38.708859 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.709828 21470 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:38.710806 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.711058 21393 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:38.712074 21464 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:38.704308 21396 rpcz_store.cc:276] 0709 13:11:37.283343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.287452 (+  4109us) service_pool.cc:224] Handling call
0709 13:11:38.694773 (+1407321us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540017f2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf212853 00007fc2c41e060a 00007fc2bd7667d4 00007fc2bd766762 00007fc2bd766691 00007fc2bd76660c 00007fc2bd7658c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:38.694966 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445447936}
I20260709 13:11:38.715454 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.718729 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.719260 21461 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:11:38.719386 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 85789.6us
I20260709 13:11:38.720017 21393 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:38.722786 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.724711 21393 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:38.726521 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.722797 25441 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:38.727785 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.729622 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:38.721639 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.734405 21468 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:38.736951 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:38.738132 24332 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:38.738335 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:38.739164 25437 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.739521 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:38.738549 24332 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:38.740267 24332 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:38.733662 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 43688.4us
I20260709 13:11:38.730564 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:38.746737 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.750345 25441 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:38.750816 25441 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.751134 25441 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:38.751785 25349 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.754142 25349 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.760636 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:38.761785 21464 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:38.762387 21470 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:38.739845 25437 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.768249 25437 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.774777 21468 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:38.780279 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:38.782362 21468 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:38.784893 25292 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:38.797649 25412 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:38.798255 21391 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:38.005273 21318 rpcz_store.cc:276] 0709 13:11:35.965523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.509627 (+544104us) service_pool.cc:224] Handling call
0709 13:11:36.509888 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.510068 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:37.342537 (+832469us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.000916 (+658379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.004184 (+  3268us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:38.004268 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.004360 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.004534 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":739967,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":5059,"raft.queue_time_us":227,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3792,"thread_start_us":1490150,"threads_started":2}
I20260709 13:11:38.806775 25291 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.807507 25291 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.809811 25291 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.810029 21466 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:11:38.810559 21466 pending_rounds.cc:85] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 7
I20260709 13:11:38.810847 21466 pending_rounds.cc:107] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:11:38.811164 21466 raft_consensus.cc:2889] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:38.814533 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:38.815265 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:38.816220 21319 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:38.803311 25412 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.817751 25412 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:38.819860 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:38.820771 21314 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:38.806659 25423 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:38.824301 25423 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.826946 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:38.827749 21315 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:38.829443 25384 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:38.829879 25384 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:38.830289 25384 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:38.832329 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:38.832615 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:38.833981 24875 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:38.836561 25274 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:38.837397 25274 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.838066 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:38.838400 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.838976 21312 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:38.839262 21320 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:38.840646 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:38.842746 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 519) took 1143 ms. Trace:
I20260709 13:11:38.843154 22042 rpcz_store.cc:276] 0709 13:11:37.699480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.824906 (+125426us) service_pool.cc:224] Handling call
0709 13:11:38.842404 (+1017498us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54005c49d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:38.842580 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158852736}
W20260709 13:11:38.845312 21389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2127) took 1871 ms (client timeout 2249 ms). Trace:
W20260709 13:11:38.845747 21389 rpcz_store.cc:269] 0709 13:11:36.973963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.239221 (+265258us) service_pool.cc:224] Handling call
0709 13:11:38.845108 (+1605887us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540009f954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:38.845245 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486821248}
I20260709 13:11:38.849041 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:38.852267 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.852998 21396 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
W20260709 13:11:38.853879 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49512.9us
I20260709 13:11:38.855854 25417 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.856154 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.857060 21387 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:38.858474 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:38.859207 21387 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:38.862619 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.863649 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.864620 21389 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:38.864749 25348 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:38.828977 21214 catalog_manager.cc:5697] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.823112 25292 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.871981 25423 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:38.876516 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:38.868654 25274 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.835682 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:38.884150 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:38.884563 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 108124us
I20260709 13:11:38.884807 25398 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:38.885480 25442 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:38.869867 21214 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.887815 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:38.892616 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:38.889441 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:38.894814 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:38.903510 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.906821 24332 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:38.887840 25441 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:38.921643 25441 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:38.922420 21389 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:38.924961 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.924927 21319 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:38.927356 21315 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:38.921890 24332 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:38.930961 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 131858us
W20260709 13:11:38.933301 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 56934.4us
I20260709 13:11:38.938869 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.922570 25062 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:38.956266 24875 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:38.956907 24875 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.957408 24875 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.943419 25292 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:38.960139 21434 connection.cc:256] RPC call timeout handler was delayed by -1.4906739970000444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:11:38.922201 25442 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:38.960623 21434 connection.cc:256] RPC call timeout handler was delayed by -1.4267739970000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:11:38.932874 25293 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:38.964432 21434 connection.cc:256] RPC call timeout handler was delayed by -1.2120887190000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:11:38.966034 21434 connection.cc:256] RPC call timeout handler was delayed by -1.2012887189999901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260709 13:11:38.954006 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 76463.4us
I20260709 13:11:38.952248 25274 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:38.967133 21320 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:11:38.975122 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 139697us
I20260709 13:11:38.966014 25442 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:38.977649 21434 connection.cc:256] RPC call timeout handler was delayed by -1.095573996999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 13:11:38.968205 25293 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:38.995091 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:38.995501 21214 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 9, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 9 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:38.997853 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44532.6us
I20260709 13:11:38.980293 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:38.973628 25274 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:38.997639 25293 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:39.012861 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.013224 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:39.013679 21391 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:39.014597 25368 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:39.015057 25368 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.015414 25368 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.015635 25062 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:39.016240 25062 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:39.022521 21321 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:11:39.023298 21284 leader_election.cc:400] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8.
I20260709 13:11:39.023633 21284 leader_election.cc:403] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:39.007513 25274 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.034108 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:39.034631 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.037621 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 148431us
W20260709 13:11:39.048868 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 49454.6us
W20260709 13:11:39.062356 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55125.9us
I20260709 13:11:39.068156 21314 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:39.067730 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:39.070735 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:39.072921 21321 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:39.073083 25277 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.078917 21318 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
W20260709 13:11:39.077997 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 190705us
I20260709 13:11:39.087021 21312 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.097131 21387 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:39.101617 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:39.103312 25292 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:39.103778 25292 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:39.104221 25292 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.104768 25412 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.106310 25417 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:39.107066 25412 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:39.107725 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.109043 25398 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:39.101652 21218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 275) took 30409 ms (client timeout 15000 ms). Trace:
I20260709 13:11:39.129786 21284 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:39.134140 21389 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
W20260709 13:11:39.137598 25505 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:11:39.134080 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:39.140954 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55809.7us
I20260709 13:11:39.138271 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:39.083987 25416 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
W20260709 13:11:39.146910 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48966us
I20260709 13:11:39.151901 25447 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:39.152418 25447 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:39.152771 25447 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:39.156548 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44248.6us
I20260709 13:11:39.161087 25440 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:39.161412 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:39.161616 25440 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:39.162042 25440 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:39.166132 24629 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.166674 24629 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.169185 24629 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:39.169209 25501 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:11:39.172971 21214 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.175001 21214 catalog_manager.cc:5697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.127892 25292 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.145151 25441 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:39.180204 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:39.190630 24332 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:39.188577 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:39.193485 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 64895.8us
W20260709 13:11:39.193663 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46840.3us
I20260709 13:11:39.188884 21214 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 8, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 8 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.182281 25412 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:11:39.178750 25190 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.194561 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:39.205760 21320 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:11:39.206697 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 59072.7us
I20260709 13:11:39.209403 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:39.199563 25490 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:39.217128 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58360.8us
I20260709 13:11:39.217929 21312 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:39.219163 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:39.212270 21214 catalog_manager.cc:5697] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 10, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 10 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.223006 21467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85584105b0f74652871311c68f5de4db"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:11:39.220849 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 639) took 1879 ms. Trace:
I20260709 13:11:39.218483 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:39.218842 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:39.223785 21467 raft_consensus.cc:606] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:39.214458 25416 raft_consensus.cc:2764] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:39.238533 21389 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:39.204831 25293 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.218573 25441 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:39.241106 21467 raft_consensus.cc:614] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:39.225183 21388 rpcz_store.cc:276] 0709 13:11:37.259696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.289662 (+ 29966us) service_pool.cc:224] Handling call
0709 13:11:37.412474 (+122812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.971727 (+559253us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:38.013736 (+ 42009us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.711620 (+697884us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b18003dc060. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:11:38.972020 (+260400us) log.cc:844] Serialized 14 byte log entry
0709 13:11:39.005615 (+ 33595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.008592 (+  2977us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:39.023128 (+ 14536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.131296 (+108168us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54000f19d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:39.131366 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.135037 (+  3671us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:39.138816 (+  3779us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4287,"prepare.queue_time_us":47489,"prepare.run_cpu_time_us":177,"prepare.run_wall_time_us":17749,"raft.queue_time_us":22827,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4710,"spinlock_wait_cycles":1298909696,"thread_start_us":220532,"threads_started":1,"wal-append.queue_time_us":983622}
I20260709 13:11:39.247483 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.248160 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:39.250628 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47873.1us
W20260709 13:11:39.250067 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45725.9us
I20260709 13:11:39.254020 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.254595 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.254194 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.236361 25490 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:39.263798 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.255223 21394 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:39.265061 21391 raft_consensus.cc:2368] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5.
I20260709 13:11:39.258016 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.258284 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:39.118649 21218 rpcz_store.cc:269] 0709 13:11:08.691803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.692251 (+   448us) service_pool.cc:224] Handling call
0709 13:11:39.101379 (+30409128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:30.320003 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:30.321011 (+  1008us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:30.321100 (+    89us) write_op.cc:435] Acquired schema lock
0709 13:11:30.321138 (+    38us) tablet.cc:662] Decoding operations
0709 13:11:30.322811 (+  1673us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:30.322919 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:30.322960 (+    41us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:11:30.669176 (+346216us) tablet.cc:701] Row locks acquired
0709 13:11:30.717186 (+ 48010us) write_op.cc:260] PREPARE: finished
0709 13:11:30.749821 (+ 32635us) write_op.cc:270] Start()
0709 13:11:30.766081 (+ 16260us) write_op.cc:276] Timestamp: P: 1783602690743938 usec, L: 0
0709 13:11:30.766103 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:30.825926 (+ 59823us) log.cc:844] Serialized 4836 byte log entry
0709 13:11:30.983016 (+157090us) op_driver.cc:464] REPLICATION: finished
0709 13:11:31.646379 (+663363us) write_op.cc:301] APPLY: starting
0709 13:11:31.646477 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:31.646750 (+   273us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:31.646889 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:31.784969 (+138080us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:31.847358 (+ 62389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:11:31.847408 (+    50us) write_op.cc:312] APPLY: finished
0709 13:11:31.847813 (+   405us) log.cc:844] Serialized 89 byte log entry
0709 13:11:31.848005 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.848171 (+   166us) write_op.cc:454] Released schema lock
0709 13:11:31.848242 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:31.848664 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.848689 (+    25us) write_op.cc:454] Released schema lock
0709 13:11:32.326003 (+477314us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21532a 00007fc2bf19af14 00007fc2bf19aec3 00007fc2bf19ae38 00007fc2bf19adf3 00007fc2bf19a0dc 00007fc2bf1c3e16 00007fc2bf1abcbb 00007fc2bf19639d 00007fc2bf199d75
Metrics: {"mutex_wait_us":438706,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":663067,"apply.run_cpu_time_us":4821,"apply.run_wall_time_us":202243,"num_ops":12,"prepare.queue_time_us":394680,"prepare.run_cpu_time_us":25996,"prepare.run_wall_time_us":661989,"raft.queue_time_us":7258,"raft.run_cpu_time_us":13417,"raft.run_wall_time_us":1375070,"replication_time_us":215223,"spinlock_wait_cycles":72869248,"thread_start_us":1125916,"threads_started":4,"wal-append.queue_time_us":103591,"wal-append.run_cpu_time_us":6829,"wal-append.run_wall_time_us":1924834}]]}
I20260709 13:11:39.249778 24629 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:39.268632 25412 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:39.269263 25412 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:39.270336 25412 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.271077 25062 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.272377 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.273098 21393 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:11:39.274881 21387 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:39.275386 21318 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:39.276419 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:39.277244 25398 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:39.277650 25398 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:39.277694 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:39.279021 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:39.281208 25447 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.281759 21396 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:11:39.282078 25503 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.143s	user 0.004s	sys 0.000s
I20260709 13:11:39.283010 25490 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.278661 25398 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.266506 21214 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.291742 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.257175 25277 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8.
I20260709 13:11:39.292196 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:39.219834 25190 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.299005 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.258461 25416 raft_consensus.cc:2764] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:39.298832 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.284111 25441 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:39.310513 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.308784 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:39.312693 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 156187us
I20260709 13:11:39.256326 24875 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.317950 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.319593 21388 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:39.314803 25348 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:39.339360 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.333137 21214 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 6, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 6 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:39.340198 21390 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:11:39.336421 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51748.1us
I20260709 13:11:39.342355 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.326118 25384 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.337852 25398 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:39.346827 21214 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 5 to 8, term changed from 7 to 8, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to <none>, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:39.325858 25292 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:39.340090 25161 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:11:39.348863 21214 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 11, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 11 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:39.350963 25506 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:11:39.351262 24629 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:39.351997 25451 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:39.352634 25451 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.355381 25451 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:39.351181 21387 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:39.345814 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:39.367666 21387 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:39.338801 25350 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:39.387598 25350 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.388074 25350 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:39.388564 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:39.388646 25456 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:39.389489 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:39.389665 25456 consensus_queue.cc:1243] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:39.390494 24332 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:39.368232 21467 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:39.390905 24332 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:39.391322 24332 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:39.391971 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.392552 25220 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:39.393019 25220 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:39.393853 25220 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.395097 25220 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:39.390372 25456 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:39.404613 25456 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:39.405452 25456 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:39.378484 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56685.5us
I20260709 13:11:39.385602 24875 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:39.407322 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.351014 21214 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.398672 24332 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.400310 25441 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.374073 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:39.404765 21390 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:39.375100 24629 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:39.365715 25293 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:39.429939 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.432241 21214 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.428562 25368 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.428808 25274 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.434518 21214 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 3 to 7, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 7 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:39.435863 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46441.5us
I20260709 13:11:39.436429 24629 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:39.436388 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62419.5us
I20260709 13:11:39.453068 24332 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:39.456624 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:39.459110 21467 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:11:39.460412 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46930.5us
I20260709 13:11:39.465704 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:39.467350 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:39.468506 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:39.469296 21315 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.473839 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:39.476042 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:39.476923 22041 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:39.480451 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:39.482045 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:39.482967 22040 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:39.484550 21317 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:39.486528 22032 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:39.413713 25451 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:39.435477 25516 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:39.496978 21313 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:39.493973 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:39.494845 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:39.500639 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:39.500563 21214 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 2 to 3, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.503755 22042 raft_consensus.cc:2368] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5.
I20260709 13:11:39.508615 24629 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:39.516814 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 159145us
I20260709 13:11:39.515197 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:39.488701 25348 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:39.421510 25442 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.523423 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.517037 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:39.522369 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.525061 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:39.526196 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.515607 21214 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:39.529726 21318 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:39.531029 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:39.497910 25516 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:39.539948 22032 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:39.459198 25416 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:11:39.516235 25490 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:39.547108 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.523036 25292 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:39.554467 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.557721 21315 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:39.554675 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:39.554865 21314 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:39.553661 21321 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:39.519881 25010 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 13:11:39.528646 25447 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:39.551110 25490 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.540058 25384 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:39.549851 25416 consensus_queue.cc:1243] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:39.593071 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:39.597347 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:39.545503 25190 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:39.593539 21214 catalog_manager.cc:5697] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 5 to 7, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 7 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.532971 25293 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 13:11:39.591763 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 76614.1us
I20260709 13:11:39.608850 22038 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 5: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:39.534264 25451 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:39.586266 25490 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.613909 21387 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:39.615376 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:39.620596 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:39.624313 22041 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:39.598096 25292 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:39.634246 21390 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:39.638103 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:39.638795 21314 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:39.638939 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:39.650487 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:39.656731 25274 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:39.660208 21390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:39.660859 21390 raft_consensus.cc:606] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:11:39.661199 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 143702us
I20260709 13:11:39.661557 25442 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:39.662678 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:39.662153 21214 catalog_manager.cc:5697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 3 to 4, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.664340 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:39.665232 22036 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:39.666347 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:39.667415 25417 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:39.584344 25456 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.668527 25345 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:39.669170 25435 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:39.669628 25435 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:39.670084 25435 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.672770 25062 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:39.673436 25062 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:39.675210 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:39.675664 25515 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.244s	user 0.000s	sys 0.002s
I20260709 13:11:39.675415 25516 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.676378 25293 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:39.677635 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:39.661211 21390 raft_consensus.cc:614] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:39.681149 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 83701.4us
I20260709 13:11:39.685220 21314 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:39.692749 25062 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:39.700716 21214 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:39.701884 21465 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:39.707566 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:39.700388 25345 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:39.695101 25274 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:39.688630 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:39.714558 22002 leader_election.cc:336] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.515s (SENT)
I20260709 13:11:39.700179 25394 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:39.717635 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:39.718305 24332 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:39.727128 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:39.729699 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.740935 21388 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 6.
I20260709 13:11:39.743713 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:39.706449 25368 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:39.686794 25412 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:11:39.692819 25161 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:11:39.716414 25274 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:39.694103 25509 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:39.730685 25197 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:39.715194 25348 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:39.766000 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 217037us
I20260709 13:11:39.770459 21284 leader_election.cc:400] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5.
I20260709 13:11:39.770953 21284 leader_election.cc:403] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:39.767976 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:39.747768 25277 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:39.776245 21465 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
W20260709 13:11:39.812650 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46494.5us
W20260709 13:11:39.814364 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 105842us
I20260709 13:11:39.769847 25274 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.816630 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:39.816795 25517 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:11:39.826293 21468 raft_consensus.cc:2410] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:39.817698 25442 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5.
W20260709 13:11:39.818179 25514 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:39.821362 25348 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.780253 25368 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:39.780916 25277 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:39.829231 25277 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.828790 25345 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:39.838827 25440 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.008s
I20260709 13:11:39.851564 25516 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:39.840873 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 122483us
I20260709 13:11:39.840391 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:39.839216 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 432131us
I20260709 13:11:39.774698 25519 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:11:39.769152 25292 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.890125 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:39.890600 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 50871.2us
W20260709 13:11:39.893092 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 178570us
I20260709 13:11:39.898409 21396 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:39.900794 21468 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:39.902240 21467 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:39.913249 22032 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:39.865442 25384 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:39.917888 22035 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:11:39.919083 21467 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:39.917945 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:39.920521 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 305211us
W20260709 13:11:39.928462 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 67022.5us
I20260709 13:11:39.932197 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:39.936077 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:39.937016 21315 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:39.862078 25440 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:39.961885 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:39.953527 21467 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:39.926395 25416 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:39.975199 21466 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:39.930436 25394 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:39.981282 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:39.982510 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:39.986852 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.930647 25451 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:39.952415 25384 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:39.997074 21468 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
W20260709 13:11:40.003006 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.017102 25010 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:40.018968 25010 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:40.019495 25010 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:39.935555 25277 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.021831 25277 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.023409 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.024355 21470 raft_consensus.cc:2410] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:40.025309 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.026396 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:40.027200 25350 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260709 13:11:40.027611 25350 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.029070 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:40.024911 25394 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:40.028571 25523 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:11:40.052431 21461 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:11:40.029874 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.052690 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.029874 21470 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.992787 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.050645 21320 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:40.051232 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 334210us
W20260709 13:11:40.055403 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 142689us
I20260709 13:11:40.059043 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.060171 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:40.060266 21388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:40.061024 21388 raft_consensus.cc:606] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:40.052853 21461 pending_rounds.cc:85] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 4
I20260709 13:11:40.061479 21388 raft_consensus.cc:614] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:40.061617 21461 pending_rounds.cc:107] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:11:40.062157 21461 raft_consensus.cc:2889] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:40.056344 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 93351.7us
I20260709 13:11:40.029510 25519 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:11:40.069541 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.069664 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.072177 25533 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:40.073037 25384 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.074317 21312 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:40.090415 21436 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:40.077234 25010 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.079666 21316 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:40.063506 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:40.080376 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.081575 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.096407 21468 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:40.082995 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:39.995217 25197 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:40.089582 21462 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:40.051115 25348 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.089982 21464 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:40.091403 24629 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:40.094626 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.106338 24629 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.106731 24629 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:40.100291 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 115765us
I20260709 13:11:40.101894 21465 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:40.102768 25197 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.029899 25274 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.104111 21312 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:11:40.112742 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.121371 22040 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:40.123935 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.126143 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:40.130477 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.130630 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.134599 21316 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:40.134775 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:40.137336 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:40.136698 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.110073 25537 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.141422 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:40.143415 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:11:40.146347 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 82941.3us
I20260709 13:11:40.131773 25524 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:40.152963 21312 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:40.153373 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:40.161041 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.097736 25533 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.163328 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.164191 21393 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:40.163313 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:40.163245 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:40.168783 21465 raft_consensus.cc:2376] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12. Re-sending same reply.
I20260709 13:11:40.170302 21470 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:40.171193 24629 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:40.164109 21464 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:11:40.126039 25435 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.175334 21470 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:40.177953 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.232333 25456 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:40.243345 25528 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:40.250252 25534 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:11:40.231436 25550 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:40.242767 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.243867 21461 raft_consensus.cc:2368] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:40.140328 25545 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:11:40.245462 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.171808 25517 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:11:40.122083 25348 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:40.248756 21312 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:40.231971 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.249452 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.241102 25350 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:40.314664 21468 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:40.315986 25274 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.317003 25220 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:40.317476 25220 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:40.320515 25539 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:40.325445 25533 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.154026 25524 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:40.124611 25490 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.243285 21465 pending_rounds.cc:85] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 3
I20260709 13:11:40.334160 21465 pending_rounds.cc:107] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:40.334522 21465 raft_consensus.cc:2889] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:40.241917 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:40.242025 21463 pending_rounds.cc:85] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 5
I20260709 13:11:40.335716 21463 pending_rounds.cc:107] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:11:40.335976 21463 raft_consensus.cc:2889] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:40.336302 21463 pending_rounds.cc:107] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:11:40.151489 25537 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.336539 21463 raft_consensus.cc:2889] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:40.336990 25539 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:40.149829 25516 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:11:40.295171 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.300282 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:40.300859 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 147581us
I20260709 13:11:40.304500 24629 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:40.311406 21389 raft_consensus.cc:2376] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10. Re-sending same reply.
I20260709 13:11:40.340492 21391 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.298775 25528 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:40.342535 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.338030 25539 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.352800 25537 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:40.354007 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:40.354365 25435 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.359135 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:40.332686 25440 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:40.348227 25528 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:40.366290 21320 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:40.340072 25524 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:40.359249 25435 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:40.387806 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:40.421501 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:40.425326 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.426168 21470 raft_consensus.cc:2376] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11. Re-sending same reply.
I20260709 13:11:40.424705 25062 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:40.432832 25435 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:40.433314 25435 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:40.433820 25435 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:40.434981 25220 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.436331 25220 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:40.437708 21390 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:40.439487 25529 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:40.433369 25398 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:40.451279 21360 leader_election.cc:336] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.507s (SENT)
I20260709 13:11:40.454200 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.446789 25398 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:40.473759 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.476601 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 337708us
I20260709 13:11:40.509997 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:40.516664 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.508653 24629 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:11:40.523088 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:40.524417 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:40.536777 24629 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:40.537506 24629 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:40.536716 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.547642 21466 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:11:40.525607 25062 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:40.526410 25161 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:40.551182 21395 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:40.469817 25528 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.533366 25348 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:40.531775 25442 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:40.559381 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.560339 21388 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:40.562450 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:40.562713 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.545636 25551 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.567344 25277 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:40.568091 25277 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.565722 24629 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:40.570204 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.555934 25519 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.572638 21469 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:40.558348 25556 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:11:40.589610 21285 connection.cc:256] RPC call timeout handler was delayed by -2.9024132870000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 13:11:40.555992 25010 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:40.594810 21388 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:40.555413 25161 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:40.590924 25519 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:40.606410 25519 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:40.608165 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.599071 21285 connection.cc:256] RPC call timeout handler was delayed by -2.6216132870000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 13:11:40.609400 21285 connection.cc:256] RPC call timeout handler was delayed by -2.5965897010000845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 13:11:40.609760 21285 connection.cc:256] RPC call timeout handler was delayed by -2.5928132870000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 13:11:40.610147 21285 connection.cc:256] RPC call timeout handler was delayed by -2.5586455320000141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 13:11:40.571022 25548 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:40.590061 25557 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:40.610474 21285 connection.cc:256] RPC call timeout handler was delayed by -2.5487132870000551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 13:11:40.610469 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:40.615397 21285 connection.cc:256] RPC call timeout handler was delayed by -2.51738970100007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:11:40.615787 21285 connection.cc:256] RPC call timeout handler was delayed by -2.4722132870000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260709 13:11:40.613866 24629 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:40.616094 21285 connection.cc:256] RPC call timeout handler was delayed by -2.4597897010000906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:11:40.616420 21285 connection.cc:256] RPC call timeout handler was delayed by -2.4578455320000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:11:40.616703 21285 connection.cc:256] RPC call timeout handler was delayed by -2.4561897010000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:11:40.617002 21285 connection.cc:256] RPC call timeout handler was delayed by -2.3832897010000806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
W20260709 13:11:40.617252 21285 connection.cc:256] RPC call timeout handler was delayed by -2.3732132869999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 13:11:40.617486 21285 connection.cc:256] RPC call timeout handler was delayed by -2.3642132869999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 13:11:40.617714 21285 connection.cc:256] RPC call timeout handler was delayed by -2.223089701000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 13:11:40.617952 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9153700160001108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:11:40.618182 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8667700160000322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 13:11:40.618412 21285 connection.cc:256] RPC call timeout handler was delayed by -1.8181700160000673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:11:40.618650 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6660700160000488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:11:40.618883 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5751700160001292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 13:11:40.619122 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5148700160000317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 13:11:40.619349 21285 connection.cc:256] RPC call timeout handler was delayed by -1.4734700160000784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:11:40.619577 21285 connection.cc:256] RPC call timeout handler was delayed by -1.4401700160000246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 13:11:40.619822 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1897455320000745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3024s for a response
W20260709 13:11:40.620074 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1664897010000459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32820000000000005s for a response
I20260709 13:11:40.614108 21466 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:11:40.564769 25442 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:40.623760 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44222.8us
I20260709 13:11:40.571249 25571 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:11:40.609679 25547 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.634256 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.635782 21391 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:11:40.571483 25551 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.638690 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:40.573508 25398 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:40.641741 25350 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:40.608624 25010 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.629959 25529 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:40.625487 25557 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:40.630182 25530 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:40.668771 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.673059 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.627220 25435 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.624787 25548 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.775013 24629 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.757925 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.754216 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:40.833922 21318 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:40.836059 21396 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:40.788412 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:40.759883 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:40.758634 21314 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:40.837064 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.838183 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.831780 24629 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.761847 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:40.768009 21316 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:40.842998 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:40.839071 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:40.842329 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54071.7us
I20260709 13:11:40.691046 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:40.852015 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.864475 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:40.865608 21466 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:40.843538 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:40.876520 22040 raft_consensus.cc:2410] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:11:40.746042 25563 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:11:40.757997 25567 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:40.677281 25557 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:40.683019 25398 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:40.878937 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.879603 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:40.764886 25528 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.905372 21394 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:40.770253 25490 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:40.879832 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:40.880219 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:40.880604 21391 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:40.878975 21393 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:40.688503 25539 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.762595 25456 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:40.885879 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:40.912753 21388 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:40.758803 25010 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.768569 25551 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.883100 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:40.689728 25277 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.903851 21461 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:11:40.909828 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.910745 21314 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:40.924278 24629 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:40.721800 25161 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:40.842185 25521 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.926123 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:40.875747 25062 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:40.879624 25529 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:40.928563 21396 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
W20260709 13:11:40.924842 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.910573 25572 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:11:40.910240 25274 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:40.932140 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 356865us
I20260709 13:11:40.905884 25533 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.935799 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 276356us
I20260709 13:11:40.751845 25524 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.907270 25350 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:11:40.941684 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 174447us
I20260709 13:11:40.945768 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:41.003747 21313 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:41.005010 21387 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:11:40.943501 25441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.116s	user 0.022s	sys 0.004s
I20260709 13:11:40.888659 25527 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:11:40.933195 25535 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:40.678188 25547 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:40.953708 25517 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:11:40.919571 25571 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:11:41.003715 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:41.005165 21389 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:40.919709 25456 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:40.689316 25530 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:40.954067 25509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.010s	sys 0.014s
I20260709 13:11:40.944180 25550 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.970297 24629 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:41.013216 25441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.023s	sys 0.004s
I20260709 13:11:41.000305 25062 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:41.031438 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:40.924721 25539 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.034832 21313 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:41.036280 24629 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:41.041455 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:41.026389 25509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.215s	user 0.021s	sys 0.020s
I20260709 13:11:41.019518 25535 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:41.054149 21313 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:41.054841 21285 leader_election.cc:400] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12.
I20260709 13:11:41.055155 21285 leader_election.cc:403] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:11:41.055670 21313 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:40.941123 25521 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:41.066205 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 111583us
W20260709 13:11:41.069836 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 163061us
W20260709 13:11:41.084786 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.003342 25533 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.042946 25527 consensus_queue.cc:1243] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:41.010737 25274 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.127588 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:41.056346 25519 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:41.117690 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:41.133208 21313 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:41.127712 21389 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:41.052484 24875 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:41.131479 24629 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.034672 25550 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.131494 25519 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:41.156652 25447 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:41.120513 25528 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:11:41.156332 24875 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:41.163203 25435 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.112629 25582 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
W20260709 13:11:41.187616 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 71822.4us
I20260709 13:11:41.161187 25441 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:41.201786 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.205647 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.207084 21467 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:41.208563 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.212298 21468 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:41.209256 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 84987us
I20260709 13:11:41.189265 25519 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:41.215070 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.214883 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.219409 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.199177 25447 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:11:41.209451 25573 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:11:41.229369 21461 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:41.230778 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 49076.7us
I20260709 13:11:41.132375 25350 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.237512 25010 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12.
I20260709 13:11:41.160806 25529 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:41.383751 21318 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:11:41.384272 21318 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:41.230487 21462 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:41.131203 25062 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.204974 25548 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:41.404441 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 174043us
I20260709 13:11:41.232545 21469 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:41.354283 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:41.378240 21313 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:41.338789 21464 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:41.338860 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:41.340832 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:41.428978 21389 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:41.430748 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.431600 21470 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:41.433418 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:41.434068 21470 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:41.435747 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.429493 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:41.449074 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.436551 21466 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:41.449862 21465 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:41.449666 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:41.450238 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.234576 25447 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.467200 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:41.468628 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:41.358776 25577 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:11:41.467139 21312 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:41.496620 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:41.504212 21468 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:41.683789 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.504331 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:41.688124 21389 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:41.167516 25456 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.510672 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:41.511018 21394 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:41.511416 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.690510 21464 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:11:41.512988 25584 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 13:11:41.204811 25535 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:41.514358 25583 log.cc:927] Time spent T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 13:11:41.515585 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2405) took 1422 ms. Trace:
I20260709 13:11:41.516228 25521 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.517436 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:41.704552 21313 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:41.518828 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 681) took 1070 ms. Trace:
I20260709 13:11:41.358029 25539 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.243311 25592 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.289s
I20260709 13:11:41.528997 25533 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.427428 25547 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.338559 25595 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:41.533442 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 285495us
I20260709 13:11:41.456943 25509 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:11:41.498551 25524 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:41.552919 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.496290 24875 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.557022 25548 raft_consensus.cc:2764] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:41.467514 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:41.583406 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 132768us
W20260709 13:11:41.584055 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 350154us
I20260709 13:11:41.373564 25550 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.630044 21470 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:41.663075 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.707455 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.711879 21389 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:41.702150 21317 rpcz_store.cc:276] 0709 13:11:40.093441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.093613 (+   172us) service_pool.cc:224] Handling call
0709 13:11:40.104965 (+ 11352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.515858 (+410893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.515911 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.536561 (+ 20650us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.627690 (+ 91129us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:40.627729 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.627799 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.515276 (+887477us) raft_consensus.cc:1685] finished
0709 13:11:41.515310 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.515515 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387484,"raft.queue_time_us":353207,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":24370,"thread_start_us":68346,"threads_started":1,"wal-append.queue_time_us":385440}
I20260709 13:11:41.701608 25535 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.722991 21462 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:41.719415 21461 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:41.705308 21390 rpcz_store.cc:276] 0709 13:11:40.448145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.448273 (+   128us) service_pool.cc:224] Handling call
0709 13:11:40.453649 (+  5376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.459951 (+  6302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.459985 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.813554 (+353569us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:40.876349 (+ 62795us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.121132 (+244783us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:41.121168 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.121232 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.518466 (+397234us) raft_consensus.cc:1685] finished
0709 13:11:41.518491 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.518758 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7498,"raft.queue_time_us":3788,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11811,"spinlock_wait_cycles":41241472,"thread_start_us":181724,"threads_started":1,"wal-append.queue_time_us":327951}
I20260709 13:11:41.701630 25516 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:41.757387 25589 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:41.757927 25589 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:41.758800 25519 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 13:11:41.759889 25519 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.762768 21388 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:41.763296 21388 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:41.773496 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:41.699575 25582 consensus_queue.cc:1175] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33be1cb5cfc143fc90e164888c96cc6f" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
I20260709 13:11:41.772236 21388 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.804044 25593 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:11:41.808889 21388 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:41.717201 25595 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.758852 25589 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:41.815333 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.815820 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.784184 25548 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:41.786768 25398 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.865s	user 0.006s	sys 0.007s
W20260709 13:11:41.815487 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 67370.4us
I20260709 13:11:41.817764 24629 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:41.818558 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:41.818681 21388 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:11:41.819167 21388 pending_rounds.cc:85] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 6
I20260709 13:11:41.819432 21388 pending_rounds.cc:107] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:11:41.819692 21388 raft_consensus.cc:2889] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:41.820525 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.821503 21387 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:11:41.821611 25603 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:11:41.826951 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:41.828444 24629 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:41.830663 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:41.830781 24629 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.832268 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:41.816733 25384 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.818804 25521 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.834921 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:41.836073 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:41.836640 21389 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:11:41.834425 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.000s	sys 0.027s
I20260709 13:11:41.837592 25398 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:41.837811 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:41.819046 25550 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:41.841970 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.000s	sys 0.027s
I20260709 13:11:41.843204 21394 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:41.846825 21461 raft_consensus.cc:2410] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:11:41.843988 25604 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:11:41.847991 25539 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:41.848430 25539 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:41.849349 25539 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.850652 25539 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:41.831331 25435 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:41.852295 25435 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:41.859186 24629 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.830385 25528 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:41.835971 25292 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:41.860150 25528 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:41.860491 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:41.860778 25292 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:41.861331 25292 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:41.861112 25528 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.862353 25528 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:41.862200 25292 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.864284 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:41.865212 25595 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:41.866005 25599 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:41.840229 25571 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:11:41.866364 25435 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:41.866904 25571 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:41.867307 25571 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:41.867434 25557 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.953s	user 0.013s	sys 0.000s
I20260709 13:11:41.867878 25557 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.868175 25571 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.869397 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2169) took 1032 ms. Trace:
I20260709 13:11:41.836351 25591 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:41.878886 25591 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:41.879132 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:41.843163 25441 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:41.855687 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:41.869808 21396 rpcz_store.cc:276] 0709 13:11:40.837041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.030609 (+193568us) service_pool.cc:224] Handling call
0709 13:11:41.042527 (+ 11918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.138349 (+ 95822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.138380 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.169313 (+ 30933us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.596961 (+427648us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:41.597015 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.597095 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.869125 (+272030us) raft_consensus.cc:1685] finished
0709 13:11:41.869149 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.869320 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88445,"raft.queue_time_us":104066,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7252,"thread_start_us":372600,"threads_started":1,"wal-append.queue_time_us":528020}
I20260709 13:11:41.881306 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:41.827800 25533 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:11:41.882620 22002 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.535s (SENT)
I20260709 13:11:41.883106 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:41.883478 25533 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:41.884217 25533 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:41.845018 25384 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.885411 25601 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:41.885514 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:41.886801 25524 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:41.853225 25521 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.887357 25524 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.888499 25456 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:41.856350 25550 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.889389 25524 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.869414 25571 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.890605 25550 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.891129 25550 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:41.853454 25589 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.879346 25591 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:41.884852 25533 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:41.897179 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:41.918033 21314 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:41.918911 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:41.882650 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:41.875155 21390 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:41.913313 21315 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:41.926021 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:41.926659 21321 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:41.891654 25550 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:41.856091 25519 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:41.951706 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 69148.7us
I20260709 13:11:41.952163 25398 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:41.951637 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:41.954000 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:41.954809 22034 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:41.955621 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:41.958523 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:41.958926 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:41.959151 22038 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:41.960079 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 125225us
W20260709 13:11:41.960889 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64564.9us
I20260709 13:11:41.931167 22035 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:41.926240 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:41.961485 22002 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.697s (SENT)
I20260709 13:11:41.978782 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:41.965668 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:41.980793 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:41.939464 25447 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:41.867508 25442 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:41.944228 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:42.001547 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:41.945039 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:41.945201 22032 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:41.948098 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:41.941807 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:41.980770 25062 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:11:41.940299 25384 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:41.987646 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:41.988204 25592 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:42.025391 25592 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:42.025854 25592 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:41.989441 25547 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:41.991063 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.028733 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.029881 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.030967 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:41.992695 25292 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:42.031792 25292 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:42.032768 25292 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.034042 25592 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.036283 25592 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:42.036347 25548 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:42.037122 25548 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:42.040278 25442 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:42.040611 25592 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:42.042243 21285 leader_election.cc:400] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 4. Current term is 5.
I20260709 13:11:42.043087 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:41.996840 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:41.925091 25274 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:42.002993 24629 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:11:41.986964 25521 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:42.002182 22041 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:42.044133 22035 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:42.045030 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.045116 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.045610 22035 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:42.046279 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.046448 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.047027 22041 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:42.047492 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.048228 22041 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:11:42.015414 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.012494 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:42.051769 21390 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.040792 25442 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:42.052412 25442 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:42.059542 21389 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:42.059926 21395 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:42.060670 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:42.061517 25456 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:42.061904 25456 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.021860 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.062273 25456 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:42.062714 21393 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:42.022320 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.063781 22042 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:42.019217 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:42.064864 22002 leader_election.cc:336] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.730s (SENT)
I20260709 13:11:42.065150 21313 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:41.916981 25533 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:42.065341 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.074350 22034 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:42.078337 21394 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:11:42.078634 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 136900us
I20260709 13:11:42.080230 22032 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:42.075803 22034 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:42.086196 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.082695 22034 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.087534 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.088267 22040 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:42.087605 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.002494 25197 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:42.089717 24629 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:41.941686 25595 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
W20260709 13:11:42.114799 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 134094us
I20260709 13:11:42.119329 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:42.090741 21390 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:42.122560 24629 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:42.123267 24332 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:11:42.114475 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:42.091329 25274 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:42.021700 25529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.010s	sys 0.026s
W20260709 13:11:42.143924 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.085243 25519 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:42.016938 25398 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:11:42.015899 25571 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:11:42.123386 25197 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:42.148586 25529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.010s	sys 0.026s
I20260709 13:11:42.089937 25526 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.149857 24332 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:42.152380 22034 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:42.021245 25348 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:11:42.177419 25582 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:42.181547 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2168) took 1344 ms. Trace:
W20260709 13:11:42.187529 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.203821 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.191145 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 71942.7us
I20260709 13:11:42.197032 21313 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:42.092465 25384 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:11:42.203531 21387 rpcz_store.cc:276] 0709 13:11:40.836776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.006397 (+169621us) service_pool.cc:224] Handling call
0709 13:11:41.006740 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.821953 (+815213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.181313 (+359360us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b540020f3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:42.181481 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872958336}
I20260709 13:11:42.122403 25442 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.092679 25547 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:11:42.154917 25394 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.165597 25197 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:42.237207 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 172391us
W20260709 13:11:42.197927 25594 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:42.241834 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45060.5us
W20260709 13:11:42.255631 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.224103 25274 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:42.258755 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 170212us
I20260709 13:11:42.261174 25442 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:42.262125 25442 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.262614 25442 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.223858 25582 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:42.227111 25509 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:42.271243 22038 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:42.275717 22042 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:42.279577 21436 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:42.280745 24332 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:42.278074 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 107720us
I20260709 13:11:42.273103 25582 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:42.287693 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:42.311626 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.310539 25524 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:42.288581 25590 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.192s
I20260709 13:11:42.273124 25348 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:42.311234 25220 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:42.338722 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2164) took 1503 ms. Trace:
I20260709 13:11:42.285892 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:42.348141 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:42.348531 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.348821 22038 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:11:42.344986 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 257486us
W20260709 13:11:42.347086 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61284.4us
I20260709 13:11:42.350714 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.352979 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:42.315275 25447 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:42.356103 21461 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:42.357410 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.340049 25524 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.346781 21392 rpcz_store.cc:276] 0709 13:11:40.835779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.001566 (+165787us) service_pool.cc:224] Handling call
0709 13:11:41.002061 (+   495us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:41.960710 (+958649us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b18002a8c80. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf210bfb 00007fc2bf21b64b
0709 13:11:41.960830 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.960853 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:41.997532 (+ 36679us) log.cc:844] Serialized 52 byte log entry
0709 13:11:42.192270 (+194738us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.203602 (+ 11332us) log.cc:844] Serialized 14 byte log entry
0709 13:11:42.208674 (+  5072us) log.cc:844] Serialized 14 byte log entry
0709 13:11:42.225285 (+ 16611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.225403 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.338453 (+113050us) raft_consensus.cc:1685] finished
0709 13:11:42.338484 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.338651 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52443,"prepare.queue_time_us":294,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":1782,"raft.queue_time_us":104899,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":23358,"spinlock_wait_cycles":72095616,"thread_start_us":249911,"threads_started":2,"wal-append.queue_time_us":244820}
I20260709 13:11:42.340356 25526 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.358736 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.358253 22035 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:42.324337 25550 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:42.369093 21320 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:42.369297 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.370977 21312 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:42.376880 25614 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:42.381264 25442 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:42.352643 25292 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:42.382411 25292 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.382790 25292 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:42.347940 25220 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:42.353992 25548 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:42.338930 25612 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.351948 25569 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.384604 22031 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:11:42.362960 25535 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:11:42.355160 25629 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.397830 22031 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:42.361959 25547 raft_consensus.cc:2764] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:11:42.402897 22031 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.404168 21469 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:42.407285 25611 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:42.408529 25435 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.002s
I20260709 13:11:42.362814 25524 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:42.413631 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:42.414727 22034 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:42.417671 25384 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:42.417987 22031 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:42.418843 25615 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:42.426702 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:42.419260 25589 consensus_meta.cc:287] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 13:11:42.382792 25620 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:42.428850 21461 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:42.360775 25456 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.400067 25612 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:42.489356 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 201686us
I20260709 13:11:42.464133 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.496403 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:42.501893 21433 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.438122 21320 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:42.391288 25526 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:42.505368 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 152454us
I20260709 13:11:42.505360 21312 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:42.448513 25607 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:11:42.429559 25539 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.578s	user 0.014s	sys 0.000s
I20260709 13:11:42.498811 25348 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:42.435806 25521 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:42.508909 25589 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:42.402961 25569 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.425745 25611 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.462185 25220 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.540688 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:42.427150 25435 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.549266 25612 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:42.549268 25220 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:42.550884 25612 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:42.529786 25601 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:42.537487 25537 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:11:42.534418 25412 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:42.498523 25620 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:42.557574 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55785.4us
I20260709 13:11:42.559532 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:42.539314 25348 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:42.572443 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.558708 25589 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:42.574906 25530 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:42.576098 25581 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 1.445s	user 0.004s	sys 0.036s
I20260709 13:11:42.577860 25456 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:42.580502 25539 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:42.581243 25637 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:42.581467 25645 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:42.579932 25441 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.004s	sys 0.006s
I20260709 13:11:42.587319 22031 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:42.588989 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:42.609040 25528 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.740s	user 0.005s	sys 0.005s
I20260709 13:11:42.593153 25569 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:42.595638 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.862s (SENT)
I20260709 13:11:42.596134 25524 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.597261 25611 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:42.600008 24875 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.600622 25161 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:42.644217 25161 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:42.619622 25637 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:42.645190 25161 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.646306 25161 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:42.646062 25637 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.647459 25637 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:42.602813 25630 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:11:42.604717 25622 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:42.566718 25633 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.650295 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.561118 25412 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:42.651875 25412 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.652798 25526 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:42.653172 25412 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:42.589536 25509 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:42.657231 25597 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.885s	user 0.005s	sys 0.000s
I20260709 13:11:42.623868 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.624265 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.560575 25601 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.664995 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.666211 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.666401 25601 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:42.666811 21315 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:42.668267 25435 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:42.595801 25620 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:42.623648 25384 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:42.669837 25384 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.566758 25640 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:11:42.667722 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.670940 21315 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:42.674743 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:42.637406 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.629968 25456 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:11:42.617801 25519 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:42.638664 22002 leader_election.cc:336] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.903s (SENT)
I20260709 13:11:42.651146 21317 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:42.681322 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.201s (SENT) [suppressed 47 similar messages]
I20260709 13:11:42.681572 25582 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:42.682348 22002 leader_election.cc:336] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.032s (SENT)
W20260709 13:11:42.682948 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.132s (SENT)
I20260709 13:11:42.683156 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.683991 21313 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:42.609946 25589 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:42.670222 25384 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:42.685457 25589 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:42.685973 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.675093 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.672791 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.626758 25644 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:42.678313 25557 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:42.678850 25592 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.006s
I20260709 13:11:42.682235 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.687176 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:42.623812 25441 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.006s
W20260709 13:11:42.620451 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 60990.2us
I20260709 13:11:42.685460 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.689117 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.689159 21321 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:42.691682 21317 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:42.690024 22002 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.535s (SENT)
I20260709 13:11:42.692552 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.699925 21313 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:42.697855 25456 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:42.700464 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:42.683815 25582 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:42.702553 22002 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.279s (SENT)
W20260709 13:11:42.690905 25591 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.763s	user 0.012s	sys 0.000s
I20260709 13:11:42.704888 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.714959 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.715874 21318 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 1.
I20260709 13:11:42.716488 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.716879 21315 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:42.675714 25197 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:42.722900 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.725036 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.693203 25592 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:42.729128 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.725867 21315 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.726563 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:42.728075 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.730918 21321 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:42.732100 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.732751 22039 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:11:42.741349 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.742831 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.743208 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.791110 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:42.728549 25220 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:42.787751 25516 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.736701 25582 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:42.775069 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.775812 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:42.777079 22031 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:42.793908 21313 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
W20260709 13:11:42.777931 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.778318 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.781643 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:42.795758 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.783031 21394 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:42.784657 21392 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:42.785938 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.800854 21317 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:42.786147 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.787264 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.802544 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.802982 21396 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:11:42.787674 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.804769 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:42.790501 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 47562.1us
I20260709 13:11:42.793685 25456 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.691610 25292 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.792709 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:42.793200 21318 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 4: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:42.809844 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:42.804912 21387 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:42.788285 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.777632 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:42.806058 21390 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:42.807512 21396 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:11:42.809725 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:42.689715 25646 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:11:42.819968 21315 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3.
I20260709 13:11:42.808794 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:42.830353 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0385971350000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 13:11:42.830941 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.831212 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.831600 21315 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:42.832311 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.832719 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.833213 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.833962 21393 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:11:42.833791 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.834728 21315 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:42.834589 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:42.835460 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.836130 21315 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:42.838605 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.842156 21390 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:42.843659 21394 raft_consensus.cc:2368] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
I20260709 13:11:42.843534 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.844309 21317 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:42.849224 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.850083 21318 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
W20260709 13:11:42.853050 22002 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.669s (SENT)
I20260709 13:11:42.853318 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.853940 21321 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
W20260709 13:11:42.855986 22002 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.711s (SENT)
I20260709 13:11:42.856500 22002 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.857538 25601 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:42.865235 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56544.2us
I20260709 13:11:42.867017 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:42.868085 24629 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:42.868619 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:42.871994 22002 leader_election.cc:336] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.843s (SENT)
I20260709 13:11:42.852537 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.875969 24629 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:42.888512 25623 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.889250 25646 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:42.919898 21315 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:42.885632 25161 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:42.882653 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.720391 25591 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.801461 25516 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.888546 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.888805 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:42.886301 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.890033 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.932251 21318 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 5: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:42.899601 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:42.899901 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:42.933264 21469 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:42.849632 25557 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:42.851027 25622 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:42.800318 25589 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:42.908771 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 128193us
I20260709 13:11:42.966692 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.851449 25197 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:42.911458 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 99939.7us
I20260709 13:11:42.968288 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.968461 25447 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.913086 21394 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:42.969348 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.969005 25447 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.970165 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:42.970340 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.971221 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:42.971568 21394 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:11:42.875609 24875 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:42.972579 24875 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.972956 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.973956 21467 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:42.974736 24875 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:42.885118 25509 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.975421 25509 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:42.976438 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.977448 25509 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:42.914827 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.978417 21468 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
W20260709 13:11:42.979177 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 64458.4us
I20260709 13:11:42.979976 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.980795 21463 raft_consensus.cc:2410] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:42.983011 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.983811 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.985263 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:42.986148 21463 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:42.916780 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:42.917408 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:42.992058 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.979761 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.873823 25220 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:11:42.809666 25412 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:42.880797 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:42.893667 25010 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:11:42.927222 24629 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:42.947104 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.999935 21466 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:42.931268 21317 raft_consensus.cc:2376] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12. Re-sending same reply.
I20260709 13:11:42.971819 25447 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:43.001461 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.002830 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.003504 21317 raft_consensus.cc:2376] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3. Re-sending same reply.
W20260709 13:11:42.949112 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.916199 21391 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:11:42.983839 21468 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:43.006546 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.932477 25646 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:43.009673 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48117.2us
I20260709 13:11:43.005384 25548 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:43.007700 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.015241 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:43.025986 21466 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:43.016690 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:42.953292 25604 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.024272 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:43.028023 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.028864 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:43.029179 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:43.031644 25619 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.766s	user 0.002s	sys 0.001s
I20260709 13:11:43.035914 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.960871 25557 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:42.961181 25622 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:43.040747 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:43.047024 21395 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:43.043406 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.044281 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.052150 21394 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:43.070411 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.078163 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:42.919013 25632 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:11:43.080792 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:42.964761 25640 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:11:42.921311 25638 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 13:11:43.034009 25412 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.109344 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.044816 25447 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:43.110844 25447 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.111331 25447 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:43.120389 21317 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 8: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:43.121724 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:43.123492 21317 raft_consensus.cc:2376] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 3. Re-sending same reply.
I20260709 13:11:43.079696 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.127372 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.053896 25622 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.053637 25509 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:43.032393 25654 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:11:43.131909 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:43.133170 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:43.137697 22031 raft_consensus.cc:2376] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13. Re-sending same reply.
W20260709 13:11:43.134286 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.160398 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 80808.4us
I20260709 13:11:43.161507 21360 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.166368 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:43.167569 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 198558us
W20260709 13:11:43.183782 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 204116us
I20260709 13:11:43.185097 21285 leader_election.cc:400] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
I20260709 13:11:43.185544 21285 leader_election.cc:403] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:43.187932 25441 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 2. Current term is 3.
I20260709 13:11:43.195760 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:43.141304 25220 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:43.197793 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 317278us
W20260709 13:11:43.164611 25645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.018s	sys 0.031s
I20260709 13:11:43.199247 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.153307 25197 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:43.176294 25647 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:11:43.168588 25412 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.201591 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.165241 25345 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:43.203464 25645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.018s	sys 0.031s
I20260709 13:11:43.214648 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:43.225943 22040 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:43.219518 21392 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:43.179128 25509 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:43.221804 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:43.174695 25442 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:43.223759 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.231245 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:43.203130 25292 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.206393 24875 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.237705 21392 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:43.247668 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:43.235968 25384 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.003s
I20260709 13:11:43.224920 25516 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.230783 25632 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.240944 25220 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:43.205368 25656 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:11:43.283622 25533 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.225350 25412 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.245687 25591 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:43.220911 25197 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.245900 25661 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:43.278214 25516 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:43.197906 25557 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.342479 21464 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:43.291064 21469 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:42.925324 25623 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.037225 25604 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.376483 25533 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:43.377708 25657 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:11:43.256426 25384 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:43.348364 25655 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 13:11:43.335258 25663 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:11:43.278546 25589 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.358549 25524 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.165297 25646 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.361083 25412 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.365012 25645 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.369036 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:43.392850 21320 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:43.371821 22040 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:43.373457 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.383952 21469 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:43.359869 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:43.281471 25632 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:43.352278 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 153112us
W20260709 13:11:43.421314 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.383257 25557 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:43.423285 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:43.430506 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:43.431270 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.432361 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.433514 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:43.437018 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 231138us
I20260709 13:11:43.446738 22040 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:43.447333 22040 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:43.451701 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.455076 21317 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:43.456460 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.457629 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.458742 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.459565 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.448333 22040 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:43.468271 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 266776us
I20260709 13:11:43.468814 21320 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:11:43.469126 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.408592 25384 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.460757 25665 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:43.460841 25010 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:43.461267 25635 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:43.402841 25524 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.470140 25666 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:43.476816 25666 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:43.477630 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.461416 25441 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:43.478749 25661 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:43.479708 25412 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.480010 25661 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:43.480548 25661 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:43.481319 25661 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:43.482085 25652 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.345s	user 0.000s	sys 0.000s
I20260709 13:11:43.482856 25661 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:43.485176 25648 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.847s	user 0.002s	sys 0.000s
I20260709 13:11:43.486042 25010 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:43.486716 25010 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:43.487041 25010 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:11:43.487388 25637 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.839s	user 0.009s	sys 0.004s
I20260709 13:11:43.487811 25010 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.490259 25345 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:43.491329 25345 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:43.491688 25345 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:43.491883 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:43.492406 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2411) took 1005 ms. Trace:
I20260709 13:11:43.492878 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:43.492535 25345 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.473897 22040 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:43.493844 25345 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.494911 25623 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.496054 25161 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.496582 25161 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.498620 25161 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:43.475364 25662 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:11:43.493566 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.502597 22040 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:43.503082 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:43.493976 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.504158 21315 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:43.505105 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:43.479092 25537 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.499027 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 618) took 1111 ms. Trace:
I20260709 13:11:43.419055 25604 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.510906 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.446861 25442 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:43.446620 25656 raft_consensus.cc:2764] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:11:43.504202 25582 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.000s
I20260709 13:11:43.533543 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:43.404232 25645 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.471616 21360 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:43.492796 21314 rpcz_store.cc:276] 0709 13:11:42.487368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.510797 (+ 23429us) service_pool.cc:224] Handling call
0709 13:11:42.511043 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:42.511197 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.511211 (+    14us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.523111 (+ 11900us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.624951 (+101840us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:42.625009 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.625102 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.484629 (+859527us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:43.492106 (+  7477us) raft_consensus.cc:1685] finished
0709 13:11:43.492129 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.492340 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85983104,"thread_start_us":90007,"threads_started":1,"wal-append.queue_time_us":110952}
I20260709 13:11:43.532711 25656 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:43.539572 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68011.5us
I20260709 13:11:43.540233 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:43.518818 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.508445 21462 rpcz_store.cc:276] 0709 13:11:42.387698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.400232 (+ 12534us) service_pool.cc:224] Handling call
0709 13:11:42.416257 (+ 16025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.593896 (+177639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.593931 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:42.593978 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:42.594013 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.498787 (+904774us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54004358d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:43.498832 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.498952 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408007424}
I20260709 13:11:43.475026 25678 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.470506 25675 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.524343 21463 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:43.541641 25582 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:43.592865 25679 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:43.593130 25197 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:43.597935 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.598171 25645 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:43.573983 25412 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:43.576542 25640 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:43.531389 25161 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:43.541066 25656 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:43.529951 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:43.601236 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.530480 25435 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:43.612366 25597 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:43.617621 25528 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:11:43.572669 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 53967.4us
I20260709 13:11:43.602020 25537 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:43.650249 25638 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:43.650772 25632 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.651861 25528 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:43.652926 25528 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.654003 25528 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:43.658509 25601 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.000s
I20260709 13:11:43.659193 25601 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:43.659963 22031 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:43.620549 25412 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:43.530692 25665 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.093s
W20260709 13:11:43.611184 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 314322us
I20260709 13:11:43.638638 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:43.666817 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.648823 25435 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.673627 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:43.664958 25556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.020s	sys 0.003s
I20260709 13:11:43.661430 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.661742 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 569) took 1099 ms. Trace:
I20260709 13:11:43.676898 21317 rpcz_store.cc:276] 0709 13:11:42.562898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.260239 (+697341us) service_pool.cc:224] Handling call
0709 13:11:43.260693 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.455535 (+194842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.661496 (+205961us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54000fcb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:43.661689 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411541760}
W20260709 13:11:43.676373 25556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.021s	sys 0.003s
I20260709 13:11:43.679903 21466 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:43.682480 21433 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.683527 22031 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:43.628273 21320 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:43.628525 25656 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:43.663486 25447 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.006s
I20260709 13:11:43.678247 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.667953 25412 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:43.666245 25220 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:43.693081 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 220030us
W20260709 13:11:43.694674 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.699519 21314 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:43.704697 21314 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 9. Ops: [7.9-7.9]
I20260709 13:11:43.685235 25161 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.706387 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 577) took 1053 ms. Trace:
I20260709 13:11:43.686069 25638 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:43.683771 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:43.710460 21314 rpcz_store.cc:276] 0709 13:11:42.652482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.704020 (+1051538us) service_pool.cc:224] Handling call
0709 13:11:43.704427 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.705260 (+   833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.705500 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:43.707198 21317 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:43.714540 21314 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:43.709992 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 247986us
I20260709 13:11:43.715346 21320 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:43.716549 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:43.721359 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:43.717733 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 571) took 1087 ms. Trace:
W20260709 13:11:43.717296 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 223854us
I20260709 13:11:43.693109 25591 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:43.715363 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 586) took 1060 ms. Trace:
I20260709 13:11:43.723393 21317 rpcz_store.cc:276] 0709 13:11:42.630230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.701058 (+1070828us) service_pool.cc:224] Handling call
0709 13:11:43.701449 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.717435 (+ 15986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.717663 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:43.727064 21314 rpcz_store.cc:276] 0709 13:11:42.655154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.713600 (+1058446us) service_pool.cc:224] Handling call
0709 13:11:43.714395 (+   795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.715065 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.715282 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:43.723696 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.688261 25447 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.722582 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:43.731668 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.732082 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:43.732913 22040 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:43.736114 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.737566 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:43.737810 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:43.733954 21320 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:43.738421 21464 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:43.741510 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.742115 21317 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:43.734444 25675 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:43.745007 25675 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.709378 25688 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:43.759435 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:43.735056 25638 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:43.766855 25638 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:43.768044 25638 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.768913 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:43.719568 25646 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:43.760551 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.740945 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:43.784816 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 43932.5us
I20260709 13:11:43.743995 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.754571 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:43.762669 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:43.783708 21320 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
I20260709 13:11:43.762238 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:43.787348 21462 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
W20260709 13:11:43.779121 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.727571 25632 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:43.751528 25456 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.914s	user 0.009s	sys 0.004s
I20260709 13:11:43.798031 25456 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:43.759495 25604 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:43.790903 25197 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:43.793376 25635 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.794504 25601 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:43.790004 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46080.6us
I20260709 13:11:43.805642 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.740329 25161 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:11:43.782843 25683 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.734860 25442 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:11:43.747853 25675 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:43.811784 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:43.817658 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.799266 25687 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:43.783423 25688 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.823431 25683 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.828059 25623 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:43.828488 25623 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.828825 25623 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:43.803954 25646 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:43.829756 25683 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:43.824295 25632 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:43.794540 25435 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:43.835791 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.830614 25646 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.811250 25601 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:43.849720 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.829783 25688 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:43.763821 25220 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:43.876256 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.877900 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.823091 25456 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.809463 25665 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 13:11:43.898020 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 132102us
I20260709 13:11:43.900556 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.905854 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.820194 25604 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:43.836431 25687 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:43.905908 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 171920us
I20260709 13:11:43.820001 25696 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:43.927615 25665 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.927682 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:43.930022 25700 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.933249 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.933792 21319 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:43.877380 25675 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:43.941907 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:43.897210 25442 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:43.944079 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:43.927853 25529 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:43.841969 25548 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:11:43.954887 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.956614 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:43.957307 21316 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:43.924255 25547 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:43.936156 25635 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:43.969448 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:43.926558 25687 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:43.975178 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:43.948705 25700 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:43.980515 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:43.980753 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:43.981164 22038 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:43.981285 22040 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:43.981565 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:43.969105 25533 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.592s	user 0.001s	sys 0.011s
I20260709 13:11:43.961404 25529 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:43.968737 25348 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:43.976769 25509 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.736s	user 0.005s	sys 0.006s
I20260709 13:11:43.971979 25441 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:43.998566 25441 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.000331 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:44.000970 21316 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:44.001091 25441 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:44.001602 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.985364 25675 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:44.003821 25675 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.004436 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:44.005504 25533 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:44.005877 25533 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.006217 25533 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.006203 25689 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:11:44.009294 25695 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:11:44.009923 25678 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.010774 25690 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:11:44.011590 25690 consensus_queue.cc:1243] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:44.012115 25690 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:44.012465 25690 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:44.013192 25690 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.014073 25533 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:44.014878 25693 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:11:44.015817 25622 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.876s	user 0.010s	sys 0.000s
I20260709 13:11:44.036409 25622 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:43.990293 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:44.038090 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 47861.4us
I20260709 13:11:44.014441 25690 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.041031 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:43.945489 25638 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:11:44.016368 25533 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:44.016469 25661 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.001s
W20260709 13:11:44.017306 25557 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.002s
I20260709 13:11:44.063244 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:44.020107 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:44.020386 25702 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:44.020977 25674 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:44.021404 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:44.021822 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:44.066732 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2186) took 1285 ms. Trace:
I20260709 13:11:44.066974 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:44.067116 21390 rpcz_store.cc:276] 0709 13:11:42.781252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.781372 (+   120us) service_pool.cc:224] Handling call
0709 13:11:44.066527 (+1285155us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b54001c3754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:44.066666 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23053568}
I20260709 13:11:44.067580 22038 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:43.934757 25632 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.068709 21396 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:11:44.021921 25700 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:44.022487 25684 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:11:44.092373 25197 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.093261 25197 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.095420 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2209) took 1085 ms. Trace:
I20260709 13:11:44.022857 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:44.095947 21468 rpcz_store.cc:276] 0709 13:11:43.009804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.009994 (+   190us) service_pool.cc:224] Handling call
0709 13:11:43.033001 (+ 23007us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:43.039415 (+  6414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.039450 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:43.040015 (+   565us) log.cc:844] Serialized 52 byte log entry
0709 13:11:43.807286 (+767271us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b18000ab220. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:11:43.934320 (+127034us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:43.947553 (+ 13233us) log.cc:844] Serialized 14 byte log entry
0709 13:11:43.947816 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.947975 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:44.095020 (+147045us) raft_consensus.cc:1685] finished
0709 13:11:44.095145 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.095338 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3243,"prepare.queue_time_us":14028,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":3684,"raft.queue_time_us":12553,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":28454,"spinlock_wait_cycles":14059648,"thread_start_us":126778,"threads_started":1,"wal-append.queue_time_us":1012349}
I20260709 13:11:44.011713 25412 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.029702 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:44.032402 25604 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:43.975828 25547 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.033799 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2435) took 1749 ms. Trace:
I20260709 13:11:44.034162 25447 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:44.110248 21319 rpcz_store.cc:276] 0709 13:11:42.284360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.284518 (+   158us) service_pool.cc:224] Handling call
0709 13:11:42.312522 (+ 28004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.934381 (+1621859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.033531 (+ 99150us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540032b4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:44.033735 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3728090368}
I20260709 13:11:43.997320 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:44.039048 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:44.040148 22040 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:44.042783 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:43.985052 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:44.048488 25689 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:44.154534 25689 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:44.155160 25689 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.107414 24875 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.156682 24875 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.049263 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:44.160983 25529 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.162758 25547 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:44.162876 25529 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:44.164616 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 125713us
I20260709 13:11:44.165829 25682 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:44.049067 25635 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:43.960757 25601 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.063948 22039 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.064054 21314 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:44.022893 25659 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:44.081590 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:44.179435 21317 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.086066 25622 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:44.023663 25699 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:11:43.991410 25696 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:44.047263 25695 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:43.996806 25548 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:44.037822 25509 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:44.160988 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:44.204125 21313 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
W20260709 13:11:44.170629 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 121436us
W20260709 13:11:44.176697 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 191881us
I20260709 13:11:44.177616 24629 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:44.209472 24629 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.209969 24629 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:44.210378 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:44.211194 22040 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:44.178452 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:44.186863 21314 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:44.054471 25456 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:11:44.179247 25659 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.181901 25547 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.209414 21316 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:44.186417 25197 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:44.110152 25674 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.107926 25702 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.217270 25447 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.238746 25412 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:44.297868 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1736) took 1103 ms. Trace:
I20260709 13:11:44.298756 21463 rpcz_store.cc:276] 0709 13:11:43.194170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.196121 (+  1951us) service_pool.cc:224] Handling call
0709 13:11:44.297559 (+1101438us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400217d54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:44.297739 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592608000}
I20260709 13:11:44.307396 25274 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:44.313290 21468 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:44.314673 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:44.308920 21318 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:44.290038 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:44.233242 25659 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:44.316102 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:44.316869 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:44.322208 21321 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:44.318984 24629 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.327124 25701 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:44.336287 25681 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.336733 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:44.339884 25694 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.531s	user 0.000s	sys 0.001s
I20260709 13:11:44.217872 25548 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.349809 22042 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:44.350615 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:44.281638 25601 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:44.365648 25654 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:11:44.218123 25623 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.369480 25623 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:44.370297 25623 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:44.352113 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.370710 25672 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.976s	user 0.006s	sys 0.008s
I20260709 13:11:44.375662 21316 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:44.376192 21316 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:44.377195 25591 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:44.376976 21316 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.377683 25591 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:44.377911 21316 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.381940 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1739) took 1107 ms. Trace:
I20260709 13:11:44.382452 21466 rpcz_store.cc:276] 0709 13:11:43.274865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.280656 (+  5791us) service_pool.cc:224] Handling call
0709 13:11:43.281043 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.685827 (+404784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.381607 (+695780us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54002f3354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:44.381861 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916568448}
I20260709 13:11:44.389488 25591 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.392941 25591 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:44.396641 21395 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:44.413861 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.416822 21394 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:44.420241 24629 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:44.400586 21388 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:44.401316 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:44.424492 21390 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:44.398367 21316 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:11:44.403049 25692 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.593s	user 0.002s	sys 0.000s
W20260709 13:11:44.404186 25691 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.595s	user 0.002s	sys 0.000s
I20260709 13:11:44.406163 21391 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:44.318498 25635 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.313112 25274 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:44.434753 21321 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:44.430228 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:44.436748 21314 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:44.354899 25571 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:44.352905 25675 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:11:44.438704 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 396011us
I20260709 13:11:44.451591 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:44.451603 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:44.454795 24629 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:44.419654 25220 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:44.316332 25447 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.426403 24875 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:44.477308 24629 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:44.477977 24629 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.436928 25664 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:44.483069 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.450299 25695 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:44.539081 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1728) took 1695 ms. Trace:
W20260709 13:11:44.460013 25656 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.769s	user 0.005s	sys 0.006s
I20260709 13:11:44.370729 25623 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.547139 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:44.578946 21466 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:44.459810 25703 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.093s
W20260709 13:11:44.542052 25687 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.002s
I20260709 13:11:44.485363 25665 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:44.441681 25635 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.552361 25656 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.475862 25571 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:44.463253 25220 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.474309 25675 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:44.599524 21316 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:44.552001 21462 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:44.600929 21467 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:44.460889 25654 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:11:44.539503 21461 rpcz_store.cc:276] 0709 13:11:42.843359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.843570 (+   211us) service_pool.cc:224] Handling call
0709 13:11:42.884489 (+ 40919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.483413 (+598924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.483449 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:43.483864 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:11:43.712116 (+228252us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:43.712155 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.305069 (+592914us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b540025a154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:44.305148 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:44.402332 (+ 97184us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:44.538854 (+136522us) raft_consensus.cc:1685] finished
0709 13:11:44.538874 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.539020 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12444,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":1408114304,"thread_start_us":227852,"threads_started":1,"wal-append.queue_time_us":251026}
I20260709 13:11:44.512527 25591 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.584126 25623 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:44.552891 25456 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.486019 25537 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:11:44.668052 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2432) took 1065 ms. Trace:
I20260709 13:11:44.598062 25533 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.764214 25661 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:44.798424 22041 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:44.795735 21313 rpcz_store.cc:276] 0709 13:11:43.602977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.234527 (+631550us) service_pool.cc:224] Handling call
0709 13:11:44.293186 (+ 58659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.293386 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:44.293667 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.667598 (+373931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:44.667666 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:44.667725 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.667816 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.667967 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16899,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":5704,"raft.queue_time_us":23575,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10228,"thread_start_us":373557,"threads_started":1}
I20260709 13:11:44.802790 25571 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.579624 25612 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:44.781898 25220 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:44.691859 25687 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:44.693236 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 514924us
W20260709 13:11:44.712272 21317 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.002s
I20260709 13:11:44.821694 21317 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:44.551440 25557 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:11:44.615587 25695 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:44.619387 25722 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:44.588582 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 137057us
I20260709 13:11:44.779811 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2430) took 1272 ms. Trace:
I20260709 13:11:44.597435 25689 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.540810 25664 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.769026 25665 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:44.770411 25683 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:44.780500 25688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.011s
I20260709 13:11:44.854669 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:44.818411 21316 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:44.818986 25661 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.688483 22039 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:11:44.842145 21468 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:11:44.842005 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:44.859184 21468 pending_rounds.cc:85] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 10
I20260709 13:11:44.859280 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:44.835387 21320 rpcz_store.cc:276] 0709 13:11:43.507813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.188229 (+680416us) service_pool.cc:224] Handling call
0709 13:11:44.188568 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.188806 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:44.220248 (+ 31442us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.779293 (+559045us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:44.779372 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:44.779450 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.779558 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.779730 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84341,"prepare.queue_time_us":31643,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":4452,"raft.queue_time_us":87426,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7217,"spinlock_wait_cycles":37497600,"thread_start_us":474031,"threads_started":1,"wal-append.queue_time_us":573034}
I20260709 13:11:44.861788 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:44.853752 25665 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:44.857271 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:44.859524 21468 pending_rounds.cc:107] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:11:44.867935 21468 raft_consensus.cc:2889] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.841194 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:44.853437 21466 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:44.856076 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:44.863903 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:44.796746 25674 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:44.797622 25591 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.870985 21461 raft_consensus.cc:2376] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11. Re-sending same reply.
I20260709 13:11:44.830238 25695 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:44.873227 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:44.839327 25702 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:44.811580 25456 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.888222 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:44.872110 24875 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:11:44.839664 25612 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.876303 25725 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:44.876477 25591 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:44.857067 25720 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:11:44.854249 25688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.000s	sys 0.011s
W20260709 13:11:44.880234 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.867969 21316 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.868958 25719 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:44.871212 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:44.844776 25722 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.856220 25161 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.849109 25582 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:44.888906 21464 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:44.854506 25646 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:44.866482 25683 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:44.936486 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.942588 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.904296 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:44.944633 21466 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:44.946614 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:44.947979 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:44.948660 22034 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:44.919513 21468 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:44.883828 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:44.870059 25557 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:11:44.919466 25537 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:44.956709 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:44.960328 22042 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:44.902648 25447 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:44.902005 25723 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:44.962445 21433 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:44.963004 22042 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:44.963184 21316 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:44.918706 25724 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.968442 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:44.918856 25719 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:44.932358 25632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.007s	sys 0.001s
W20260709 13:11:44.935385 25721 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
W20260709 13:11:44.993818 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 110099us
I20260709 13:11:44.994634 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:44.979076 25632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.007s	sys 0.001s
W20260709 13:11:45.029572 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 179836us
W20260709 13:11:45.045573 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 83233.4us
I20260709 13:11:44.959743 25582 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.977829 25719 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.939630 25161 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:44.999845 25725 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:45.189555 25731 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:11:45.189936 25725 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:45.190902 25730 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:11:45.190872 25725 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:44.966682 25646 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.196544 25646 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:44.956453 25695 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.197538 25695 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:45.200727 25612 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:45.201283 25742 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:11:45.203668 25748 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:11:45.206465 25601 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.000s
W20260709 13:11:45.206755 25746 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:11:45.182102 25664 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.207831 25661 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:45.208411 25661 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:45.208910 25661 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.210937 25661 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:45.211414 25661 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.212723 25722 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.214469 25683 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.215590 25604 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:45.216156 25604 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:45.217061 25659 consensus_meta.cc:287] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.000s
I20260709 13:11:45.217504 25659 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.217203 25604 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.219223 25604 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.219668 25659 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:45.093672 25635 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.096414 25557 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:45.110013 25656 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:45.150549 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 182830us
I20260709 13:11:45.243368 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:45.159291 22031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 982) took 1800 ms (client timeout 1566 ms). Trace:
I20260709 13:11:44.978127 25724 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:45.244010 22031 rpcz_store.cc:269] 0709 13:11:43.359353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.359543 (+   190us) service_pool.cc:224] Handling call
0709 13:11:45.159065 (+1799522us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540045c254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:45.159219 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605556480}
I20260709 13:11:45.161515 21466 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:45.091653 24875 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:45.171403 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 176833us
I20260709 13:11:44.873075 25675 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.246269 25724 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:45.186594 25737 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:11:45.187196 25726 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 13:11:45.191376 21320 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:45.251925 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:44.968983 25738 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 13:11:44.980748 25537 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:45.221879 25529 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.058s	user 0.007s	sys 0.006s
I20260709 13:11:45.159153 25745 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:11:45.225037 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2447) took 1498 ms. Trace:
I20260709 13:11:45.227031 25533 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:45.174638 25728 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:45.175056 25687 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.172250 25689 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:45.234741 25706 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.407s	user 0.009s	sys 0.010s
I20260709 13:11:45.236617 22035 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:11:45.240166 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1722) took 2319 ms. Trace:
I20260709 13:11:45.274194 21396 rpcz_store.cc:276] 0709 13:11:42.864089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.864259 (+   170us) service_pool.cc:224] Handling call
0709 13:11:44.068478 (+1204219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.069163 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.182702 (+1113539us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001c3750. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:45.182912 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2768387840}
I20260709 13:11:45.104389 25591 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:11:45.186606 25741 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:11:45.252853 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.257782 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:45.283845 22034 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:45.260747 21312 rpcz_store.cc:276] 0709 13:11:43.726138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.305926 (+579788us) service_pool.cc:224] Handling call
0709 13:11:44.306383 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.436345 (+129962us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:44.436601 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.881350 (+444749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:44.881420 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:44.881481 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.224727 (+343246us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003f5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:45.224797 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.224959 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2000,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":7706,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":16733,"spinlock_wait_cycles":298381568,"thread_start_us":444375,"threads_started":1,"wal-append.queue_time_us":532116}
I20260709 13:11:45.288079 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:45.290843 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 115666us
I20260709 13:11:45.096748 25509 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:45.273613 21320 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:45.303031 22034 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:11:45.280701 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:45.211841 25661 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.303802 22041 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.242152 25557 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.301923 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:45.279850 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.305363 21393 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:45.305387 22040 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:45.310884 22031 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:45.325819 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:45.302225 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:45.273319 24875 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:45.280536 25683 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:45.274188 25747 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:45.343910 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:45.280149 25722 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.331239 21395 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:45.282294 25591 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:45.334170 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:45.355122 21320 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:11:45.333629 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 159381us
I20260709 13:11:45.336674 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.334563 25509 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:45.346336 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.357035 21389 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:11:45.349593 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.279889 25695 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:11:45.329571 25557 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.331784 25656 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.365634 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:45.368543 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:45.381847 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:45.382299 21316 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:45.388021 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.389322 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.333140 25635 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:45.395135 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:45.398806 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.399459 21389 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:11:45.355893 25612 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:45.380561 25740 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 13:11:45.335373 25723 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:45.300695 25220 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.333760 25688 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:11:45.420570 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:45.427316 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.431177 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.432353 21389 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:45.343436 24875 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:45.436165 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.445604 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1745) took 1690 ms. Trace:
I20260709 13:11:45.405741 25664 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:45.446353 22032 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:45.395557 25456 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.355304 25683 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.359743 25722 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.355568 25747 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.452622 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:45.398366 25701 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:45.455799 21388 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:45.451125 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:45.396857 25348 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:11:45.408730 25765 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:45.457141 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:45.460655 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 61097.2us
I20260709 13:11:45.446115 21465 rpcz_store.cc:276] 0709 13:11:43.754741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.754927 (+   186us) service_pool.cc:224] Handling call
0709 13:11:43.755292 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.755553 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.755588 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:43.772180 (+ 16592us) log.cc:844] Serialized 26 byte log entry
0709 13:11:43.812442 (+ 40262us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:43.823543 (+ 11101us) log.cc:844] Serialized 14 byte log entry
0709 13:11:43.823843 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.823956 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:45.234051 (+1410095us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:45.414756 (+180705us) raft_consensus.cc:1685] finished
0709 13:11:45.445362 (+ 30606us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.445541 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6129,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":8249,"raft.queue_time_us":120,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":10375936,"thread_start_us":21456,"threads_started":1,"wal-append.queue_time_us":43241}
I20260709 13:11:45.395733 25656 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.461544 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:45.469471 25758 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:45.470193 25758 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.470624 25758 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:45.476570 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:45.409502 25632 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:11:45.405311 25635 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.449692 25664 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:45.524955 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:45.527271 21389 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:45.502830 25724 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:45.501250 25010 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:45.464896 25456 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:45.439221 25591 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.465360 25753 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:45.506314 25665 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.003s
W20260709 13:11:45.507197 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.542644 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 90118.7us
W20260709 13:11:45.516940 25623 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.003s
I20260709 13:11:45.505692 25664 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:45.504400 25582 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.554703 25675 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.553612 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:45.560835 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:45.561051 21320 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:45.528044 25632 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.562343 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:45.562320 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:45.532174 25756 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.577872 21320 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:45.579993 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:45.531965 25760 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.586440 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:45.466049 25509 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.535080 25612 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:45.535697 25537 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:45.545667 25724 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:45.577683 25739 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:11:45.558303 25623 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.607539 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:45.631263 21320 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:45.579572 25456 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:45.508976 25701 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:11:45.612330 22042 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:45.575796 25161 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:45.584616 25591 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:45.592818 25197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.010s
I20260709 13:11:45.581003 25348 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.599480 22032 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 13:11:45.585469 25661 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.645128 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:45.646827 22042 raft_consensus.cc:2376] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10. Re-sending same reply.
I20260709 13:11:45.515566 25723 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:45.613965 25744 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.419s	user 0.001s	sys 0.001s
I20260709 13:11:45.639921 21389 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:11:45.643173 21435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.001s	sys 0.004s
I20260709 13:11:45.643105 21320 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:11:45.632133 25761 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 13:11:45.613610 25725 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.655392 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2445) took 1157 ms. Trace:
I20260709 13:11:45.655794 21313 rpcz_store.cc:276] 0709 13:11:44.498068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.800842 (+302774us) service_pool.cc:224] Handling call
0709 13:11:44.801210 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.801559 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:44.801591 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:44.802125 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:11:45.107170 (+305045us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:45.107229 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.107338 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:45.655170 (+547832us) raft_consensus.cc:1685] finished
0709 13:11:45.655189 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.655325 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":557,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":50,"thread_start_us":304672,"threads_started":1,"wal-append.queue_time_us":478149}
W20260709 13:11:45.646100 25197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.001s	sys 0.010s
I20260709 13:11:45.583882 25675 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.658623 25764 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.558779 25665 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.649708 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:45.652245 22041 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
W20260709 13:11:45.654090 21435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.001s	sys 0.005s
I20260709 13:11:45.647460 21387 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:45.592478 25632 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.652490 25547 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:11:45.636474 21394 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:45.661080 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.688428 21389 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:45.688938 25665 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:45.689363 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.689914 25722 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.690586 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.692142 22034 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:45.599542 25759 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.261s
I20260709 13:11:45.646387 25161 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:45.692277 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.659579 21320 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:11:45.692952 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.700541 22031 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:45.653730 25220 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.695245 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:45.663133 25675 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.698484 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.650377 25348 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.701045 25435 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:45.704228 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:45.697933 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:45.695856 25687 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:45.733425 25687 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:45.705925 25763 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:11:45.684535 25724 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.691768 25764 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.708755 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:45.662751 25779 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:45.602843 25760 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:45.713677 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.682323 25582 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:45.713958 25665 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:45.695278 24875 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.659566 25738 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:11:45.719328 22041 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:45.697224 25722 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:45.639027 25758 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.606518 25756 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.727352 21394 raft_consensus.cc:2376] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10. Re-sending same reply.
I20260709 13:11:45.728368 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2439) took 1492 ms. Trace:
I20260709 13:11:45.728873 25775 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:45.732209 25442 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:11:45.732620 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:45.662493 25725 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.766660 21318 rpcz_store.cc:276] 0709 13:11:44.236386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.335379 (+ 98993us) service_pool.cc:224] Handling call
0709 13:11:44.335749 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.797947 (+462198us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:44.840956 (+ 43009us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.926994 (+ 86038us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.927179 (+   185us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:44.927731 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:11:44.927883 (+   152us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:44.927928 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.718116 (+790188us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400227c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:45.718170 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:45.728111 (+  9941us) raft_consensus.cc:1685] finished
0709 13:11:45.728149 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.728306 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1376,"prepare.queue_time_us":45984,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":74,"raft.queue_time_us":1642,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":230,"spinlock_wait_cycles":1058601216,"thread_start_us":60467,"threads_started":1,"wal-append.queue_time_us":65454}
I20260709 13:11:45.716245 25656 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:45.752774 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 107041us
W20260709 13:11:45.752837 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44194.8us
I20260709 13:11:45.758136 25774 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:45.759500 25348 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.759886 25665 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.760387 25632 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.760639 25582 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:45.761082 25770 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:11:45.790148 21433 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:45.790517 22039 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:45.759910 25764 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.722981 25623 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.758086 21359 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:45.712736 25612 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.735759 25635 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.741397 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:45.773288 25775 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:45.802405 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61139.4us
I20260709 13:11:45.781064 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.702756 25456 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:45.785195 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1737) took 2562 ms (client timeout 2218 ms). Trace:
I20260709 13:11:45.779253 25722 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.787645 25702 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:45.796937 25687 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.754382 25779 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.761442 25778 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.763667 25760 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:45.757555 25701 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:45.754325 25688 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:45.791574 25783 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:11:45.793561 25725 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.770674 21394 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:11:45.804929 22031 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:45.832955 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:45.807314 21467 rpcz_store.cc:269] 0709 13:11:43.222987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.223116 (+   129us) service_pool.cc:224] Handling call
0709 13:11:45.784922 (+2561806us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54002495d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:45.785058 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924522368}
I20260709 13:11:45.827620 21393 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:45.810423 25759 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:45.806770 25775 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:45.807914 25623 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:45.837312 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.825963 25774 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:45.807031 25738 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.808247 25348 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:45.842409 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.842633 25756 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.811065 25702 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:45.844019 21394 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:45.859334 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:45.828637 25779 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:45.830370 25701 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.846845 22031 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:45.795861 25557 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.844467 25759 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.875931 25701 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:45.882732 25759 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:45.848767 25722 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.849355 25665 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.850430 24629 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:45.851385 25435 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:45.859663 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:45.875489 25776 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:11:45.835311 25778 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.885028 21318 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:45.880880 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.843775 25623 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:45.857071 25604 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.634s	user 0.016s	sys 0.000s
I20260709 13:11:45.896016 22031 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:45.897094 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.901043 22038 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:45.835498 25688 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.899933 25623 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.910369 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:45.899686 25795 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:45.892176 25348 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:45.848917 25274 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.861196 25738 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:45.922017 25719 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260709 13:11:45.929132 21315 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:45.930366 25674 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.930872 25674 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.931430 25747 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.915441 25774 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:45.934576 25674 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.913606 25795 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.917019 25604 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:45.945581 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:45.938647 25665 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.945385 25778 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.948523 25665 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.949332 25758 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.907119 25702 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.953665 25702 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:45.954774 25738 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:45.954523 25348 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.958312 25779 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.951481 25582 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.966265 25665 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:45.965875 25775 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:45.940279 25795 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.991537 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:45.943799 25604 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:45.973440 25797 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:11:45.972051 21395 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:11:45.993386 22036 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
W20260709 13:11:46.005218 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.007262 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.007892 22038 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:45.982064 25591 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:46.010242 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:45.992177 25747 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.994024 25604 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.938066 25719 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.025827 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:46.031275 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:46.032572 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:46.033161 21396 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:45.968686 25701 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.019763 25747 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.040704 25530 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:46.041404 25530 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:46.042701 25530 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.044369 25719 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.045292 21391 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:46.045535 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.046339 21393 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:46.047322 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.049427 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:46.050567 25161 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:46.050751 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.051040 25161 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.051465 25161 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:46.052752 25530 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:46.041524 25688 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.018236 25738 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:46.055943 25738 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.056180 25775 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.056403 25738 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:46.047667 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:46.056797 21315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2419) took 2694 ms (client timeout 1755 ms). Trace:
W20260709 13:11:46.085299 21315 rpcz_store.cc:269] 0709 13:11:43.362109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.504842 (+142733us) service_pool.cc:224] Handling call
0709 13:11:46.056560 (+2551718us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b5400229054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:46.056710 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5491661568}
W20260709 13:11:46.088236 25718 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.312s	user 0.002s	sys 0.002s
I20260709 13:11:46.080307 21318 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:46.090929 25749 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.977s	user 0.001s	sys 0.000s
I20260709 13:11:46.057147 21393 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:46.092411 22038 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:46.094282 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:46.101859 21396 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:11:46.018836 25557 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.041152 25747 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:46.023984 25779 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.109324 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:46.110550 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:46.016393 25591 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.024134 25664 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.114322 25774 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:46.121074 25701 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.100759 25688 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:46.125401 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:46.136600 21391 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:46.127332 25591 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:46.113576 25747 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:46.128068 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.144467 21315 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:46.128639 25548 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.127589 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.129592 25759 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.130439 25623 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.139251 22031 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:46.154004 21313 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:46.155820 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.156620 22038 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:46.157899 25727 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:46.162837 21391 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:11:46.164386 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:46.152940 25688 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:46.163904 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.155041 25774 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:46.159040 25759 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:46.175251 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.175926 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:46.178489 22038 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:46.184355 21315 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:46.184993 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:46.185943 25701 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:46.186602 25701 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:46.187758 25701 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.193868 21315 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:46.181766 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.151218 25604 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.152338 25738 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.199339 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.171195 25591 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:46.208645 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.202877 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:46.204213 25521 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:46.206255 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 994) took 1259 ms. Trace:
I20260709 13:11:46.212249 21394 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:46.211222 22035 rpcz_store.cc:276] 0709 13:11:44.947264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.947878 (+   614us) service_pool.cc:224] Handling call
0709 13:11:46.206102 (+1258224us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54006c5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:46.206202 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642100992}
I20260709 13:11:46.246129 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.247032 21390 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:46.250165 21396 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:46.251598 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:46.211149 25521 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:46.255946 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.256991 21390 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:46.214221 25591 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:46.252768 25703 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.258057 25665 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:46.272432 25623 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.273450 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.276858 25161 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.282650 21390 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:46.285606 21390 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:46.284653 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 615) took 1722 ms. Trace:
I20260709 13:11:46.286842 21317 rpcz_store.cc:276] 0709 13:11:44.562427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.822396 (+259969us) service_pool.cc:224] Handling call
0709 13:11:44.822779 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.823229 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:44.823270 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:44.833260 (+  9990us) log.cc:844] Serialized 26 byte log entry
0709 13:11:46.125825 (+1292565us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b1800271300. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:11:46.261521 (+135696us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:46.261561 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.261640 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.284309 (+ 22669us) raft_consensus.cc:1685] finished
0709 13:11:46.284336 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.284582 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2815,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":38337,"spinlock_wait_cycles":4470528,"thread_start_us":135526,"threads_started":1,"wal-append.queue_time_us":1409324}
I20260709 13:11:46.294219 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.254740 25688 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.294057 21390 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.289631 25665 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:46.307708 21390 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:46.312229 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:46.318037 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5345038749999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
I20260709 13:11:46.260205 25774 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.293318 25664 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.281184 25703 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.334507 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:46.329782 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.338830 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.345486 25674 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.346083 25547 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:46.346155 25674 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.346760 25547 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.348979 25547 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.349535 25547 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:46.350329 25547 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:46.350965 25547 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:46.345620 25670 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:46.351791 25670 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.354007 25670 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.351302 25547 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:46.355931 25547 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.357821 25547 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:46.362752 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.364377 21315 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:46.365177 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.363533 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.365561 21390 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:11:46.365958 21316 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:46.366011 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.366024 21390 pending_rounds.cc:85] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 5
I20260709 13:11:46.366904 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.366988 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:46.367508 21388 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:46.367630 21316 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:46.366932 21390 pending_rounds.cc:107] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:11:46.368218 21390 raft_consensus.cc:2889] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.364126 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.346401 21207 maintenance_manager.cc:643] P 5338d281947a4ef192ba752d67ec0067: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.251s	user 0.164s	sys 0.087s Metrics: {"bytes_written":30582,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":158466,"dirs.run_cpu_time_us":534,"dirs.run_wall_time_us":10651,"drs_written":1,"lbm_read_time_us":518,"lbm_reads_lt_1ms":4,"lbm_write_time_us":157832,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":77099,"threads_started":2,"update_count":20,"wal-append.queue_time_us":69371}
I20260709 13:11:46.369652 21390 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:46.370005 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:46.370675 21320 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:46.371156 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.371498 21320 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:46.372155 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.369015 21388 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:11:46.373685 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.374390 21467 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:46.323889 25629 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.379954 21462 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:46.375458 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.327543 25702 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.384876 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.385704 21465 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:11:46.387161 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:46.396298 21314 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
W20260709 13:11:46.401183 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.401228 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:46.334507 25412 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.402316 21465 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:46.404208 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.406297 21462 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:46.413230 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:46.388140 25701 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:11:46.414131 25701 consensus_queue.cc:1243] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:46.403638 25670 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:46.416532 25670 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:46.416630 21208 maintenance_manager.cc:419] P 5338d281947a4ef192ba752d67ec0067: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9438 bytes on disk
I20260709 13:11:46.417488 25670 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.384222 25604 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.423477 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.425771 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.426807 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:46.427709 25548 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:46.389273 25738 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.427891 25701 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:11:46.430193 25161 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:46.328450 25591 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.433840 21207 maintenance_manager.cc:643] P 5338d281947a4ef192ba752d67ec0067: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.016s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":412,"lbm_reads_lt_1ms":4}
I20260709 13:11:46.319682 25521 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.401840 25702 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.388797 25629 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.411298 25412 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.458472 25161 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.459306 25161 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.463639 25161 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.436743 25778 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:46.470222 21315 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:11:46.471380 25778 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.476178 25759 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:46.476686 25759 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.478770 25759 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:46.487289 25798 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.496s	user 0.001s	sys 0.000s
I20260709 13:11:46.489111 25412 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.492725 25700 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:46.493297 25700 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:46.494379 25700 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.475706 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:46.447783 25674 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.454730 25747 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:46.507517 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.468307 25521 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:46.431733 25665 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.432127 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:46.520205 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.520545 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:46.528708 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 96692.6us
I20260709 13:11:46.518518 21465 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:46.529881 21469 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:11:46.529675 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 140221us
I20260709 13:11:46.530689 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:46.524972 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 211549us
I20260709 13:11:46.507230 25528 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:46.518570 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:46.532066 21464 raft_consensus.cc:2368] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:46.532363 21463 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.533274 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:46.506512 25700 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:46.535768 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.536005 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.542438 21467 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:46.537014 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:46.537086 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:46.539076 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.535491 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.546064 21466 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:46.547446 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.512478 25719 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.535609 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.550770 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:46.554319 25604 raft_consensus.cc:2764] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:46.551054 25701 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:46.555495 25701 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.555882 25701 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:46.559476 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 693) took 2170 ms. Trace:
I20260709 13:11:46.545503 25548 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:46.560801 25548 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:46.561192 25548 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:46.562714 25683 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.564409 21389 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:46.513715 25759 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:46.532401 25674 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:46.559904 21387 rpcz_store.cc:276] 0709 13:11:44.389531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.412865 (+ 23334us) service_pool.cc:224] Handling call
0709 13:11:44.413237 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.685999 (+1272762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.559216 (+873217us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002ce054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:46.559412 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2835689728}
I20260709 13:11:46.572588 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.573618 21470 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:46.575615 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:46.565331 25547 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:46.576406 21468 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:46.583465 21463 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:11:46.584712 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.584991 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:46.586165 21320 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:46.587261 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.587599 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.577917 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:46.587858 21461 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:46.590830 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:46.551733 25719 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.595713 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.568782 25674 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.601408 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.601150 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:46.603049 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:46.604933 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2428) took 3175 ms. Trace:
I20260709 13:11:46.577433 25703 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:46.605334 21319 rpcz_store.cc:276] 0709 13:11:43.426301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.183217 (+756916us) service_pool.cc:224] Handling call
0709 13:11:44.183524 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.351598 (+168074us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:44.435569 (+ 83971us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.772577 (+337008us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:44.772629 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:44.772671 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.601276 (+1828605us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400228b54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:46.601338 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.601468 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1872,"prepare.queue_time_us":83829,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":12923,"raft.queue_time_us":2897,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9794,"spinlock_wait_cycles":385939328,"thread_start_us":336434,"threads_started":1,"wal-append.queue_time_us":419234,"wal-append.run_cpu_time_us":2088,"wal-append.run_wall_time_us":1020954}
W20260709 13:11:46.596885 25795 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.004s
I20260709 13:11:46.606557 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.614296 21468 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:46.581620 25533 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:46.605649 25674 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.572224 25759 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.576766 25547 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.790561 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:46.791349 22041 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:46.780678 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.605115 25747 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:46.787132 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.792963 22036 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:46.787177 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.794103 22034 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:46.795213 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.805876 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:46.806702 22031 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:46.833206 21466 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:46.792193 25530 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:46.608284 25816 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.197s
I20260709 13:11:46.849424 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:46.793902 25778 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.805161 25702 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.805035 25689 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:46.830318 25775 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:46.859427 21466 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:46.631428 25795 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.804795 25629 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.836958 25818 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:46.804106 25747 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:46.892020 22031 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:46.907938 21464 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:46.908756 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.904898 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:46.910735 21463 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:46.908831 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.911441 25547 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.912009 21319 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:46.916426 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.917366 21320 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:46.918200 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.919324 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.920210 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.920847 21314 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:46.921121 25759 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:46.920936 25548 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.921617 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.922607 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.922955 25548 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:46.924007 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.909770 22032 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:46.924904 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:46.897998 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.923030 25817 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:46.928292 21468 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:11:46.867070 25689 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.927209 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:46.929041 21317 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:46.931644 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.934203 21317 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:46.936403 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:46.937119 21314 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:46.937958 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:46.939800 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:46.891696 25670 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:46.942273 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:46.943836 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:46.945734 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.946563 21317 raft_consensus.cc:2410] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:46.922973 25795 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.949774 22002 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:46.928527 25817 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:46.934146 25548 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:46.955101 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:46.957827 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:46.961328 21317 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:46.968091 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.974005 21465 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:46.979475 25664 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:46.979614 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.963598 24875 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:46.945206 25719 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.951419 25822 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:46.946893 25703 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:46.933706 25547 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:46.989526 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.989523 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2462) took 1049 ms. Trace:
I20260709 13:11:47.020490 21318 rpcz_store.cc:276] 0709 13:11:45.940485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.940688 (+   203us) service_pool.cc:224] Handling call
0709 13:11:46.989250 (+1048562us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540022d8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:46.989413 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307644288}
I20260709 13:11:46.982252 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2214) took 1635 ms. Trace:
I20260709 13:11:47.022173 21389 rpcz_store.cc:276] 0709 13:11:45.346899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.690315 (+343416us) service_pool.cc:224] Handling call
0709 13:11:46.982059 (+1291744us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54003435d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:46.982185 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008064768}
I20260709 13:11:47.018009 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:46.953840 25774 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.947304 25670 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:46.992182 21469 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:46.979717 25700 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:46.950243 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 354705us
I20260709 13:11:47.028527 22036 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
W20260709 13:11:47.037313 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.038054 21314 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:47.027915 25412 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:47.049027 25670 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.041404 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:46.972121 25828 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:47.034354 25700 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.044697 25747 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:47.049674 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2460) took 1316 ms. Trace:
I20260709 13:11:46.984920 25701 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.049958 25700 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:47.050890 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1216) took 1334 ms. Trace:
I20260709 13:11:47.051256 22039 rpcz_store.cc:276] 0709 13:11:45.716003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.716200 (+   197us) service_pool.cc:224] Handling call
0709 13:11:45.736639 (+ 20439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.790977 (+ 54338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.050660 (+1259683us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b54006446d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:47.050827 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70940032}
I20260709 13:11:47.017827 25664 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:47.051875 25701 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:47.049738 25828 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:47.052954 25828 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.052763 25664 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.053812 25664 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:47.056391 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:47.056886 25766 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.423s	user 0.003s	sys 0.009s
I20260709 13:11:47.057992 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:47.059621 21360 leader_election.cc:400] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:47.061689 25719 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:47.062858 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:47.047220 25689 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.047714 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:47.047966 21320 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:47.030021 25547 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.046602 21469 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:47.059901 21360 leader_election.cc:403] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:47.064064 21466 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
W20260709 13:11:47.048974 21395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1732) took 1635 ms (client timeout 1993 ms). Trace:
I20260709 13:11:47.061373 25828 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.065804 21391 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:46.870368 25775 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.068708 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:47.083370 22032 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:47.050166 21313 rpcz_store.cc:276] 0709 13:11:45.733242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.733427 (+   185us) service_pool.cc:224] Handling call
0709 13:11:45.733759 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.154598 (+420839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.049451 (+894853us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540022cc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:47.049618 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966109056}
I20260709 13:11:47.072352 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:47.084563 22041 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:47.084488 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:47.074780 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:47.088936 22042 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:47.019088 24875 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:47.066272 21395 rpcz_store.cc:269] 0709 13:11:45.413894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.455342 (+ 41448us) service_pool.cc:224] Handling call
0709 13:11:47.048740 (+1593398us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54003430d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:47.048893 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000275200}
I20260709 13:11:46.909977 25818 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.107103 25818 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.091209 25604 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:47.108843 25828 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.109287 25547 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:47.109380 25775 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:46.983275 25817 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.090196 25759 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:47.110747 25759 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.112363 25604 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:47.112879 25759 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:47.113511 25604 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:47.119099 25814 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.680s	user 0.003s	sys 0.000s
I20260709 13:11:47.081260 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:47.120877 25197 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:47.121291 25197 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:47.122102 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:47.122159 25197 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.123234 25765 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:47.123492 25197 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.123765 25765 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:47.124202 25778 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:47.124320 25765 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.086338 21433 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:47.125738 21468 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:47.128383 21391 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:46.964457 25548 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.082625 25412 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:47.020680 25822 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:11:47.122109 25772 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.532s	user 0.004s	sys 0.000s
I20260709 13:11:47.133039 25822 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:47.134362 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2203) took 1833 ms. Trace:
I20260709 13:11:47.134703 21392 rpcz_store.cc:276] 0709 13:11:45.301135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.301264 (+   129us) service_pool.cc:224] Handling call
0709 13:11:45.333296 (+ 32032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:45.334793 (+  1497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.334822 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:45.348859 (+ 14037us) log.cc:844] Serialized 26 byte log entry
0709 13:11:45.457508 (+108649us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:45.457567 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.457668 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.121467 (+1663799us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:47.134061 (+ 12594us) raft_consensus.cc:1685] finished
0709 13:11:47.134085 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.134303 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1127,"raft.queue_time_us":22766,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":22568,"spinlock_wait_cycles":3462912,"thread_start_us":51699,"threads_started":1,"wal-append.queue_time_us":156148}
I20260709 13:11:47.110962 25817 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:47.081046 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:47.140682 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59732us
I20260709 13:11:47.141772 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:47.143198 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:47.081900 25728 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:47.130172 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 43907.8us
W20260709 13:11:47.148658 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.024s
W20260709 13:11:47.149914 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.004s	sys 0.024s
I20260709 13:11:47.103688 24875 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:47.130194 22041 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:47.080958 25528 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:11:47.152851 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 615802us
I20260709 13:11:47.154366 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:47.163708 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:47.166919 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:47.035554 25774 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.160846 21470 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.128154 25547 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:47.171928 25759 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:47.149048 25533 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:47.174216 22038 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:47.149192 25738 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:47.149220 25687 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:47.159826 25664 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:47.196930 21461 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:11:47.197425 21461 pending_rounds.cc:85] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 9
I20260709 13:11:47.197696 21461 pending_rounds.cc:107] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:11:47.197997 21461 raft_consensus.cc:2889] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:47.198945 25689 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.199633 25689 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:47.323036 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.330278 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.159988 25674 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:47.373569 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 423842us
I20260709 13:11:47.376574 21470 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:11:47.379460 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:47.389423 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:47.507840 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.508304 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.509425 21470 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:47.506983 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 356643us
I20260709 13:11:47.516073 24875 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.520438 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:47.520830 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 377717us
W20260709 13:11:47.521981 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 132670us
I20260709 13:11:47.523725 24875 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.149425 25728 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:47.525565 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.526870 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:47.211539 25509 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:47.208715 25738 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:47.173127 25750 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.345s
I20260709 13:11:47.529835 21316 raft_consensus.cc:2368] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14.
I20260709 13:11:47.181103 25547 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.527487 21313 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:47.519573 25818 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:47.529395 21466 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:47.533016 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:47.529536 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:47.534018 22041 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:47.536055 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:47.209585 25664 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:47.559039 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 392217us
I20260709 13:11:47.528249 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:47.560173 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 361942us
I20260709 13:11:47.561448 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:47.540405 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2221) took 1023 ms. Trace:
I20260709 13:11:47.562103 21314 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
I20260709 13:11:47.540580 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:47.536059 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:47.552393 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 710) took 1430 ms. Trace:
I20260709 13:11:47.552778 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:47.565847 24875 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:47.566895 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:47.524186 25701 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:47.562402 21462 rpcz_store.cc:276] 0709 13:11:46.517359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.517504 (+   145us) service_pool.cc:224] Handling call
0709 13:11:46.517816 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.518005 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:46.929629 (+411624us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.540094 (+610465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:47.540142 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:47.540184 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.540248 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.540356 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":375529,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":26426,"raft.run_wall_time_us":3849,"spinlock_wait_cycles":368725376,"thread_start_us":1021376,"threads_started":3,"wal-append.queue_time_us":282500}
I20260709 13:11:47.569226 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:47.571225 22038 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:11:47.571864 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:47.572881 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:47.534507 25537 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:47.598882 21317 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:47.599525 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:47.527333 25831 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.599449 25537 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.600292 25831 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.601243 22042 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:47.601742 25537 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:47.526563 25632 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.602286 21318 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.602766 25831 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.602470 25632 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.603292 25831 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:47.603752 25831 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.604564 25632 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.577241 25447 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:47.605659 25831 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.606411 21462 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:47.531586 25665 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:47.582820 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:47.607064 25665 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:47.608006 25665 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.590019 25519 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:47.609115 25519 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.590180 21215 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 6, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 6 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:47.574512 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:47.613058 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:47.598202 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:47.540563 25591 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:47.583528 21313 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:11:47.617468 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:47.619818 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:47.567529 25442 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:47.634234 22038 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:47.639719 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:47.626992 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:47.637362 24875 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:47.575127 25834 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:47.614738 25521 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:47.629108 25447 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.608520 21462 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:47.647509 22031 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:11:47.649505 25765 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 13:11:47.637256 25442 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.646018 25604 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:47.645862 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:47.650828 25760 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:47.614473 25701 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.676764 25844 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:47.677452 25844 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:47.679675 25840 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:47.680826 25840 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:47.681161 25840 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:47.682015 25840 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.683310 25840 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:47.684237 25519 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:47.684832 25547 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.667943 25548 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:47.653690 25834 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:47.687022 25412 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.001s
I20260709 13:11:47.687485 25412 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:47.670499 21318 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:47.646952 25839 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:47.656498 25528 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:47.665033 25831 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:47.671412 25703 consensus_meta.cc:287] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 13:11:47.670562 25442 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:47.672185 25760 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.675420 25521 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:47.709260 25703 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:47.701366 25839 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.658929 25738 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.722298 25442 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.723405 25674 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.749150 22034 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:47.750065 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:47.750676 21320 raft_consensus.cc:2376] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11. Re-sending same reply.
W20260709 13:11:47.723750 25822 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.000s
I20260709 13:11:47.724200 25728 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:47.724475 25689 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.706344 25528 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:47.765185 21312 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:47.739789 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:47.779974 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:47.762183 25442 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:47.757990 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:47.759690 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:47.762605 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:47.670310 25765 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.674870 21462 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:11:47.765805 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 152815us
I20260709 13:11:47.728737 25548 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:47.715647 25760 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.717408 25774 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:47.765065 25817 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
W20260709 13:11:47.807876 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.807328 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47706.5us
I20260709 13:11:47.791708 21318 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:47.747063 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 190833us
I20260709 13:11:47.918094 21314 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [7.9-9.10]
W20260709 13:11:48.079989 21315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 625) took 1716 ms (client timeout 1687 ms). Trace:
W20260709 13:11:48.626909 21315 rpcz_store.cc:269] 0709 13:11:46.363705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.364964 (+  1259us) service_pool.cc:224] Handling call
0709 13:11:48.079806 (+1714842us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003ca0d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:48.079932 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240305920}
W20260709 13:11:48.343779 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.881659 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:48.632509 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.633644 25727 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:48.634473 25727 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.563753 21390 rpcz_store.cc:276] 0709 13:11:46.122296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.388081 (+265785us) service_pool.cc:224] Handling call
0709 13:11:46.403612 (+ 15531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.403833 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:46.409706 (+  5873us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.059438 (+649732us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b18002001a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:11:47.551953 (+492515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:47.552093 (+   140us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:47.552136 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.552201 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.552335 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5881,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":21397,"spinlock_wait_cycles":5733632,"thread_start_us":477179,"threads_started":1}
I20260709 13:11:48.282550 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:48.345849 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.009s	sys 0.020s
W20260709 13:11:48.639426 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.010s	sys 0.022s
W20260709 13:11:48.639950 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.05481e+06us
I20260709 13:11:48.187523 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:48.642143 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 760411us
I20260709 13:11:48.644384 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:48.263446 21463 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:48.648806 25719 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:48.649804 25719 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:48.651558 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 631) took 1705 ms. Trace:
W20260709 13:11:48.261161 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2231) took 1725 ms (client timeout 1963 ms). Trace:
I20260709 13:11:47.916615 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:47.907395 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2230) took 1373 ms. Trace:
W20260709 13:11:48.117138 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.687s (SENT) [suppressed 11 similar messages]
I20260709 13:11:48.497040 21312 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:48.500322 21320 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:48.501526 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 2473) took 1586 ms. Trace:
I20260709 13:11:48.853729 21316 rpcz_store.cc:276] 0709 13:11:46.914874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.931404 (+ 16530us) service_pool.cc:224] Handling call
0709 13:11:48.491967 (+1560563us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400229054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:48.501309 (+  9342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373782912}
W20260709 13:11:48.662827 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.549412 21359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.021s	sys 0.000s
W20260709 13:11:48.861251 21359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.288s	user 0.024s	sys 0.000s
I20260709 13:11:48.553920 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2246) took 1407 ms. Trace:
I20260709 13:11:48.525243 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:48.659113 21465 rpcz_store.cc:276] 0709 13:11:46.534846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.535013 (+   167us) service_pool.cc:224] Handling call
0709 13:11:47.907219 (+1372206us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400248bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:47.907336 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975049472}
I20260709 13:11:48.458046 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 635) took 1405 ms. Trace:
I20260709 13:11:49.038292 21468 rpcz_store.cc:276] 0709 13:11:47.052879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.062610 (+  9731us) service_pool.cc:224] Handling call
0709 13:11:48.457457 (+1394847us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b54003539d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:48.457789 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143052672}
W20260709 13:11:48.652558 21469 rpcz_store.cc:269] 0709 13:11:46.536098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.536705 (+   607us) service_pool.cc:224] Handling call
0709 13:11:48.260900 (+1724195us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001a7cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:48.261080 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032736128}
I20260709 13:11:48.657866 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1773) took 1142 ms. Trace:
I20260709 13:11:49.041754 21470 rpcz_store.cc:276] 0709 13:11:47.515728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.635554 (+119826us) service_pool.cc:224] Handling call
0709 13:11:48.457878 (+822324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.458636 (+   758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.458707 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:48.458806 (+    99us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:48.458876 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.459038 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.657432 (+198394us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54003539d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:48.657618 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877078784}
I20260709 13:11:48.661559 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:48.534724 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:49.046943 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 512723us
W20260709 13:11:48.658640 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 741926us
I20260709 13:11:48.058176 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.052438 22031 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:11:47.848901 22036 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
W20260709 13:11:47.853369 25197 consensus_meta.cc:287] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.001s
I20260709 13:11:47.889238 25447 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:48.531522 25591 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:48.327382 25612 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.912524 25274 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:48.556736 25442 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.089890 25442 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.791018 25521 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.831254 25528 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:47.871732 25533 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.688s	user 0.004s	sys 0.005s
I20260709 13:11:49.102219 25442 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.102342 25533 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:47.837251 25548 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.816742 25664 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:47.850301 25701 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:48.693511 25719 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:48.690093 25723 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:48.053594 25638 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:49.130041 25638 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:49.130430 25638 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:48.383594 25687 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:49.133376 25687 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:48.396556 25688 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:47.763275 25700 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.005s
I20260709 13:11:49.137552 25688 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.140600 25700 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.142133 22041 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:47.915995 25703 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.880467 25760 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.853693 25765 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:48.205972 25778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.004s	sys 0.007s
W20260709 13:11:48.211061 25830 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.999s	user 0.001s	sys 0.001s
W20260709 13:11:47.965886 25832 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.431s	user 0.001s	sys 0.000s
W20260709 13:11:48.684449 25833 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.482s	user 0.001s	sys 0.006s
I20260709 13:11:48.143771 25834 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:48.192934 25835 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.687s	user 0.004s	sys 0.000s
I20260709 13:11:47.707513 25831 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:47.729238 25839 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.765002 25822 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:47.917459 25817 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.809731 25779 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.656647 25753 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:47.762302 25750 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.386564 25728 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:48.662293 25727 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:48.565788 25845 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.953s	user 0.006s	sys 0.000s
W20260709 13:11:48.123651 25847 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.538s	user 0.003s	sys 0.000s
I20260709 13:11:48.342464 25852 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:47.758024 25843 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.812305 25844 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:48.714900 25870 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:48.655033 25867 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:48.731766 25010 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:48.809978 25875 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:48.810885 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1233) took 1172 ms. Trace:
I20260709 13:11:48.818789 25818 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.821764 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2232) took 2275 ms. Trace:
I20260709 13:11:48.865239 21461 rpcz_store.cc:276] 0709 13:11:47.146348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.148108 (+  1760us) service_pool.cc:224] Handling call
0709 13:11:47.150787 (+  2679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.198560 (+ 47773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.553137 (+1354577us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54004303d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:48.553650 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105311488}
I20260709 13:11:48.890017 25856 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.899072 25876 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.905050 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 781345us
W20260709 13:11:48.923516 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 280042us
I20260709 13:11:48.936700 21462 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:48.937412 21463 rpcz_store.cc:276] 0709 13:11:46.945925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.947297 (+  1372us) service_pool.cc:224] Handling call
0709 13:11:48.263153 (+1315856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.648507 (+385354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.651132 (+  2625us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001a7cd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:48.651342 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025465728}
I20260709 13:11:48.941947 25880 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.947168 25879 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:48.956099 25530 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.960994 25622 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.963093 25666 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.965747 25872 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.966881 25702 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:48.968101 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 178074us
I20260709 13:11:48.968626 25773 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.972245 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:48.973903 21320 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:48.987248 25853 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.999235 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 325703us
I20260709 13:11:49.005990 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:45.110134 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:49.014830 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2466) took 2101 ms. Trace:
I20260709 13:11:49.048216 25795 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:49.057289 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 426319us
I20260709 13:11:49.060918 22036 pending_rounds.cc:85] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 10
I20260709 13:11:49.060447 25774 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:49.064586 25623 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.066466 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:49.072464 21215 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 5 to 6, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 6 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:49.082297 25612 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.063679 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:49.127949 25548 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.128582 25723 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.250953 25521 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:11:49.265013 25779 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:49.230716 21491 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0fe0 after lost signal to thread 20202
I20260709 13:11:49.265527 25875 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:49.267427 21491 debug-util.cc:398] Leaking SignalData structure 0x7b080014d440 after lost signal to thread 21253
I20260709 13:11:49.267761 25747 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:49.268421 25747 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:49.268707 22036 pending_rounds.cc:107] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:11:49.269209 22036 raft_consensus.cc:2889] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:49.270021 25747 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.270841 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1024) took 2122 ms. Trace:
I20260709 13:11:49.271672 25747 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:49.272806 25773 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.273674 25779 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:49.131832 25638 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.274876 25591 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:49.275301 25591 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:49.275467 25773 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.276404 25880 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.276499 25591 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.278085 25591 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:49.279214 25880 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.279717 25701 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:49.281363 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 275523us
I20260709 13:11:49.281519 25638 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.282521 25719 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:49.282455 25701 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:49.283759 25664 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:49.284292 25664 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:49.283576 25719 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:49.284416 25856 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.285531 25664 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.284466 25533 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:11:49.286976 25664 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:49.287451 25852 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.290761 25622 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.220619 25687 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.293363 25622 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.294034 25530 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.294464 25612 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:49.294739 25689 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:49.324242 21491 debug-util.cc:398] Leaking SignalData structure 0x7b080017a400 after lost signal to thread 21345
I20260709 13:11:49.325181 25831 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.294989 25818 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:49.326383 21491 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3020 after lost signal to thread 21420
I20260709 13:11:49.327534 25818 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:49.327804 21491 debug-util.cc:398] Leaking SignalData structure 0x7b08002c45c0 after lost signal to thread 21494
I20260709 13:11:49.328598 22034 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:49.329358 21491 debug-util.cc:398] Leaking SignalData structure 0x7b080037c560 after lost signal to thread 22066
W20260709 13:11:49.329684 21491 debug-util.cc:398] Leaking SignalData structure 0x7b080038f260 after lost signal to thread 22067
W20260709 13:11:49.330570 21491 debug-util.cc:398] Leaking SignalData structure 0x7b0800312da0 after lost signal to thread 25748
I20260709 13:11:49.296108 25843 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:49.331418 21491 debug-util.cc:398] Leaking SignalData structure 0x7b08004055e0 after lost signal to thread 25848
I20260709 13:11:49.290035 25852 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.296522 25010 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.297279 25883 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:49.297437 25872 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.297677 25750 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.297137 21215 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 8, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 8 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.298209 25666 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.337852 25666 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.299121 25870 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.338063 21467 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:11:49.338514 25870 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:49.338842 25530 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:49.223779 21214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 286) took 22268 ms (client timeout 15000 ms). Trace:
I20260709 13:11:49.167501 25823 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.342240 25750 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.341989 25823 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:49.339412 21214 rpcz_store.cc:269] 0709 13:11:26.954988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.955242 (+   254us) service_pool.cc:224] Handling call
0709 13:11:49.223432 (+22268190us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:40.316261 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:40.316919 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:40.316964 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:11:40.316983 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:40.318783 (+  1800us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:40.318877 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:40.318911 (+    34us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:11:40.367507 (+ 48596us) tablet.cc:701] Row locks acquired
0709 13:11:40.367554 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:11:40.367766 (+   212us) write_op.cc:270] Start()
0709 13:11:40.367959 (+   193us) write_op.cc:276] Timestamp: P: 1783602700367683 usec, L: 0
0709 13:11:40.367987 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:11:40.368904 (+   917us) log.cc:844] Serialized 7945 byte log entry
0709 13:11:40.642459 (+273555us) op_driver.cc:464] REPLICATION: finished
0709 13:11:41.066300 (+423841us) write_op.cc:301] APPLY: starting
0709 13:11:41.155927 (+ 89627us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:41.381507 (+225580us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:41.381668 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:41.545509 (+163841us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:41.546031 (+   522us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=40
0709 13:11:41.546104 (+    73us) write_op.cc:312] APPLY: finished
0709 13:11:41.546709 (+   605us) log.cc:844] Serialized 139 byte log entry
0709 13:11:41.546909 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:41.547087 (+   178us) write_op.cc:454] Released schema lock
0709 13:11:41.547160 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:41.547556 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:41.547584 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2983762,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":374653,"apply.run_cpu_time_us":21158,"apply.run_wall_time_us":510343,"num_ops":20,"prepare.queue_time_us":278590,"prepare.run_cpu_time_us":23852,"prepare.run_wall_time_us":213176,"raft.queue_time_us":72803,"raft.run_cpu_time_us":21100,"raft.run_wall_time_us":237134,"replication_time_us":274190,"thread_start_us":458587,"threads_started":4,"wal-append.queue_time_us":174663,"wal-append.run_cpu_time_us":21497,"wal-append.run_wall_time_us":2003850}]]}
W20260709 13:11:49.343250 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.345113 25723 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.265121 25703 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.299834 21316 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:49.300487 25778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.092s	user 0.009s	sys 0.009s
I20260709 13:11:49.300621 25844 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:49.301111 21319 rpcz_store.cc:276] 0709 13:11:46.912870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.925615 (+ 12745us) service_pool.cc:224] Handling call
0709 13:11:48.500610 (+1574995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.724896 (+224286us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:48.793081 (+ 68185us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.968693 (+175612us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.969344 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.969517 (+   173us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:48.969553 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.969620 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.977680 (+  8060us) raft_consensus.cc:1685] finished
0709 13:11:48.977712 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.014444 (+ 36732us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003ca0d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:49.014622 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":385650,"prepare.queue_time_us":66079,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":621793,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":240,"spinlock_wait_cycles":3621393280,"thread_start_us":80636,"threads_started":2,"wal-append.queue_time_us":12695}
I20260709 13:11:49.210167 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2448) took 3661 ms. Trace:
I20260709 13:11:49.303862 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:49.304312 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 241322us
I20260709 13:11:49.305171 25521 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:49.142767 25688 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.313326 22042 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:49.226017 25700 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.269184 25876 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.276427 25853 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.264614 22038 rpcz_store.cc:276] 0709 13:11:47.638474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.640831 (+  2357us) service_pool.cc:224] Handling call
0709 13:11:47.641116 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.808955 (+1167839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.809017 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:48.809095 (+    78us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:48.809121 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.810365 (+  1244us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001c0054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:48.810406 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.810623 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2684433664}
W20260709 13:11:49.358419 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 66070.5us
I20260709 13:11:49.271962 25623 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.271307 22036 rpcz_store.cc:276] 0709 13:11:47.148667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.148831 (+   164us) service_pool.cc:224] Handling call
0709 13:11:47.172471 (+ 23640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.269968 (+2097497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.270554 (+   586us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54007e0c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:49.270757 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496129792}
I20260709 13:11:49.268618 21464 rpcz_store.cc:276] 0709 13:11:46.546148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.547134 (+   986us) service_pool.cc:224] Handling call
0709 13:11:48.821317 (+2274183us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540029a9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:48.821572 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805586176}
I20260709 13:11:49.286983 25856 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:49.295553 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.370672 21434 connection.cc:256] RPC call timeout handler was delayed by -1.4806389189999436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:11:49.371167 21434 connection.cc:256] RPC call timeout handler was delayed by -1.3946355460000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:11:49.371479 21434 connection.cc:256] RPC call timeout handler was delayed by -1.3895470720000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:11:49.371814 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.371915 25853 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.372545 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.373185 22038 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:49.374019 25876 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.374313 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.354210 21321 rpcz_store.cc:276] 0709 13:11:45.548207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.643489 (+ 95282us) service_pool.cc:224] Handling call
0709 13:11:45.643822 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.163638 (+3519816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.163691 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.163753 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:49.163787 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.209547 (+ 45760us) spinlock_profiling.cc:243] Waited 3.52 s on lock 0x7b5400088254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:49.209618 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.209944 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114,"raft.queue_time_us":108930,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"spinlock_wait_cycles":8093329920}
I20260709 13:11:49.376220 25834 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:49.376848 25834 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.378471 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.337841 21215 catalog_manager.cc:5697] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 6 to 9, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 9 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:49.361018 25010 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:49.379261 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.362881 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 310988us
I20260709 13:11:49.363613 25703 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:49.313413 25817 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:49.364279 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 60592.5us
I20260709 13:11:49.365129 25688 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:49.364888 25844 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.366199 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:49.391844 25688 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:49.393328 25688 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.397207 25852 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:49.397699 21362 leader_election.cc:400] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14.
I20260709 13:11:49.398025 21390 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:49.398254 21362 leader_election.cc:403] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:49.398492 25852 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:49.400327 25852 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:49.400259 25883 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:49.401031 25883 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:49.402325 25883 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.366282 25872 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:49.361596 22042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1230) took 1748 ms (client timeout 1922 ms). Trace:
I20260709 13:11:49.279911 25880 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:49.408608 25852 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14.
I20260709 13:11:49.268366 25875 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.384367 21316 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
W20260709 13:11:49.408246 22042 rpcz_store.cc:269] 0709 13:11:47.613379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.626749 (+ 13370us) service_pool.cc:224] Handling call
0709 13:11:49.361332 (+1734583us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400648554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:49.361520 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3833254144}
I20260709 13:11:49.410729 25834 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.414633 25839 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.415505 25760 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:49.415443 25867 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:49.416891 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.417693 21318 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:49.418174 25623 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.357333 25753 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.378880 25843 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.422228 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.418805 21215 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 4 to 10, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 10 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.431447 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.430081 21315 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:49.412413 25876 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.446986 25876 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.448567 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.449401 21316 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:49.449532 25876 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.450302 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.450925 25856 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.451622 25856 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.452001 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.452831 21318 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:49.421368 25703 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.458374 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.459858 21314 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:49.461232 21319 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:11:49.461652 25765 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.462150 25765 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.462633 21312 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:49.464062 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.465859 21318 raft_consensus.cc:2410] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:11:49.468811 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 54742.1us
I20260709 13:11:49.469501 25822 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:49.469583 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:49.471418 25727 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.471532 25851 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:49.472231 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:49.468653 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.462177 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.483559 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.484515 21390 raft_consensus.cc:2393] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:49.456975 25779 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.464188 25447 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.475615 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.498406 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.466142 21215 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:49.512104 21320 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:49.472189 25727 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.484733 25591 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.500671 25883 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.509092 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:49.455893 25753 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:49.529646 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57519us
I20260709 13:11:49.563511 22034 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:49.489073 25533 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:11:49.484984 25703 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.503640 25778 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.572536 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:49.572713 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.565418 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.515726 25612 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:49.573249 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:49.489238 25879 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:11:49.505402 25765 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.589397 22036 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:11:49.566413 25843 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:49.597061 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 106732us
I20260709 13:11:49.602078 25591 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.603111 25687 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:49.603509 25687 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.603864 25687 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:49.604568 25591 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.605230 25856 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.599702 25823 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.606243 25778 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.609278 21392 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:49.609484 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.596312 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.610562 25882 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:49.602499 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 175783us
I20260709 13:11:49.611197 25882 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.612435 25778 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:49.612128 21215 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 7 to 9, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 9 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.613507 25882 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.614476 21390 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:11:49.615092 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.615952 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.614012 21215 catalog_manager.cc:5697] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 7 to 8, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 8 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.618750 21215 catalog_manager.cc:5697] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:11:49.505295 25447 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.616719 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:49.625802 25703 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.626705 25703 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:49.627175 25703 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:49.611208 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.616600 21463 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:49.627568 25703 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:49.628296 25834 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:49.625866 25447 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:49.629931 25834 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:49.631583 25890 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:49.632023 25890 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:49.633219 25890 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.633989 25753 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.634192 25817 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:49.635012 25873 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:49.635663 21462 raft_consensus.cc:2410] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:49.634961 25890 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.641395 25727 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:49.642551 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 77525.7us
I20260709 13:11:49.642656 25765 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.643280 25765 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.509804 25870 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.520943 25779 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.590950 25612 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.657723 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.659855 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.652066 25591 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:49.679818 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.655086 25612 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:49.677959 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.680691 22031 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:49.674189 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.685796 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.679463 25591 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.696501 25591 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:49.716442 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63760us
I20260709 13:11:49.720808 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.721709 21320 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:49.723616 25872 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.723093 21215 catalog_manager.cc:5697] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 5 to 7, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 7 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:49.746788 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.747416 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.748080 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.720289 22034 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:11:49.748860 22039 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:49.750524 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.751384 21392 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:49.752058 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.752419 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.752521 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.753046 22035 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:49.753268 21387 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
W20260709 13:11:49.724718 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08001b22a0 after lost signal to thread 20199
I20260709 13:11:49.724253 21316 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:49.726052 25852 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:49.727298 25839 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.729804 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:49.737313 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.740728 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:49.741448 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.746979 21391 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:49.751219 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:49.753765 21389 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:49.728688 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2483) took 1976 ms. Trace:
I20260709 13:11:49.724270 25872 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:49.761730 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.757485 21342 debug-util.cc:398] Leaking SignalData structure 0x7b080029fe60 after lost signal to thread 20202
W20260709 13:11:49.762388 21342 debug-util.cc:398] Leaking SignalData structure 0x7b080035ef80 after lost signal to thread 21215
W20260709 13:11:49.763131 21342 debug-util.cc:398] Leaking SignalData structure 0x7b0800365c20 after lost signal to thread 21253
I20260709 13:11:49.764711 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:49.764854 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:49.766095 21313 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:49.770143 21395 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:49.770886 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:49.771237 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08001b20a0 after lost signal to thread 21273
W20260709 13:11:49.772838 21342 debug-util.cc:398] Leaking SignalData structure 0x7b0800378a20 after lost signal to thread 21345
W20260709 13:11:49.774398 21342 debug-util.cc:398] Leaking SignalData structure 0x7b0800387340 after lost signal to thread 21420
I20260709 13:11:49.772540 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:49.775964 21342 debug-util.cc:398] Leaking SignalData structure 0x7b080031d1c0 after lost signal to thread 21494
W20260709 13:11:49.779093 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4ec0 after lost signal to thread 22031
W20260709 13:11:49.779560 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003755a0 after lost signal to thread 22036
I20260709 13:11:49.780947 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:49.781558 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003af900 after lost signal to thread 22066
I20260709 13:11:49.776613 22036 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
W20260709 13:11:49.784818 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4ea0 after lost signal to thread 22067
W20260709 13:11:49.784907 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62414.6us
W20260709 13:11:49.785436 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6820 after lost signal to thread 25197
W20260709 13:11:49.785830 21342 debug-util.cc:398] Leaking SignalData structure 0x7b0800270f40 after lost signal to thread 25274
I20260709 13:11:49.785432 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.754649 25843 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:49.787809 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0380 after lost signal to thread 25447
W20260709 13:11:49.788247 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb160 after lost signal to thread 25521
W20260709 13:11:49.788508 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003f16c0 after lost signal to thread 25528
W20260709 13:11:49.788741 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4120 after lost signal to thread 25533
W20260709 13:11:49.788956 21342 debug-util.cc:398] Leaking SignalData structure 0x7b080005d320 after lost signal to thread 25548
W20260709 13:11:49.789196 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee5a0 after lost signal to thread 25622
W20260709 13:11:49.789423 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08001af5e0 after lost signal to thread 25638
W20260709 13:11:49.789625 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003c81c0 after lost signal to thread 25664
I20260709 13:11:49.790203 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:49.791653 21342 debug-util.cc:398] Leaking SignalData structure 0x7b080036fd00 after lost signal to thread 25700
W20260709 13:11:49.791967 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5760 after lost signal to thread 25701
I20260709 13:11:49.791429 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:49.792214 21342 debug-util.cc:398] Leaking SignalData structure 0x7b080035fe00 after lost signal to thread 25703
I20260709 13:11:49.790135 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:49.792174 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 61248.2us
W20260709 13:11:49.792964 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003389a0 after lost signal to thread 25750
W20260709 13:11:49.795553 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1d40 after lost signal to thread 25760
W20260709 13:11:49.795827 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003fbee0 after lost signal to thread 25765
W20260709 13:11:49.796108 21342 debug-util.cc:398] Leaking SignalData structure 0x7b0800387180 after lost signal to thread 25778
W20260709 13:11:49.796909 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003289a0 after lost signal to thread 25779
W20260709 13:11:49.797384 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2b20 after lost signal to thread 25817
I20260709 13:11:49.780604 25533 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:49.798902 25533 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.793754 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.799311 25533 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:49.790818 25882 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:49.800172 25882 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:49.800532 25882 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:49.801628 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:49.802474 25823 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:49.802835 25823 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:49.803220 25823 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.804155 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:49.804620 21391 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:49.781891 25688 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:49.805351 25688 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.805759 25688 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.805615 25723 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:11:49.806820 25723 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:49.807173 25723 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:49.808158 25775 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.809463 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:49.810225 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:49.810424 25664 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:49.811025 21392 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:49.811700 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:49.812479 25010 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:49.812846 25010 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.813215 25010 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:49.815083 25779 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.809518 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.816433 21389 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:11:49.816670 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.817152 25843 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.761485 21317 rpcz_store.cc:276] 0709 13:11:47.751764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.276763 (+524999us) service_pool.cc:224] Handling call
0709 13:11:48.277102 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.288901 (+1011799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.288956 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.289497 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.413313 (+123816us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:49.413352 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.728219 (+314867us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540015c2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:49.728262 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.728301 (+    39us) raft_consensus.cc:1685] finished
0709 13:11:49.728313 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.728542 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":116,"spinlock_wait_cycles":2325836672,"thread_start_us":123465,"threads_started":1,"wal-append.queue_time_us":214686}
W20260709 13:11:49.818775 25874 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:49.810911 25664 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:49.797022 25852 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.820282 25834 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:49.820701 25834 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.820477 25664 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.793776 25856 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:11:49.822762 25876 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.823308 25876 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.824575 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.825690 25876 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:49.821480 21284 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:49.823935 21387 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:49.827247 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.833308 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:49.836998 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.821107 25834 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:49.829499 21342 debug-util.cc:398] Leaking SignalData structure 0x7b0800103ee0 after lost signal to thread 25822
I20260709 13:11:49.826164 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:49.839080 21342 debug-util.cc:398] Leaking SignalData structure 0x7b080038fea0 after lost signal to thread 25824
I20260709 13:11:49.836697 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:49.828049 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:49.843096 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca900 after lost signal to thread 25830
W20260709 13:11:49.843484 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf700 after lost signal to thread 25831
W20260709 13:11:49.843771 21342 debug-util.cc:398] Leaking SignalData structure 0x7b080017e720 after lost signal to thread 25832
W20260709 13:11:49.844063 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003cca20 after lost signal to thread 25834
W20260709 13:11:49.844331 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003aad20 after lost signal to thread 25835
I20260709 13:11:49.847784 25010 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.853219 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:49.853652 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6280 after lost signal to thread 25839
W20260709 13:11:49.854149 21342 debug-util.cc:398] Leaking SignalData structure 0x7b0800397da0 after lost signal to thread 25843
I20260709 13:11:49.854202 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:49.854594 21342 debug-util.cc:398] Leaking SignalData structure 0x7b0800307d40 after lost signal to thread 25844
I20260709 13:11:49.852926 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:49.856645 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:49.857434 21389 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:49.856654 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:49.858798 21463 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:49.860008 21342 debug-util.cc:398] Leaking SignalData structure 0x7b08003256c0 after lost signal to thread 25847
I20260709 13:11:49.860913 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.821604 25852 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:49.859683 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7107381399999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260709 13:11:49.872454 21285 connection.cc:256] RPC call timeout handler was delayed by -1.6765381400000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:11:49.873152 21285 connection.cc:256] RPC call timeout handler was delayed by -1.4101381399999582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:11:49.873643 21285 connection.cc:256] RPC call timeout handler was delayed by -1.4044759680000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 13:11:49.874140 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:49.875244 21285 connection.cc:256] RPC call timeout handler was delayed by -1.3588381399999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:11:49.876607 21285 connection.cc:256] RPC call timeout handler was delayed by -1.3399381399999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:11:49.878094 21285 connection.cc:256] RPC call timeout handler was delayed by -1.3174381400000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 13:11:49.877120 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 56163.2us
W20260709 13:11:49.879969 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.880874 21285 connection.cc:256] RPC call timeout handler was delayed by -1.188738140000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260709 13:11:49.887657 25010 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.888880 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:49.889231 21395 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:49.889739 21317 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:49.833977 25856 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.897876 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:49.899255 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:49.900820 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:49.865152 25747 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.007s
I20260709 13:11:49.857811 25890 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:49.905898 25853 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.906447 25723 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.909415 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.914160 21392 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:49.916862 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.856765 25876 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:49.888406 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.901654 21388 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:49.915005 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:49.917865 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 70485.6us
I20260709 13:11:49.873260 25870 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:49.936138 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.896878 25530 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:49.940322 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.898717 25623 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.940835 25872 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.915570 25856 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.934137 25765 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:49.948271 21393 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.855741 25591 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.838667 25687 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:49.951231 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:49.833103 25775 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:49.890688 25839 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.954911 21387 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:49.954528 25530 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:49.969245 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:49.972944 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.914234 25852 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.889990 25447 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:49.925953 25876 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:49.977746 21463 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:11:49.979527 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.981956 22036 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:49.950570 21462 raft_consensus.cc:2376] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12. Re-sending same reply.
I20260709 13:11:49.993481 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:49.994202 21470 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:11:49.997640 21461 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:49.998313 21391 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:49.930568 25612 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.016947 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.016811 25447 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:50.018973 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.020903 21317 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:50.021854 25876 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.025233 25852 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:50.026113 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1257381399999531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 13:11:50.026537 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0966759680001132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 13:11:50.026820 21285 connection.cc:256] RPC call timeout handler was delayed by -1.042159139999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 13:11:50.019775 25447 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:50.029790 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.030014 25687 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:50.037227 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:50.037982 22032 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:50.038184 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:50.039062 22034 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:50.040839 22035 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:50.042425 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:50.057410 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.015534 21467 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:50.014292 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.073242 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.991494 25723 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.080555 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:50.082787 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.084136 21464 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:50.074432 21387 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:11:49.990669 25839 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.993547 25530 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.092507 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.102273 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.103565 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.108383 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:50.108536 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 139397us
I20260709 13:11:50.109782 21465 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:50.095248 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:49.975991 25853 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.113332 22035 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:50.118518 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:49.991783 25623 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:50.039770 25882 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.097523 25727 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:50.112336 21312 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 3.
I20260709 13:11:50.048228 25823 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.092258 25839 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:50.154811 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.135763 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:50.125401 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:50.157569 21466 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:50.146641 25853 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:50.149000 25856 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:50.149468 25612 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:50.162287 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.161561 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.170718 21321 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:11:50.177544 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68021.9us
I20260709 13:11:50.177812 25834 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.178623 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:50.179283 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.177841 21393 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:50.180246 25879 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:50.180773 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.181564 21393 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:50.182474 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.184016 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.184662 25727 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:50.185148 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.186175 25834 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:50.187098 25823 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:50.192225 25775 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:50.192587 21387 raft_consensus.cc:2393] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:50.193612 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.194998 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.195668 21387 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:50.210034 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.200934 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:50.178223 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:50.177953 21466 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:50.196379 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.212697 22035 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:50.212846 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.218516 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:50.219852 22036 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:11:50.222769 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.212159 21396 raft_consensus.cc:2376] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11. Re-sending same reply.
I20260709 13:11:50.230126 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:50.230983 22031 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:50.220633 25703 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.001s
I20260709 13:11:50.250887 25839 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.172075 25852 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:50.255268 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:50.256342 22042 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:50.253821 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.180764 25879 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:50.259773 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.262265 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:50.262260 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:50.271895 21321 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:50.273398 21394 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:50.255128 25727 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:50.279667 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.273406 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:50.277525 25760 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.284780 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.285633 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.258957 25879 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:50.270628 25883 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.001s
I20260709 13:11:50.288723 21387 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:50.289265 21312 raft_consensus.cc:2368] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:11:50.291575 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.299144 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.253160 25703 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.306511 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.307488 21387 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:11:50.309566 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.260282 25876 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.313336 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.312650 21313 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:50.318454 21468 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:11:50.327565 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.334510 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:50.335987 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:50.336436 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 77825.9us
I20260709 13:11:50.336791 21318 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:50.336871 21468 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:50.337389 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.337870 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.337997 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:50.338460 21318 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:50.338627 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.335829 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:50.339483 21387 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:50.339668 21320 raft_consensus.cc:2376] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10. Re-sending same reply.
I20260709 13:11:50.339897 22038 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:50.339689 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.301178 25591 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:50.346730 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.349611 22035 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:50.352380 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.342298 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.319097 25822 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:50.356561 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.336534 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.358403 21464 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:50.360878 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:50.331197 25852 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:50.363348 21312 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.367710 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:50.372548 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.374002 21314 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:11:50.378456 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.384524 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.385354 21387 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:50.386468 21463 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:50.389777 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.382536 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:50.385593 21388 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:50.394894 21468 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:50.398738 21470 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:50.399742 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:50.405917 21314 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:50.380366 25852 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:50.410988 25919 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:11:50.415380 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.387367 25882 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:50.419332 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.422055 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.424263 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:50.425372 21313 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:50.422466 21388 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:50.373296 25822 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.435372 21314 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:50.440001 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.440768 21391 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:50.441411 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.443787 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.421613 25623 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:50.449977 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.432197 25834 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:50.430199 25839 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:50.452963 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.470116 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:50.453478 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 76466.5us
I20260709 13:11:50.455129 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:50.459916 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:50.492190 21320 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:50.460144 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.453336 21362 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:50.462608 21316 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:50.462735 25760 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:50.463519 25922 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:11:50.467877 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.509049 21394 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:50.475894 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:50.487659 25688 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.681s	user 0.001s	sys 0.009s
I20260709 13:11:50.497291 22002 leader_election.cc:400] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:11:50.511521 22002 leader_election.cc:403] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:50.509400 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:50.503058 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51877us
I20260709 13:11:50.512378 25687 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:50.514853 25687 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:50.515354 25687 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.504498 25760 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.516703 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:50.522768 21316 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.516753 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:50.518374 21320 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:50.529953 21396 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:50.498489 25703 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:50.533471 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:50.533003 21388 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:50.549103 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.551318 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:50.534204 25923 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260709 13:11:50.535840 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:50.504844 25890 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:50.531230 25774 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:50.534404 25834 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:11:50.558571 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.548619 25591 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:50.567660 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 188947us
I20260709 13:11:50.575402 25843 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:11:50.519101 25688 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:50.577159 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.558670 25612 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:50.557237 25876 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:50.567035 25839 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:50.576478 25723 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:11:50.550980 25852 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.619944 25774 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:50.613993 21390 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:50.578109 25856 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:11:50.575033 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:50.632534 25927 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:11:50.618355 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.618579 25795 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.618389 25591 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.629803 25612 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.632272 21394 raft_consensus.cc:2376] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7. Re-sending same reply.
I20260709 13:11:50.669215 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.670018 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.670384 21394 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:50.671108 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.671589 21394 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.611302 21316 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:50.646806 21392 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:50.647966 22031 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:50.616744 21388 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.636984 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:50.638876 25839 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.667387 21321 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:50.675949 25765 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:50.678639 25931 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:11:50.680845 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 174291us
I20260709 13:11:50.684868 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.686657 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.687479 21390 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:50.688372 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.689461 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.690477 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.691377 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.653892 25774 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.667694 25591 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:50.712019 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 214946us
I20260709 13:11:50.675071 25612 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:50.720885 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.676190 25822 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:50.676172 25839 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.717754 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:50.730803 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:50.731667 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 94750.7us
I20260709 13:11:50.702602 25915 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:50.737753 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.709021 25853 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:50.724117 25533 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.892s	user 0.013s	sys 0.000s
W20260709 13:11:50.723179 25925 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:11:50.743832 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 182449us
I20260709 13:11:50.782616 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:50.787988 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.678567 25765 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.676864 25795 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:50.796176 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 112276us
I20260709 13:11:50.843624 21436 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:50.734294 25623 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:50.806645 25687 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.811861 21313 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:50.830338 21312 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:11:50.830969 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.832883 21396 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
W20260709 13:11:50.834113 25879 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:11:50.789872 25533 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:50.797060 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:50.851816 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:50.870420 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.829502 25876 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.835165 25760 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.875434 21396 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:50.873606 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:50.878297 21392 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:50.877383 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:50.881819 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.883302 22039 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:50.880992 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:50.876325 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 145589us
I20260709 13:11:50.740316 25915 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:50.890825 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:50.892551 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:50.893656 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:50.894570 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:50.896862 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:50.898747 21464 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:50.900748 21389 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 4: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:50.901655 21395 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:50.902408 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:50.904579 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:50.904484 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:50.907799 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:50.887466 25853 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:50.885277 25822 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.889379 25521 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:50.935672 21387 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:50.908583 25703 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:50.885257 25882 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:11:50.876915 25879 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:50.946576 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46183.7us
I20260709 13:11:50.909724 25890 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:50.943444 21391 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:11:50.889883 25876 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.928704 25834 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.935420 25822 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.959038 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:50.938431 25521 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.928835 25940 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:50.893750 25942 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:11:50.971621 21388 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:50.972321 21393 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:50.973655 21388 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:50.971072 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2507) took 1036 ms. Trace:
W20260709 13:11:50.975579 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 135826us
I20260709 13:11:50.952870 25890 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:50.992815 25530 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.877s	user 0.005s	sys 0.009s
I20260709 13:11:50.993422 25530 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:50.994843 25942 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:50.995319 25942 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:50.974637 21315 rpcz_store.cc:276] 0709 13:11:49.934288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.934434 (+   146us) service_pool.cc:224] Handling call
0709 13:11:49.976317 (+ 41883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.976545 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.976582 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.991791 (+ 15209us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.255607 (+263816us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:50.490945 (+235338us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.491304 (+   359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.491424 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.968384 (+476960us) raft_consensus.cc:1685] finished
0709 13:11:50.968407 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.970990 (+  2583us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":332950,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3218,"raft.queue_time_us":129,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":1693,"thread_start_us":377785,"threads_started":2,"wal-append.queue_time_us":377684}
I20260709 13:11:50.997293 25890 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:50.995738 25530 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:51.002759 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2282) took 1030 ms. Trace:
I20260709 13:11:50.966317 25822 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.969921 25521 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:51.011009 21317 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:51.022722 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.005894 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.006332 21388 rpcz_store.cc:276] 0709 13:11:49.954096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.973189 (+1019093us) service_pool.cc:224] Handling call
0709 13:11:50.973483 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.974122 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.974295 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.012560 21391 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:51.000456 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.033516 22034 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:51.047144 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.048588 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:50.970438 25834 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:51.072310 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 164589us
I20260709 13:11:51.030265 25703 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.078081 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 733) took 1031 ms. Trace:
I20260709 13:11:51.084568 21388 rpcz_store.cc:276] 0709 13:11:50.046481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.076993 (+1030512us) service_pool.cc:224] Handling call
0709 13:11:51.077409 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.077633 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.077672 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:51.077734 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:51.077780 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.077857 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.078006 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.021049 25941 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:51.070269 25938 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:11:51.092633 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.013590 25623 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:51.096923 22041 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:50.968472 25915 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.069737 25823 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.101984 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2269) took 1155 ms. Trace:
I20260709 13:11:51.022465 25638 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:11:51.066856 25948 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:51.070024 25533 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:51.076298 25687 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:51.106771 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 353697us
I20260709 13:11:51.117913 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:51.106884 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 258839us
I20260709 13:11:51.114405 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2271) took 1173 ms. Trace:
I20260709 13:11:51.105391 21396 rpcz_store.cc:276] 0709 13:11:49.940615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.890542 (+949927us) service_pool.cc:224] Handling call
0709 13:11:50.900009 (+  9467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.900217 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:50.939778 (+ 39561us) log.cc:844] Serialized 14 byte log entry
0709 13:11:51.091878 (+152100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:51.091947 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:51.095408 (+  3461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.095523 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.095695 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2544,"prepare.queue_time_us":41276,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":5236,"thread_start_us":96537,"threads_started":1}
I20260709 13:11:51.093537 25941 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.116009 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.095283 25853 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:51.118947 21393 rpcz_store.cc:276] 0709 13:11:49.941177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.184907 (+243730us) service_pool.cc:224] Handling call
0709 13:11:51.114243 (+929336us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54003f5554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:51.114350 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808830720}
W20260709 13:11:51.121002 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 118801us
I20260709 13:11:51.120914 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.127076 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:51.075927 25530 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:11:51.139967 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:51.146065 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:51.146200 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:51.146754 21319 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.147012 21315 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:51.149042 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:51.151453 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.154633 22041 raft_consensus.cc:2368] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9.
I20260709 13:11:51.145318 25843 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.178179 21393 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:51.179070 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1741) took 1049 ms. Trace:
I20260709 13:11:51.179486 21393 rpcz_store.cc:276] 0709 13:11:50.129264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.158012 (+1028748us) service_pool.cc:224] Handling call
0709 13:11:51.177954 (+ 19942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.178755 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.178986 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.155606 21394 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:51.158135 21396 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:51.160225 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:51.162247 25944 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:11:51.064277 25942 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:51.163355 25943 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:11:51.164386 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:51.112020 25823 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:51.165201 25765 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:51.117123 25760 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:51.135921 25795 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:51.112680 25703 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:11:51.140187 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:51.198423 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1740) took 1081 ms. Trace:
W20260709 13:11:51.220573 21359 connection.cc:256] RPC call timeout handler was delayed by -1.5958496470001364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 13:11:51.220966 21396 rpcz_store.cc:276] 0709 13:11:50.116914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.119677 (+1002763us) service_pool.cc:224] Handling call
0709 13:11:51.157889 (+ 38212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.198103 (+ 40214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.198361 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.142066 25941 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:51.221997 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.224435 22032 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:51.208730 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 134855us
W20260709 13:11:51.210039 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 63554.1us
I20260709 13:11:51.246965 21396 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:51.205686 21313 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.212713 21393 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:51.248705 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1744) took 1060 ms. Trace:
I20260709 13:11:51.249053 21393 rpcz_store.cc:276] 0709 13:11:50.188738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.180705 (+991967us) service_pool.cc:224] Handling call
0709 13:11:51.212479 (+ 31774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.248440 (+ 35961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.248645 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.250451 21393 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:51.215857 25876 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:51.251036 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 735) took 1045 ms. Trace:
I20260709 13:11:51.251479 21393 rpcz_store.cc:276] 0709 13:11:50.205283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.249815 (+1044532us) service_pool.cc:224] Handling call
0709 13:11:51.250257 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.250815 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.250979 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:51.210282 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70437.8us
W20260709 13:11:51.215006 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59357.7us
I20260709 13:11:51.252774 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:51.224720 25942 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:51.225472 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 338630us
I20260709 13:11:51.160602 25948 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.217042 21394 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:51.162247 25834 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:51.228343 25823 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:51.227921 25623 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.228894 25952 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:51.230314 25947 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:51.211493 25940 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:51.244668 21319 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 4.
W20260709 13:11:51.245493 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 100548us
I20260709 13:11:51.210444 25879 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:51.247726 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1754) took 1056 ms. Trace:
I20260709 13:11:51.257967 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:51.258360 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:51.253111 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:51.202224 25843 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.403872 21388 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:51.429349 21396 rpcz_store.cc:276] 0709 13:11:50.191826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.221893 (+1030067us) service_pool.cc:224] Handling call
0709 13:11:51.239499 (+ 17606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.247405 (+  7906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.247667 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.289330 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 634) took 1261 ms. Trace:
I20260709 13:11:51.300873 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 732) took 1358 ms. Trace:
I20260709 13:11:51.257366 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:51.286631 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:51.432313 21393 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:51.305729 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2269) took 1377 ms. Trace:
I20260709 13:11:51.259357 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:51.308354 21312 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:51.407361 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1758) took 1106 ms. Trace:
I20260709 13:11:51.434724 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1746) took 1245 ms. Trace:
I20260709 13:11:51.293115 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:51.435961 21464 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:51.430480 21317 rpcz_store.cc:276] 0709 13:11:50.027593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.081676 (+ 54083us) service_pool.cc:224] Handling call
0709 13:11:51.289037 (+1207361us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400229554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:51.289257 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064786816}
W20260709 13:11:51.437497 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 181895us
I20260709 13:11:51.296466 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:51.438253 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:51.434674 21389 rpcz_store.cc:276] 0709 13:11:50.301031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.563604 (+262573us) service_pool.cc:224] Handling call
0709 13:11:51.403420 (+839816us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002e31d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:51.407271 (+  3851us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545440640}
I20260709 13:11:51.440050 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:51.444862 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:51.430696 21391 rpcz_store.cc:276] 0709 13:11:49.942539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.953998 (+1011459us) service_pool.cc:224] Handling call
0709 13:11:51.004603 (+ 50605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.023627 (+ 19024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.300676 (+277049us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b54002ccc50. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:51.300812 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115583872}
I20260709 13:11:51.448873 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:51.435164 21394 rpcz_store.cc:276] 0709 13:11:50.189368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.188541 (+999173us) service_pool.cc:224] Handling call
0709 13:11:51.216796 (+ 28255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.434468 (+217672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.434669 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.432933 21467 rpcz_store.cc:276] 0709 13:11:49.928234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.080376 (+152142us) service_pool.cc:224] Handling call
0709 13:11:50.108073 (+ 27697us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:50.108507 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:50.371383 (+262876us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.600451 (+229068us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:50.654135 (+ 53684us) log.cc:844] Serialized 52 byte log entry
0709 13:11:50.654356 (+   221us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:50.654719 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.675489 (+ 20770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.675592 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:51.258425 (+582833us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b180048dba0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:11:51.303235 (+ 44810us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b180048dba0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1
0709 13:11:51.304572 (+  1337us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b180048dba0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:11:51.305494 (+   922us) raft_consensus.cc:1685] finished
0709 13:11:51.305514 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.305655 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46849,"prepare.queue_time_us":334990,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":8715,"raft.queue_time_us":22558,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":46464,"spinlock_wait_cycles":74609152,"thread_start_us":386827,"threads_started":2,"wal-append.queue_time_us":276574}
I20260709 13:11:51.301331 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.440711 21362 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:51.481742 22035 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:11:51.484381 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 231333us
W20260709 13:11:51.485764 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 226653us
I20260709 13:11:51.487159 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:51.489362 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.489683 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:51.464785 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:51.467669 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:51.374464 25774 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.004s
I20260709 13:11:51.255930 25963 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:51.500906 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:51.291059 25949 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:51.514456 21313 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:51.515594 21320 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:51.504295 21389 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:51.527802 21315 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
W20260709 13:11:51.534740 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 47680.9us
I20260709 13:11:51.535755 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:51.463267 25945 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:51.490106 25747 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:51.553038 21393 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:11:51.485606 25947 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:51.488936 25876 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:51.558753 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 118186us
I20260709 13:11:51.305373 25521 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:51.564759 22035 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:51.508836 25775 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.504011 25963 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.302693 25822 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.489147 25834 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:11:51.501111 25950 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.568289 22041 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.304949 25965 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.256s
I20260709 13:11:51.482949 25447 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:11:51.504866 25955 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:51.519234 25949 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:11:51.581879 25969 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:11:51.582546 25961 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
W20260709 13:11:51.570937 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 126093us
I20260709 13:11:51.528852 25948 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:51.567657 25954 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:51.301028 25853 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.557018 25952 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.557441 25852 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.533542 25760 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:51.559860 25879 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:51.590585 25890 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.003s
I20260709 13:11:51.592113 25962 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.593022 25955 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:51.592629 25947 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:51.519286 25774 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.501075 25964 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:11:51.594022 25983 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:51.620417 22038 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:11:51.620857 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 324517us
I20260709 13:11:51.480851 25940 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:51.623261 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.596616 25747 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:51.638223 25962 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.625993 25954 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:51.619014 25760 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.573514 25775 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.570600 25533 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:11:51.644402 25973 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:51.572333 25963 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:51.630072 25765 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:11:51.701457 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 138190us
W20260709 13:11:51.738590 25839 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.950s	user 0.010s	sys 0.005s
W20260709 13:11:51.754632 25591 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.015s	user 0.013s	sys 0.000s
W20260709 13:11:51.744974 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.726987 25612 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.986s	user 0.016s	sys 0.000s
W20260709 13:11:51.748968 22032 consensus_meta.cc:287] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.006s
I20260709 13:11:51.760562 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:51.771636 22032 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:51.746455 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:51.752012 21359 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:51.753134 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 494838us
I20260709 13:11:51.628566 25890 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.698448 25876 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:51.751179 25760 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:51.782893 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:51.794225 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.794307 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53539.3us
I20260709 13:11:51.795658 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:51.755271 25965 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:11:51.797607 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:51.779378 25899 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:51.784422 25954 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.697893 25949 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.763273 25447 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:11:51.834877 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:51.834465 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:51.853645 21470 raft_consensus.cc:2368] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:51.837705 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:51.781992 25765 raft_consensus.cc:2764] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:11:51.844410 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2263) took 2019 ms. Trace:
I20260709 13:11:51.855706 21395 rpcz_store.cc:276] 0709 13:11:49.825389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.936643 (+111254us) service_pool.cc:224] Handling call
0709 13:11:49.973815 (+ 37172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.902202 (+928387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.844069 (+941867us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54000abed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:51.844305 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133297920}
I20260709 13:11:51.858477 22032 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:51.804553 22031 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 13:11:51.834676 25972 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.144s	user 0.004s	sys 0.000s
W20260709 13:11:51.862260 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 89802.8us
I20260709 13:11:51.863269 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:51.779255 25945 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 13:11:51.837313 25970 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 13:11:51.835040 25978 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:11:51.838245 25981 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:11:51.778679 25591 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.750171 25983 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.773080 25839 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:51.864174 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 68612us
I20260709 13:11:51.837800 25985 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:51.837528 25687 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:51.836017 25775 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:51.804189 25899 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:51.843655 25950 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:51.891861 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:51.893855 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:51.894349 22032 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.879752 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:51.883893 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:51.780278 25612 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.867908 25952 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:51.869833 25521 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:51.877979 25974 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:51.895665 21466 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:51.896353 21390 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:51.804814 25638 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:51.919448 25941 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.002s
I20260709 13:11:51.845371 25747 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:51.921054 25839 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:51.878444 25988 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:51.930509 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 46713us
I20260709 13:11:51.881436 25822 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:51.927531 22035 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:51.926352 25899 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.980089 22032 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
W20260709 13:11:51.930058 25977 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:11:51.930281 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 50635us
I20260709 13:11:51.982504 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:51.931092 25976 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:11:51.931026 25990 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:51.931720 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2268) took 1991 ms. Trace:
I20260709 13:11:51.932338 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1061) took 1082 ms. Trace:
I20260709 13:11:51.924110 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:51.792209 25975 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:11:51.930337 25995 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:51.984815 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 100781us
I20260709 13:11:51.911551 25985 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:51.930083 25942 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.013s
I20260709 13:11:51.790663 25955 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.991302 22036 rpcz_store.cc:276] 0709 13:11:50.849785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.849933 (+   148us) service_pool.cc:224] Handling call
0709 13:11:50.850347 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.088698 (+238351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.088753 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.094027 (+  5274us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.195626 (+101599us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:51.195682 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.559594 (+363912us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540057dd54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:51.559641 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:51.921672 (+362031us) raft_consensus.cc:1685] finished
0709 13:11:51.921701 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.932233 (+ 10532us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69258,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6363,"spinlock_wait_cycles":292758912,"thread_start_us":153061,"threads_started":2,"wal-append.queue_time_us":375986}
I20260709 13:11:51.997195 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:51.990111 21392 rpcz_store.cc:276] 0709 13:11:49.940237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.890226 (+949989us) service_pool.cc:224] Handling call
0709 13:11:50.905287 (+ 15061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.060412 (+155125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.060464 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.091389 (+ 30925us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.251221 (+159832us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:51.251256 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.251318 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:51.836773 (+585455us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:51.921910 (+ 85137us) raft_consensus.cc:1685] finished
0709 13:11:51.921932 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.931604 (+  9672us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41894,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9752,"spinlock_wait_cycles":12021120,"thread_start_us":233443,"threads_started":2,"wal-append.queue_time_us":424100}
I20260709 13:11:52.003145 21359 leader_election.cc:400] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9.
I20260709 13:11:52.008569 21359 leader_election.cc:403] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:52.011831 25985 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.017161 25890 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.018011 25890 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:51.916594 25950 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.022519 25591 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:51.934592 25843 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:51.984500 25988 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.004659 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:51.986038 25774 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:52.050637 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.051524 21393 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:52.054673 21391 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:11:52.056068 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.056835 25760 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.057315 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.057920 21391 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:11:52.058799 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.059031 25760 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.059376 21394 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:52.060108 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1772) took 1540 ms. Trace:
I20260709 13:11:52.060483 21390 rpcz_store.cc:276] 0709 13:11:50.519440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.691159 (+171719us) service_pool.cc:224] Handling call
0709 13:11:52.059841 (+1368682us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002e2cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:52.060000 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2768107904}
W20260709 13:11:52.062681 25997 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:52.063902 25623 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:52.067085 21394 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:52.067301 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2516) took 1330 ms. Trace:
I20260709 13:11:52.067715 21316 rpcz_store.cc:276] 0709 13:11:50.737383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.737576 (+   193us) service_pool.cc:224] Handling call
0709 13:11:50.737981 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:50.944939 (+206958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.944973 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.960486 (+ 15513us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.225261 (+264775us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:51.225308 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.225386 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.067087 (+841701us) raft_consensus.cc:1685] finished
0709 13:11:52.067105 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.067244 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":181126,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":23254,"thread_start_us":355237,"threads_started":2,"wal-append.queue_time_us":612918}
I20260709 13:11:52.068961 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.005795 25839 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:52.019842 25940 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.088810 21392 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:52.080699 21387 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:52.032536 25899 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:52.005720 25822 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:52.117398 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.118547 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.039050 25723 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9.
W20260709 13:11:52.116801 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 192818us
I20260709 13:11:51.932668 25941 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:51.895743 25876 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.124118 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.126063 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.055892 25688 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:52.079576 25977 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:11:52.115150 25843 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:52.141240 21469 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:52.141737 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.142690 25612 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:52.149083 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 151912us
I20260709 13:11:52.149971 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.173430 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:52.129665 25940 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:11:52.128176 25822 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.174124 21470 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:52.186899 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.190454 21393 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:52.188585 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.194288 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.194851 21391 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:52.194348 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.195874 21390 raft_consensus.cc:2376] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12. Re-sending same reply.
I20260709 13:11:52.196610 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:52.195951 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46053.5us
I20260709 13:11:52.200958 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.203436 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.204300 21390 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:52.204109 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.205348 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.206007 21393 raft_consensus.cc:2376] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12. Re-sending same reply.
W20260709 13:11:52.206709 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 65094.3us
I20260709 13:11:52.206986 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.207587 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.207707 21393 raft_consensus.cc:2376] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12. Re-sending same reply.
I20260709 13:11:52.205402 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.209414 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.206348 25530 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:52.210019 21394 raft_consensus.cc:2376] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14. Re-sending same reply.
I20260709 13:11:52.210332 25530 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.213322 25530 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:52.176894 25612 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:52.214736 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:52.215975 25822 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.216180 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.209628 21389 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:52.205725 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.217476 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.217931 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.218205 21395 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:52.219475 22002 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.219615 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.220474 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:52.222219 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.227751 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.153442 25843 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.230059 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.223181 25612 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:52.246815 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.249017 21394 raft_consensus.cc:2376] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14. Re-sending same reply.
W20260709 13:11:52.256867 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.223408 25834 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:52.259613 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.276319 25834 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:52.276572 21389 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:52.277582 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.277292 25834 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.278602 25834 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:52.279110 21389 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:52.222980 25774 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:52.257066 21284 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:52.280400 25774 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:52.272917 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.281363 21394 raft_consensus.cc:2376] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12. Re-sending same reply.
W20260709 13:11:52.281445 26002 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:11:52.282114 25530 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:52.282642 25530 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:52.284017 25998 raft_consensus.cc:2764] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:52.283658 25530 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.285702 25983 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.221645 26004 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:52.286793 26004 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:52.287732 26004 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.281499 25774 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.280308 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:52.301358 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.246507 25822 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:52.348912 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1241) took 1366 ms. Trace:
I20260709 13:11:52.297297 25760 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:52.361784 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 101798us
I20260709 13:11:52.356859 22034 rpcz_store.cc:276] 0709 13:11:50.982719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.034722 (+ 52003us) service_pool.cc:224] Handling call
0709 13:11:51.068758 (+ 34036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.104912 (+ 36154us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:51.196049 (+ 91137us) log.cc:844] Serialized 14 byte log entry
0709 13:11:51.249561 (+ 53512us) log.cc:844] Serialized 14 byte log entry
0709 13:11:51.250386 (+   825us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.267230 (+ 16844us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.267420 (+   190us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:51.267467 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.840194 (+572727us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b54004696d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:51.840261 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.305507 (+465246us) raft_consensus.cc:1685] finished
0709 13:11:52.348641 (+ 43134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.348838 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86638,"prepare.queue_time_us":136391,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":63,"raft.queue_time_us":66231,"raft.run_cpu_time_us":583,"raft.run_wall_time_us":69266,"spinlock_wait_cycles":265336448,"thread_start_us":127526,"threads_started":2,"wal-append.queue_time_us":544107}
I20260709 13:11:52.245913 25950 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.369158 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:52.382071 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:52.376205 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 183853us
I20260709 13:11:52.384464 22039 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 10: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:52.381659 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.390858 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2274) took 2448 ms. Trace:
I20260709 13:11:52.391433 21387 rpcz_store.cc:276] 0709 13:11:49.941953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.943199 (+1001246us) service_pool.cc:224] Handling call
0709 13:11:52.070677 (+1127478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.121661 (+ 50984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.390586 (+268925us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002e2cd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:52.390777 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538716032}
I20260709 13:11:52.381999 25940 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:52.379237 25822 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:52.407593 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.381184 25638 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:11:52.412736 25638 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:52.388810 25760 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:52.413522 25953 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.414100 25953 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.414151 25760 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.416277 25530 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.413160 25638 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:52.386823 25945 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:52.380527 25591 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:11:52.382055 25747 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:52.382345 25965 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:11:52.425873 22042 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:52.385928 25521 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:11:52.399008 25998 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:52.432092 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.429709 25638 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.421723 25974 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:52.480839 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 99277.1us
I20260709 13:11:52.424329 25941 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:52.486536 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2274) took 1606 ms. Trace:
I20260709 13:11:52.430578 25853 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:52.487186 21466 rpcz_store.cc:276] 0709 13:11:50.880281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.888453 (+  8172us) service_pool.cc:224] Handling call
0709 13:11:52.458074 (+1569621us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400249ad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:52.486483 (+ 28409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273337600}
I20260709 13:11:52.420542 25530 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.510017 21468 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:52.510663 21468 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:52.488556 26008 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.229s	user 0.003s	sys 0.000s
W20260709 13:11:52.515961 26005 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.156s	user 0.003s	sys 0.000s
I20260709 13:11:52.461054 25822 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.518092 25953 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:52.520005 26015 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:11:52.524354 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2525) took 1045 ms. Trace:
W20260709 13:11:52.525297 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 93346.1us
I20260709 13:11:52.526443 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.486568 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:52.495338 25853 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.495988 25687 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:52.524751 21320 rpcz_store.cc:276] 0709 13:11:51.479410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.479613 (+   203us) service_pool.cc:224] Handling call
0709 13:11:51.515323 (+ 35710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.516177 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.524151 (+1007974us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b54004155d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:52.524295 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27371776}
I20260709 13:11:52.483582 25948 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:52.532723 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46222.5us
I20260709 13:11:52.511612 21468 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.539616 21468 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:52.535260 25853 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:52.557468 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1243) took 1524 ms. Trace:
I20260709 13:11:52.539716 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.538118 25687 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:52.548492 26003 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.508s	user 0.005s	sys 0.006s
I20260709 13:11:52.550750 25843 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:52.488700 25998 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:52.567749 26013 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:11:52.568920 26011 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:52.569657 25998 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:52.541008 25953 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:52.536697 25591 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:52.560519 22031 rpcz_store.cc:276] 0709 13:11:51.033179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.045148 (+ 11969us) service_pool.cc:224] Handling call
0709 13:11:51.045619 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.861041 (+815422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.557216 (+696175us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b540069c3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:52.557409 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733932800}
W20260709 13:11:52.555313 25963 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.773s	user 0.009s	sys 0.000s
W20260709 13:11:52.558014 22038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1235) took 1584 ms (client timeout 1745 ms). Trace:
I20260709 13:11:52.580587 25521 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:52.589080 25623 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:52.595376 25947 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:52.598691 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.614821 21320 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:52.612597 25623 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.607470 25703 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:52.619329 25703 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.621025 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:52.578608 25591 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.603248 21315 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:52.629643 25703 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:52.629813 25623 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:52.630276 21319 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:52.630771 25591 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.630895 25949 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:52.627591 25795 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:52.633383 25795 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:52.634219 25795 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.635476 25795 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:52.607568 25954 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.612877 25688 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.636394 25954 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.636754 25688 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.637904 25962 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:52.638756 25954 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.638885 25688 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:52.603160 22038 rpcz_store.cc:269] 0709 13:11:50.973809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.974003 (+   194us) service_pool.cc:224] Handling call
0709 13:11:52.557848 (+1583845us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:52.557963 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363503488}
I20260709 13:11:52.640223 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:52.641597 25530 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:52.642443 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:52.644073 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2523) took 1396 ms. Trace:
I20260709 13:11:52.611580 25963 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.644462 21312 rpcz_store.cc:276] 0709 13:11:51.247499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.248330 (+   831us) service_pool.cc:224] Handling call
0709 13:11:51.308143 (+ 59813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.434230 (+126087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.643847 (+1209617us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5400229550. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:52.643993 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64812288}
I20260709 13:11:52.646715 25963 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:52.614509 25947 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:52.648227 25947 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.649222 25947 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:52.608906 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.622006 21461 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:11:52.659324 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 132992us
I20260709 13:11:52.660580 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:52.663869 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 246052us
I20260709 13:11:52.667129 21465 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:52.669531 25530 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:52.670908 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.681828 22031 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:52.684579 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:52.684928 22042 raft_consensus.cc:3055] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:52.685113 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:52.685377 22042 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:52.686136 22042 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.687124 22042 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:52.695829 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 87411.2us
W20260709 13:11:52.703096 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 94258.5us
I20260709 13:11:52.704421 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.709131 22042 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:52.710217 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:52.714366 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 52965.7us
I20260709 13:11:52.670058 25530 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:52.716084 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.718711 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.676888 25703 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:52.719337 21393 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:52.720283 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.722795 21390 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:52.705433 25984 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:52.725714 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:52.726369 21395 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:52.699296 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:52.700892 26004 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:52.728380 26004 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.716019 25955 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:52.730088 25955 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:52.730449 25955 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:52.730484 26004 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.700167 25795 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:52.732522 25591 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.732738 26023 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:11:52.716459 25843 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:11:52.714689 26024 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:52.705710 25998 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:52.736292 25998 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.737303 25521 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:52.721038 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:52.715888 25687 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.724756 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.734663 25591 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:52.742308 21466 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:52.747385 21393 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:52.726579 25703 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.750130 25703 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:52.756770 25979 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 1.010s	user 0.013s	sys 0.000s
I20260709 13:11:52.758543 25952 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:52.758991 25952 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:52.759873 25952 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.761010 25952 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.718355 25530 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:52.769055 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.776912 25688 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:52.779592 26027 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:52.780195 26027 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:52.780581 26027 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:52.781631 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.782398 21395 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:52.767887 25984 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:52.788625 25853 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.790828 25853 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.768324 25687 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:11:52.798540 25688 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:52.798991 25688 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:52.799790 25688 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.800420 25530 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:52.802275 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59344.3us
W20260709 13:11:52.806413 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.809129 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.810182 25989 raft_consensus.cc:2764] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:52.810995 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.805915 25988 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.807476 25949 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:52.813789 25774 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:52.814251 25774 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:52.814340 25530 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:52.818449 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.818787 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.828634 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:52.829526 21395 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:52.832546 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58339.9us
I20260709 13:11:52.840602 26023 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:52.840893 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:52.842211 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:52.842507 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:52.844358 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:52.845057 22036 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:52.845865 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:52.846443 22031 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:52.847667 25986 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:52.848093 25986 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:52.848920 25986 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.849424 25998 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:52.850138 25986 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:52.850230 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.850889 21312 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:52.851161 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.851747 21315 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:52.851938 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:52.852403 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:52.841123 26023 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:52.853009 21319 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:52.853922 26023 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.854724 21317 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:11:52.855604 26023 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:52.859648 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:52.860294 21314 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:52.815279 25774 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:52.868322 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 84687.9us
I20260709 13:11:52.886101 21395 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:52.888098 22031 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
W20260709 13:11:52.868532 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.869670 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.879926 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.869680 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:52.891275 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:52.870263 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.871060 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:52.873982 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:52.893194 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:52.893716 22035 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:52.874575 21316 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:52.894837 22041 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:52.874636 25687 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:52.875121 21314 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:11:52.877014 25962 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:52.878681 25852 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:52.880194 25990 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:52.880514 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 69927.2us
I20260709 13:11:52.912642 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:52.913578 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.882364 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.892547 21313 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:11:52.895364 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.896246 21319 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:52.898973 21315 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:52.900116 21360 leader_election.cc:400] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:52.915570 21360 leader_election.cc:403] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:11:52.916694 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.906307 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:52.908272 22031 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:52.867398 25989 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:52.867362 25949 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:52.921463 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.929073 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.935109 21315 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:11:52.931242 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.940359 21313 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:52.930330 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.935118 21319 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:52.941488 21312 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:52.933291 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:52.942880 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.943215 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:52.948850 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:52.945114 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:52.949815 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.951625 21313 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:52.947777 22041 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:52.950695 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:52.956359 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.884626 25623 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:11:52.962409 25949 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:52.966331 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.989773 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:52.945091 25952 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:52.945966 25953 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:52.931758 25950 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:52.959420 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:52.920369 25984 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.946058 25948 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:52.948251 25853 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:52.946947 22002 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.008s (SENT)
I20260709 13:11:52.953814 25843 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:52.946298 25973 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:53.007467 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48137us
W20260709 13:11:53.006812 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 124552us
I20260709 13:11:53.030249 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:53.010160 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:53.001343 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44195.1us
I20260709 13:11:52.979111 25883 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:53.031371 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:53.009562 25984 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:52.951049 25521 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:11:53.003018 25822 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:53.029495 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:53.039726 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:11:53.040104 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 93203.7us
W20260709 13:11:53.040804 22002 leader_election.cc:336] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.071s (SENT)
I20260709 13:11:53.041337 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:53.010200 25998 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:53.012426 25856 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:52.963527 25963 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:11:53.011965 25530 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:53.034353 25975 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:53.031275 25973 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.069747 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:53.073117 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:53.010993 25955 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.064380 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:53.065028 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:53.085719 22041 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:52.920902 25990 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.035154 25822 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:53.043836 25723 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:53.039810 25966 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:53.034158 25883 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:53.071664 25795 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:53.075107 25623 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:53.106745 25623 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:53.107283 25623 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:53.108072 25795 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:53.108678 25795 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:53.091737 25952 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:11:53.104112 25883 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:53.074762 25948 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:11:53.062983 25856 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.119542 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 734) took 3072 ms. Trace:
I20260709 13:11:53.120239 21388 rpcz_store.cc:276] 0709 13:11:50.046827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.086017 (+1039190us) service_pool.cc:224] Handling call
0709 13:11:51.403619 (+317602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.429837 (+ 26218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.119256 (+1689419us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54002e31d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:53.119456 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729436544}
W20260709 13:11:53.068120 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.087602 22040 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:53.061491 25988 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:53.069180 25941 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:53.073663 25975 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:53.076076 25973 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:53.074744 25998 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:53.105918 21318 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:53.082310 25687 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:53.089879 25533 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:53.096549 25822 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:53.072880 25530 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.098991 25843 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:53.132844 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.099035 25852 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:53.126514 25856 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.160502 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:53.165676 21388 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:53.132525 25941 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.134325 25975 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:53.167420 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 78336us
W20260709 13:11:53.165732 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 209441us
I20260709 13:11:53.175136 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:53.238512 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:53.238579 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 64093.5us
I20260709 13:11:53.237404 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:53.242838 26038 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:11:53.175297 25843 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:53.244165 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 71513.8us
W20260709 13:11:53.188171 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.245787 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:53.250013 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:53.154886 25533 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:53.170141 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 69092.8us
I20260709 13:11:53.171485 25941 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:53.258296 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:53.263844 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:53.256124 25985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.240s	user 0.025s	sys 0.038s
I20260709 13:11:53.168423 25952 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.257997 25533 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:53.245023 25843 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.292658 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:53.295526 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:53.279893 25985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.025s	sys 0.039s
I20260709 13:11:53.285859 25952 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.346524 21394 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:11:53.305162 26027 consensus_meta.cc:287] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.003s
I20260709 13:11:53.350214 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:53.351138 21388 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:11:53.351557 21388 pending_rounds.cc:85] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 5
I20260709 13:11:53.351794 21388 pending_rounds.cc:107] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:11:53.352072 21388 raft_consensus.cc:2889] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:53.353992 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:53.357372 21314 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:53.305670 26047 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:53.333912 26029 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:11:53.327062 25966 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:53.363746 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.368242 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.374159 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:53.348896 25955 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.383149 25995 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:53.325626 25883 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.288668 25998 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.382634 25948 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:53.383936 22041 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:53.369331 25990 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:53.373497 26047 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:53.384856 25966 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:11:53.394076 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.386958 25995 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.401669 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:53.392457 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:53.481814 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 89440.6us
W20260709 13:11:53.481899 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 80371.3us
I20260709 13:11:53.483366 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:53.483430 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:53.484634 25955 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:53.484823 26043 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:53.488292 26020 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:53.354008 26027 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.478580 25995 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.479423 25530 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:53.480170 26044 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:53.501825 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:53.506438 21396 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:53.508646 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:53.496611 25870 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:53.511616 26040 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:53.509205 25530 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:53.615497 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 113749us
I20260709 13:11:53.617192 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:53.499800 25795 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:53.620903 26039 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:11:53.623348 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 140075us
I20260709 13:11:53.609256 26050 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:53.639605 26050 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:53.608606 25530 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:53.633221 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:53.532052 26053 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:11:53.642984 26050 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:53.637132 25948 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:53.653410 25795 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:53.637459 25952 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.540683 25870 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.669778 25870 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.658103 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:53.678700 25883 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.649415 26020 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:53.682068 26020 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.684813 26027 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.686903 26023 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:53.687357 26023 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:53.687505 25975 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.688283 25948 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:53.688784 21312 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:53.689363 25948 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.690551 26023 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.698945 26023 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:53.683444 25533 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.706640 25533 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:53.649392 26047 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.710457 25915 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:53.715984 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 658) took 2429 ms. Trace:
W20260709 13:11:53.717190 26035 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.748s	user 0.000s	sys 0.013s
I20260709 13:11:53.717474 26043 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:53.651867 25843 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:53.718510 21313 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:11:53.756950 21313 pending_rounds.cc:85] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 6
W20260709 13:11:53.723639 25612 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:11:53.726848 25984 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:53.726009 25530 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:53.754439 25973 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
W20260709 13:11:53.742163 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 109019us
I20260709 13:11:53.743537 25994 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.744287 25688 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:53.748175 25822 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.001s
I20260709 13:11:53.749661 25975 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.751881 21469 rpcz_store.cc:276] 0709 13:11:51.374923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.375104 (+   181us) service_pool.cc:224] Handling call
0709 13:11:51.440086 (+ 64982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.144228 (+704142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.715569 (+1571341us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540025a154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:53.715891 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611998720}
W20260709 13:11:53.751302 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 835339us
I20260709 13:11:53.757225 21313 pending_rounds.cc:107] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:11:53.744683 25995 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.738829 25955 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:53.766283 25856 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:11:53.766283 25954 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.766803 25533 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.767663 21390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:53.811977 21390 raft_consensus.cc:606] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:53.772099 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.799832 21314 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
W20260709 13:11:53.761579 25989 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.006s
I20260709 13:11:53.803238 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:53.802673 21313 raft_consensus.cc:2889] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:53.809752 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2304) took 1036 ms. Trace:
I20260709 13:11:53.804010 25822 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:53.765625 25623 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.002s
I20260709 13:11:53.757181 25945 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:11:53.711102 26050 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:53.841348 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.843710 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2297) took 1118 ms. Trace:
W20260709 13:11:53.847251 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.814019 21389 rpcz_store.cc:276] 0709 13:11:52.772902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.802546 (+ 29644us) service_pool.cc:224] Handling call
0709 13:11:52.802903 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.803227 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.803250 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.803780 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.890325 (+ 86545us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:52.890364 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.890429 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.716585 (+826156us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:53.809305 (+ 92720us) raft_consensus.cc:1685] finished
0709 13:11:53.809338 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.809657 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1558,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":43664256,"thread_start_us":86195,"threads_started":1,"wal-append.queue_time_us":164549}
I20260709 13:11:53.857398 25591 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:53.858596 25591 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:53.859100 25591 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.841014 25954 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.863168 25954 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.849301 25530 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:53.865592 25795 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:53.867424 25795 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:53.819841 25533 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.796361 25973 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.870537 25533 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.870770 25973 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:53.844271 21387 rpcz_store.cc:276] 0709 13:11:52.725344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.725465 (+   121us) service_pool.cc:224] Handling call
0709 13:11:52.778545 (+ 53080us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.883141 (+104596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.883194 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.883781 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.271307 (+387526us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:53.286452 (+ 15145us) log.cc:844] Serialized 14 byte log entry
0709 13:11:53.286891 (+   439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.818779 (+531888us) spinlock_profiling.cc:243] Waited 93.3 ms on lock 0x7b54000acdd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:53.818848 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.818895 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:53.843475 (+ 24580us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.843634 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14537,"prepare.queue_time_us":16612,"prepare.run_cpu_time_us":277,"prepare.run_wall_time_us":277,"raft.queue_time_us":12517,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":14063,"spinlock_wait_cycles":214508800,"thread_start_us":387077,"threads_started":1,"wal-append.queue_time_us":427880}
I20260709 13:11:53.867820 25795 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:53.760895 25843 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.886107 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:53.886996 21316 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:53.848327 25989 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:53.760138 25941 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:53.892856 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 89708.1us
I20260709 13:11:53.894851 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:53.815862 25856 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.840139 25623 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.802670 25994 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:53.899667 22002 leader_election.cc:336] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.748s (SENT)
I20260709 13:11:53.899148 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:53.918854 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:53.905119 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97443.3us
I20260709 13:11:53.895584 26053 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.898458 25765 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:53.909705 25521 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:53.922865 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:53.927167 21387 raft_consensus.cc:606] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:53.925189 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:53.926460 21316 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:53.928812 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:53.920783 25964 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:53.939317 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:53.953524 21469 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:53.940536 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:53.941584 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:53.942612 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:53.954622 21468 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.943660 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:53.944408 25591 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:53.944766 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:53.963976 21462 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:53.964751 25915 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:53.965207 25915 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:11:53.965672 26057 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.310s	user 0.000s	sys 0.002s
I20260709 13:11:53.966004 25915 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.967046 25915 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:53.947359 25822 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.947651 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:53.969096 21463 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:53.925942 25983 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:53.948720 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:53.969828 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:53.970507 21470 raft_consensus.cc:2410] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:11:53.949528 25994 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.950016 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:53.959461 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:53.972637 21466 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:11:53.959935 25988 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:53.960819 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:53.961287 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.961741 25856 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.930426 25795 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:53.934434 25747 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:53.946681 21467 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:53.970467 21387 raft_consensus.cc:606] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:53.957832 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:53.993552 21387 raft_consensus.cc:614] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:53.975389 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 50279.7us
I20260709 13:11:53.994460 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:53.978169 21468 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:53.981742 25623 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:53.983537 25988 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:53.972241 25964 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.995085 21469 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:11:53.953208 25948 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:53.928465 26053 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:53.960860 25995 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:53.995579 26040 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:53.995674 25988 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:53.996987 25983 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.997989 25795 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:54.010957 25989 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:54.016654 25965 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.999473 25747 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:54.025650 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.029644 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:54.029976 21468 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:54.030246 21387 raft_consensus.cc:606] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:54.030572 21387 raft_consensus.cc:614] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:53.999639 25964 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.033134 26053 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.022539 25983 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:54.040829 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.027530 26050 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:54.052346 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.054090 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.054533 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.059525 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.050386 25948 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:54.062201 26023 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:54.062917 25941 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.065630 25774 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:54.068637 26056 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.425s	user 0.003s	sys 0.000s
I20260709 13:11:54.031188 25965 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:54.069859 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.072525 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:54.075140 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49612.6us
I20260709 13:11:54.077376 21318 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:54.077857 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.075325 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:11:54.078649 21387 raft_consensus.cc:606] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:54.078910 21387 raft_consensus.cc:614] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:54.052318 25989 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:54.023000 25988 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.074294 26023 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:54.086205 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:54.086419 25988 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:54.087574 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:54.088295 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:54.089505 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:54.097294 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:54.102936 25983 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:54.106488 21388 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:54.106407 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:54.107626 25995 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.108244 25995 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.108927 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:54.109143 25638 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:54.109403 25994 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:54.110363 25995 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.110860 25995 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.111153 25994 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:54.111295 25995 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.109731 21389 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:54.116683 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2300) took 1345 ms. Trace:
I20260709 13:11:54.117100 21396 rpcz_store.cc:276] 0709 13:11:52.771452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.771556 (+   104us) service_pool.cc:224] Handling call
0709 13:11:52.781290 (+  9734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.507143 (+725853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.116458 (+609315us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54000ad2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:54.116621 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667104128}
I20260709 13:11:54.118829 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:54.121542 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43771.9us
I20260709 13:11:54.125149 21387 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:54.126372 21464 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:54.084399 25530 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.128310 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.129829 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:54.118031 26040 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.133991 21464 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:11:54.118870 25983 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:11:54.135706 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.132128 25955 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:54.136514 26043 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:54.140364 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:54.076495 25747 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:54.141777 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.877s (SENT) [suppressed 39 similar messages]
I20260709 13:11:54.144398 21467 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:54.147866 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.149164 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.150003 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.150195 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.151199 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.153569 21318 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:54.152019 21314 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:54.155428 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:54.188551 21467 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:54.159312 25995 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.159746 25983 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:54.160398 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:54.140133 26040 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.160809 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:54.162040 25989 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.162580 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:54.196517 22031 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:54.163501 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.196733 21319 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:11:54.164053 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.198508 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:54.198766 26040 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.164373 25915 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.164906 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.165033 26023 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.166458 25964 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.166720 25843 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:54.168285 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2543) took 1261 ms. Trace:
I20260709 13:11:54.168586 25965 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.170949 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:54.179634 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:54.179664 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.179368 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:54.177536 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:54.182610 25856 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:54.183285 22040 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:54.185503 25994 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.191196 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.183938 25521 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.199986 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:54.216466 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45599.7us
I20260709 13:11:54.204583 21315 rpcz_store.cc:276] 0709 13:11:52.906435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.956992 (+ 50557us) service_pool.cc:224] Handling call
0709 13:11:53.006964 (+ 49972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.031058 (+ 24094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.031105 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:53.031175 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:53.031221 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.168062 (+1136841us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b540032b4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:54.168120 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.168232 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54805248}
I20260709 13:11:54.205297 21470 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:54.207922 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.212335 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.212790 22042 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
W20260709 13:11:54.224622 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.225157 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.221241 21362 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:54.201985 25852 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:54.200552 25962 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.232121 25533 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:54.245795 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:54.203593 26023 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:54.208259 26040 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:54.265153 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44052.7us
I20260709 13:11:54.282012 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:54.285851 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 78034.1us
I20260709 13:11:54.238294 25530 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:54.239265 25723 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:54.200407 25915 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.232013 25521 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.231557 25994 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.268203 25533 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.280264 25839 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:54.262188 25941 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:11:54.289201 26061 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:54.304149 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.310252 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:54.290149 25987 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.309417 25533 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:54.313171 25723 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.304803 25852 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:54.321547 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.280954 25962 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.316387 26061 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:54.315654 25998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.009s	sys 0.021s
W20260709 13:11:54.325050 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 183289us
W20260709 13:11:54.330534 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.331511 22002 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.567s (SENT)
I20260709 13:11:54.333114 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:54.320782 25530 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:54.322965 25839 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.322885 25852 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.324213 25623 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.345088 22031 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:54.326507 25688 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.329833 25998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.010s	sys 0.022s
I20260709 13:11:54.350342 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.365425 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.365681 22041 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:54.335107 25983 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.330210 26061 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:54.328727 26040 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:54.370087 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51578.7us
I20260709 13:11:54.371302 21466 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:11:54.340790 25530 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:54.358383 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.343555 25986 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:54.360436 25954 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.328449 25856 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.372189 21461 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:54.322693 25987 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.323869 25723 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.375646 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:54.379081 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 97166.4us
I20260709 13:11:54.351967 25852 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:54.380628 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.381810 21388 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:11:54.364619 26054 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.739s	user 0.003s	sys 0.000s
I20260709 13:11:54.338102 25964 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:11:54.365095 25973 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.378770 25530 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:54.380100 25822 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:54.352226 25839 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.367194 25623 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.561707 25623 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:54.563115 26083 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.141s	user 0.000s	sys 0.004s
I20260709 13:11:54.399876 22039 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
W20260709 13:11:54.454320 26078 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:11:54.565275 25988 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:54.565747 25990 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.566458 25990 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.456645 25964 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.565742 25988 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:54.568377 25964 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.569445 25988 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.570818 25964 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.571376 25988 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:54.572606 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:54.552304 26079 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.183s	user 0.003s	sys 0.002s
I20260709 13:11:54.383266 25954 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:54.551025 26074 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.270s	user 0.005s	sys 0.000s
I20260709 13:11:54.421674 25986 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:11:54.397378 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 61435.7us
I20260709 13:11:54.577105 25521 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:54.417392 21387 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:54.577126 25954 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.398801 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:54.548097 26089 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:54.578847 26089 consensus_queue.cc:1243] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:54.548906 26040 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.549804 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2532) took 1699 ms. Trace:
I20260709 13:11:54.580458 21467 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:54.579564 21320 rpcz_store.cc:276] 0709 13:11:52.850517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.851631 (+  1114us) service_pool.cc:224] Handling call
0709 13:11:53.321320 (+469689us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800181298. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:11:53.321550 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:53.322003 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.322036 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:53.322504 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.474804 (+152300us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:53.474879 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.474945 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:54.321585 (+846640us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:54.549533 (+227948us) raft_consensus.cc:1685] finished
0709 13:11:54.549563 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.549733 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2286,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":161286912,"thread_start_us":79057,"threads_started":1,"wal-append.queue_time_us":201625}
I20260709 13:11:54.550057 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:54.581709 21389 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.552199 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:54.584223 26027 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:54.588256 26027 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:54.589496 26027 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.590973 26027 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:54.552199 26081 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.095s	user 0.002s	sys 0.002s
I20260709 13:11:54.553254 25987 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.554095 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:54.554538 25962 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.555593 25994 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:54.555713 21388 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:54.559015 25915 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:54.456094 26076 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:11:54.597229 25990 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.371752 25688 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.552270 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:54.586267 26040 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:54.601714 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.610596 26097 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.377853 25983 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:54.618848 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.619496 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.626888 22039 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:54.628229 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.629267 22031 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:54.419298 25998 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.395605 25856 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.634254 21394 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
W20260709 13:11:54.632397 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 261532us
W20260709 13:11:54.634712 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 235964us
I20260709 13:11:54.420972 25723 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.637444 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.638105 22042 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:54.636725 22039 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:54.640347 21388 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:11:54.642024 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.642277 22035 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:11:54.643391 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:54.644084 21393 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
W20260709 13:11:54.632970 26073 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.319s	user 0.002s	sys 0.002s
I20260709 13:11:54.648283 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:54.649940 21388 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:54.653476 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:54.423237 25973 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.657047 21387 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:54.640583 26061 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.654294 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:54.657385 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:54.666260 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:54.634189 26097 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.658447 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:54.668305 26097 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.668789 26027 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:54.669464 26027 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:54.658212 25983 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:54.656502 26095 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.670873 26095 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.659830 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:54.672883 25998 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:54.658849 26040 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.673446 25998 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.676848 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.627621 25822 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.673835 25915 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:54.678381 25915 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:54.678252 25822 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.679280 25915 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.637490 25995 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:54.681039 25591 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:54.682818 25591 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.682701 25942 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:54.683732 26060 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:54.684281 26060 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:54.637112 25986 consensus_queue.cc:1243] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:54.666289 26061 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.689446 25688 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.692051 25688 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.692574 25688 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.692919 25998 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:54.692919 25856 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.686811 26060 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:54.694226 26060 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.694629 25688 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.692078 25852 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.697412 25852 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:54.697839 25948 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.623s	user 0.006s	sys 0.007s
I20260709 13:11:54.698280 25948 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:54.698887 25822 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.699097 26050 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:54.700577 26095 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:54.704595 25839 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:54.687330 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.705047 22039 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:54.697604 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.709098 21389 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:54.717427 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.717592 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.718489 21313 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:54.720818 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.721299 21313 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:54.721421 21314 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:54.731258 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.732061 21313 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.743495 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.613631 26043 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:54.743274 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:54.747063 21316 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:54.748726 21389 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:54.751137 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.751441 21318 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:54.751842 21320 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:54.752660 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.751300 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.753229 21320 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:54.754129 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:54.754268 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.754760 22035 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:54.755908 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.756583 21320 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:54.757344 25530 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.759326 25530 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:54.762364 22035 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:54.754123 26047 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:54.763576 26047 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.763991 26047 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:54.764086 25856 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.751360 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:54.796403 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.757359 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.765420 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.774370 21314 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:54.801610 21317 raft_consensus.cc:2368] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
I20260709 13:11:54.707105 26050 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:11:54.803966 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52672.1us
I20260709 13:11:54.809478 21314 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:54.815517 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 417361us
I20260709 13:11:54.815852 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.816272 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.816533 22042 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:54.817031 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.817567 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.820642 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.844468 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:54.845728 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:54.793068 25949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.822s	user 0.011s	sys 0.031s
I20260709 13:11:54.748541 26061 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:54.850271 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:54.867544 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 58290.8us
W20260709 13:11:54.867822 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.868404 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.868578 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.925618 21313 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:54.947183 21317 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:54.950766 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.955571 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.965945 21316 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:11:54.966676 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 98173.8us
I20260709 13:11:54.967772 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:54.800438 26090 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:54.815428 25942 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:54.856644 25949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.886s	user 0.011s	sys 0.031s
I20260709 13:11:54.806304 26050 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:54.998929 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 130614us
I20260709 13:11:55.006361 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:55.009120 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:55.009948 22039 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:54.854879 26095 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:54.844408 25822 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.752801 26062 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.221s
I20260709 13:11:54.764632 25856 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:54.965616 25998 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:55.026898 21318 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:55.004436 25747 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:54.965752 25964 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.965518 26087 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.778952 26043 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:55.032819 21286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.042s	sys 0.079s
I20260709 13:11:54.989413 25988 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:55.035624 21316 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:55.053192 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:54.997532 25994 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:55.038983 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.039934 21312 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:55.041620 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:54.965798 25688 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.026819 25852 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.022006 25942 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.035764 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.062959 21315 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
W20260709 13:11:55.051941 21286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.042s	sys 0.079s
I20260709 13:11:54.986413 25945 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:11:54.989859 25983 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:11:55.061378 21317 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.028827 26095 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:55.067077 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.069078 21318 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:55.056473 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:55.072398 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.077149 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:55.041400 25521 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:55.083639 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:55.092283 21390 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:55.092338 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.042734 25998 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:55.025417 26090 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.096774 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.058362 25822 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.103155 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.103837 21313 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:11:55.104584 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.105407 21319 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:55.069661 25942 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:55.102782 21316 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:11:55.108549 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:55.116515 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.117908 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.135434 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.082382 26103 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:55.129523 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.074787 25994 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:55.131984 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.068904 25964 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.063021 26087 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.074249 25688 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.088793 26095 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.137210 21313 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:55.165395 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.130702 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:55.166419 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.167062 21313 raft_consensus.cc:2368] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
I20260709 13:11:55.167183 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:55.098474 25447 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:55.103163 25998 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:55.148897 26043 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.074414 25852 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.041596 26061 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:11:55.084088 25962 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:11:55.161041 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.162137 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.128748 25822 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.146705 25856 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.171370 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.171546 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.092993 26050 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.179553 21318 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:55.208611 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.209420 21318 raft_consensus.cc:2410] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:55.210126 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.210664 21318 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:55.108898 25521 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:55.226544 25521 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.229004 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.229842 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.230440 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.231254 21469 raft_consensus.cc:2368] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:11:55.231491 21312 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:55.183321 26090 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:55.185029 25852 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.170830 25530 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:55.187254 26093 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:55.188347 25638 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:55.204768 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.213114 21467 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:55.254750 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.213729 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.169040 25447 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.224195 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.233176 21317 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:11:55.263170 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 104145us
W20260709 13:11:55.192512 25533 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.862s	user 0.008s	sys 0.001s
I20260709 13:11:55.238008 21313 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:55.152284 26091 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:11:55.234295 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 104963us
I20260709 13:11:55.267705 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:55.245976 21285 connection.cc:256] RPC call timeout handler was delayed by -1.5816719709999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 13:11:55.271277 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:55.272509 21285 leader_election.cc:400] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:11:55.272770 21285 leader_election.cc:403] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:55.278271 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:55.278271 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.280071 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.280792 21461 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:55.280937 22039 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:55.281797 21469 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:11:55.282207 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:55.282948 21390 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:55.284148 21388 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:55.284202 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:55.284902 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 317174us
I20260709 13:11:55.285264 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.285873 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:55.292821 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:55.293413 21388 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:55.264576 26108 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:55.301931 21395 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:55.303149 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.257690 25638 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:55.257586 25994 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:55.304900 26106 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:11:55.304795 25638 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.263749 25447 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:55.306167 25638 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.288259 25533 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.308431 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.309338 25533 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.256521 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:55.313402 21312 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:55.313715 26087 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.294932 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.254695 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.315369 21465 raft_consensus.cc:2410] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:11:55.249977 21320 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:55.316366 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.316740 21387 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:55.251111 25530 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:55.309259 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.326648 21396 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:11:55.327548 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.298272 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.327848 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.330024 21391 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:55.334133 21390 raft_consensus.cc:2410] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:11:55.336549 21467 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:55.303831 21395 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:55.296672 21317 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:55.317691 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.336597 21392 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:55.286096 25989 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:55.357736 21312 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:11:55.295782 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.337661 25530 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:55.360520 26110 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:11:55.325140 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.361532 25688 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:55.336550 26102 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:55.362895 25973 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:55.364588 26102 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.365060 26102 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:55.370359 26047 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.001s
I20260709 13:11:55.370997 26047 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.372296 21470 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 11. Ops: []
I20260709 13:11:55.372537 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.370460 25530 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.332072 25983 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:11:55.377032 25983 consensus_queue.cc:1243] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:55.349063 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.377770 25994 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:55.377902 25964 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:55.378209 25994 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:55.318135 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:55.383261 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:55.384114 22042 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.291332 26043 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:11:55.336787 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:55.349987 21391 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:55.338610 21395 pending_rounds.cc:85] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 8
I20260709 13:11:55.339555 21463 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:11:55.347148 21387 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:55.347435 21396 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:55.348079 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 156151us
I20260709 13:11:55.316596 25986 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:55.357169 21464 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:55.357306 21388 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:55.250936 26093 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:55.372329 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.404443 21461 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:55.392194 21395 pending_rounds.cc:107] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:55.405578 21395 raft_consensus.cc:2889] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:55.405931 21395 pending_rounds.cc:107] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 13:11:55.405784 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 87730.4us
I20260709 13:11:55.406203 21395 raft_consensus.cc:2889] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:55.404377 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:55.406674 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:55.407668 21359 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:55.398564 22039 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:55.411156 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74435.3us
I20260709 13:11:55.408772 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:55.417340 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.425393 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.403913 25988 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.405241 25986 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:55.413702 26105 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:11:55.412755 26090 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:55.418164 26087 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:55.449911 21312 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:55.450307 21312 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:55.414892 26113 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:55.439584 21469 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:55.440507 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.410647 25688 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:55.410703 26020 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:55.439841 22042 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:55.445894 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.412588 25795 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:11:55.475291 21461 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:55.444309 25986 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:55.447296 26090 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.431576 26061 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:55.464855 26115 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:55.455566 26087 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.483789 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.450953 21312 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.487020 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:55.491714 21312 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:55.493597 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:55.471966 25530 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:55.453161 25899 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:11:55.498927 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:55.412842 25994 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.473932 26113 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:55.495010 25989 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:55.443979 25988 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.485432 26090 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:55.504482 25949 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:55.501638 26092 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:11:55.501387 25948 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:55.507313 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1265) took 1129 ms. Trace:
W20260709 13:11:55.507530 26117 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:55.489935 26087 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.490552 26115 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:55.502810 26098 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:11:55.643769 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.645313 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.645961 21467 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:55.510033 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:55.623862 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:55.625778 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.626459 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.501870 25822 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:55.490957 26089 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:11:55.630014 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.632905 22041 rpcz_store.cc:276] 0709 13:11:54.378060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.378282 (+   222us) service_pool.cc:224] Handling call
0709 13:11:54.378643 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:54.655537 (+276894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:54.655583 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:54.656282 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 13:11:54.814281 (+157999us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:54.814342 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.995379 (+181037us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54006e50d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:54.995448 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:55.504869 (+509421us) raft_consensus.cc:1685] finished
0709 13:11:55.504890 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.507244 (+  2354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5916,"raft.queue_time_us":10842,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"spinlock_wait_cycles":622058368,"thread_start_us":147519,"threads_started":1,"wal-append.queue_time_us":408763}
W20260709 13:11:55.660591 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 281590us
I20260709 13:11:55.669422 21465 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:11:55.659973 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 189746us
W20260709 13:11:55.667858 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 254966us
I20260709 13:11:55.671072 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:55.668792 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:55.672418 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:55.677964 21436 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:55.484483 25591 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:11:55.638607 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.490363 26095 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.641038 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.624547 25973 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:11:55.691985 21468 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:55.644836 25949 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:55.681103 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.692965 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:55.628499 25989 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:55.696440 25989 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.698750 25989 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.702195 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:55.632131 21312 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:11:55.686772 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.621968 25530 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:11:55.644447 21462 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:55.643965 26115 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:55.659416 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.674732 26063 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:55.717344 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.717429 26063 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.718747 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.719365 21463 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:55.707782 21461 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:55.683629 26091 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:55.732254 26061 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:55.732913 26061 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:55.733855 26061 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.735010 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.735628 21388 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:55.736603 21389 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:55.737241 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.737882 21396 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:55.719870 26063 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:55.738912 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.739589 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:55.740147 21391 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.705430 25795 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:55.743495 25795 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:55.744474 25795 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.749818 26095 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.750466 26095 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:55.750780 26095 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:55.751128 26095 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:55.744489 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.752899 21465 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:11:55.755575 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.672107 25948 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.709816 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:55.710222 26123 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:55.710503 25723 raft_consensus.cc:2764] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:11:55.686486 26047 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:55.711745 26122 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:55.686180 26062 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:11:55.665351 25447 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.716653 26103 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.720199 26113 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.722666 25949 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:55.766552 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56823.9us
I20260709 13:11:55.766695 21391 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:55.757411 25948 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:55.802748 25942 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.670s	user 0.006s	sys 0.004s
I20260709 13:11:55.833976 21469 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:55.775914 21461 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
W20260709 13:11:55.777027 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 75050.3us
I20260709 13:11:55.777889 21312 pending_rounds.cc:85] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 6
I20260709 13:11:55.835788 21312 pending_rounds.cc:107] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:11:55.836170 21312 raft_consensus.cc:2889] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:55.774662 21463 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:11:55.765810 25530 consensus_queue.cc:1243] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:55.767359 25915 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:55.825766 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.767510 26091 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:55.675078 25822 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:11:55.801445 25988 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.888075 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:55.818390 26131 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:55.894011 21466 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:55.890275 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.895166 21314 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:55.896373 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.897212 21316 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
W20260709 13:11:55.892633 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 221616us
W20260709 13:11:55.838016 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 328292us
I20260709 13:11:55.907531 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:55.908212 21317 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.909260 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:55.909890 21319 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:55.913581 25948 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:55.917958 25447 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:55.887194 26133 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:55.925854 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:55.926486 21392 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:55.825162 26103 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.886417 25723 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.943392 21317 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:55.831082 26102 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.899549 26131 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.953554 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.953598 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:55.955068 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:55.942579 26099 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.905s	user 0.005s	sys 0.000s
I20260709 13:11:55.956208 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:55.962572 21463 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:55.838979 26115 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.930971 25530 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:55.840072 25942 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:55.965940 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 293396us
I20260709 13:11:55.964553 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:55.967363 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:55.977222 21391 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:55.978793 21464 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:11:55.968575 22002 leader_election.cc:400] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
I20260709 13:11:55.980273 22002 leader_election.cc:403] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:55.923439 26093 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.971071 26087 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.971913 26102 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:55.983748 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:55.972572 26090 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.966019 25521 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:55.941967 25948 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:55.962072 26133 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:55.957187 26131 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:55.986783 26135 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:55.991371 26135 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.991710 26135 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:55.944401 25723 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.977038 25530 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:55.997956 25723 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:55.998198 25530 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.000833 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:56.001648 21396 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:56.001448 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:56.003383 26131 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.005920 25942 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.010038 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:56.011092 21396 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:55.959429 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:11:56.011883 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52459.6us
I20260709 13:11:56.012696 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:56.013002 26131 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:56.013914 25942 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.014317 25942 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.014675 25942 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.016489 25945 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:56.016943 25945 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:56.017349 25945 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:56.023219 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.985816 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:55.988730 26138 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
I20260709 13:11:56.027923 26053 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:56.028431 26053 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:56.029312 26053 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.030079 26087 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.031658 21387 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:56.033229 26115 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:56.034063 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.036563 21392 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:11:56.037245 21391 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:56.039892 26103 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.041262 26020 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:56.041746 26020 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:11:56.043139 25986 consensus_meta.cc:287] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.002s
I20260709 13:11:56.042639 26020 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.043551 25986 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:55.968252 26091 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.060925 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:56.058300 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:56.077316 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:56.046370 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:56.076862 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:56.036293 21436 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:56.123116 21467 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:11:56.037189 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:56.133561 21387 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:56.075654 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:56.134238 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:56.126487 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.135952 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:56.061281 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:56.083510 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 97759us
I20260709 13:11:56.137233 21390 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:11:56.137574 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:56.049036 21389 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:56.073553 21469 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:56.074872 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:56.064317 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:56.140328 21395 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:56.140251 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:56.142362 21467 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:56.151811 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:56.024899 25998 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.001s
W20260709 13:11:56.205442 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 69566.7us
W20260709 13:11:56.205745 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 68254.2us
I20260709 13:11:56.267799 21469 raft_consensus.cc:1217] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[8.8-11.9]   Dedup: 8.8->[11.9-11.9]
I20260709 13:11:56.292363 21469 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [8.8-11.9]
I20260709 13:11:56.291950 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:56.298928 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.270099 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1805) took 1057 ms. Trace:
I20260709 13:11:56.136494 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:56.318305 21470 rpcz_store.cc:276] 0709 13:11:55.212770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.228120 (+ 15350us) service_pool.cc:224] Handling call
0709 13:11:55.228479 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.372831 (+144352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.269616 (+896785us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400259c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:56.270025 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330136448}
W20260709 13:11:56.366039 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 329799us
I20260709 13:11:56.415184 21467 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:11:56.417843 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 125975us
W20260709 13:11:56.420120 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.419744 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:56.426309 25986 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.426963 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:56.427138 25822 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:56.432425 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.435634 25962 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.436209 25962 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:56.436612 25962 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.322297 26133 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:56.440974 26133 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.441344 26133 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:56.444685 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 292962us
I20260709 13:11:56.065805 26093 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:56.446007 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:56.447240 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:56.076164 25945 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.071761 26090 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.416013 25998 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.450321 25945 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:56.451305 25998 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.451591 26063 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.451992 26063 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.452239 21469 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:56.452421 26063 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.024736 26102 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.426s
I20260709 13:11:56.456075 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:56.456207 25955 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:56.458616 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:56.464956 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:56.476620 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.043951 26020 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:56.487262 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 120222us
I20260709 13:11:56.140189 26138 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.268913 26128 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:56.150425 26104 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:56.268613 26087 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.505820 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:56.415078 25688 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:56.415284 26092 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.484987 25955 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:56.483446 25533 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.524250 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:56.499503 26090 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:56.505453 25723 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.027993 26135 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.484375 26115 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:11:56.479388 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59737.3us
I20260709 13:11:56.515818 21436 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:56.483737 25986 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:56.491673 25995 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.510730 21469 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:11:56.492076 26136 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:56.532333 21465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.004s	sys 0.008s
I20260709 13:11:56.515944 26104 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.035676 25521 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:56.541383 21396 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 13:11:56.546607 21317 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:56.563797 21396 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
W20260709 13:11:56.546713 21465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.004s	sys 0.009s
I20260709 13:11:56.573096 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:56.514083 21313 raft_consensus.cc:2410] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:55.661696 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:56.554371 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.518496 26087 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.588449 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:56.531325 25949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.011s
I20260709 13:11:56.556229 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:56.572621 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:56.558763 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:56.590248 22040 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:56.525045 25688 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.592667 22031 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:56.560550 25795 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:56.591032 25949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.001s	sys 0.011s
I20260709 13:11:56.600369 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:56.590443 21313 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:56.596927 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:56.530129 26092 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.614725 21315 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:56.617152 26069 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:56.617624 26069 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:56.618510 26069 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.622087 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:56.624776 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:56.567869 26136 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.600250 25983 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:56.626796 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.627694 25948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.012s
W20260709 13:11:56.619927 26095 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.868s	user 0.009s	sys 0.003s
W20260709 13:11:56.625875 26113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.035s	sys 0.068s
I20260709 13:11:56.624184 25822 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.600466 25998 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:11:56.599830 26102 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:11:56.633323 25948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.013s	sys 0.012s
W20260709 13:11:56.658139 26113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.036s	sys 0.068s
I20260709 13:11:56.630538 25795 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:56.671566 25899 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:56.632678 25983 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.623313 25765 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:11:56.623950 25986 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:11:56.661326 25822 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.690537 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:56.681831 25948 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:56.688751 25983 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.676712 26103 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:56.691944 26103 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:56.690716 25822 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.692857 26103 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.694195 26103 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.695660 26135 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:56.665580 26141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.028s
W20260709 13:11:56.696516 26141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.010s	sys 0.029s
W20260709 13:11:56.697563 26147 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:11:56.697837 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.699101 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:56.699775 21314 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:56.700650 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:56.701920 21314 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:56.703490 26024 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.588733 25955 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.704039 26024 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.706171 26024 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:56.708200 26135 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:56.708454 26092 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.708760 26135 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:56.709834 26145 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:11:56.710955 26135 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:56.711741 21321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2541) took 3841 ms (client timeout 2227 ms). Trace:
W20260709 13:11:56.712144 21321 rpcz_store.cc:269] 0709 13:11:52.870717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.870847 (+   130us) service_pool.cc:224] Handling call
0709 13:11:56.711524 (+3840677us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54000fd054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:56.711653 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4925351296}
I20260709 13:11:56.715638 25994 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:56.716244 21318 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:56.738972 21318 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:56.717805 26138 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:56.719071 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:56.719995 22038 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:56.721542 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:56.724020 25688 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.726207 21312 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:56.761996 21312 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:56.726858 26104 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.730721 25983 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.782954 25533 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:56.741168 26102 consensus_queue.cc:1243] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:56.732661 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1801) took 1521 ms. Trace:
I20260709 13:11:56.691277 21319 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:11:56.784641 25521 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.787163 25983 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.733040 26087 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.740309 21314 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:56.788378 25795 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.790164 22035 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:11:56.790920 22035 pending_rounds.cc:85] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 10
I20260709 13:11:56.791136 22035 pending_rounds.cc:107] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:11:56.738354 21315 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:11:56.793605 26093 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.794186 26093 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.791383 22035 raft_consensus.cc:2889] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:56.797809 25942 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.000s
I20260709 13:11:56.798282 25942 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:56.740942 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 238178us
I20260709 13:11:56.762748 21312 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.776008 25822 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.801280 26136 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.801533 21312 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.803277 25822 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:56.777705 26146 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:11:56.659235 26095 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.806651 26095 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:56.763199 25955 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.809737 26104 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.810400 25723 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:56.810410 26104 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.811489 25723 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:56.780547 26138 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.811869 25723 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:56.812739 25723 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.813265 26104 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.814097 26138 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.759323 26113 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.814661 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:56.815011 26113 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.817821 26113 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:56.819001 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:56.809880 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46592.1us
I20260709 13:11:56.782581 26133 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.822463 22032 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:56.784225 21466 rpcz_store.cc:276] 0709 13:11:55.211652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.213255 (+  1603us) service_pool.cc:224] Handling call
0709 13:11:55.232020 (+ 18765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.894588 (+662568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.732436 (+837848us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54002495d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:56.732599 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521870208}
I20260709 13:11:56.826859 25688 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:56.827418 25688 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:56.813925 25723 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:56.626832 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:56.829504 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.842478 22040 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:56.844883 25962 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:56.852586 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:56.853307 22041 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:56.836362 26136 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:56.854184 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:56.854883 22041 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:56.854292 26136 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.855664 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:56.774384 21318 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.877274 21318 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.857192 25530 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:56.859733 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:56.860285 21393 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:56.860718 25942 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:56.863195 26135 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:56.864699 25948 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:56.830775 21312 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:56.878396 22041 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:56.895525 21318 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:11:56.896175 21318 pending_rounds.cc:85] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 5
I20260709 13:11:56.846464 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:56.898360 22040 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:56.900250 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:56.873859 25962 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:56.876554 25915 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.910252 22040 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:56.896515 21318 pending_rounds.cc:107] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 13:11:56.908605 21392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.023s	sys 0.066s
W20260709 13:11:56.911578 21392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.023s	sys 0.066s
I20260709 13:11:56.911512 21318 raft_consensus.cc:2889] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:56.915058 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 371391us
W20260709 13:11:56.913203 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 471177us
I20260709 13:11:56.879771 25530 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:56.889390 25447 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:56.924137 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:56.924615 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.926230 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 350692us
I20260709 13:11:56.937009 21468 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:56.918248 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2343) took 1240 ms. Trace:
I20260709 13:11:56.922165 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:56.932127 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:56.931242 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:56.933475 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 360451us
I20260709 13:11:56.912619 22040 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:56.887606 25948 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:56.944842 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:56.948640 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1093) took 1548 ms. Trace:
I20260709 13:11:56.950687 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:56.938354 21465 rpcz_store.cc:276] 0709 13:11:55.677677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.756141 (+ 78464us) service_pool.cc:224] Handling call
0709 13:11:55.756389 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.756572 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:55.961285 (+204713us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.917781 (+956496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.917851 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:56.917917 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.918003 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.918184 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":246598,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":31718,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3838,"thread_start_us":1160444,"threads_started":3,"wal-append.queue_time_us":620186}
I20260709 13:11:56.964759 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:56.965835 22040 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:56.949204 22035 rpcz_store.cc:276] 0709 13:11:55.400495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.401042 (+   547us) service_pool.cc:224] Handling call
0709 13:11:55.401368 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.796412 (+1395044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.948308 (+151896us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400693054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:56.948563 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3193215872}
I20260709 13:11:56.967906 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:56.969831 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.968439 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:56.972168 21466 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:11:56.972450 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.927865 26089 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 13:11:56.975327 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53306.8us
I20260709 13:11:56.975317 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:56.979369 22042 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.996492 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:56.997264 22040 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:56.998355 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:56.999601 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:57.005856 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:56.969308 26102 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:56.903307 26135 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.010102 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:56.913338 26063 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.019501 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:56.916752 25915 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:56.973919 25447 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:57.036554 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.040972 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:57.041610 22035 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:57.037143 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:57.042312 21391 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:57.043780 22035 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:57.007160 26069 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.053073 22042 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
W20260709 13:11:57.055722 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.057626 26155 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:57.059660 26155 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.008765 26104 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:57.036463 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:57.098609 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 132304us
I20260709 13:11:57.099133 21393 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.942169 26090 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:11:57.063618 26138 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:57.075727 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.109618 21312 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:11:57.076498 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.111320 21316 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:57.077348 21313 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:57.078035 21391 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:11:57.079077 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:57.022701 25994 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.927604 25688 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.102648 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:57.118296 21467 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.996172 26150 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:57.103325 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:57.104809 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:57.124775 21465 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:57.124989 21462 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:57.010986 26103 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:11:57.125926 26103 consensus_queue.cc:1243] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:57.067375 26091 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:57.062697 26136 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:57.131112 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 164374us
I20260709 13:11:57.070564 25822 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.137372 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:57.063150 26095 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:11:57.098380 26104 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.141721 21462 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:57.103780 25942 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.156680 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:57.103081 25533 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:57.201774 25533 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.207038 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:11:57.211233 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 60040.9us
W20260709 13:11:57.221414 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.221740 21465 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:11:57.227011 21393 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:11:57.142769 21467 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:11:57.129266 25638 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.223398 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:57.165200 26135 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:57.072111 26154 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:11:57.236104 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:57.148732 26086 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.168778 25915 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:57.170109 26063 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:57.155226 26091 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:57.068596 25530 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.149937 25822 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.180071 25447 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.184470 26133 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:57.103435 26043 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:11:57.239590 26095 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:57.155848 26104 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:57.135666 26093 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:57.192202 26020 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.692s	user 0.012s	sys 0.000s
I20260709 13:11:57.193744 26138 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.197957 25795 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:57.197906 26024 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:57.166929 25942 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:57.246001 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 238402us
I20260709 13:11:57.301726 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:57.247167 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 769) took 1208 ms. Trace:
I20260709 13:11:57.303056 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:57.245275 26157 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:57.245277 26103 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:57.268999 21393 pending_rounds.cc:85] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 9
I20260709 13:11:57.308506 21393 pending_rounds.cc:107] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:11:57.308776 21393 raft_consensus.cc:2889] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:57.272781 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:57.276021 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:11:57.281837 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 277122us
I20260709 13:11:57.311069 21391 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.311914 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:57.312438 26093 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:57.312981 26093 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:57.313599 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:57.313832 26093 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.239579 25638 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.317622 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:57.257469 26086 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.289300 22038 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:57.269698 26063 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:57.301726 25533 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:57.308248 26157 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.274479 25530 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:57.285545 26095 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:57.320346 25521 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.307897 26092 raft_consensus.cc:2764] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:57.302955 21392 rpcz_store.cc:276] 0709 13:11:56.038885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.068164 (+ 29279us) service_pool.cc:224] Handling call
0709 13:11:56.068554 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.068787 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:56.076508 (+  7721us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.246288 (+1169780us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.246563 (+   275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.246645 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:57.246707 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.246789 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.247090 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19224,"prepare.queue_time_us":7531,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":33,"raft.queue_time_us":535,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":18400,"thread_start_us":1168938,"threads_started":2,"wal-append.queue_time_us":1123193}
I20260709 13:11:57.317725 25747 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:57.285069 26138 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:57.322675 26136 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:57.378978 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61441.1us
I20260709 13:11:57.389644 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:57.379710 21391 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:57.391444 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:57.380622 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 374856us
W20260709 13:11:57.393666 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.322360 26150 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:57.381875 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 169279us
I20260709 13:11:57.396764 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:57.397967 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:57.325325 26103 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:57.399200 26103 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:57.339473 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.401593 21362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.001s	sys 0.016s
W20260709 13:11:57.401937 21362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.001s	sys 0.016s
W20260709 13:11:57.402261 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 582226us
W20260709 13:11:57.386996 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.331694 25638 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:57.402992 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:57.406718 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.378567 26157 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:57.408902 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:57.410336 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.418337 21391 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:57.409622 22038 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:57.419193 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:57.419816 21390 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:57.422044 21392 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:57.422374 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:57.403414 26059 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:11:57.424247 26164 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:11:57.423955 26135 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:57.425905 26092 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:57.431049 21394 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:57.432586 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:57.433223 21465 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:57.431416 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:57.332938 26063 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.436451 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:57.389317 25688 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:57.442654 21462 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:57.443903 21390 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
W20260709 13:11:57.447026 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 290417us
W20260709 13:11:57.439599 26161 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:57.383927 25521 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.326375 26091 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:57.461014 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 69639us
I20260709 13:11:57.464249 25915 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:57.465400 25915 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.463320 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:57.467115 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 153575us
I20260709 13:11:57.394783 25747 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.444391 25795 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:57.484252 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49866.3us
I20260709 13:11:57.430830 26181 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:57.431486 26169 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:57.448022 26059 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:57.485641 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:57.456679 26180 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:57.482009 26170 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:57.484845 26133 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:57.490986 26103 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:57.517578 26063 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:57.518736 26087 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:57.519141 26087 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:57.519248 25521 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:57.487505 26183 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:57.545197 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.496230 26169 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:57.504802 25795 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:57.457046 26095 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.552403 25822 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:57.517661 26160 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:11:57.565376 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 64496.2us
I20260709 13:11:57.567544 21465 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:57.564575 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:57.570287 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:57.572472 25688 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:57.572834 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:57.483220 26138 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.575487 26138 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.576041 25948 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.576568 26169 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.545215 26133 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:57.520048 26087 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.501551 26187 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:11:57.520421 26170 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.563426 25942 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:57.577337 25948 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:57.596199 26133 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.584340 26059 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.602794 22035 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:57.580530 26177 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:11:57.556232 26183 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.591325 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:57.610941 26183 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:57.583256 25723 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.004s
I20260709 13:11:57.570940 21462 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
W20260709 13:11:57.614394 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 151844us
W20260709 13:11:57.616863 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 185498us
I20260709 13:11:57.621187 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:57.624063 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:57.589600 25915 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:57.622028 25986 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:57.623560 25942 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:57.636894 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.630257 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:57.649307 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.638371 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 152807us
I20260709 13:11:57.655651 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:57.618484 26157 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.624533 26104 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:57.666719 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.666940 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2575) took 2478 ms. Trace:
I20260709 13:11:57.670855 21318 rpcz_store.cc:276] 0709 13:11:55.188463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.263310 (+ 74847us) service_pool.cc:224] Handling call
0709 13:11:56.716131 (+1452821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.914697 (+198566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.661069 (+746372us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000fd050. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:57.666856 (+  5787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3280930048}
I20260709 13:11:57.637885 26020 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.637843 25945 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:57.632490 26191 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:57.680388 21388 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:57.681381 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:57.686115 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2588) took 1251 ms. Trace:
I20260709 13:11:57.686506 21321 rpcz_store.cc:276] 0709 13:11:56.434631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.713016 (+278385us) service_pool.cc:224] Handling call
0709 13:11:56.821195 (+108179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.821393 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.821430 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.821486 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:56.821522 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.821597 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.685946 (+864349us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000bdbd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:57.686047 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248096128}
I20260709 13:11:57.687361 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:57.653296 25942 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.688191 21318 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:57.659840 26202 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:57.692049 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:57.689561 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.692674 21316 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.693001 21321 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:57.690212 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.676481 25986 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:57.694496 21312 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:57.690642 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.691355 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.697599 21314 raft_consensus.cc:2410] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:57.701665 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.702369 21393 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:11:57.704324 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:57.704598 26159 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:57.704975 26159 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:57.705067 22031 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:57.705838 26159 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.707010 26159 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:57.708657 22038 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:57.710263 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.710711 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.710628 25530 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:57.711186 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.711265 25530 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.713407 25530 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:57.713894 25530 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:57.714321 25530 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.715260 25942 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:57.715618 26181 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:57.715770 26202 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:11:57.715977 26090 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:57.716399 26090 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:57.716161 26181 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.716792 26202 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.717267 26090 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.718525 26090 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:57.722455 26150 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:57.723057 26150 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.727473 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:57.728366 22036 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:57.728911 21316 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:11:57.731845 25747 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:57.680766 26020 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.734025 26020 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:57.734122 26053 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:57.735057 26193 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:57.679433 26170 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:57.704221 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:57.682494 26203 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.754753 26198 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:57.755429 26198 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.759567 26050 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:57.798849 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:57.804653 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 94127.7us
W20260709 13:11:57.802598 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 49910.3us
I20260709 13:11:57.818640 21318 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:57.784767 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 2584) took 1716 ms. Trace:
I20260709 13:11:57.778345 26086 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:57.792527 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.819777 21317 rpcz_store.cc:276] 0709 13:11:56.068224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.074632 (+  6408us) service_pool.cc:224] Handling call
0709 13:11:57.784503 (+1709871us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400088754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:57.784684 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936552704}
I20260709 13:11:57.820479 21315 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:57.793967 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:57.821904 21312 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:57.821635 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.823135 21317 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:11:57.760882 25942 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:57.797500 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.857194 21319 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:11:57.796407 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:57.775044 26136 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:57.770825 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:57.760339 26069 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.687755 26158 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.773615 26203 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.691717 26187 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:57.870448 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 51203.2us
I20260709 13:11:57.871382 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:57.872834 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53390.1us
I20260709 13:11:57.873651 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:57.874308 21463 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:57.681041 26191 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:57.787112 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.767743 26104 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:57.680377 25945 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:57.765766 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.802170 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.911587 21313 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:57.796407 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:57.913062 21393 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:57.789798 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.914335 21320 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:57.793035 26157 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:57.771322 26195 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:57.846578 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.849960 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.850623 21392 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:11:57.852319 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:57.919651 21396 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:57.856295 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.856787 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:57.920696 21317 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.858353 21394 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:57.788012 26172 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.352s	user 0.001s	sys 0.001s
W20260709 13:11:57.857017 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.863029 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:57.869647 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.924559 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.924926 21319 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:57.925773 21318 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
W20260709 13:11:57.881438 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 110676us
I20260709 13:11:57.881742 26069 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:57.882293 26089 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:57.881533 26136 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:57.882774 26201 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:57.884853 26047 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:57.888387 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:11:57.945540 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 57244.3us
I20260709 13:11:57.891966 21312 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:57.933502 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.939899 21317 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:57.862452 26020 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:11:57.953336 21315 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:11:57.955695 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55576.4us
I20260709 13:11:57.957186 21312 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:11:57.951099 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 384551us
I20260709 13:11:57.907280 26191 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.936190 26136 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:57.931556 25765 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.975275 21313 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:57.940305 26201 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.977031 21396 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:57.985525 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.985971 21394 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:57.959578 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:57.954041 26093 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:57.986268 21312 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:57.906694 26158 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:58.012099 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.960275 26150 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:58.025053 26204 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:11:58.042623 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:58.043291 21313 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:11:57.991058 26201 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:58.026886 26136 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.046430 21396 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:57.995127 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:58.026113 26207 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:57.976337 25530 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.050477 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1825) took 2097 ms. Trace:
I20260709 13:11:58.061901 21362 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:57.992081 26093 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.061466 21461 rpcz_store.cc:276] 0709 13:11:55.952661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.952808 (+   147us) service_pool.cc:224] Handling call
0709 13:11:55.953148 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.969594 (+ 16446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.969697 (+   103us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:56.922215 (+952518us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b2c0002f1a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:56.922672 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:11:57.238271 (+315599us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:57.238314 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.238383 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.787313 (+548930us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:58.050185 (+262872us) raft_consensus.cc:1685] finished
0709 13:11:58.050217 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.050398 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7517,"raft.queue_time_us":12693,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8023,"spinlock_wait_cycles":20712448,"thread_start_us":230199,"threads_started":1,"wal-append.queue_time_us":366285}
I20260709 13:11:58.070664 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:57.961963 25795 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:58.073825 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:58.074550 21319 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:57.991984 25521 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.066164 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 115816us
W20260709 13:11:58.066282 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 71228us
I20260709 13:11:58.068974 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:58.063488 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:58.071374 21313 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:57.994647 26104 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:58.042527 26095 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.083314 26095 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:58.086733 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.087612 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:58.089860 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 374686us
I20260709 13:11:58.091964 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:58.093282 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:58.093672 21470 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:58.094904 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:58.095928 21462 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:58.046924 26198 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.092571 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:58.064404 26187 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.103755 21468 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:57.992470 25765 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.105201 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:58.108140 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:58.108419 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:58.029166 25533 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:11:58.074295 26093 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:58.073453 25995 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:58.064646 26183 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:58.089066 26138 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.513s	user 0.014s	sys 0.000s
I20260709 13:11:58.116016 21465 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:11:58.109268 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45847.2us
I20260709 13:11:58.133358 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:58.114053 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:11:58.127946 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:58.046259 26103 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:11:58.086439 25962 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:58.089592 26150 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.103521 26136 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:58.134730 21466 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:58.139844 21319 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:11:58.144789 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 90301.3us
I20260709 13:11:58.073303 26086 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:11:58.108798 26113 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:58.107725 25964 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.077992 26194 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:11:58.146291 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:11:58.152101 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46966.4us
I20260709 13:11:58.189628 21436 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:58.101567 26104 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:58.182242 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 51386.5us
I20260709 13:11:58.196094 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:58.131903 26157 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:58.194907 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:58.203490 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.143672 26092 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:58.199695 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.202950 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.145459 25962 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:58.100260 26094 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:11:58.191736 21436 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:58.206676 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.207182 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.199096 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.207798 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.261406 21393 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:58.262810 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:58.209087 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 62934.1us
I20260709 13:11:58.210942 22038 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:58.089352 25521 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.264340 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:58.266373 21394 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:58.183266 25795 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:58.142508 26203 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:58.270895 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79241us
I20260709 13:11:58.292397 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:58.120082 26187 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.282148 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:58.187733 25852 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.284876 21394 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:58.212939 26020 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:58.321301 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 188066us
I20260709 13:11:58.205873 26170 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:58.288844 25795 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.305445 21387 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:58.176733 26138 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:11:58.213883 26092 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.260840 26115 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.150000 26150 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.181790 25723 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 13:11:58.271982 25962 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:58.341310 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:58.278599 26157 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:58.286382 26159 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:58.190533 26113 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.289093 26069 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.284711 25990 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:58.279341 25945 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.188386 25964 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.143456 26183 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.386138 21390 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:58.400043 26092 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:58.418167 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.212150 26198 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:11:58.325888 26094 consensus_queue.cc:1243] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:58.211755 26104 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:58.401521 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 115574us
I20260709 13:11:58.323015 26203 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:11:58.425232 26210 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:11:58.393327 25795 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:58.285674 25747 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.391572 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 98053.5us
I20260709 13:11:58.418570 26158 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.392452 26020 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:58.410036 26159 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:58.444521 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:58.405450 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64258us
I20260709 13:11:58.465852 21391 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:11:58.466322 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:58.439072 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:58.439545 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:58.447702 21388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.009s	sys 0.013s
W20260709 13:11:58.470378 21388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.009s	sys 0.013s
I20260709 13:11:58.416229 26103 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:58.451707 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:58.328418 25852 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.436422 26197 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:58.458690 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:58.467813 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:58.405217 26115 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.437703 26094 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:58.453804 26091 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.004s	sys 0.011s
I20260709 13:11:58.587312 21387 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:58.578377 21390 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:58.562916 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.481448 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:11:58.491590 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:58.622345 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 141025us
W20260709 13:11:58.622450 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 130991us
W20260709 13:11:58.632694 26089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.004s	sys 0.008s
W20260709 13:11:58.567183 26191 consensus_meta.cc:287] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.000s
W20260709 13:11:58.633209 22002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.011s
I20260709 13:11:58.633577 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:11:58.654978 22002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.008s	sys 0.011s
W20260709 13:11:58.618538 26091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.004s	sys 0.011s
W20260709 13:11:58.549247 26162 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:11:58.560058 26219 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 13:11:58.572005 26053 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.837s	user 0.010s	sys 0.004s
W20260709 13:11:58.559368 26213 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:11:58.451428 26203 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:58.549158 26221 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:11:58.553651 26216 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 13:11:58.726969 26115 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:11:58.558585 26226 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:11:58.727607 26115 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:11:58.575315 26209 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.466s	user 0.000s	sys 0.002s
I20260709 13:11:58.443477 26196 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.728181 26115 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.467450 26159 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:58.653878 26235 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:11:58.746695 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 278979us
W20260709 13:11:58.747138 25995 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.002s
I20260709 13:11:58.747624 25995 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:58.657393 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:58.748415 26217 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.394s	user 0.002s	sys 0.000s
I20260709 13:11:58.549325 26130 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:58.749181 26130 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.748945 26224 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:11:58.749594 26130 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:58.555689 25964 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.532271 26024 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:58.752336 26024 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.752719 26024 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:58.754792 26201 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.000s
I20260709 13:11:58.755247 26201 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.556480 26211 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.576658 25521 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.573892 26113 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.573025 26150 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.756381 26211 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.561088 26183 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.476199 25765 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.706562 21387 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:58.468708 26157 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.465130 25747 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.633946 26138 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:58.634500 26170 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.660125 26089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.004s	sys 0.009s
I20260709 13:11:58.554049 26181 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.643343 25533 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:58.714468 22035 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:58.715191 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:58.618902 26094 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:58.557542 26185 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.407s
W20260709 13:11:58.757900 26050 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.894s	user 0.008s	sys 0.004s
I20260709 13:11:58.770135 26094 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:58.770449 25899 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.546406 26229 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:58.557772 26231 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:58.558769 26218 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.655652 26087 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:58.532104 26103 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:58.713984 26090 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.995s	user 0.008s	sys 0.018s
I20260709 13:11:58.782069 26103 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.782759 25747 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.783361 26203 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.766848 26238 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.767982 26089 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:58.749194 25795 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.764293 26235 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.772573 26181 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.776023 26138 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.803872 26225 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:58.802551 26181 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.562793 26020 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.634060 26158 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:58.669960 26191 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.757171 25852 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.772323 26170 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.772572 25899 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.776515 26244 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:58.777261 26243 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.777824 26093 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 13:11:58.731510 26187 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.780680 26104 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:58.787014 26136 consensus_meta.cc:287] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.002s
I20260709 13:11:58.804463 26238 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.826022 26191 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.826457 26095 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.829952 26092 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:58.831393 26214 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.712s	user 0.001s	sys 0.000s
I20260709 13:11:58.804674 26225 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.786181 26231 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:58.824266 25942 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:58.832283 25942 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:58.833137 26181 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.832808 26231 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.831278 26130 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.822016 26243 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.825354 26201 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.822198 26244 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.823014 26158 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:11:58.821782 26093 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.841483 26158 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.842253 26093 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.800367 26211 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.805325 26138 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:58.851274 26170 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.885823 21312 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:11:58.666141 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:11:58.890321 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 224143us
I20260709 13:11:58.758908 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:58.747849 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:58.743757 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.897171 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1826) took 1049 ms. Trace:
I20260709 13:11:58.892007 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:58.897750 21395 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
W20260709 13:11:58.895807 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 147870us
I20260709 13:11:58.898020 21388 rpcz_store.cc:276] 0709 13:11:57.847422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.847566 (+   144us) service_pool.cc:224] Handling call
0709 13:11:57.847899 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.848420 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.848461 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.860229 (+ 11768us) log.cc:844] Serialized 26 byte log entry
0709 13:11:58.470888 (+610659us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:58.661506 (+190618us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.709693 (+ 48187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.709772 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:58.896405 (+186633us) raft_consensus.cc:1685] finished
0709 13:11:58.896460 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.896904 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7117,"prepare.queue_time_us":302722,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":49169,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":19511,"thread_start_us":800354,"threads_started":2,"wal-append.queue_time_us":911518}
I20260709 13:11:58.724481 21469 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:11:58.729985 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:58.937041 26089 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.768602 22040 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:58.941059 26244 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:58.941606 22039 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:58.941073 21464 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:11:58.945838 26225 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.909951 25948 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:58.949862 26235 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.831202 26024 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.848019 26159 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:58.953440 26024 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.954366 25795 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.955133 21468 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:58.956696 26092 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:11:58.894945 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 135999us
I20260709 13:11:58.839141 26115 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.896940 21389 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:11:58.896834 21391 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:11:58.961043 26181 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:58.962770 26159 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.803716 25962 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.964543 21396 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:58.965764 25962 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:58.912750 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:58.833387 25942 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:58.942778 26059 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.894450 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.939421 26087 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:58.931375 26238 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:58.979729 26251 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260709 13:11:58.973575 26087 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:58.988451 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 258389us
I20260709 13:11:58.990273 21317 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:58.990108 26087 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:58.999379 26115 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:58.999212 26059 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:11:58.999902 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 87501.7us
I20260709 13:11:59.000108 26115 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:11:59.000602 26208 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.813s	user 0.000s	sys 0.003s
I20260709 13:11:59.000643 26115 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:59.004335 26130 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:58.989207 25852 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:59.008251 21464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1829) took 3007 ms (client timeout 3181 ms). Trace:
W20260709 13:11:59.008785 21464 rpcz_store.cc:269] 0709 13:11:56.001038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.001194 (+   156us) service_pool.cc:224] Handling call
0709 13:11:59.007932 (+3006738us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b54001a72d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:59.008137 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6700526464}
I20260709 13:11:59.010228 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.015866 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.016652 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.016924 21320 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:59.017117 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.979205 21216 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:11:59.018857 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.019318 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.020370 21320 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:11:58.990936 26181 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:59.022038 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.023419 21320 raft_consensus.cc:2410] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:11:59.016788 26243 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:11:59.024966 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2349) took 2100 ms (client timeout 2282 ms). Trace:
W20260709 13:11:59.025439 21469 rpcz_store.cc:269] 0709 13:11:56.930760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.930909 (+   149us) service_pool.cc:224] Handling call
0709 13:11:59.024650 (+2093741us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54000b7f54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:59.024799 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4107924864}
I20260709 13:11:59.033926 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:58.990070 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:59.032898 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:58.998131 25962 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:11:59.037118 21316 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:59.038388 26181 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:59.040735 22002 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:59.042284 26059 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:59.034210 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.056090 26230 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:59.056794 26230 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.057228 26230 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:59.060096 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.077972 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:59.078166 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:59.078470 25899 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:59.078750 21394 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.079624 21464 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:11:59.082890 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.084239 21470 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:59.086747 25962 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:59.095852 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 106234us
I20260709 13:11:59.099615 25949 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:59.075687 25942 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:59.105012 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.105134 21321 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:59.105599 21465 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:59.104857 26225 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:59.105665 21393 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:59.121687 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.096489 25962 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:59.122156 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.133101 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:59.112159 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:59.154054 21463 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:59.135170 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:59.100116 25949 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:59.140205 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.135613 26104 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.154547 25962 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:59.156217 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:59.159652 26230 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.148458 26225 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:59.164752 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 99406.7us
I20260709 13:11:59.165463 26254 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:59.166072 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:11:59.167137 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 101685us
I20260709 13:11:59.131165 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.176721 25530 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:59.178268 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:59.178293 26243 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:59.179365 21320 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:59.181823 26138 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:59.184966 26256 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:11:59.186187 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53284us
W20260709 13:11:59.187080 26262 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:59.192344 25852 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:59.193300 26115 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.195627 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1109) took 1492 ms. Trace:
I20260709 13:11:59.191285 26094 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.202966 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:59.218838 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.201006 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 65995us
I20260709 13:11:59.220417 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:59.136260 26170 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.223703 21394 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:11:59.199980 25955 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:59.215039 26222 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.779s	user 0.000s	sys 0.003s
I20260709 13:11:59.241555 22039 rpcz_store.cc:276] 0709 13:11:57.702981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.706825 (+  3844us) service_pool.cc:224] Handling call
0709 13:11:57.707084 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.942351 (+1235267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.195294 (+252943us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400319554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:59.195523 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778486016}
I20260709 13:11:59.231966 25530 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.242473 26243 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.200731 26187 raft_consensus.cc:2764] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:59.244980 26138 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.245604 26230 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.245476 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.228363 26254 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:59.228541 26225 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:59.212702 21216 catalog_manager.cc:5697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 10, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 10 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.133526 26211 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:11:59.251466 21315 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:11:59.251683 21314 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:59.252885 21461 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:59.250375 25955 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:11:59.256403 25986 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.259522 26202 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.240154 25852 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.263113 21462 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:59.265571 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.210969 26087 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.274091 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2605) took 1329 ms. Trace:
I20260709 13:11:59.270802 26254 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:59.281723 26089 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.281724 26202 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.282829 26113 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:59.271806 21315 pending_rounds.cc:85] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 6
I20260709 13:11:59.284763 21317 rpcz_store.cc:276] 0709 13:11:57.943771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.950714 (+  6943us) service_pool.cc:224] Handling call
0709 13:11:57.951649 (+   935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.998724 (+1047075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.264845 (+266121us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000fcb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:59.272773 (+  7928us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352149760}
I20260709 13:11:59.288914 21463 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:11:59.290580 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.283812 25852 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.291162 26130 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:59.296648 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:59.293313 21315 pending_rounds.cc:107] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:11:59.302764 21315 raft_consensus.cc:2889] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:59.297304 21467 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:59.308852 26150 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:59.309696 26200 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:59.264729 26104 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.311595 21465 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:11:59.315804 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:59.301981 26191 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:59.302377 25986 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.320231 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.319613 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.325753 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:11:59.333941 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.329164 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1115) took 1394 ms. Trace:
I20260709 13:11:59.337347 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:59.330221 21317 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:11:59.330752 21315 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:11:59.329458 22035 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:59.329069 22038 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:59.358490 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:11:59.385623 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.330724 26086 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:59.386718 26086 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.387459 26086 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:59.387372 26191 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.388345 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.389307 22041 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:59.297307 26170 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:59.401533 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.340083 22036 rpcz_store.cc:276] 0709 13:11:57.899081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.899201 (+   120us) service_pool.cc:224] Handling call
0709 13:11:57.899555 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.929941 (+ 30386us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:57.959382 (+ 29441us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.128176 (+168794us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.038309 (+910133us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b2c00101178. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:11:59.039058 (+   749us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.039328 (+   270us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:59.095858 (+ 56530us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.151419 (+ 55561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.283635 (+132216us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b5400693054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:11:59.283690 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.283733 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:59.283745 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.293315 (+  9570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12744,"prepare.queue_time_us":258780,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":2708,"raft.queue_time_us":154867,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":68202,"spinlock_wait_cycles":66570240,"thread_start_us":213469,"threads_started":2,"wal-append.queue_time_us":298086}
W20260709 13:11:59.407855 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 114739us
I20260709 13:11:59.330333 26234 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.331930 26138 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.324105 26089 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.332690 25986 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.411635 26094 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.320189 26187 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:11:59.429960 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2601) took 1605 ms. Trace:
I20260709 13:11:59.430392 21318 rpcz_store.cc:276] 0709 13:11:57.824754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.926399 (+101645us) service_pool.cc:224] Handling call
0709 13:11:57.926691 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.936281 (+  9590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.936327 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.952912 (+ 16585us) log.cc:844] Serialized 26 byte log entry
0709 13:11:58.136431 (+183519us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:58.136470 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.136545 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.214134 (+1077589us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:11:59.429476 (+215342us) raft_consensus.cc:1685] finished
0709 13:11:59.429496 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.429776 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9200,"raft.queue_time_us":12899,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4918,"spinlock_wait_cycles":9153280,"thread_start_us":144899,"threads_started":1,"wal-append.queue_time_us":429420}
I20260709 13:11:59.335059 26087 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.329754 26174 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:59.414804 26138 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.434792 26138 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.419296 26104 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.419615 26089 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.411674 26115 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.420356 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.328552 25955 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.425506 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:59.426225 26234 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.428223 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.440204 22032 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:59.428876 21320 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:59.429061 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.330799 25530 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.438855 22035 raft_consensus.cc:2410] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:11:59.389930 26191 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:59.439201 22041 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:11:59.441205 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 121196us
I20260709 13:11:59.445055 22039 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:59.332366 26130 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.455377 22034 raft_consensus.cc:2410] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:59.452306 21362 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:59.459066 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 147651us
I20260709 13:11:59.444887 25955 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:59.461304 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.327639 25949 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.462263 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.473379 25949 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.469720 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:59.459088 26230 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:59.457502 26243 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.479336 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.463310 26020 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:11:59.488897 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.469077 25530 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.493147 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.473448 26087 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:59.478014 26230 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:11:59.509709 26179 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:59.511109 25688 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:11:59.511770 25688 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.514117 25688 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.515864 26094 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:59.516479 26094 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.517226 26230 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:59.518769 26094 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.519227 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:59.519795 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.520380 21313 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:59.509765 26170 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.521121 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.521332 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.522310 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.523106 21315 raft_consensus.cc:2410] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:11:59.523164 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.524515 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:59.513840 26225 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.526226 21317 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:59.526381 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.526999 21470 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:11:59.528785 26263 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.406s	user 0.001s	sys 0.002s
I20260709 13:11:59.529068 26150 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:59.529588 26150 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:59.529381 25530 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.529987 26150 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:59.531579 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.531685 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:59.533015 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.533283 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:11:59.533675 21394 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:11:59.534121 21465 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:59.535095 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.540778 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:59.542119 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.543217 26243 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:59.493413 26089 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.544497 26089 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:59.545568 26264 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.421s	user 0.001s	sys 0.001s
I20260709 13:11:59.545936 21313 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:59.547376 26202 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.547597 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.507479 26087 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.548295 21469 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:11:59.548385 26087 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.512097 26174 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:59.529070 21463 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:59.523841 21464 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:11:59.527865 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:11:59.570279 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 82805.5us
I20260709 13:11:59.560003 21317 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:59.573035 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 1839) took 1134 ms. Trace:
I20260709 13:11:59.494283 26113 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:59.589761 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.590536 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.591171 22034 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:11:59.591741 21387 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:59.594231 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:59.595046 22034 raft_consensus.cc:2368] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:11:59.595242 25915 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:59.595361 25723 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:59.592859 26234 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.595804 25915 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.598191 25915 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.598435 26130 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:59.600502 26104 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:59.601368 26104 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:59.601720 26104 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:59.601660 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:59.602598 21396 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:59.602839 26104 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.604188 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:59.604466 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.604873 21392 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:59.605453 26170 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:59.606528 26200 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:59.606983 26200 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:59.607933 26200 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.608793 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:59.609730 26243 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:59.610314 26243 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.611613 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:59.571009 26174 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:11:59.612911 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.579873 26020 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.584192 26179 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:59.587644 25530 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.587843 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.588243 26115 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.588677 25986 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.624179 25986 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.618695 21315 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:59.613034 26174 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.625402 21466 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:59.625743 26174 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:59.612942 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:11:59.581043 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 70642.4us
I20260709 13:11:59.573472 21468 rpcz_store.cc:276] 0709 13:11:58.438560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.438708 (+   148us) service_pool.cc:224] Handling call
0709 13:11:59.551035 (+1112327us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400216954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:11:59.572971 (+ 21936us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114457472}
I20260709 13:11:59.623145 26115 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.624660 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.593564 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.615833 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:11:59.642194 21387 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:59.641819 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:11:59.643754 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:59.644842 22039 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:11:59.645149 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.658094 25688 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:59.658656 25688 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.617825 26181 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.659055 25688 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:59.659468 26181 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.660104 26130 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.660849 26130 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.663975 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.676805 21315 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:59.593083 26202 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.659063 25942 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:59.689519 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:59.690246 21319 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:59.680522 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.619443 26104 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:59.697211 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:59.715626 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 73992.3us
I20260709 13:11:59.623934 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:11:59.715169 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 102302us
I20260709 13:11:59.723161 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.724591 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.721819 22034 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:11:59.725871 22040 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:11:59.722409 26263 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:59.635349 26094 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:11:59.739285 22038 raft_consensus.cc:1217] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Deduplicated request from leader. Original: 7.8->[10.9-14.11]   Dedup: 14.11->[]
W20260709 13:11:59.744136 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 225022us
I20260709 13:11:59.754238 22038 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: [10.9-14.11]
I20260709 13:11:59.754086 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:59.769619 21387 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:11:59.772396 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:11:59.773087 22031 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:59.773725 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.775457 21315 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:59.740909 26243 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.784559 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:59.801723 26020 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.807904 21318 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:59.809497 25822 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:59.810148 25822 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.810590 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.812093 22041 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:11:59.812350 25822 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.813112 22042 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:59.813591 22041 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:59.814172 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:11:59.814805 22042 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:59.815480 25822 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:11:59.815855 21433 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.602s (SENT) [suppressed 6 similar messages]
I20260709 13:11:59.816140 25822 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.818427 25822 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.820343 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:11:59.822238 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 241319us
W20260709 13:11:59.823521 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51548.7us
I20260709 13:11:59.833941 21392 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:59.835292 22031 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
W20260709 13:11:59.845429 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.847510 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 239198us
I20260709 13:11:59.754897 25852 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.762178 26202 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:11:59.877789 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.836081 25915 raft_consensus.cc:2764] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:59.884734 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:11:59.885753 21321 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:11:59.887013 26181 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.891017 26115 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:11:59.895377 26200 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:59.897104 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:59.898756 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:11:59.899533 21392 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:59.923533 21392 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:11:59.924919 21396 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:11:59.925472 21319 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:11:59.881963 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:11:59.927987 21391 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:59.838742 25949 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:59.860245 25990 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:11:59.879801 26089 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:11:59.949862 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:11:59.945120 22036 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:11:59.959216 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.959288 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:11:59.860224 26138 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.086s
W20260709 13:11:59.964850 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 238131us
I20260709 13:11:59.966950 21392 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:11:59.977401 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:11:59.910364 26086 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.964989 25688 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:11:59.963779 25962 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.005s
I20260709 13:11:59.996472 25962 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:11:59.997857 21389 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:00.000730 26231 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:00.003652 21359 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:11:59.963930 25986 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:00.009056 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.013579 21391 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:11:59.958885 26059 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:00.011023 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:00.016594 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.017649 21392 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:11:59.975282 26130 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:11:59.957028 26230 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:00.024479 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 186071us
I20260709 13:12:00.020777 21393 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:00.027302 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.028142 21464 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
W20260709 13:12:00.029017 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 283169us
I20260709 13:12:00.029798 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:00.006384 25852 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.032384 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:00.038085 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 60795.6us
I20260709 13:12:00.036679 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.033164 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.040369 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:11:59.982823 26150 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.045411 21463 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:12:00.046047 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58587.1us
I20260709 13:12:00.027704 26059 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:00.046922 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 262494us
I20260709 13:11:59.979331 25990 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.001577 26231 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.036654 25986 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:00.072260 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.064862 26059 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:00.076807 21468 raft_consensus.cc:2368] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:00.078943 26231 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.080839 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.098649 26231 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:00.098883 21469 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:00.080801 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.073733 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.100944 26115 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:00.085386 25942 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:12:00.101640 26115 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:00.102247 26150 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.102659 26115 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.087462 26020 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:12:00.087442 26230 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.104288 26020 consensus_queue.cc:1243] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:00.104939 26020 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:00.105290 26020 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:00.106201 26020 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.107591 26020 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:00.100845 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44834.9us
I20260709 13:12:00.088086 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:00.109352 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:00.110839 26087 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.004s
I20260709 13:12:00.096388 21316 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:00.110805 26179 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:00.112239 26179 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:00.112609 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 66347.5us
I20260709 13:12:00.113391 26179 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.076531 26130 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:12:00.089845 25990 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.117388 25942 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:00.077081 25986 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:00.096073 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:00.122478 25986 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.080165 26090 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:00.111467 26087 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.123508 25990 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:00.131556 21465 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.009s
W20260709 13:12:00.123129 25955 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.652s	user 0.005s	sys 0.002s
I20260709 13:12:00.096534 21462 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:00.109368 26047 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:00.138684 26150 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:00.138860 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:00.140616 26169 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:00.143189 26202 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.143889 21216 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 6 to 7, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 7 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.074302 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:00.086243 26254 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.785s	user 0.012s	sys 0.006s
W20260709 13:12:00.146827 21215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 279) took 36474 ms (client timeout 15000 ms). Trace:
I20260709 13:12:00.154281 25990 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:00.132313 25852 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:00.154753 21465 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:00.157146 21320 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:00.148878 26086 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.175751 21394 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:00.177635 21314 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:00.158707 26047 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.161062 26150 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:00.225742 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50544.1us
I20260709 13:12:00.227986 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:00.180930 25955 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:00.231703 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 121279us
I20260709 13:12:00.215231 26047 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:00.237385 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.215580 26150 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:00.229274 26174 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.001s
W20260709 13:12:00.249233 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.179647 26254 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.261622 21317 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:00.264297 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.265239 26274 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.265776 26274 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.269222 21465 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:12:00.271652 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 51797.5us
I20260709 13:12:00.232134 25955 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:00.272955 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 159216us
W20260709 13:12:00.274942 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 235016us
I20260709 13:12:00.275703 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:00.280447 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.281105 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.281960 21465 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.290195 21359 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:00.292232 21315 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:00.267933 26274 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.294101 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.274525 25955 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.301111 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.281437 25949 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:00.247648 26276 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:12:00.309835 26279 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:00.313385 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.332818 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:00.313905 22067 heartbeater.cc:646] Failed to heartbeat to 127.19.185.254:40067 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.185.254:40067 timed out after 15.000s (SENT)
I20260709 13:12:00.296403 26174 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:00.316371 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.317155 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.317806 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.340943 21464 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:00.343655 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.320463 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:00.346333 21997 leader_election.cc:400] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:00.346628 21997 leader_election.cc:403] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:00.347683 26095 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:00.348218 25822 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:00.350020 26090 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:00.350422 26090 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:00.350625 25822 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:00.351625 26095 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.351297 26090 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.325189 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:00.325418 26087 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.289171 26130 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:00.326164 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.368711 21462 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:00.327188 26254 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.326198 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:00.330634 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:00.260324 25990 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:00.352231 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 91535.1us
I20260709 13:12:00.352994 26095 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:00.352917 26278 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:00.354097 26115 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.324362 26059 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.333654 22038 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:12:00.364670 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.352934 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:00.390560 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.390761 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 107931us
I20260709 13:12:00.390821 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.370838 21216 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 8 to 11, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 11 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.394397 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.394732 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.395757 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.407645 21468 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:00.401736 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48864.9us
I20260709 13:12:00.409497 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:00.410566 21315 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:00.413424 21465 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
W20260709 13:12:00.399111 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 164217us
I20260709 13:12:00.397853 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.415179 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:00.415570 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:00.416198 22032 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:00.401029 21464 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:00.397652 22035 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:00.416484 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.352948 25688 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:00.419353 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 129246us
I20260709 13:12:00.425273 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:00.419499 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:00.382061 26104 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.005s
I20260709 13:12:00.423067 21461 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:00.428073 21395 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:12:00.418342 26202 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:00.429431 26202 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.429826 26202 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:00.430647 26087 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:00.431206 26087 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:00.432267 26113 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:00.432149 26087 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.432945 26113 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:00.433642 26174 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:00.434098 26174 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.434588 26174 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:00.433920 26113 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.436022 26225 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:00.369819 26130 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:00.437423 26115 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.389582 26283 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:00.439640 26059 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:00.439785 26283 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:00.174058 21215 rpcz_store.cc:269] 0709 13:11:23.672335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.689504 (+ 17169us) service_pool.cc:224] Handling call
0709 13:12:00.146546 (+36457042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:50.429682 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:50.468895 (+ 39213us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:50.468963 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:11:50.468996 (+    33us) tablet.cc:662] Decoding operations
0709 13:11:50.470425 (+  1429us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:50.470549 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:50.470589 (+    40us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:11:50.471834 (+  1245us) tablet.cc:701] Row locks acquired
0709 13:11:50.471897 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:11:50.498926 (+ 27029us) write_op.cc:270] Start()
0709 13:11:50.532830 (+ 33904us) write_op.cc:276] Timestamp: P: 1783602710492119 usec, L: 0
0709 13:11:50.552012 (+ 19182us) op_driver.cc:348] REPLICATION: starting
0709 13:11:50.630896 (+ 78884us) log.cc:844] Serialized 4035 byte log entry
0709 13:11:51.236270 (+605374us) op_driver.cc:464] REPLICATION: finished
0709 13:11:51.298212 (+ 61942us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf213e28 00007fc2c2c4e581 00007fc2c2c4dd58 00007fc2c2c529f1 00007fc2c2c529a9 00007fc2c2c52939 00007fc2c2c52901 00007fc2c2c51b2d 000000000038f354 000000000038f199
0709 13:11:51.780424 (+482212us) write_op.cc:301] APPLY: starting
0709 13:11:51.792986 (+ 12562us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:52.270387 (+477401us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:52.270457 (+    70us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:52.581963 (+311506us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:52.582300 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:11:52.582369 (+    69us) write_op.cc:312] APPLY: finished
0709 13:11:52.582738 (+   369us) log.cc:844] Serialized 97 byte log entry
0709 13:11:52.681302 (+ 98564us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:52.681802 (+   500us) write_op.cc:454] Released schema lock
0709 13:11:52.681877 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:52.766729 (+ 84852us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:52.766764 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3457694,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":515402,"apply.run_cpu_time_us":34430,"apply.run_wall_time_us":959830,"cfile_cache_hit":38,"cfile_cache_hit_bytes":39824,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6223,"cfile_init":2,"lbm_read_time_us":86283,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":10,"prepare.queue_time_us":385729,"prepare.run_cpu_time_us":73458,"prepare.run_wall_time_us":897174,"raft.queue_time_us":169806,"raft.run_cpu_time_us":53570,"raft.run_wall_time_us":390200,"replication_time_us":657460,"spinlock_wait_cycles":6478592,"thread_start_us":869413,"threads_started":5,"wal-append.queue_time_us":427658,"wal-append.run_cpu_time_us":16652,"wal-append.run_wall_time_us":2147456}]]}
I20260709 13:12:00.451043 21468 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
W20260709 13:12:00.452164 26280 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.154s	user 0.002s	sys 0.001s
I20260709 13:12:00.465814 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:00.453943 26150 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.304137 25852 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:12:00.455349 21284 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:00.464844 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.469172 21359 leader_election.cc:400] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:12:00.471611 21359 leader_election.cc:403] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:00.472831 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.466459 21216 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 5 to 8, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 8 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:00.477216 25688 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:00.483402 21321 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:00.483841 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:00.487098 26104 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11.
I20260709 13:12:00.487373 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:00.482247 25688 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.479310 26279 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.489585 26279 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.485608 26130 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.479920 26086 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:00.493741 26130 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.494371 26086 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:00.493731 26187 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:00.495807 26086 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.472600 26243 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.497404 26243 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:00.498154 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.499683 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.502722 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:00.489876 25688 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.499619 26243 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.520675 21316 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:00.477957 26276 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:00.480118 26090 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:00.491916 26279 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.493994 26278 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:00.546625 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.562548 21394 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:00.547530 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:00.563370 21390 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:00.549105 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.548868 26138 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:00.550630 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:00.477751 26089 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:00.551501 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:00.524506 26200 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.002s
W20260709 13:12:00.573608 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 86320.2us
I20260709 13:12:00.574402 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.575686 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:00.577041 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.578303 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:00.588649 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 176590us
I20260709 13:12:00.551175 26059 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:00.591404 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.600731 21320 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:00.591949 21388 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:00.525944 26276 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:00.603879 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.600073 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.594013 21317 raft_consensus.cc:2410] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:00.581709 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.597023 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:00.590840 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.553493 25990 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.603012 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.608073 21396 raft_consensus.cc:2410] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:00.613281 21312 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:00.613380 21216 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 6 to 7, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 7 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:00.615259 21391 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:00.622594 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47000.3us
I20260709 13:12:00.623221 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:00.624320 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:00.576789 26104 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:00.625039 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.624346 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:00.647907 22034 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:00.577490 26278 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:00.551224 25688 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:12:00.626868 26283 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.637324 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:00.620926 25949 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:00.641952 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.662487 21392 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:00.605433 26059 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:00.613673 26276 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:00.605245 26243 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:00.599555 26291 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:00.645438 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 71111.2us
I20260709 13:12:00.623731 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:00.618988 26225 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:00.678378 21319 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:00.647949 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:00.598650 26230 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:00.657666 21396 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:12:00.596752 26089 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.643302 25723 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.666464 21216 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 11, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 11 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.681346 26243 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.688149 25949 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:00.689714 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51834.5us
I20260709 13:12:00.689185 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.660912 26115 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:00.675077 26059 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:00.681877 26225 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:00.698910 26150 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.699074 26225 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.682129 26230 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.700285 26230 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:00.700325 26150 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:00.700852 26150 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:00.701220 26150 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:00.704000 21216 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 7 to 10, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 10 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.705345 26089 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:00.706046 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 82393.2us
I20260709 13:12:00.705792 21216 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 7, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 7 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.710263 21462 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:00.687985 26278 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.718012 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:00.728269 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 120095us
I20260709 13:12:00.729921 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.694792 26020 raft_consensus.cc:2764] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:00.731403 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.738159 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.741477 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.741695 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.702206 26047 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.730898 26138 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:00.697075 26306 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:00.748296 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.756001 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:00.756115 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.757197 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.757472 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.757930 21462 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:00.758772 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.711424 26291 raft_consensus.cc:2764] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:00.758805 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.754745 21468 pending_rounds.cc:85] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 8
I20260709 13:12:00.763659 21468 pending_rounds.cc:107] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:12:00.764015 21468 raft_consensus.cc:2889] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:00.749840 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 147732us
I20260709 13:12:00.760633 21389 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:00.760872 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.767828 21394 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:00.770046 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:00.779812 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48495.4us
W20260709 13:12:00.780478 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.780349 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.781103 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.711588 25949 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.719108 26089 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:12:00.793147 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 168481us
I20260709 13:12:00.792589 21216 catalog_manager.cc:5697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 9, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 9 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.794066 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:00.799772 22038 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:00.806070 25723 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:00.806684 26298 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:12:00.807050 26286 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:00.808198 26293 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:12:00.811546 22034 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:00.791674 26301 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:00.812851 26047 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.768143 26306 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.815630 26306 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.817032 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.806600 25723 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:00.784605 26020 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:00.819763 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61045.3us
I20260709 13:12:00.820549 26115 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:00.821825 21216 catalog_manager.cc:5697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.823866 21216 catalog_manager.cc:5697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.826282 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.827858 21390 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:00.827577 26202 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.828382 25949 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:00.829211 26292 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:12:00.829548 26296 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:12:00.829905 26202 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:00.830032 26289 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:12:00.830879 26299 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:00.832108 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.832320 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.832710 21390 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:00.832985 21392 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:00.833544 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:00.834271 21390 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:00.835222 26291 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:00.836287 26297 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:12:00.836802 26243 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.838249 26174 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.838717 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:00.841297 26305 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.841984 26305 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.843250 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:00.844925 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.845861 25942 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:00.846503 25942 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:00.848254 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.847487 25942 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.841229 26286 raft_consensus.cc:2764] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:12:00.797771 25688 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:00.866096 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:00.866341 26174 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.867200 21216 catalog_manager.cc:5697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 7 to 8, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 8 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.868718 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:00.825695 25723 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.882375 21464 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:00.890731 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:00.869213 26312 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.891347 21321 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.890930 21216 catalog_manager.cc:5697] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:00.874519 25962 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.898921 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:00.877658 26202 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:00.906694 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:00.890555 25688 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:00.908628 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:00.908895 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:00.909546 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:00.908341 21216 catalog_manager.cc:5697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 9, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 9 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:00.929064 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.934710 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:00.935870 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 69312.5us
I20260709 13:12:00.937191 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:00.893532 26089 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:00.895463 26138 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:00.935463 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 66961us
I20260709 13:12:00.896600 26305 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.944429 21389 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:00.903204 26174 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.886930 26095 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.946091 21216 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:00.964833 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.974577 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:00.977432 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:00.977957 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:00.933156 26202 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:00.954210 26211 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:00.993202 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:01.000551 22035 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:00.994693 21316 raft_consensus.cc:2368] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:00.905059 26317 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:12:00.903069 26312 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:00.967126 26020 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:00.979300 26286 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:01.001235 21317 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:00.983753 26287 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:01.003464 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:01.028455 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:00.979673 25688 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.004572 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.951333 26225 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.016323 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:01.017760 26316 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:00.951514 26089 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:01.018498 25955 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.003s
W20260709 13:12:01.019598 26130 consensus_meta.cc:287] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:12:00.981706 26230 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.020736 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:01.007694 26286 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.021456 26312 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.022096 21470 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:01.023509 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:00.954412 26138 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.057548 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 798) took 1160 ms. Trace:
I20260709 13:12:01.058125 26138 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:00.960448 26174 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.060658 26174 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:00.984587 26313 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:01.030437 26047 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:12:01.062682 26276 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.049331 26286 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:01.059726 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:01.006084 26150 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.034489 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:01.037900 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.067672 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:01.034612 21314 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:01.039023 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:01.040234 21463 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:01.041016 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.042462 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:01.070436 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:01.070894 21465 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:01.042830 26202 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:01.050055 21320 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:01.002954 26322 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:12:00.981137 26291 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:12:01.052241 26303 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.364s	user 0.003s	sys 0.000s
I20260709 13:12:01.058514 26230 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.057991 21388 rpcz_store.cc:276] 0709 13:11:59.896707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.896838 (+   131us) service_pool.cc:224] Handling call
0709 13:12:01.057214 (+1160376us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54000f19d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:01.057456 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569010560}
I20260709 13:12:01.033776 21464 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:12:01.069633 21312 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:01.074239 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:01.069178 21316 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:01.079560 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.080893 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:01.083612 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:01.084239 21316 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:01.083968 21317 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:12:01.088228 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:01.088850 21464 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:01.088974 21315 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:01.047844 25955 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.092438 21468 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:01.093886 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:01.098039 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:01.086542 26312 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:01.107637 21313 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:01.108650 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 239969us
I20260709 13:12:01.118057 25723 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.120164 21312 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:01.120268 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.120688 21312 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:01.121570 21312 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.121949 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:01.122506 21312 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:01.130280 21313 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:01.132054 21389 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:01.123306 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.135075 22034 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:01.134931 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:01.140235 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.141736 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:01.150216 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:01.126751 26295 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.547s	user 0.000s	sys 0.002s
W20260709 13:12:01.129668 25990 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.511s	user 0.003s	sys 0.007s
I20260709 13:12:01.153959 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:01.106276 26314 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:12:01.158800 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:01.159053 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61209.5us
I20260709 13:12:01.159411 22042 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:01.125211 25955 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.124747 26301 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:01.124456 26312 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:01.155902 22031 raft_consensus.cc:2393] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:01.126363 26150 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.157804 22035 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:01.138813 26104 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:01.162947 21315 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:12:01.152202 26305 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:01.183879 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:01.144222 26094 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:01.154621 26274 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:01.122675 26059 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.111399 26279 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:12:01.139822 26254 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.148218 25723 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.194216 21321 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:12:01.187485 26301 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:01.223721 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 60810.5us
I20260709 13:12:01.183416 26230 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:12:01.197610 26305 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.188627 26330 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:01.183212 26307 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:12:01.204545 26274 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.230490 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.230790 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.231158 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.239374 21469 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:12:01.240578 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.242656 26318 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:01.243211 26089 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.244611 21318 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:01.205955 26094 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.241189 21463 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:01.229081 26301 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:01.186841 26286 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.199769 26306 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:01.228933 26047 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:01.236690 26305 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:01.239499 26330 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:01.236334 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48455.4us
I20260709 13:12:01.204538 26225 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:01.241652 26274 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:01.232483 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:01.207836 25986 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:12:01.201196 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.246794 26094 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.235847 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:01.268342 26202 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:01.268810 26202 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:01.237845 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.265561 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.269209 26202 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:01.270462 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 69360.4us
I20260709 13:12:01.271813 26138 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:01.272945 26335 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:12:01.273936 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.275754 21396 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:12:01.289983 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.292567 26332 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:01.287137 21470 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:01.295403 26331 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:01.296139 26225 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:01.297537 26328 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:12:01.299993 26333 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:12:01.309268 26286 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:01.264276 26330 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:01.316602 21312 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:12:01.317078 21312 pending_rounds.cc:85] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 7
I20260709 13:12:01.318507 21312 pending_rounds.cc:107] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:12:01.320379 21312 raft_consensus.cc:2889] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:01.318092 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.331779 21391 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:01.333698 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.334117 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:01.334839 21469 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:01.335028 21464 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:12:01.340929 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67102.5us
I20260709 13:12:01.341792 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:01.349531 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 117152us
I20260709 13:12:01.352157 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.352566 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:01.353205 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:01.353792 21465 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:01.353820 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:01.354702 21387 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:01.356007 21391 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:01.356424 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:01.356987 21394 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:01.357740 21391 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:01.358700 22002 leader_election.cc:400] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:01.359699 22002 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:01.361152 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:01.361775 21388 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:01.365854 21461 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:01.366179 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:01.344384 26094 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.371201 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:01.371781 21392 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:01.373405 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:01.378695 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.362133 26307 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.380764 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:01.367340 26138 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:01.370834 26230 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:01.393859 21465 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:01.376796 26323 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:01.386343 25986 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.382297 26094 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.407136 26094 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.377283 25688 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:01.414156 26200 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:01.396273 26326 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:01.415386 26326 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:01.383318 25822 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:01.433375 21394 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:01.427776 21387 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:01.436976 21321 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:12:01.399098 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:01.440274 21320 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:01.415908 26326 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:01.435818 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47197.1us
I20260709 13:12:01.393795 26059 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.450706 26103 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:12:01.456941 21469 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:01.470659 21392 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:12:01.480688 21321 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:01.429769 26307 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:01.474740 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:01.496696 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.429169 25822 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:01.488615 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.606508 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:01.400307 26138 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.658849 26150 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:01.610322 26094 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:01.713965 26346 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:12:01.721073 26343 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:12:01.614354 25822 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:01.729938 26202 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.736366 26138 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.482923 26301 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.748109 26301 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.761196 26305 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.726845 26330 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.776305 26330 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:01.781934 26202 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:01.782866 26274 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.828441 26301 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:01.853454 26301 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.833900 26150 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:01.856366 26150 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.858731 26150 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.859875 26301 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.861425 21312 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:01.865159 26274 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.839918 26305 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:01.882436 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 393902us
W20260709 13:12:01.897434 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 287695us
I20260709 13:12:01.898375 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.888746 21320 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:01.892870 26307 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:01.896389 26094 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:01.897179 22002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.023s	sys 0.092s
W20260709 13:12:01.902246 22002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.024s	sys 0.092s
W20260709 13:12:01.902858 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 524247us
I20260709 13:12:01.903573 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:01.910135 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 420904us
I20260709 13:12:01.909777 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:01.914040 21469 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:01.916827 21469 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:01.917068 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.901495 26274 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:01.903141 26301 raft_consensus.cc:2764] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:12:01.920490 26274 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.909119 25915 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:01.921267 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1835) took 1349 ms. Trace:
I20260709 13:12:01.921675 21393 rpcz_store.cc:276] 0709 13:12:00.571435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.571551 (+   116us) service_pool.cc:224] Handling call
0709 13:12:01.921078 (+1349527us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54001c3754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:01.921213 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261532032}
I20260709 13:12:01.922736 26274 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.911940 26150 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:12:01.924043 26150 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:01.924407 26150 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:01.799644 25822 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.903959 25986 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.926960 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:01.926213 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.931216 25723 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.912114 26170 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.931761 25723 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.930227 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:01.930347 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:01.933943 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:01.931985 26170 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.899478 26348 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:12:01.928931 26301 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:01.910677 26286 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:12:01.938799 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:01.930645 26305 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:01.897102 26326 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.925207 26150 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.927806 26230 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:01.929188 26323 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:01.948632 25723 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.950718 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.935276 26274 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:12:01.958494 26202 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:01.953387 26170 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.954754 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.956182 26324 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:12:01.936393 26314 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.982729 26314 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:01.985924 26314 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.936107 26094 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:01.921643 25915 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.968719 21468 raft_consensus.cc:2410] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:12:01.952595 25822 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:01.958079 26301 raft_consensus.cc:2764] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:01.958324 26103 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:01.935570 25986 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:01.988910 26351 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:12:01.989055 25915 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.991930 26103 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:01.992972 26103 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:01.996701 25986 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:01.998622 26336 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.756s	user 0.004s	sys 0.000s
I20260709 13:12:01.987483 26094 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:02.003147 26094 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.005406 26094 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:01.970883 26115 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:01.969520 26307 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.009473 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:02.017841 26150 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:02.025244 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:02.025542 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.968330 26230 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:02.038101 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2633) took 1736 ms. Trace:
I20260709 13:12:02.036242 26230 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:01.968298 26306 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.046990 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:02.047765 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:01.969436 26323 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.043697 21467 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:02.048022 21462 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:02.038671 21319 rpcz_store.cc:276] 0709 13:12:00.301343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.301454 (+   111us) service_pool.cc:224] Handling call
0709 13:12:00.324745 (+ 23291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.678801 (+354056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.037801 (+1359000us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400228654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:02.038012 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812848896}
I20260709 13:12:01.972122 26202 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:02.056578 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.056811 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.057591 21461 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:02.067476 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:02.053190 26323 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:02.062542 26202 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:02.068013 26314 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.055135 25723 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:12:02.054605 25915 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:12:02.099700 26314 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.102344 26095 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:02.055179 26306 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.109946 26291 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:12:02.114735 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.146471 21395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.001s	sys 0.022s
W20260709 13:12:02.146854 21395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.001s	sys 0.022s
I20260709 13:12:02.147826 26314 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:02.149180 26353 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:02.162451 26276 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.163717 26326 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.118870 26104 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.119736 26291 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:02.195637 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1844) took 1451 ms. Trace:
I20260709 13:12:02.196228 21396 rpcz_store.cc:276] 0709 13:12:00.744014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.744187 (+   173us) service_pool.cc:224] Handling call
0709 13:12:02.195389 (+1451202us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b540020e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:02.195555 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929768832}
I20260709 13:12:02.159584 26230 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.175925 26314 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:02.176290 26276 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:02.254019 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.314738 22036 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:02.198633 26104 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.249050 25915 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:02.248090 26314 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.354673 26305 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.324232 26276 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.371196 26095 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.437328 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:02.447676 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 513767us
I20260709 13:12:02.450026 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:02.451817 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 405916us
I20260709 13:12:02.370223 25915 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.418190 26179 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.416520 26047 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:02.457486 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.461194 22035 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:02.354626 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 442629us
I20260709 13:12:02.463478 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:02.355859 26291 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.453073 26274 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:02.490239 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:02.494203 21321 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:02.457610 26094 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:02.494139 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.506896 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:02.511018 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.438845 26095 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.517146 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:02.517793 21312 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:02.517948 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:02.518679 21314 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:02.521196 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:02.522881 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.492100 26274 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.454229 26305 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.533960 26357 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:02.534482 25915 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:02.470785 26179 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.538020 26179 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.538602 26323 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.539804 22032 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:02.540215 21313 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:12:02.540798 26323 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:02.541165 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.542632 26095 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:02.496273 26306 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.544375 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:02.547433 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:02.478310 26047 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.561357 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 812) took 1233 ms. Trace:
I20260709 13:12:02.568570 21313 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:02.570365 21312 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:02.529719 26274 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:02.575484 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:02.577093 26047 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:02.578220 26356 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:02.579078 26150 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.005s
I20260709 13:12:02.612691 21463 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:12:02.614464 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.615653 21468 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:02.569067 21395 rpcz_store.cc:276] 0709 13:12:01.328211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.328370 (+   159us) service_pool.cc:224] Handling call
0709 13:12:01.328707 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.358369 (+ 29662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.358392 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.376174 (+ 17782us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.147201 (+771027us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:02.147241 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.147318 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.561083 (+413765us) raft_consensus.cc:1685] finished
0709 13:12:02.561111 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.561281 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3899,"raft.queue_time_us":24626,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":10918,"thread_start_us":748276,"threads_started":1,"wal-append.queue_time_us":991605}
I20260709 13:12:02.561292 26306 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:02.584491 26104 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.617951 21321 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:12:02.579331 26321 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:02.593355 26350 log.cc:927] Time spent T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.699s	user 0.000s	sys 0.006s
W20260709 13:12:02.592712 26355 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:12:02.597288 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:02.638105 21317 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:02.560563 26329 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:12:02.606307 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:02.609270 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.614462 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:02.620652 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2648) took 1571 ms. Trace:
I20260709 13:12:02.571624 26230 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:02.593421 22002 connection.cc:256] RPC call timeout handler was delayed by -1.0658366619999242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
I20260709 13:12:02.634459 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:02.600275 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.031s	sys 0.071s
I20260709 13:12:02.653784 22040 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:02.648609 21315 rpcz_store.cc:276] 0709 13:12:01.049420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.204990 (+155570us) service_pool.cc:224] Handling call
0709 13:12:01.205397 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.233983 (+ 28586us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:01.234198 (+   215us) log.cc:844] Serialized 14 byte log entry
0709 13:12:01.237668 (+  3470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:01.237715 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:01.237752 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.620431 (+1382679us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b540021a7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:02.620480 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.620599 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3259,"prepare.queue_time_us":20248,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":3594,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":3818,"spinlock_wait_cycles":65261952}
W20260709 13:12:02.657080 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.032s	sys 0.072s
I20260709 13:12:02.647876 22039 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:02.659932 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:02.662477 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 732139us
I20260709 13:12:02.665238 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:02.663398 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:02.667670 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.669242 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.670531 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.671799 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.672521 22039 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:12:02.673535 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.673930 26305 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.674818 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:02.653496 26356 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:02.677326 26356 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.639221 26306 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.700184 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.720325 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.721453 21312 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:02.724126 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:02.724891 22034 raft_consensus.cc:2368] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14.
W20260709 13:12:02.717437 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57596.6us
I20260709 13:12:02.723035 21314 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:02.730952 26095 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:02.731561 26095 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:02.732594 26095 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.733220 26103 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:02.733835 26103 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.734477 26150 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:02.735016 26150 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.735967 26103 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:02.739106 26291 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:02.739394 26103 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:02.741392 21284 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:02.742511 26305 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:02.746611 21284 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:02.748127 26305 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:02.748226 26278 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.748541 26305 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.748989 26305 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.749284 26329 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:02.748953 26278 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:02.750442 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.749706 26329 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:02.737135 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:02.752488 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:02.754148 26230 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:02.756606 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:02.757426 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.758186 21315 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:02.758306 26329 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.759109 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.759708 21315 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:02.700521 26047 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:02.760330 26047 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.761679 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.762382 26047 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:02.762712 21313 raft_consensus.cc:2410] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:12:02.754850 26276 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:02.606841 26364 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.119s
W20260709 13:12:02.751492 26350 log.cc:927] Time spent T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:12:02.736838 26326 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.738740 26361 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:12:02.765154 26361 consensus_queue.cc:1243] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:12:02.765080 26326 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.765431 26301 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:02.766013 26301 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:02.717542 26202 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.005s
I20260709 13:12:02.766772 26202 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.767269 26326 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.768396 26020 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:02.768927 26202 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:02.769668 22038 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:02.769086 26020 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.770102 26225 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:02.770646 26225 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:02.772320 26230 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:02.757627 26278 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.754179 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:02.763801 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.767079 26301 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.780442 21313 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:02.760360 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.783174 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:02.773314 26230 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.785207 21317 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:02.785087 21284 leader_election.cc:400] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14.
I20260709 13:12:02.787915 21284 leader_election.cc:403] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:12:02.795807 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44163.4us
I20260709 13:12:02.802145 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.803546 21394 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:02.799703 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:02.809875 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:02.785965 26321 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:02.788403 26329 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:02.771898 26020 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:02.784790 26312 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:02.815371 26309 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.817970 26306 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:02.782846 26361 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.821635 21396 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:02.788223 26286 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:12:02.823428 22038 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:02.798357 26276 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:02.826742 25723 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:02.826887 26321 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.771564 26225 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:02.856447 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 319462us
I20260709 13:12:02.804059 26087 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:12:02.832376 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:02.860692 21392 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:02.804265 26364 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:02.837951 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:02.812223 26301 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:02.826817 26367 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:12:02.841987 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.827467 26104 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.844135 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:02.821578 21317 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:12:02.846632 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:02.847008 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.848157 26369 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.851948 21312 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:02.870743 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.804140 25688 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:02.853305 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.809928 26317 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:12:02.857674 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:02.859591 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:02.865417 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:02.866858 21467 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:02.881569 21467 pending_rounds.cc:85] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 11
I20260709 13:12:02.881855 21467 pending_rounds.cc:107] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:12:02.882069 21467 raft_consensus.cc:2889] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:02.847821 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.882187 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:02.853852 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:02.849015 26276 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:02.873023 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.873167 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.850633 25723 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.892608 21469 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:02.873955 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:02.852269 26094 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:02.908262 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:02.905628 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:02.883280 21396 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:02.884606 21392 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:02.909291 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.903465 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:02.904340 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:02.870622 26330 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:02.856597 26321 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:02.918543 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:02.874011 25688 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.841516 26309 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.850582 26361 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.887239 26278 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:02.904624 25723 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:02.933451 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:02.872905 26312 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:02.873512 26104 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:02.969923 21312 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:02.973459 21396 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:02.915688 26103 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:02.903142 26362 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:02.920148 26200 raft_consensus.cc:2764] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:02.920572 26330 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:02.945616 25688 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:03.004149 22034 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:03.006613 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.007927 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:02.935016 25915 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:03.023059 21393 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:02.949077 26278 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:02.886042 26369 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:02.949481 26314 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:02.971495 26150 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.048076 21312 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:03.035816 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.063973 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:03.075333 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.028604 26087 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:03.138708 26325 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:03.139578 26325 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.142315 26325 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:03.143344 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79489.6us
I20260709 13:12:03.145224 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:03.147265 26326 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:03.149084 26326 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:03.150476 26326 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:03.151060 26326 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:03.152235 26047 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:03.152781 26047 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:03.153785 26047 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.155480 26047 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:03.164757 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.998108 26312 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.050042 26314 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:03.028657 25915 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.089121 26306 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.045789 26287 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:03.201130 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.086627 26323 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:03.207479 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:03.223354 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.223387 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.233615 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.243458 21389 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:03.247174 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:03.236606 26307 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.026s	sys 0.043s
I20260709 13:12:03.225721 26087 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:03.049479 26094 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.250041 21394 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:03.254361 21393 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:03.217195 26323 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:03.249123 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:03.252359 22036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.015s
I20260709 13:12:03.264746 21396 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:03.267391 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:03.274668 22036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.007s	sys 0.015s
I20260709 13:12:03.253706 26103 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:03.269287 21390 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:12:03.249723 26325 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.256562 26307 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.026s	sys 0.043s
I20260709 13:12:03.257973 26059 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.256716 26170 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.267601 26372 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.276638 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.217759 26306 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.288865 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:03.277210 21321 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:03.305027 26362 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:03.237514 26287 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.313331 26362 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:03.281720 26371 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
W20260709 13:12:03.305917 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 332902us
W20260709 13:12:03.306900 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 402645us
I20260709 13:12:03.199216 26326 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:03.299690 26274 consensus_meta.cc:287] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.002s
W20260709 13:12:03.273967 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 334866us
I20260709 13:12:03.314469 26287 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.277887 26323 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:03.316054 21317 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:03.317994 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:03.313444 21321 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:03.300225 21389 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:03.339125 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:03.237862 26330 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.285362 26314 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:03.275372 26087 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.354496 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:03.358568 21468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.003s	sys 0.032s
W20260709 13:12:03.362778 21468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.004s	sys 0.033s
I20260709 13:12:03.339897 26104 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.305601 26059 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.374634 26179 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.305881 26170 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.306173 26325 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:03.388787 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 501336us
I20260709 13:12:03.394587 21390 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:03.395756 21396 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:12:03.307071 26372 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.400230 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:03.418609 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:03.420756 26386 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:12:03.422915 26291 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
W20260709 13:12:03.423698 26378 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
W20260709 13:12:03.425493 26385 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:12:03.430619 26202 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.431228 26202 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.433403 26059 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:03.436323 26095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.006s	sys 0.005s
W20260709 13:12:03.443186 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 158432us
I20260709 13:12:03.367823 26361 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.450589 26372 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.350431 26274 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.416280 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.483520 21393 raft_consensus.cc:2368] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16.
I20260709 13:12:03.439921 21312 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:03.451838 21392 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:03.403365 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:03.452627 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:03.487568 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 84327.4us
I20260709 13:12:03.488494 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:03.366122 26314 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:03.439287 26095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.006s	sys 0.006s
I20260709 13:12:03.493368 21390 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:03.408309 26373 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.506685 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.508482 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.509353 21312 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:12:03.511091 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 252366us
I20260709 13:12:03.517067 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.518002 21393 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:03.519106 21393 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:03.521343 21393 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:03.503118 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.504673 26363 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:03.535297 21319 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:03.434005 26202 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.538662 21318 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:03.532836 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.393427 26179 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.575675 22035 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:03.576683 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:03.576320 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.452217 26312 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.494781 26150 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:03.602639 21392 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
W20260709 13:12:03.589604 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44280.5us
I20260709 13:12:03.598778 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:03.673674 21313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.010s	sys 0.005s
W20260709 13:12:03.674343 21313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.010s	sys 0.006s
W20260709 13:12:03.646657 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 329284us
I20260709 13:12:03.704658 22034 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:03.708943 22031 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:03.397743 26103 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.538144 25915 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.494542 25723 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.726027 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.494622 26381 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.158s
I20260709 13:12:03.645939 26374 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.743108 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.505997 26361 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.190s
I20260709 13:12:03.758582 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:03.689175 26403 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:03.647284 26356 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.633992 26291 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:03.746937 21315 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:03.542302 26363 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:03.748363 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:03.751829 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.752671 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.762651 26361 consensus_queue.cc:1243] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:12:03.769006 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 427022us
I20260709 13:12:03.726588 26307 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:03.719442 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:03.804952 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:03.805346 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 85983.8us
I20260709 13:12:03.776985 21318 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:03.778698 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.807253 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:03.778893 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:03.751135 26391 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 13:12:03.750794 26305 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.001s	user 0.011s	sys 0.003s
W20260709 13:12:03.787469 26399 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:03.546366 26373 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.825613 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 655) took 1170 ms. Trace:
I20260709 13:12:03.722651 21389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:03.826731 21389 raft_consensus.cc:606] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:03.827354 21389 raft_consensus.cc:614] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:03.826233 22036 rpcz_store.cc:276] 0709 13:12:02.654992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.655413 (+   421us) service_pool.cc:224] Handling call
0709 13:12:02.655853 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.656498 (+   645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.656532 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.657079 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.275107 (+618028us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:03.275148 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.275212 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.825281 (+550069us) raft_consensus.cc:1685] finished
0709 13:12:03.825312 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.825527 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25527,"raft.queue_time_us":22895,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8892,"thread_start_us":526789,"threads_started":1,"wal-append.queue_time_us":927605}
I20260709 13:12:03.837275 26422 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:03.838603 26306 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.838873 26422 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:03.808254 21466 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:03.761484 26369 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.762909 26287 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:12:03.817978 26400 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:03.820199 26305 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.814133 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:03.742313 26230 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:12:03.815826 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:03.850752 26276 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.852020 26170 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.852267 26286 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:03.853402 26179 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.804572 26307 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:03.856806 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.791146 26291 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.876735 26286 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:03.886950 26291 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.887073 26314 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:03.887444 26392 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:12:03.888587 21393 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:03.889958 26276 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:03.891146 26358 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:03.891554 26358 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:03.892395 26358 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:03.893360 26301 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.000s
I20260709 13:12:03.893424 26358 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:03.771149 26374 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.895249 21312 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
W20260709 13:12:03.895906 26398 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.476s	user 0.001s	sys 0.001s
I20260709 13:12:03.887485 26286 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.898298 26286 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:03.899060 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.899487 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.901301 26301 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.901937 26301 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.869310 26400 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:03.902858 26330 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:03.903128 26400 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:03.904639 26406 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:03.905304 26406 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:03.906490 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.906229 26406 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.908181 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2668) took 1310 ms. Trace:
I20260709 13:12:03.908602 21313 rpcz_store.cc:276] 0709 13:12:02.597892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.805901 (+208009us) service_pool.cc:224] Handling call
0709 13:12:02.808730 (+  2829us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:02.823604 (+ 14874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.823650 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:02.852548 (+ 28898us) log.cc:844] Serialized 52 byte log entry
0709 13:12:03.713154 (+860606us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:03.713206 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.713287 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.907929 (+194642us) raft_consensus.cc:1685] finished
0709 13:12:03.907950 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.908124 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32833,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11333,"thread_start_us":796186,"threads_started":1,"wal-append.queue_time_us":1043105}
I20260709 13:12:03.808190 26363 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:03.851815 26321 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.002s
I20260709 13:12:03.912792 26321 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:03.902468 26329 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.071s	user 0.005s	sys 0.007s
I20260709 13:12:03.904765 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 827) took 1117 ms. Trace:
I20260709 13:12:03.916337 21470 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:03.915997 21395 rpcz_store.cc:276] 0709 13:12:02.787488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.787615 (+   127us) service_pool.cc:224] Handling call
0709 13:12:02.787897 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.793823 (+  5926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.793852 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.828736 (+ 34884us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.873533 (+ 44797us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b48000b22d8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:12:03.245675 (+372142us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:03.245758 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.250483 (+  4725us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.904463 (+653980us) raft_consensus.cc:1685] finished
0709 13:12:03.904483 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.904707 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9536,"raft.queue_time_us":6017,"raft.run_cpu_time_us":1538,"raft.run_wall_time_us":79368,"spinlock_wait_cycles":9253760,"thread_start_us":384634,"threads_started":1,"wal-append.queue_time_us":1059257}
I20260709 13:12:03.918449 26321 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:03.803444 26404 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:12:03.924613 21391 raft_consensus.cc:1217] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Deduplicated request from leader. Original: 11.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:12:03.924856 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 715) took 1433 ms. Trace:
I20260709 13:12:03.925012 26274 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.925221 21320 rpcz_store.cc:276] 0709 13:12:02.491469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.491600 (+   131us) service_pool.cc:224] Handling call
0709 13:12:02.519071 (+ 27471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.875296 (+356225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.875323 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.888156 (+ 12833us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.258705 (+370549us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:03.406720 (+148015us) log.cc:844] Serialized 14 byte log entry
0709 13:12:03.409126 (+  2406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.409324 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.924649 (+515325us) raft_consensus.cc:1685] finished
0709 13:12:03.924672 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.924790 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14738,"prepare.queue_time_us":80988,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":142145,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":8678,"thread_start_us":718839,"threads_started":3,"wal-append.queue_time_us":511732}
I20260709 13:12:03.795279 26356 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.927860 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:03.928771 26307 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.929642 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.920495 21394 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:03.931356 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.931627 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:03.934372 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 118654us
I20260709 13:12:03.934716 26179 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:03.935096 26179 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:03.936204 21465 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:03.936738 26170 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:03.937642 26279 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:03.937914 26170 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:03.939191 26314 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.940088 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.939656 26314 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.940742 21321 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:03.941817 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.942265 26314 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.942387 21321 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:03.943313 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:03.943902 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.944376 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.945487 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.945886 26087 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.922070 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.947765 21396 raft_consensus.cc:2368] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:12:03.924865 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2665) took 1352 ms. Trace:
I20260709 13:12:03.948801 21315 rpcz_store.cc:276] 0709 13:12:02.572682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.774838 (+202156us) service_pool.cc:224] Handling call
0709 13:12:02.799819 (+ 24981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.794441 (+994622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.924619 (+130178us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54000fc154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:03.924801 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177696512}
I20260709 13:12:03.925187 21391 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:12:03.940088 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.951375 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.951747 26087 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.906981 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.951941 26279 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:03.952313 26087 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.921420 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 728) took 1084 ms. Trace:
W20260709 13:12:03.944527 26389 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.560s	user 0.002s	sys 0.001s
I20260709 13:12:03.953905 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.954430 26087 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.954578 21466 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:03.955228 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 712) took 1467 ms. Trace:
I20260709 13:12:03.955300 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 826) took 1171 ms. Trace:
I20260709 13:12:03.956125 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:03.956866 21465 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:03.957352 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 734) took 1101 ms. Trace:
I20260709 13:12:03.955850 21387 rpcz_store.cc:276] 0709 13:12:02.783519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.783762 (+   243us) service_pool.cc:224] Handling call
0709 13:12:02.784255 (+   493us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:02.793002 (+  8747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.793054 (+    52us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:12:02.811861 (+ 18807us) log.cc:844] Serialized 78 byte log entry
0709 13:12:03.210727 (+398866us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:03.210784 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.210876 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.943900 (+733024us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:03.954944 (+ 11044us) raft_consensus.cc:1685] finished
0709 13:12:03.954964 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.955242 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9004,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":15794,"spinlock_wait_cycles":84055296,"thread_start_us":357945,"threads_started":1,"wal-append.queue_time_us":504621}
I20260709 13:12:03.957701 21470 rpcz_store.cc:276] 0709 13:12:02.856374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.856507 (+   133us) service_pool.cc:224] Handling call
0709 13:12:03.957145 (+1100638us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004303d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:03.957296 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2366587136}
I20260709 13:12:03.958921 21469 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:03.953513 21468 rpcz_store.cc:276] 0709 13:12:02.837024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.837158 (+   134us) service_pool.cc:224] Handling call
0709 13:12:02.837496 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.837837 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.837864 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.838351 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.363330 (+524979us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:03.363381 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.363478 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.921185 (+557707us) raft_consensus.cc:1685] finished
0709 13:12:03.921209 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.921334 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5384,"raft.queue_time_us":712,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":8776,"thread_start_us":515345,"threads_started":1,"wal-append.queue_time_us":1071383}
I20260709 13:12:03.960666 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.961356 21388 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:03.961861 25723 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:03.962436 26278 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.963730 26278 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:03.965296 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:03.967881 26202 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:03.968641 26202 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.969573 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.970286 21315 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:03.970781 26202 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:03.935865 26179 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:03.973043 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2658) took 1329 ms. Trace:
I20260709 13:12:03.973536 26373 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:03.976462 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.944543 26369 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.978188 21388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85584105b0f74652871311c68f5de4db"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:03.933295 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:03.969676 26301 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:03.875672 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 124935us
I20260709 13:12:03.956490 26309 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:03.933363 26387 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.612s	user 0.004s	sys 0.008s
I20260709 13:12:03.955780 21319 rpcz_store.cc:276] 0709 13:12:02.488306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.488450 (+   144us) service_pool.cc:224] Handling call
0709 13:12:03.955035 (+1466585us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540015ccd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:03.955155 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352904576}
I20260709 13:12:03.845798 26225 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:03.857151 26325 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:03.981865 26364 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.116s	user 0.008s	sys 0.004s
I20260709 13:12:03.801072 26403 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:03.982237 26395 raft_consensus.cc:2764] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:03.982455 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:03.884975 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 70949.3us
I20260709 13:12:03.929827 26307 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:04.060461 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.063409 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:03.987764 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.988229 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:03.943794 21321 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:12:04.002871 21465 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:04.066764 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.067971 21390 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:04.067824 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.068708 21465 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:12:04.069818 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:04.003562 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 237977us
I20260709 13:12:04.004787 21392 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:04.057224 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:04.061966 21469 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:04.078087 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:04.061219 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:03.986337 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:04.008250 21314 rpcz_store.cc:276] 0709 13:12:02.643944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.866075 (+222131us) service_pool.cc:224] Handling call
0709 13:12:02.866399 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.867426 (+  1027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.867469 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.868068 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.279977 (+411909us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:03.280055 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.280146 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.895300 (+615154us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:03.972635 (+ 77335us) raft_consensus.cc:1685] finished
0709 13:12:03.972659 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.972976 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":569,"raft.queue_time_us":1493,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7064,"spinlock_wait_cycles":50632576,"thread_start_us":354510,"threads_started":1,"wal-append.queue_time_us":515852}
I20260709 13:12:04.016251 25723 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.080545 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 94325.3us
I20260709 13:12:04.080756 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:04.081633 21314 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:12:04.016508 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:04.013480 21312 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:04.027323 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.028980 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.031764 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:04.082873 21393 raft_consensus.cc:2368] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14.
W20260709 13:12:04.083458 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67087.9us
I20260709 13:12:03.982940 26356 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:04.092396 26384 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.005s	sys 0.041s
I20260709 13:12:04.051642 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.093076 22035 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
W20260709 13:12:04.052165 26323 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
W20260709 13:12:04.052361 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.056783 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:04.028713 26396 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:04.096828 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.086527 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:04.097592 21465 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:04.097672 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:04.098300 21319 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:04.084741 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:04.099238 22042 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.082424 22036 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:04.094652 21394 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:04.097010 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.100019 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:04.100930 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:04.101346 21390 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:04.033435 26179 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:04.089655 21467 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:04.055415 26291 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.104542 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:04.108861 21470 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:04.106429 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.107074 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.057361 26364 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14.
W20260709 13:12:04.096449 26384 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.005s	sys 0.041s
I20260709 13:12:04.088195 26225 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:04.115027 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:04.022770 26369 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.115417 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:04.128113 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.101845 26150 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:04.127938 21466 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:04.143138 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.111442 26425 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.199s	user 0.003s	sys 0.001s
I20260709 13:12:04.096751 26396 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:04.114678 26170 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:12:04.148260 21469 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:04.151309 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:04.105973 26309 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:04.161231 26087 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:04.112134 26200 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:04.112072 26279 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:04.109656 26362 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:04.178972 26095 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:04.179244 26279 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.179672 26279 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.179425 26362 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.179574 26095 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.181651 26362 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:04.181874 26095 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:04.183917 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.187404 21319 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:04.159981 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:04.098892 25723 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.189544 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:04.189759 25723 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.115129 26395 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:04.165655 21321 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:04.191044 26395 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:04.172299 21394 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:04.109562 26426 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:04.174356 21315 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:04.176090 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:04.145964 25688 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.118s	user 0.015s	sys 0.000s
I20260709 13:12:04.178656 26087 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.195992 21317 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:04.105692 26323 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.197853 21395 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:04.198342 21470 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:04.198851 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.202482 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:04.203372 22034 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:04.203441 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.161836 26274 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:04.204250 22031 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:04.178753 26200 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.206387 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:04.191515 26395 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:04.210004 21315 pending_rounds.cc:85] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 9
I20260709 13:12:04.209299 22038 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:04.217382 21315 pending_rounds.cc:107] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:12:04.217814 21315 raft_consensus.cc:2889] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:04.207070 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:04.214570 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.219587 22035 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:04.219861 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.222012 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.198596 26426 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.200898 26087 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:04.226411 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.162443 26364 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:12:04.250243 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 87892.4us
W20260709 13:12:04.274048 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.274982 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.250350 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:04.200503 26362 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:04.208951 26358 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.212687 26200 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:04.276084 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 69063.3us
I20260709 13:12:04.276330 21319 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.221014 26274 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:04.200222 25688 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:04.287256 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.274811 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:04.266922 26385 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:04.213564 26095 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:04.290179 22034 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:04.292441 21394 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:04.293596 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:04.233775 26426 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:04.301808 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.252183 26424 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:04.307011 21321 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:04.312011 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.312894 21321 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:04.314016 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:04.314790 21321 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:04.320768 26403 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:04.336947 26274 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.308694 26103 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:12:04.285205 26396 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.341531 26396 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.303552 26409 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:04.344319 26409 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.344726 26409 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.351404 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:04.352151 26405 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:12:04.310556 26202 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:04.354202 26301 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:04.355105 26301 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:04.356789 25688 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:04.253648 26225 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.357522 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 717) took 1865 ms. Trace:
I20260709 13:12:04.292232 26358 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.325785 26372 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:04.360723 26372 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:04.361949 26372 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:04.362450 26323 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:04.364574 26435 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:12:04.366178 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.367365 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.340144 26444 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:04.369704 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:04.369871 26444 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.370376 21313 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:04.371654 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:04.373039 26314 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.373355 25915 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:04.369959 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:04.374555 21317 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:04.379803 21314 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:12:04.384626 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:04.386162 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.387137 21464 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:04.391219 21433 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:04.391463 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:04.394754 21464 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:04.358086 21316 rpcz_store.cc:276] 0709 13:12:02.492271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.492384 (+   113us) service_pool.cc:224] Handling call
0709 13:12:02.492693 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.836872 (+344179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.836901 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.847830 (+ 10929us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.252125 (+404295us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:03.271588 (+ 19463us) log.cc:844] Serialized 14 byte log entry
0709 13:12:03.282847 (+ 11259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.282950 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.830793 (+547843us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b1800287680. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:04.356213 (+525420us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b2400135d58. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc169fb0 00007fc2bede0488 00007fc2bede0be8 00007fc2bedb8398 00007fc2bedb376a 00007fc2bedb2bb6
0709 13:12:04.357159 (+   946us) raft_consensus.cc:1685] finished
0709 13:12:04.357193 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.357443 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10985,"prepare.queue_time_us":19470,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":126310,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":52502,"spinlock_wait_cycles":129600640,"thread_start_us":745112,"threads_started":2,"wal-append.queue_time_us":840253}
W20260709 13:12:04.320816 26437 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:12:04.408103 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.404314 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 154085us
I20260709 13:12:04.411067 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:04.411871 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:04.413396 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:04.414225 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.420439 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.425077 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:04.373553 26314 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.428902 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:04.430230 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:04.408552 26278 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:04.439422 21395 raft_consensus.cc:2368] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14.
I20260709 13:12:04.439153 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.424598 26179 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:04.331732 26363 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:04.447800 26402 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.452200 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.421142 26374 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.443588 26325 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:04.442694 25688 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:04.443099 26278 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:04.472213 22042 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
W20260709 13:12:04.472851 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.443100 26369 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.477728 21313 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:04.463693 21314 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:04.462222 21464 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:04.479130 21319 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:12:04.437155 26358 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.499449 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.498538 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.500262 22036 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:12:04.500875 21394 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:12:04.502846 21462 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:12:04.451313 25915 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.450863 26179 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.315936 26395 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.499651 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:04.519609 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.518195 25915 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:04.480862 26278 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:04.520988 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:04.525141 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:04.518662 26443 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:04.538246 26402 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:04.570822 22042 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:04.465919 26325 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.450381 26357 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:12:04.457244 26446 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:04.493121 26230 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:04.518965 26179 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.605309 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.574776 26321 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:04.603065 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:04.480571 25688 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.609284 21387 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.567377 26358 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:04.607082 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 183257us
I20260709 13:12:04.620019 25915 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:04.608770 26321 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.633141 26087 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.574324 26301 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:04.576879 26325 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:04.575585 26305 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.651230 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:04.651908 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 204540us
I20260709 13:12:04.656414 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.660081 21312 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:04.656595 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.658329 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.600940 26446 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.663173 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:04.665362 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:04.668491 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.670660 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.672803 21387 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:04.654278 26321 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.699909 26444 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.710778 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:04.679838 26400 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.007s
I20260709 13:12:04.731142 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.697510 26363 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:04.698419 26323 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:04.699295 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:04.734057 21319 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:04.659030 26358 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:04.675422 26446 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.677068 26402 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:04.702366 26279 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.007s
I20260709 13:12:04.694782 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:04.745468 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.746315 21395 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:04.733325 26431 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:04.750130 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 463596us
I20260709 13:12:04.751646 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:04.762045 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:04.753165 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 58466.9us
I20260709 13:12:04.771380 21395 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:04.772814 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.729573 26200 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:04.775609 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:04.786280 21391 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:04.776399 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:04.760984 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:04.784281 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:04.790138 21390 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:04.792652 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:04.798875 21470 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:04.737252 26400 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:04.802724 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 138285us
I20260709 13:12:04.803390 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:04.803565 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:04.803694 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:04.749624 26453 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:04.807425 21320 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:04.804250 21321 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:04.761698 26402 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.776799 26432 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:04.818514 21466 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:04.816905 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:04.749678 26422 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:12:04.824900 21388 raft_consensus.cc:606] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:04.825372 21388 raft_consensus.cc:614] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:04.829295 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:04.804507 26357 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.747613 26279 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:04.847085 21359 connection.cc:256] RPC call timeout handler was delayed by -2.3972088099999382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:12:04.850842 21359 connection.cc:256] RPC call timeout handler was delayed by -2.3553499649999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:12:04.852284 21359 connection.cc:256] RPC call timeout handler was delayed by -1.3195282310000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:12:04.817167 26314 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.802156 26362 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:12:04.776518 26431 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:04.887905 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 129076us
W20260709 13:12:04.890609 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.893105 21394 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:04.828184 26453 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:04.832702 26432 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:04.831034 26455 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:04.869850 26451 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:04.831094 26104 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:12:04.889463 25688 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.851622 26357 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.905480 25915 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.832600 26358 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:04.933314 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.933543 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:04.907397 26455 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:04.938912 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.913882 26087 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:04.918087 26286 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.918989 26150 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.916690 25688 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:04.984876 25688 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:04.991472 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:04.992641 21467 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:04.948503 26455 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:05.012473 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:04.995577 26452 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.004s
I20260709 13:12:04.914412 26451 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.016144 21466 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
W20260709 13:12:05.023845 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 90152us
I20260709 13:12:04.996001 26150 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:05.022578 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 135295us
I20260709 13:12:04.942507 25915 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.008108 26314 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:12:05.020023 26459 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 13:12:04.987278 26402 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:12:05.028330 26409 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.006s
I20260709 13:12:04.992367 26286 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.046993 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:05.047847 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 110035us
I20260709 13:12:05.052418 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.052790 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.017706 26460 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:12:05.032150 26314 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:05.057514 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.058239 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.031895 26200 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:05.034417 26400 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:05.059679 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.990664 26453 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.067353 21359 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.068796 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:04.990789 26432 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.073087 22035 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:05.073421 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.076543 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.037245 26225 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:12:05.041141 26104 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:12:05.080551 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.076064 26179 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:05.106776 26426 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.002s
I20260709 13:12:05.108124 26451 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:05.067873 26473 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:05.109385 25688 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:05.109668 26458 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:12:05.070036 26357 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:05.110405 26466 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:12:05.110566 26279 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.051448 26409 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:05.111207 26470 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:12:05.111266 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.112154 26468 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:05.128235 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.117203 26323 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:05.090132 26460 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:05.128435 26478 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:05.135521 26460 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:05.135701 26478 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:05.118136 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44849.4us
I20260709 13:12:05.121268 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:05.136643 26478 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.137840 26478 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:05.138407 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:05.123279 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:05.086086 26465 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:05.141395 26473 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.119192 26087 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:05.113178 26463 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:12:05.130862 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:05.129585 21467 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
W20260709 13:12:05.113247 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.133185 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:05.148012 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.131538 26307 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.043s	user 0.014s	sys 0.000s
I20260709 13:12:05.059556 26438 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:12:05.151355 26330 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:05.145012 21468 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:05.151928 26330 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.141104 26460 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.154119 26330 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.154281 26460 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.154630 26330 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:05.147142 26473 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:05.156174 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 395247us
I20260709 13:12:05.157395 26375 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.146013 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:05.158707 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 329487us
I20260709 13:12:05.159168 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:05.159498 21285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 2.160s (SENT) [suppressed 28 similar messages]
I20260709 13:12:05.160331 26475 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:05.161026 26475 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.161916 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.163188 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.164295 21316 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:12:05.164875 26373 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:05.165366 26179 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.165431 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.166128 21316 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:05.166266 26395 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.167196 21318 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:05.168336 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.128559 26431 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.168943 21319 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:05.169881 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.170589 21319 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:05.171036 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.171388 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.172206 26312 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.158067 26473 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.172701 25915 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.173540 21317 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:05.173965 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:05.174443 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.175164 26467 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:05.175562 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.176746 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.177729 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.178211 21314 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.174553 21468 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:05.179430 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.182636 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.182943 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.183795 21319 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:05.184973 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:05.186127 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.187141 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.120097 26426 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.188862 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.111228 26314 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.195720 21387 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:05.196213 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.198601 21396 raft_consensus.cc:2368] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 17.
I20260709 13:12:05.193279 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.165584 26373 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:05.199630 26373 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:05.199663 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.200017 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.200922 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.201442 21392 raft_consensus.cc:2376] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13. Re-sending same reply.
I20260709 13:12:05.202080 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.202230 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.202787 21392 raft_consensus.cc:2376] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14. Re-sending same reply.
I20260709 13:12:05.203553 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.201584 21285 leader_election.cc:400] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14.
I20260709 13:12:05.204463 26286 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:05.172206 26104 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:05.205754 26357 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:05.209275 26325 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.002s
I20260709 13:12:05.210155 26325 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.206569 26301 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:05.189812 26087 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:05.197176 26363 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.213493 26426 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:05.184661 26356 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:12:05.214654 26356 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:05.215009 26356 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:05.215097 26321 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.215886 26356 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.193728 26422 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:05.232640 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.233421 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.233986 21318 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:05.217085 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.217306 26317 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:05.215971 26357 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:05.200191 26373 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:05.224428 21393 raft_consensus.cc:2368] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:12:05.222002 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.228942 21314 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:05.220356 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.243376 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.235288 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.247371 21391 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:05.247323 26363 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:05.248986 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.249795 21392 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:05.251834 21469 raft_consensus.cc:2368] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:05.258391 26325 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.277117 26363 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:05.282735 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.232411 26422 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.293390 26422 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:05.295575 26278 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.717s	user 0.004s	sys 0.008s
I20260709 13:12:05.236322 26087 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:05.296161 26278 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.296569 26087 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.298998 26278 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.299487 26087 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.300432 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.301190 21314 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.218797 26455 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.305073 26455 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:05.306588 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.313241 21396 raft_consensus.cc:2368] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14.
I20260709 13:12:05.314724 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.188230 26179 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:12:05.327512 21314 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:05.322100 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.253439 26274 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.242125 26317 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:05.334780 21318 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
W20260709 13:12:05.329221 26446 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:12:05.325544 26356 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.336410 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.326395 26301 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:05.324329 26363 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.337414 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.327149 26467 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.335664 26312 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:05.340785 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.346022 21318 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:05.345769 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 159767us
W20260709 13:12:05.344501 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 161931us
I20260709 13:12:05.351679 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.352669 21314 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
W20260709 13:12:05.353777 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.356518 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.342047 26301 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:05.358423 21318 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:05.353330 26375 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.352543 26326 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.367883 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.350701 26274 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:05.372399 26321 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:05.372594 26481 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:12:05.343039 26446 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.375614 26446 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:05.376386 22036 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:05.373179 26291 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.345539 26467 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.380415 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.362833 26409 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:05.358310 26422 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.377758 26357 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:05.393632 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59951.8us
I20260709 13:12:05.391372 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:05.394552 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.396991 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.398957 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:05.399583 21466 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:05.403183 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.403779 21392 raft_consensus.cc:2376] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12. Re-sending same reply.
I20260709 13:12:05.405159 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.406865 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.407503 21390 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:05.409584 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.357225 26317 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.398046 26291 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:05.377918 26326 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.409801 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.414907 21391 raft_consensus.cc:2376] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14. Re-sending same reply.
I20260709 13:12:05.415908 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:05.416416 26456 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.333s	user 0.004s	sys 0.000s
I20260709 13:12:05.416509 21391 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:05.417699 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1887) took 1032 ms. Trace:
I20260709 13:12:05.418054 21463 rpcz_store.cc:276] 0709 13:12:04.385111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.385694 (+   583us) service_pool.cc:224] Handling call
0709 13:12:04.417514 (+ 31820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:04.443013 (+ 25499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:04.443060 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:04.450924 (+  7864us) log.cc:844] Serialized 26 byte log entry
0709 13:12:04.759000 (+308076us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:04.759062 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.759158 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:05.415821 (+656663us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:05.417387 (+  1566us) raft_consensus.cc:1685] finished
0709 13:12:05.417406 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.417640 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30044,"raft.queue_time_us":27490,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":3712896,"thread_start_us":292635,"threads_started":1,"wal-append.queue_time_us":572663}
I20260709 13:12:05.402264 26274 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:05.420416 26274 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:05.420519 26400 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:05.420890 26274 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:05.425304 26326 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.425822 26422 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.426409 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1878) took 1118 ms. Trace:
I20260709 13:12:05.426796 21393 rpcz_store.cc:276] 0709 13:12:04.307889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.308078 (+   189us) service_pool.cc:224] Handling call
0709 13:12:05.426216 (+1118138us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540020e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:05.426353 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091390720}
I20260709 13:12:05.427666 21395 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:05.411820 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.413084 26357 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:05.420894 26400 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:05.429293 26357 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.429774 26357 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.429989 26400 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.430454 26274 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.431340 26400 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.431493 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49116 (request call id 43) took 1458 ms. Trace:
I20260709 13:12:05.432678 26274 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:05.405071 26375 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:05.412868 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.401677 26301 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.451752 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.433866 26467 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:05.437287 26431 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.431949 21388 rpcz_store.cc:276] 0709 13:12:03.973274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.978031 (+  4757us) service_pool.cc:224] Handling call
0709 13:12:05.431241 (+1453210us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54003430d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf212853 00007fc2c41e060a 00007fc2bd7667d4 00007fc2bd766762 00007fc2bd766691 00007fc2bd76660c 00007fc2bd7658c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:05.431388 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854475648}
I20260709 13:12:05.410192 21392 raft_consensus.cc:2376] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11. Re-sending same reply.
I20260709 13:12:05.441625 21463 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:12:05.462335 26485 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:05.464651 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.464488 26150 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.465261 21319 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:05.466125 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.466609 21319 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:05.466697 26150 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.468348 21314 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:05.472417 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.474973 26087 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:05.475478 26087 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.475901 26087 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:05.476528 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:05.477313 21315 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:05.481699 26431 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:05.484954 21387 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:05.488006 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:05.429912 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:05.489135 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59297us
I20260709 13:12:05.489869 21469 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:05.446954 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.447273 21317 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:12:05.452404 21321 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.490883 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.443842 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.490291 21394 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: [9.10-10.11]
I20260709 13:12:05.492738 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.490015 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.499325 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.501063 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.502432 21360 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.505719 21469 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:05.506497 21434 leader_election.cc:400] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 17.
I20260709 13:12:05.506803 21434 leader_election.cc:403] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.506975 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.507192 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.507477 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.507838 26095 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:12:05.529247 26461 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:12:05.528276 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.546736 26095 consensus_queue.cc:1243] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:05.529858 26457 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:12:05.530705 26455 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:05.547739 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.509610 26362 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:05.553505 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:05.554100 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51748.4us
I20260709 13:12:05.501539 26431 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:05.529178 21396 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:12:05.554793 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.554914 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.530012 26230 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:12:05.556129 26396 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:05.528239 21464 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:05.527920 26422 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 17.
W20260709 13:12:05.555603 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 80843us
I20260709 13:12:05.510385 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.562067 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.512094 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:05.560951 26457 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:05.566018 26457 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:05.529048 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.566790 26457 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.567492 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.567869 26278 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:05.568387 22038 raft_consensus.cc:2410] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:05.570170 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.513471 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:05.562175 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51861.1us
I20260709 13:12:05.557261 22031 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.518731 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:05.528780 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.510317 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:05.510718 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 66953.1us
I20260709 13:12:05.528566 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:05.572388 21461 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.509730 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.544899 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.572652 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.545776 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.516074 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:05.518416 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:05.573381 21387 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:05.512341 22040 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:05.572057 22041 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:05.574623 21389 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:12:05.565352 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 53346.8us
I20260709 13:12:05.576843 21469 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:05.577211 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 66963.2us
I20260709 13:12:05.577579 21319 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:05.577824 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.578032 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.553527 22039 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:05.509153 21436 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:05.536629 26488 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:05.583226 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.579731 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.581327 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.579689 21321 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:05.584843 21387 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:05.585201 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.576102 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.492931 21391 raft_consensus.cc:2410] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:05.587909 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.515785 26467 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:05.548916 26317 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:05.591177 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.592062 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:05.592806 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 88219.2us
I20260709 13:12:05.561810 26150 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:05.598248 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.574930 26431 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:05.617847 21997 leader_election.cc:400] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:05.622591 21285 leader_election.cc:400] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:12:05.622920 21997 leader_election.cc:403] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.623031 21285 leader_election.cc:403] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.604933 21317 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:05.598518 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.620699 21387 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:05.608954 21468 raft_consensus.cc:1217] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[8.8-13.10]   Dedup: 8.8->[11.9-13.10]
I20260709 13:12:05.628460 21468 pending_rounds.cc:85] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 8
I20260709 13:12:05.598773 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:05.574956 26362 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.619861 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.580246 26374 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.580152 26170 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.580955 26464 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.631402 21434 leader_election.cc:400] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14.
I20260709 13:12:05.628753 21468 pending_rounds.cc:107] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:05.590091 26375 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:05.631940 22031 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:05.600081 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:05.635097 22041 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:05.638509 21468 raft_consensus.cc:2889] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.625058 22032 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:05.630040 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.590365 26432 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:05.601171 26278 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:05.686414 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56454.6us
I20260709 13:12:05.624142 26234 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:05.661676 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.661986 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.580327 26087 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.667744 21461 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:05.600979 26305 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:05.671489 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.672050 26312 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:05.640777 26375 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:05.676249 25688 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:05.677256 26502 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:12:05.700646 26375 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:05.601289 26286 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:05.617251 26291 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:05.702044 26087 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.702054 26291 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.702994 26291 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.649087 26325 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:05.683236 26363 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11.
I20260709 13:12:05.684456 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.597139 26395 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:05.621412 26426 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:05.616365 26368 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:05.623699 26104 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:05.706406 26457 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:05.706283 26469 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:12:05.707635 26469 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:05.708021 26469 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:05.709044 26469 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.710491 26469 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.712706 26278 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:05.712795 26363 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:05.714017 26278 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.601639 26326 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:12:05.676188 26484 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:05.624724 26493 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:05.738134 26493 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.635703 26309 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.629606 26150 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:05.740021 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 55645us
I20260709 13:12:05.741217 26440 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:05.741027 26150 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.698244 22039 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:05.649263 26489 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:05.720432 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:05.748518 26499 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:12:05.748927 21313 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:05.748874 26409 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:05.650990 26170 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.749498 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:05.750309 26363 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:05.750955 26363 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:05.719692 21396 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:05.679610 26478 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:12:05.665771 21469 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:12:05.698319 26492 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:05.768442 26492 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.769618 26330 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:05.770160 26330 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:05.770358 26493 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.770781 26492 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.692654 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.694342 26279 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:05.685874 26431 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:05.765550 26426 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:05.783933 26279 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:05.784422 26279 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:05.784745 26431 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.784968 26426 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.766080 26368 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:05.788509 26493 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.789239 26493 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:05.789019 26368 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.789733 26493 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.793342 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.794128 22040 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
W20260709 13:12:05.792652 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 100070us
I20260709 13:12:05.748644 26489 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.796592 26489 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:05.796836 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:05.638252 26373 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.772171 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:05.772907 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.775770 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.783438 26170 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:05.766361 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 186843us
I20260709 13:12:05.799127 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:05.697784 26301 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:05.800392 22039 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:05.802794 21313 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:05.791796 26493 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.813589 21313 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:05.814723 21359 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.812958 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.818674 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:05.815630 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47087.4us
I20260709 13:12:05.820250 26473 raft_consensus.cc:2764] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:12:05.831779 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.832643 21391 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:05.836367 21391 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:12:05.842751 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.850044 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:05.850992 21393 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:05.855988 21313 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:12:05.858032 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45185.3us
I20260709 13:12:05.860342 21316 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:05.860529 21317 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:05.763106 26395 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:05.801128 26312 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:05.797664 26325 consensus_queue.cc:1243] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:05.751174 26357 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.751755 26363 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:05.862896 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66358.3us
I20260709 13:12:05.779541 26330 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:05.871232 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51230.6us
I20260709 13:12:05.857028 26170 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:05.878506 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:05.903599 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:05.868489 25688 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:05.904543 22039 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:05.910444 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:05.870523 26312 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:05.905730 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:05.873116 26455 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:05.805498 26375 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:05.916107 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 279529us
I20260709 13:12:05.920331 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:05.921136 22039 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:12:05.921789 22039 pending_rounds.cc:85] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 9
I20260709 13:12:05.863921 26493 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:12:05.923362 26374 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:05.923873 26374 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:05.924409 26375 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:05.924746 26374 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:05.922199 22039 pending_rounds.cc:107] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:12:05.929689 22039 raft_consensus.cc:2889] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.930964 26395 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.943353 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.909686 26301 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.874760 26361 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:12:05.946869 21469 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:12:05.917213 26312 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:05.951745 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.916900 25688 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:05.956584 26432 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:05.956197 25688 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:05.955034 26472 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:05.934868 26492 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:05.959887 21433 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.963516 26472 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.984109 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:05.984360 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.951514 26469 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:12:05.982369 26317 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:05.992087 26274 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:12:05.992568 26498 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.200s	user 0.000s	sys 0.003s
I20260709 13:12:05.994025 26286 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:05.951649 26301 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:06.004021 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:05.976603 26493 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:05.966405 26230 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:12:05.997172 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 278331us
I20260709 13:12:06.087884 21317 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:06.044678 26357 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:05.994923 26305 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:06.000491 26274 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:06.144881 26274 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:06.087169 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 487159us
I20260709 13:12:06.032197 26291 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:06.148725 26291 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:05.998168 26487 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:06.000377 26286 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:06.150555 26286 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:06.095075 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:05.996301 26472 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:06.152359 21461 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:06.022544 26373 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:06.107939 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:06.101320 26150 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.109581 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:06.109895 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:06.159507 21395 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:06.160190 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:06.110927 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:06.161439 21396 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:06.112212 26314 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:06.113093 26400 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.681s	user 0.003s	sys 0.009s
I20260709 13:12:06.116789 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:06.121022 26279 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:06.122771 26506 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:12:06.125646 26494 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
W20260709 13:12:06.110687 26503 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:06.159513 21464 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:06.182996 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:06.168009 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:06.167899 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 60075.1us
I20260709 13:12:06.170450 22034 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:12:06.183889 22034 pending_rounds.cc:85] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 10
I20260709 13:12:06.177023 21394 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:12:06.179345 21316 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:06.182410 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:06.184166 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:06.164675 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:06.184161 22034 pending_rounds.cc:107] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:12:06.185832 22034 raft_consensus.cc:2889] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:06.169904 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:06.189350 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:06.158070 26451 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:06.160585 26461 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:06.176623 26406 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:12:06.176311 26279 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:06.218761 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:06.220085 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62667.2us
W20260709 13:12:06.208246 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 204299us
I20260709 13:12:06.130209 26493 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:06.226948 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 141242us
I20260709 13:12:06.177693 25688 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:06.164963 26395 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:12:06.239691 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.205142 26509 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:06.168150 26150 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:06.234206 26363 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:06.217581 26461 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:06.272585 26505 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:12:06.318426 26514 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:12:06.256024 26506 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:12:06.321702 21388 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:06.275827 26493 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:06.322696 26493 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:06.323212 26493 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:06.231925 26526 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:06.324293 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 99394.6us
I20260709 13:12:06.324492 26526 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:06.325560 26526 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:06.324349 26511 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:12:06.331033 22039 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:06.332003 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:06.278817 26234 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.003s
I20260709 13:12:06.332603 26455 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:06.332928 26234 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:06.333173 26455 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:06.217835 26512 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:06.334307 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.335258 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:06.226048 26373 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:06.227708 26400 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:06.236361 26375 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:12:06.345628 21463 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:06.359205 21394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:06.303766 21395 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:06.304804 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:06.314123 26431 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:06.316159 26363 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:06.317108 26461 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:06.338277 21469 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:06.332597 22035 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:06.340575 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:06.282295 26489 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:06.341915 21464 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:06.348893 26305 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:06.229038 26451 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:06.395303 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 90588.7us
W20260709 13:12:06.357501 26504 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:12:06.390548 26512 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:06.341667 26301 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:06.362097 26170 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.433625 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:06.435500 21394 raft_consensus.cc:606] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:06.447654 21394 raft_consensus.cc:614] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:06.419211 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59490us
I20260709 13:12:06.391975 26464 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:06.441883 26451 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:06.420979 26363 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:06.419059 26234 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:06.383809 26507 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:12:06.430148 26509 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:06.451725 26461 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:06.505259 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 286563us
I20260709 13:12:06.509895 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:06.458381 26431 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:06.471680 26509 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:06.516932 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:06.519356 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 849) took 1043 ms. Trace:
I20260709 13:12:06.457324 26170 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:06.519960 21392 rpcz_store.cc:276] 0709 13:12:05.475740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.487759 (+ 12019us) service_pool.cc:224] Handling call
0709 13:12:05.488076 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.570352 (+ 82276us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:05.570381 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.580643 (+ 10262us) log.cc:844] Serialized 26 byte log entry
0709 13:12:05.871306 (+290663us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:05.871346 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.871704 (+   358us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.356859 (+485155us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:06.515883 (+159024us) raft_consensus.cc:1685] finished
0709 13:12:06.515912 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.519265 (+  3353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75318,"raft.queue_time_us":69529,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4790,"spinlock_wait_cycles":3195264,"thread_start_us":232925,"threads_started":1,"wal-append.queue_time_us":440527}
I20260709 13:12:06.463548 26464 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:06.541836 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 242538us
W20260709 13:12:06.528823 26312 consensus_meta.cc:287] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 13:12:06.571568 21318 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:06.530891 26431 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:06.505642 26473 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:12:06.583005 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:06.589666 21318 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:06.595242 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:06.581156 26312 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:06.599315 26312 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:06.602020 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:06.602635 21318 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:06.604219 26507 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:06.604655 26472 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:06.606742 26472 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:06.607332 26507 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:06.608492 21314 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:06.608794 26432 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:06.613982 21314 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:06.614034 26432 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:06.614898 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.615283 26432 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:06.616815 26432 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:06.609409 26522 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:12:06.621371 21318 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:06.625365 26291 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:06.627559 21436 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:06.628829 26510 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:06.630698 26510 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:06.631281 26510 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:06.633025 26510 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:06.644371 26493 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:06.649423 21393 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:06.650657 26431 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:06.656210 26532 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:06.659708 26464 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:06.661168 26489 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:06.668505 26501 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:12:06.573158 26509 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:06.667651 21390 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:06.677055 22035 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
W20260709 13:12:06.700562 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.695358 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 257168us
I20260709 13:12:06.708123 21468 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:06.712158 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:06.716048 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:06.691715 26170 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:06.732230 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:06.718631 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 240170us
I20260709 13:12:06.733181 21321 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:06.735321 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:06.695875 26426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.014s	sys 0.025s
I20260709 13:12:06.734838 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:06.760887 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.744596 26426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.014s	sys 0.025s
I20260709 13:12:06.769229 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:06.715950 26440 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:12:06.743343 26536 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:12:06.834028 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:06.862818 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.833622 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:06.836958 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:06.929162 21388 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:06.930079 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:06.825609 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59097us
I20260709 13:12:06.849893 21395 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:06.927243 21313 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:06.750187 26170 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:06.875463 21389 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:06.934551 21392 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:06.939538 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 218950us
I20260709 13:12:06.947839 21389 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:06.821427 26464 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:06.955154 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:06.955785 21391 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:06.825203 26532 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:06.978950 21395 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:12:07.087729 21285 leader_election.cc:336] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.684s (SENT)
I20260709 13:12:06.977412 21319 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:06.962579 26464 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.111769 26179 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:06.979012 26545 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.954635 26312 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.203s
W20260709 13:12:07.054675 26528 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:12:06.975067 26555 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.207s
I20260709 13:12:06.974402 26279 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.995429 26473 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.054020 26547 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.999411 26532 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.134902 26464 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:07.178964 21395 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:12:07.180914 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:07.182099 21395 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:07.154151 26534 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
W20260709 13:12:07.152278 26540 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:12:07.190841 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2436) took 1104 ms. Trace:
I20260709 13:12:07.046520 26440 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:07.192414 26440 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:07.191534 21396 rpcz_store.cc:276] 0709 13:12:06.086689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.170572 (+ 83883us) service_pool.cc:224] Handling call
0709 13:12:06.170889 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.173534 (+  2645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.173577 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.217082 (+ 43505us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.529748 (+312666us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:06.573145 (+ 43397us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.573354 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.573423 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.153570 (+580147us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:07.160430 (+  6860us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b180019e9a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:07.190538 (+ 30108us) raft_consensus.cc:1685] finished
0709 13:12:07.190573 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.190762 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10521,"prepare.queue_time_us":49981,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":13101,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":5041,"spinlock_wait_cycles":11642368,"thread_start_us":247746,"threads_started":1,"wal-append.queue_time_us":459658}
I20260709 13:12:07.193560 26440 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.200426 26509 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:07.140677 26544 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.204833 26544 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.207067 26544 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.167960 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2435) took 1081 ms. Trace:
I20260709 13:12:07.224401 21393 rpcz_store.cc:276] 0709 13:12:06.086402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.112464 (+ 26062us) service_pool.cc:224] Handling call
0709 13:12:06.112796 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:06.650028 (+537232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.167714 (+517686us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540009f954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:07.167899 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233603328}
I20260709 13:12:07.233423 21389 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:12:07.222019 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 265601us
I20260709 13:12:07.030668 26536 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:07.158856 26549 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:12:07.166994 26461 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.001s
W20260709 13:12:07.163417 26363 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.001s
I20260709 13:12:07.156466 26551 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.160703 26150 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:07.171046 26455 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.837s	user 0.009s	sys 0.003s
I20260709 13:12:07.145956 26179 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.131631 26554 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:07.259454 22040 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:12:07.161881 26555 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:07.282326 26555 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:07.283216 26555 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.284576 26555 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:07.291045 26179 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.291249 26150 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:07.291954 26150 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.156980 26545 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.294461 26150 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.261888 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:07.162696 26473 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.263585 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:07.264338 26478 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:07.298470 26473 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.298739 26478 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.266038 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:07.301085 26478 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.301100 26464 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.302114 21320 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:07.267028 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:07.267565 26325 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:07.312532 26325 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.314348 26464 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.314988 26325 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:07.317293 26515 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.204s	user 0.004s	sys 0.000s
I20260709 13:12:07.275501 22038 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:12:07.321362 22038 pending_rounds.cc:85] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 11
I20260709 13:12:07.321480 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2427) took 1494 ms. Trace:
I20260709 13:12:07.321787 22038 pending_rounds.cc:107] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:12:07.322290 22038 raft_consensus.cc:2889] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:07.257037 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.247385 26372 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.279341 22040 pending_rounds.cc:85] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 10
I20260709 13:12:07.326620 22040 pending_rounds.cc:107] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:12:07.321972 21387 rpcz_store.cc:276] 0709 13:12:05.827368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.829128 (+  1760us) service_pool.cc:224] Handling call
0709 13:12:05.829548 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:05.829984 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:05.830318 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.003482 (+173164us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:06.004238 (+   756us) log.cc:844] Serialized 52 byte log entry
0709 13:12:06.004403 (+   165us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:06.009137 (+  4734us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.017277 (+  8140us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.024464 (+  7187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.024556 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.849150 (+824594us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b18000c6c40. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:07.212909 (+363759us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b18000c6c40. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:07.316695 (+103786us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:07.321258 (+  4563us) raft_consensus.cc:1685] finished
0709 13:12:07.321281 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.321423 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164729,"prepare.queue_time_us":1208482,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":128,"raft.queue_time_us":19424,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":24004,"spinlock_wait_cycles":80645632,"thread_start_us":170057,"threads_started":1,"wal-append.queue_time_us":226578}
I20260709 13:12:07.326934 22040 raft_consensus.cc:2889] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:07.256390 26234 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:12:07.163093 26547 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.328400 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:07.330351 26547 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.281527 26554 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.336580 26545 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.337976 26554 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.338796 26554 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:07.339354 26554 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.162281 26279 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.340410 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.341589 21320 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:07.341709 26279 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:07.343565 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.017s
W20260709 13:12:07.346899 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.003s	sys 0.017s
I20260709 13:12:07.350752 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.278728 26532 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.357815 22034 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:07.274413 26363 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:07.370471 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 105949us
I20260709 13:12:07.422664 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:07.425252 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.358762 26484 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:07.356468 26150 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:07.305274 26455 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.498520 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.280556 26551 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.344200 26480 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:12:07.516526 26564 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.508126 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:07.517683 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 95104.8us
I20260709 13:12:07.519117 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:07.585584 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.609124 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.353420 26372 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.599413 21461 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:07.628623 21388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.012s	sys 0.016s
W20260709 13:12:07.629019 21388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.012s	sys 0.016s
I20260709 13:12:07.432578 26484 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:07.509786 26473 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.509604 26464 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.510453 26409 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:07.636277 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.013s	sys 0.016s
W20260709 13:12:07.644608 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.013s	sys 0.016s
I20260709 13:12:07.608235 26545 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.649643 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:07.655793 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 136787us
I20260709 13:12:07.598042 26574 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:07.433681 26559 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.221s
W20260709 13:12:07.646528 26368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.768s	user 0.014s	sys 0.021s
W20260709 13:12:07.673159 26368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.800s	user 0.014s	sys 0.021s
I20260709 13:12:07.672780 26484 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.654757 26409 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.676396 26409 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:07.679737 26519 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.328s	user 0.000s	sys 0.006s
I20260709 13:12:07.680786 26363 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.633739 26526 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.674161 26484 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:07.640444 26234 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:07.645658 26230 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.641837 26361 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.640703 26542 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.521876 26150 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.691215 21391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:07.693005 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:07.667397 26563 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 13:12:07.666610 26532 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:07.723913 26532 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:07.724221 26562 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:12:07.725672 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 684) took 1005 ms. Trace:
I20260709 13:12:07.724143 26542 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.724879 26532 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.726233 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:07.724898 26150 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.717183 21391 raft_consensus.cc:606] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:07.731004 21391 raft_consensus.cc:614] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:07.723338 26567 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:12:07.517093 26564 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.726092 22035 rpcz_store.cc:276] 0709 13:12:06.719912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.720085 (+   173us) service_pool.cc:224] Handling call
0709 13:12:06.720483 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.827306 (+106823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.827343 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.833006 (+  5663us) log.cc:844] Serialized 26 byte log entry
0709 13:12:07.054265 (+221259us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:07.054322 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.054469 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.725441 (+670972us) raft_consensus.cc:1685] finished
0709 13:12:07.725462 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.725611 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":274298,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":23331,"spinlock_wait_cycles":1734400,"thread_start_us":326434,"threads_started":2,"wal-append.queue_time_us":411222}
I20260709 13:12:07.694134 26554 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.707190 26363 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.674171 26325 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:07.651408 26464 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.652813 26473 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.662674 26545 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.743820 26478 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.759980 26565 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:07.712103 26234 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.717859 26230 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.695554 26526 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:07.763911 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.750046 26325 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:07.720585 26361 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.758035 26150 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:07.764989 26536 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.004s
I20260709 13:12:07.775775 26487 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.787285 21391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:07.787943 21391 raft_consensus.cc:606] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:07.788296 21391 raft_consensus.cc:614] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:07.751343 26363 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.785904 22040 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:12:07.790217 26539 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.844s	user 0.004s	sys 0.004s
I20260709 13:12:07.765451 26565 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.797361 22041 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:07.782486 26464 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.791765 26536 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.780473 26526 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.812458 26542 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:07.812961 26572 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:12:07.813308 26234 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.816541 26363 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.804790 26582 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:07.820218 26582 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.822463 26582 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:07.824765 26577 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:07.829600 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:07.830307 21387 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:07.765204 26478 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.833608 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:07.834396 21387 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:07.834640 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:07.835315 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:07.835566 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:07.836009 21394 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:07.837365 21391 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:07.836122 21388 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:07.837548 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1185) took 1493 ms. Trace:
I20260709 13:12:07.838156 22039 rpcz_store.cc:276] 0709 13:12:06.344378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.344762 (+   384us) service_pool.cc:224] Handling call
0709 13:12:06.345118 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.347224 (+  2106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.347265 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.347797 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.692717 (+344920us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:06.692757 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.692821 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.783454 (+1090633us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:07.807448 (+ 23994us) raft_consensus.cc:1685] finished
0709 13:12:07.807474 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.837448 (+ 29974us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2416,"raft.queue_time_us":1800,"raft.run_cpu_time_us":1055,"raft.run_wall_time_us":32699,"spinlock_wait_cycles":14277504,"thread_start_us":344605,"threads_started":1,"wal-append.queue_time_us":412313}
I20260709 13:12:07.825976 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:12:07.843847 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.845242 26559 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.845517 26564 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.845822 26559 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.825358 26545 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:07.847003 26286 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:07.848021 26559 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:07.848048 26565 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.849334 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1895) took 1753 ms. Trace:
I20260709 13:12:07.849740 21469 rpcz_store.cc:276] 0709 13:12:06.096392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.096563 (+   171us) service_pool.cc:224] Handling call
0709 13:12:06.097090 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:06.420158 (+323068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.849066 (+1428908us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54002490d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:07.849267 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554276608}
I20260709 13:12:07.851118 26179 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:07.854123 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 639961us
I20260709 13:12:07.854398 26566 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:07.854965 26566 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.856824 26202 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:07.857307 26202 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:07.861420 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:07.862254 26510 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:07.862490 26582 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:07.862879 26510 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.863065 26582 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.865239 26582 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:07.793102 26487 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.865748 26582 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:07.866988 26291 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:07.867410 26487 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.867733 26291 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.851668 26179 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.810846 26372 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.789170 26150 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.866251 26582 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:07.872540 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.872952 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:07.883801 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:07.888247 21469 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:07.882094 26565 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.891618 26565 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.889585 26564 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.892179 26566 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.872599 26234 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:07.893352 26234 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.893765 26565 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:07.895418 26234 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:07.870045 26291 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:07.877328 26473 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.896102 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:07.896919 21461 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:07.867995 26487 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:07.897598 26487 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.892560 26564 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:07.871153 26555 consensus_meta.cc:287] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.004s
I20260709 13:12:07.900887 21319 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:12:07.901198 21319 pending_rounds.cc:85] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 7
I20260709 13:12:07.901331 26564 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.895948 26230 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.905514 26274 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:07.901424 21319 pending_rounds.cc:107] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:12:07.907503 21319 raft_consensus.cc:2889] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:07.907068 26373 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.885210 26551 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.899766 26487 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:07.911998 21390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1897) took 2501 ms (client timeout 1684 ms). Trace:
I20260709 13:12:07.919922 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.953299 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.922623 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:07.955235 21469 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:07.929522 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.930729 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:07.933107 21316 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:07.935776 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:07.940016 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:07.950392 21390 rpcz_store.cc:269] 0709 13:12:05.410935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.411259 (+   324us) service_pool.cc:224] Handling call
0709 13:12:07.911761 (+2500502us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001c4654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:07.911879 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2802022144}
I20260709 13:12:07.935025 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.972457 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:07.878651 26578 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:12:07.983832 21315 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:07.974031 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:07.986521 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.987553 21317 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:07.987651 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.987735 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:07.988534 21315 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:07.992143 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:07.993055 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:07.996932 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.865247 26510 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:07.881218 26150 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.878511 26179 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.876576 26455 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:07.935920 26536 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.933588 26555 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:08.006914 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:07.913569 26361 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.940579 26478 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:07.986824 26312 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:07.924957 26489 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:08.008203 21463 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:08.023011 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.023969 21469 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:07.999455 26512 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:07.999212 26305 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:07.912577 26373 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:07.999337 26531 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:08.025542 26547 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.037196 26547 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.040153 26510 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:08.032811 26489 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.028779 21469 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:08.045717 26547 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.044054 26489 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.030835 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:07.881340 26325 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:07.991993 26480 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:12:08.001410 26532 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.048313 26532 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.035172 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.036399 21461 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:08.028831 26512 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:08.049448 21312 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:08.051110 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:08.054975 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.055914 21317 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:08.057300 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.057463 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:08.026228 26492 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.058625 26312 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:08.065886 26532 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.069507 26291 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:08.070139 26291 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:08.070617 26291 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:08.026081 26555 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.058451 26512 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:08.068017 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.085237 21469 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:08.066700 26312 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:08.018781 26582 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.030136 26305 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.050676 26531 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.091833 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:08.093920 26312 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:08.086120 26375 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:08.094858 26373 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.087312 26492 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:08.097487 26518 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.627s	user 0.003s	sys 0.017s
I20260709 13:12:08.017783 26536 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:08.101383 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 258542us
I20260709 13:12:08.080137 26526 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:08.119012 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.129415 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:08.120841 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.122222 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.104642 26150 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:08.098789 26511 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.100611 26305 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.123787 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.124995 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.102581 26531 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.079735 26551 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:12:08.131675 21394 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:08.122927 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.129341 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 765) took 1416 ms. Trace:
I20260709 13:12:08.146214 21388 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:08.144802 21464 rpcz_store.cc:276] 0709 13:12:06.712819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.712949 (+   130us) service_pool.cc:224] Handling call
0709 13:12:06.713215 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:06.713450 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:06.948676 (+235226us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.948999 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.008284 (+ 59285us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.292504 (+284220us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b1800239aa0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:07.866028 (+573524us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b1800239aa0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:12:07.924750 (+ 58722us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b1800239aa0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:08.129017 (+204267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:08.129073 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:08.129117 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.129180 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.129286 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46539,"prepare.queue_time_us":978582,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":95608,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":16972,"spinlock_wait_cycles":109487872,"thread_start_us":497722,"threads_started":2}
I20260709 13:12:08.131888 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:08.102505 26309 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:08.130540 21391 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:08.132952 21317 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:08.133462 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.105854 26532 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:08.140964 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:08.111608 26547 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:08.100631 26581 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:12:08.157816 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.130290 26526 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.159477 26526 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.138862 26150 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:08.160320 26150 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.161079 26555 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.162819 26492 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.166111 26536 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.151823 26455 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:12:08.169323 26547 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.172271 26590 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:08.172763 26590 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:08.172988 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2734) took 1550 ms. Trace:
I20260709 13:12:08.173136 26590 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:08.173410 21314 rpcz_store.cc:276] 0709 13:12:06.622185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.622357 (+   172us) service_pool.cc:224] Handling call
0709 13:12:06.622690 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.623004 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.623034 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.792082 (+1169048us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b2c00014818. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:12:07.800260 (+  8178us) log.cc:844] Serialized 26 byte log entry
0709 13:12:07.978184 (+177924us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:07.978242 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.978337 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.172684 (+194347us) raft_consensus.cc:1685] finished
0709 13:12:08.172704 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.172928 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24421,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":54498560,"thread_start_us":160661,"threads_started":1,"wal-append.queue_time_us":309465}
I20260709 13:12:08.175415 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.148741 26309 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.183483 26309 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.184214 26532 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.186023 26150 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.186666 26532 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.189375 26150 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.187011 26526 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.192003 26526 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.193101 26551 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:08.193567 26551 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:08.194332 26551 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.145658 26406 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:08.195751 26406 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.196132 26406 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:08.145519 26511 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.112574 26375 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.199436 26574 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.199946 26574 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.201485 26375 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.202575 21320 raft_consensus.cc:2410] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:12:08.203624 26581 consensus_queue.cc:1243] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:08.204545 26406 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.206930 26406 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.199322 21468 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:08.208940 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.213152 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1187) took 1607 ms. Trace:
I20260709 13:12:08.210932 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.213748 22038 rpcz_store.cc:276] 0709 13:12:06.605850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.608919 (+  3069us) service_pool.cc:224] Handling call
0709 13:12:06.609198 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.323170 (+713972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.212846 (+889676us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54004655d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:08.213075 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527179648}
W20260709 13:12:08.222635 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 109177us
I20260709 13:12:08.252674 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:08.253624 21314 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.155400 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:08.264940 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 109686us
I20260709 13:12:08.267688 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:08.276532 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.171962 26547 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:08.278705 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 395691us
I20260709 13:12:08.288379 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.288684 21314 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:08.289692 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.290009 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:08.291136 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.274567 26545 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:08.295024 21393 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:08.295444 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.297058 21314 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:08.279565 26570 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.301101 21389 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:08.301774 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.283221 26375 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:08.281805 26591 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:08.303222 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.300566 26507 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:08.304481 26570 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.305497 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.286815 26457 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:08.314983 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.307955 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.307364 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:08.306490 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.316378 21393 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:08.312860 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.297372 26545 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.298611 26492 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:08.315182 21467 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:08.317742 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.322196 21469 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:08.322602 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.312968 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.323382 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:08.318688 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.323527 21465 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:12:08.329255 21467 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:08.329799 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.321036 26545 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:08.315867 26591 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.309827 26375 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.305729 26566 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:12:08.318400 26457 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.339630 26511 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:08.346729 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.348378 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.400609 21389 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:08.400897 21393 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:08.401414 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.348745 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.350402 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.402798 21391 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:08.403664 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.404248 21391 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:08.404431 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:08.405054 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.348429 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.354827 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.319128 26507 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:08.358647 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.409119 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.409870 21393 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:08.361173 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.410765 21465 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:08.361577 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.369252 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.314893 26484 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:12:08.377589 21387 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:08.331496 26570 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:08.397380 26457 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:08.382130 26592 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:08.382867 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:08.428488 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45693.4us
I20260709 13:12:08.425144 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.328212 26492 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.389281 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.390606 26591 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.392194 26375 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.388505 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.415328 26361 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:08.407687 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.410866 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.412142 21469 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:08.445102 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.411620 21319 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:08.447333 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.362534 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.371559 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.413120 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.413655 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.451232 21389 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:08.451373 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.387326 26286 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.452085 26286 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.452736 26361 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:08.453715 26361 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.454283 26286 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:08.423962 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.455026 21468 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:08.402602 26305 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.457587 26305 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.434058 26493 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:08.460352 26493 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:08.460769 26493 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:08.440726 26484 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:08.464499 26484 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.466734 26484 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:08.441943 26363 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.467756 26363 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.469839 26363 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.471514 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1913) took 1294 ms. Trace:
I20260709 13:12:08.381711 26301 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:08.425935 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:08.477200 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.355520 26312 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.486773 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.487537 22039 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:08.488919 26583 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:08.429939 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.434224 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.489035 26590 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.490679 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.491268 21467 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:08.491693 26590 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.439280 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.441144 21461 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:08.406013 21395 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:08.422724 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.500985 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.502337 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.471923 21392 rpcz_store.cc:276] 0709 13:12:07.176911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.177040 (+   129us) service_pool.cc:224] Handling call
0709 13:12:07.177507 (+   467us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:07.213746 (+ 36239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:07.237353 (+ 23607us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.872241 (+634888us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b18004a1460. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:12:08.151745 (+279504us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:08.155378 (+  3633us) log.cc:844] Serialized 52 byte log entry
0709 13:12:08.155525 (+   147us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:08.155873 (+   348us) log.cc:844] Serialized 14 byte log entry
0709 13:12:08.156736 (+   863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.156810 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.471293 (+314483us) raft_consensus.cc:1685] finished
0709 13:12:08.471317 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.471456 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68311,"prepare.queue_time_us":28415,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":94384,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":20319,"spinlock_wait_cycles":5655424,"thread_start_us":254677,"threads_started":1,"wal-append.queue_time_us":1053052}
I20260709 13:12:08.504176 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.505525 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.460353 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.474253 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.476369 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:08.477968 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52111.7us
I20260709 13:12:08.478325 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.479409 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.509507 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:08.480924 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.511880 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:08.512792 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.513674 21461 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:08.483544 21468 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:08.432401 26570 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:12:08.437467 22038 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:08.494277 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.540171 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.540565 21469 raft_consensus.cc:2410] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:12:08.541492 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.491937 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:08.495847 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.430019 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:08.544648 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.501058 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:08.546566 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 54700.1us
I20260709 13:12:08.517295 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.515817 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.552961 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.556370 26375 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.533381 26593 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:08.560515 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.561124 21468 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.543687 26582 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:08.564949 26492 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.503762 26512 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.559352 26545 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.566331 26312 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.567189 26512 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.518395 21390 raft_consensus.cc:2410] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:08.569208 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.531252 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:08.569852 21469 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:08.532604 21392 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:08.533215 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.537792 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 1907) took 1037 ms. Trace:
I20260709 13:12:08.570746 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.571530 26431 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:08.572255 26431 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:08.572507 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:08.572741 26431 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:08.573804 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:08.428857 26507 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.529305 21388 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 15: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:08.574149 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.577097 21470 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:08.577468 26531 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.504818 26291 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.573763 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:08.585775 21315 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:08.586380 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:08.537602 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 165803us
I20260709 13:12:08.586712 22039 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:08.587023 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:08.587622 22031 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.571004 21466 rpcz_store.cc:276] 0709 13:12:07.500368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.500499 (+   131us) service_pool.cc:224] Handling call
0709 13:12:07.624728 (+124229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.625002 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:07.636053 (+ 11051us) log.cc:844] Serialized 14 byte log entry
0709 13:12:08.519052 (+882999us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b1800099040. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2c2c103c7 00007fc2bf2229a7 00007fc2bf2320bf 00007fc2bf232038
0709 13:12:08.528804 (+  9752us) log.cc:844] Serialized 14 byte log entry
0709 13:12:08.533885 (+  5081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:08.533959 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:08.534018 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.534106 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.537730 (+  3624us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":906823,"prepare.queue_time_us":901138,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":108114,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":10980,"spinlock_wait_cycles":50359296}
I20260709 13:12:08.594311 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.595769 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.599031 26531 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.604321 26309 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.604362 26583 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:08.605072 26309 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.606174 26583 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:08.607117 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:08.608047 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.607944 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:08.591641 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:08.608812 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.610662 21313 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:08.614784 21470 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:08.615885 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:08.622165 22031 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:08.625706 21468 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:08.635671 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:08.639271 26591 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:08.638449 26570 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:08.643435 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.641559 26593 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:08.573954 26431 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.647768 26591 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:08.648103 26431 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.638051 26234 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:08.650606 26440 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:08.607658 26566 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:08.652275 26566 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.652720 26566 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.654660 21466 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:08.644534 21470 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.661978 21316 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
W20260709 13:12:08.662997 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.601517 26545 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:08.666301 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:08.634089 26314 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:08.673780 26314 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.676295 26314 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.635010 26286 raft_consensus.cc:2764] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:08.676717 21319 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:08.637599 26554 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:08.681296 21316 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:08.696732 21470 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:08.696218 21360 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:08.679141 26493 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.702657 26493 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.703773 21314 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:08.641170 26372 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:12:08.702704 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:08.702874 26278 raft_consensus.cc:2764] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:08.723507 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:08.706421 26309 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:08.637655 26202 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.705335 26554 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:08.686075 26513 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:12:08.726615 26453 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.739009 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:08.739727 26469 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:08.742972 26325 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:08.765584 26531 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:08.766871 21316 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:08.767455 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.767963 26568 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:08.785319 26551 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.780875 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:08.781200 26309 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:08.786768 26493 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.784911 26278 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:08.785876 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:08.816323 21389 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:08.787408 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.719115 26314 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:12:08.731032 26455 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:08.790068 26469 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:08.770605 26424 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:08.800678 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.837134 21316 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:08.817075 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:08.826277 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.790942 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.839321 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.837970 21320 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:08.853844 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:08.878975 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:08.816166 26568 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.849011 26291 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:08.831317 26278 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.830605 26493 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.906600 21390 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:08.880137 26532 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:08.852717 26457 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.850261 26424 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:08.914011 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:08.891186 26568 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:08.925812 21389 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:08.900472 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:08.927196 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 146393us
I20260709 13:12:08.930907 22034 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:08.930626 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:08.932767 26309 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:08.933185 26309 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.933522 26309 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:08.933882 26574 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:08.953215 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52875.5us
I20260709 13:12:08.954602 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.955394 22040 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:12:08.956635 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:08.957427 22040 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:08.960714 22031 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:12:08.969911 22031 pending_rounds.cc:85] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 11
I20260709 13:12:08.970214 22031 pending_rounds.cc:107] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:12:08.970475 22031 raft_consensus.cc:2889] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:08.960917 26600 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.399s	user 0.003s	sys 0.000s
I20260709 13:12:08.968465 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:08.979712 21462 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:08.986763 22031 pending_rounds.cc:85] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 12
I20260709 13:12:08.987390 22031 pending_rounds.cc:107] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:12:08.987707 22031 raft_consensus.cc:2889] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:09.001046 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:09.002053 21462 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:08.915400 26532 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:08.967854 26573 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:12:09.005553 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 91628us
I20260709 13:12:08.894829 26469 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:09.008510 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 285063us
I20260709 13:12:09.010105 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:09.006815 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52775.3us
I20260709 13:12:08.949338 26617 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:09.019829 26617 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.022377 26617 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.026904 26617 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:09.029670 26617 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:09.039234 26278 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:09.049496 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:09.051079 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:09.064950 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54986.2us
I20260709 13:12:09.065825 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:09.072398 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:09.048792 26469 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.087718 26369 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:09.100901 26532 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:09.101392 26615 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:09.108493 26493 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:09.109581 26424 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:09.109723 26487 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:09.110107 26487 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:09.100906 26613 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:09.120054 22035 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:09.078423 26513 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:09.120705 26461 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.121201 26461 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.128396 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.072594 26631 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:09.088187 26573 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:09.111099 26487 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:09.163859 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 147115us
W20260709 13:12:09.162833 26566 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.001s
W20260709 13:12:09.172986 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 94252.3us
I20260709 13:12:09.175661 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:09.166733 26457 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:09.181734 26630 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:09.175206 26487 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.184633 26630 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.187562 26630 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:09.183552 26469 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:09.195529 26431 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260709 13:12:09.177084 26566 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:09.209501 26614 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.148s	user 0.002s	sys 0.000s
W20260709 13:12:09.211179 26601 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.654s	user 0.004s	sys 0.000s
I20260709 13:12:09.211750 26566 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:09.213083 26622 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.150s	user 0.003s	sys 0.000s
I20260709 13:12:09.256333 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2764) took 1174 ms. Trace:
I20260709 13:12:09.257326 21312 rpcz_store.cc:276] 0709 13:12:08.082107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.598085 (+515978us) service_pool.cc:224] Handling call
0709 13:12:08.598424 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.598642 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.598674 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.599136 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.815655 (+216519us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:08.815715 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.818590 (+  2875us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.255502 (+436912us) raft_consensus.cc:1685] finished
0709 13:12:09.255570 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.255989 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":215949,"threads_started":1,"wal-append.queue_time_us":369838}
I20260709 13:12:09.259703 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.278441 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:09.282236 21461 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:12:09.286624 21470 raft_consensus.cc:2368] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
I20260709 13:12:09.287564 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:09.290869 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2749) took 1365 ms. Trace:
I20260709 13:12:09.316357 21318 rpcz_store.cc:276] 0709 13:12:07.925082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.930816 (+  5734us) service_pool.cc:224] Handling call
0709 13:12:07.931142 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.077325 (+146183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.077370 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.077959 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.956830 (+878871us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b1800435b80. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:12:09.007562 (+ 50732us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:09.007624 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.289827 (+282203us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400089154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:09.289981 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.290111 (+   130us) raft_consensus.cc:1685] finished
0709 13:12:09.290135 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.290570 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187,"raft.queue_time_us":104,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5485,"spinlock_wait_cycles":341797632,"thread_start_us":50452,"threads_started":1,"wal-append.queue_time_us":966008}
I20260709 13:12:09.293174 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2765) took 1243 ms. Trace:
I20260709 13:12:09.320411 21315 rpcz_store.cc:276] 0709 13:12:08.049784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.351395 (+301611us) service_pool.cc:224] Handling call
0709 13:12:08.351663 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.586168 (+234505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.292230 (+706062us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54000fb754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:09.292943 (+   713us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522736896}
I20260709 13:12:09.294919 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 760) took 1291 ms. Trace:
I20260709 13:12:09.321713 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.322661 21317 rpcz_store.cc:276] 0709 13:12:08.003664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.056986 (+ 53322us) service_pool.cc:224] Handling call
0709 13:12:09.294382 (+1237396us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b540032afd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:09.294670 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172257664}
I20260709 13:12:09.324937 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:09.326086 21469 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:09.189491 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:09.327874 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 138355us
W20260709 13:12:09.332540 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 149026us
I20260709 13:12:09.334483 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.337821 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.344525 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:09.352001 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.361151 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.356804 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.363402 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.365075 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.365291 22032 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:09.366231 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.366428 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.353596 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:09.367314 22041 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:09.367740 21392 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.366516 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.357160 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.354456 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.372704 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.358549 21394 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:09.373780 22042 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:12:09.375173 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 88010.1us
I20260709 13:12:09.355119 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.378423 22031 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:09.388787 21392 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:09.390206 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:09.203826 26309 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.399608 26279 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:09.400106 26279 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:09.400954 26309 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:09.401691 26279 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.403301 21318 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:09.403812 26279 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:09.404637 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:09.405647 21317 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.405758 26278 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:09.407311 26278 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:09.394268 26095 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:12:09.403831 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.411898 26095 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:09.416924 26095 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.397648 26170 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:09.415757 26314 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:09.395475 26202 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:09.425674 26170 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:09.441424 26453 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.001s
I20260709 13:12:09.442237 26453 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:09.441329 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 271506us
I20260709 13:12:09.436939 26170 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:09.448429 26493 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:09.472278 26493 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:09.472812 26493 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.475003 22036 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:09.459714 26317 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:12:09.453996 26369 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:09.476576 26369 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:09.478099 26369 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.442229 26571 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:09.456267 26551 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:12:09.458209 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 152150us
I20260709 13:12:09.458904 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.456284 26372 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 13:12:09.461768 26325 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.004s
I20260709 13:12:09.435995 26361 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.464654 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:09.478796 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:09.488273 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 58243.6us
I20260709 13:12:09.515235 21317 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:09.520051 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:09.521751 21284 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.523772 26531 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:09.524295 26369 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.524739 26531 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:09.525179 26531 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:09.525565 26531 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:09.526381 22038 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:09.528932 26532 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.529249 26461 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:09.532259 26202 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:09.533712 26202 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:09.534053 26202 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:09.535180 26202 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.540548 21464 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
W20260709 13:12:09.514261 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 75548.9us
W20260709 13:12:09.515980 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 66564.2us
I20260709 13:12:09.564236 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2502) took 1151 ms. Trace:
I20260709 13:12:09.564736 21464 rpcz_store.cc:276] 0709 13:12:08.412553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.476969 (+ 64416us) service_pool.cc:224] Handling call
0709 13:12:09.563938 (+1086969us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000b8e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:09.564152 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443687808}
W20260709 13:12:09.567404 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43883.2us
I20260709 13:12:09.568756 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.570542 21436 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:09.572372 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:09.573549 26574 raft_consensus.cc:2764] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:12:09.574103 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:09.576457 26574 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:09.577127 26574 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:09.578565 26574 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.580696 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.581063 26202 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.556241 26551 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:09.581694 21394 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:09.582520 26551 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.584483 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.584647 26532 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:09.575547 26493 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.576705 21215 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 11, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 11 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.544687 26314 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.586184 26531 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.620287 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.581293 26571 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.626658 26317 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:09.636197 26510 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:09.640690 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.640210 26511 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:09.643319 21394 raft_consensus.cc:2410] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:12:09.639264 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:09.654238 21389 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 13:12:09.641427 26317 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.659132 21392 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:12:09.657796 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 199253us
I20260709 13:12:09.662022 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:09.662904 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43807.4us
I20260709 13:12:09.663071 26493 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:09.640731 26510 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:09.664263 26510 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.664918 26526 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:09.666545 26631 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:09.667143 26631 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:09.668113 26631 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.668699 26650 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:09.669137 26314 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:09.669379 26650 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.678954 26571 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:09.680991 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 96713.6us
W20260709 13:12:09.684162 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 162536us
I20260709 13:12:09.684412 22041 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:09.686635 22036 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:09.660858 26317 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:09.713161 21317 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:09.716738 21392 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:12:09.704320 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:09.723634 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:09.725061 26484 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:09.704223 26590 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:09.726177 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:09.726558 21313 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:09.705063 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.726258 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:09.728210 21321 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:09.729172 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:09.729629 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:09.730137 26581 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:09.730330 21390 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:09.731115 26581 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:09.731483 26581 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.731804 26581 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.734052 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:09.734982 26632 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 13:12:09.736894 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.706637 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:09.737269 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:09.675302 26361 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:09.738098 21388 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:09.738165 26361 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.740613 26361 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:09.741726 26566 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:09.744583 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.744964 21314 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 13:12:09.745864 26424 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:09.746256 26424 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.746590 26424 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:09.746763 26406 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:09.747175 26406 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.747504 26406 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.748155 26484 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:09.749239 26484 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.743634 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.674396 25688 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:09.757230 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:09.756290 25688 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:09.756642 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 127999us
I20260709 13:12:09.672011 26650 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:09.759562 21321 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:09.758826 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:09.761008 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 75487.6us
I20260709 13:12:09.762835 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.762709 26571 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:09.763044 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:09.753633 26170 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.764273 26493 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:09.764770 26493 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.765132 26493 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:09.765964 26170 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:09.766985 21215 catalog_manager.cc:5697] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 12, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 12 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.769094 21215 catalog_manager.cc:5697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:09.769586 26406 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.769615 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.770718 21215 catalog_manager.cc:5697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.772125 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:09.774202 21388 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
W20260709 13:12:09.780530 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.777729 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:09.792471 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:09.800654 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:09.802479 26406 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:09.808421 26651 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.807893 21215 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 12, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 12 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:09.809257 21395 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.809967 21215 catalog_manager.cc:5697] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.811822 21215 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.813668 26314 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:09.814100 26314 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.813558 21215 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:09.814424 26314 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.815471 21215 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 9, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 9 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:09.817206 21215 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:09.818311 26493 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.818827 21215 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 10 to 11, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 11 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:09.820123 21284 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:09.820556 26493 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:09.821230 26493 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:09.821581 26493 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.821987 26493 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.809036 26651 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.827656 26651 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:09.830822 26314 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.832453 21215 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.834048 21215 catalog_manager.cc:5697] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:09.835451 21215 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 11, leader changed from <none> to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 11 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.837875 21215 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.839845 21215 catalog_manager.cc:5697] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 9, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 9 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.841706 21215 catalog_manager.cc:5697] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:09.842928 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:09.843590 21316 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.844481 21395 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:09.852487 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.853744 26431 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:09.854676 21215 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.856117 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:09.856324 21215 catalog_manager.cc:5697] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 6 to 10, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 10 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:09.858124 21215 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 10 to 14, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 14 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.859272 26574 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:09.859985 26574 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.805140 26511 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:09.865051 26511 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.867491 26511 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:09.869969 26581 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:09.860522 21215 catalog_manager.cc:5697] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:09.876543 21390 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:09.881435 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:09.852567 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:09.883728 21388 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:09.797427 26526 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:09.862314 26574 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:09.798741 26309 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:12:09.863823 26317 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.904330 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:09.912086 21468 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:12:09.927282 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 171592us
W20260709 13:12:09.926729 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 183238us
I20260709 13:12:09.936764 21470 raft_consensus.cc:2368] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15.
I20260709 13:12:09.928692 21285 leader_election.cc:400] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
I20260709 13:12:09.987500 21285 leader_election.cc:403] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.896209 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:09.939745 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 87250.3us
I20260709 13:12:09.959246 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:09.991109 21388 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:12:09.903721 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:09.991849 21395 raft_consensus.cc:2368] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
I20260709 13:12:09.946307 21390 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:09.910952 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:09.996793 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:09.997184 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:09.903997 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:09.921907 21216 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 276) took 40228 ms (client timeout 15000 ms). Trace:
I20260709 13:12:09.917500 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:10.004904 22041 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:09.896824 21215 catalog_manager.cc:5697] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.009187 21396 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:09.900416 25688 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:09.916261 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:09.904219 26487 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.004s
I20260709 13:12:09.942005 26649 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:09.916947 26571 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.915918 26581 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:09.912061 26531 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:09.955876 26314 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:10.021396 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 145284us
I20260709 13:12:09.904837 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:10.033756 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.948738 26582 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:10.042905 21215 catalog_manager.cc:5697] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 6, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 6 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:10.045989 26571 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:10.030923 26551 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
I20260709 13:12:10.048429 26571 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:10.049158 21464 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:12:10.050083 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.006143 26309 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:10.053416 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.975443 26510 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.065366 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:10.066646 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:10.067198 21468 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:10.068866 21462 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:10.070557 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:10.071280 25688 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:10.053452 26431 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:12:10.072528 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:10.073299 21464 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:10.060454 26493 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.077651 26493 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:10.079111 26510 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:10.063638 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.081954 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:10.082056 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:10.083244 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:10.083185 26309 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.083846 21390 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:10.083994 21466 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:12:10.085610 26309 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:10.003432 21216 rpcz_store.cc:269] 0709 13:11:29.723717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.740924 (+ 17207us) service_pool.cc:224] Handling call
0709 13:12:09.921570 (+40180646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:01.447095 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:01.460896 (+ 13801us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:01.460955 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:12:01.460977 (+    22us) tablet.cc:662] Decoding operations
0709 13:12:01.462728 (+  1751us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:01.462832 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:01.462863 (+    31us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:12:01.722005 (+259142us) tablet.cc:701] Row locks acquired
0709 13:12:01.722073 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:12:01.722291 (+   218us) write_op.cc:270] Start()
0709 13:12:01.722490 (+   199us) write_op.cc:276] Timestamp: P: 1783602721722213 usec, L: 0
0709 13:12:01.722588 (+    98us) op_driver.cc:348] REPLICATION: starting
0709 13:12:01.723650 (+  1062us) log.cc:844] Serialized 6376 byte log entry
0709 13:12:03.351112 (+1627462us) op_driver.cc:464] REPLICATION: finished
0709 13:12:03.853506 (+502394us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bc10e0ac 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2c2c4eef0
0709 13:12:04.341344 (+487838us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b18000b3bc0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:04.341512 (+   168us) write_op.cc:301] APPLY: starting
0709 13:12:04.341614 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:05.309934 (+968320us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:05.309977 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:05.933081 (+623104us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:05.933466 (+   385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:12:05.933540 (+    74us) write_op.cc:312] APPLY: finished
0709 13:12:05.934319 (+   779us) log.cc:844] Serialized 148 byte log entry
0709 13:12:06.423130 (+488811us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.440530 (+ 17400us) write_op.cc:454] Released schema lock
0709 13:12:06.469317 (+ 28787us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:06.519263 (+ 49946us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.525458 (+  6195us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5232838,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":797089,"apply.run_cpu_time_us":116978,"apply.run_wall_time_us":2164295,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71199,"num_ops":16,"prepare.queue_time_us":136810,"prepare.run_cpu_time_us":27712,"prepare.run_wall_time_us":810207,"raft.queue_time_us":554879,"raft.run_cpu_time_us":47782,"raft.run_wall_time_us":852924,"replication_time_us":1595772,"spinlock_wait_cycles":74094848,"thread_start_us":2040072,"threads_started":5,"wal-append.queue_time_us":1209975,"wal-append.run_cpu_time_us":25274,"wal-append.run_wall_time_us":2918719}]]}
I20260709 13:12:10.088177 21468 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:10.093259 22041 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:10.096982 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:10.022660 26649 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:10.099785 21387 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:10.105370 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:10.094310 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:10.103355 21315 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:10.104700 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 53827.8us
I20260709 13:12:10.056473 26317 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:10.113018 21464 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:10.115937 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64911.8us
I20260709 13:12:10.117730 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:10.120297 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:10.120592 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:10.033468 26484 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:12:10.129153 26509 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:10.129603 26170 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:10.097298 26095 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:12:10.140983 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.141543 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:10.145682 21470 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:10.144784 21316 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:10.161001 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:10.164121 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:10.176507 21462 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:10.138914 26279 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:10.188825 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:10.184363 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:10.186997 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.194298 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.122951 26487 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:12:10.198129 21360 leader_election.cc:400] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15.
I20260709 13:12:10.209414 21360 leader_election.cc:403] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:10.177536 26493 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:10.204566 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:10.207010 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:10.169696 26526 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:10.204468 26406 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:10.123266 26431 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:12:10.219798 21468 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:10.182226 26650 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:10.121140 26424 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.227941 26566 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:10.228524 26566 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:10.233887 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:10.234819 26566 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:10.236006 26631 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:10.236740 26631 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:10.237874 26631 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:10.240319 21463 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:10.163388 26484 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:12:10.247680 21314 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:10.266002 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 87213.4us
I20260709 13:12:10.276342 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.269129 26493 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.220734 26406 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:10.219240 26581 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:10.385324 21464 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:10.458742 21465 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:10.323163 21321 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:12:10.280931 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 84768.3us
I20260709 13:12:10.344321 21462 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
W20260709 13:12:10.355209 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 165789us
W20260709 13:12:10.442524 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.275720 26279 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:12:10.421635 26657 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:12:10.518368 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 483532us
I20260709 13:12:10.267601 26574 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:10.519757 22041 raft_consensus.cc:2368] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15.
W20260709 13:12:10.522734 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.374133 26431 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:10.561949 21470 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:10.526466 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:10.530153 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.338045 26582 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.527861 26509 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:10.540946 21313 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 13:12:10.541728 26406 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.544584 21389 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:10.276925 26650 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.555616 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:10.557794 21314 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:10.568146 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:10.575058 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.578680 26432 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:10.580083 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.580186 26509 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:10.581030 26095 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:10.581656 26095 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.581915 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:10.582937 21314 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:10.583717 26095 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:10.585179 26551 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:10.575814 26582 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:10.587288 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:10.588810 22034 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:10.589067 26582 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:10.589900 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.591070 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.593238 26493 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:10.594038 26493 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:10.594501 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.595520 26493 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:10.595381 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.596215 26431 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:10.599516 26431 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:10.599630 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.601468 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.610525 26424 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:10.610999 26659 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:12:10.614017 21319 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:10.277374 26649 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.632192 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:10.616417 26309 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:10.570114 26574 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:10.642872 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 160807us
I20260709 13:12:10.627836 26571 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:10.649855 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:10.634538 26170 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:10.655901 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:10.657779 22031 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:10.641758 26317 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:10.662935 22042 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:10.668453 26493 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:10.689555 26650 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:10.694540 26551 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:10.655011 26649 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:10.704630 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 187046us
I20260709 13:12:10.700562 26424 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:10.668009 26279 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15.
I20260709 13:12:10.704178 26317 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:10.706205 26493 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:10.718370 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 585369us
I20260709 13:12:10.714318 26431 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:12:10.718371 26424 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.758113 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:10.758651 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:10.758874 21470 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:10.759254 21462 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:10.783509 21359 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:10.788256 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:10.796475 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 151775us
I20260709 13:12:10.799523 21469 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:10.755848 26317 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:10.797518 26636 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.797945 26672 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:10.802230 26676 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:10.812855 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 152953us
W20260709 13:12:10.819162 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 64632.5us
W20260709 13:12:10.818248 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:10.817303 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 163535us
W20260709 13:12:10.825363 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 68754.4us
I20260709 13:12:10.792086 26493 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.811990 26279 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:10.828827 26646 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:10.831513 26424 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:10.811784 26677 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:10.834201 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.847568 21462 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:10.849853 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.851385 26681 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:10.851994 26681 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.849234 26677 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:10.853734 26662 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:12:10.855218 26681 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:10.841320 26279 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.857566 26279 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:10.858768 26571 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:10.849406 26672 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:10.841035 26646 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:10.862272 26646 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:10.863457 21359 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:10.888970 26677 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:10.892012 26675 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:12:10.816155 26636 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:10.892962 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 118232us
I20260709 13:12:10.902802 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:10.908849 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:10.867750 26646 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:10.910346 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:10.826773 26676 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:10.922003 26676 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:10.923906 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 74170us
I20260709 13:12:10.924952 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.926303 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:10.928380 26674 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:12:10.930276 26636 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:10.892813 26681 raft_consensus.cc:2764] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:10.888479 26631 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:12:11.012460 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 149140us
I20260709 13:12:10.916764 26424 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:10.917703 26566 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:11.014271 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.016441 26682 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:11.018229 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.019673 26574 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.020985 21320 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:11.023813 26510 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:11.024201 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.009511 26676 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:12:11.045629 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 217353us
I20260709 13:12:11.025283 26424 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:11.043545 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.616s (SENT) [suppressed 4 similar messages]
I20260709 13:12:11.054584 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:11.037441 26431 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.035260 26510 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:11.038296 26574 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:11.069063 26493 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:11.049295 26676 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:11.053797 26424 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:11.059304 26693 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:11.080566 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 154341us
I20260709 13:12:11.082535 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2520) took 1164 ms. Trace:
I20260709 13:12:11.082255 26689 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:12:11.083760 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.050931 26509 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:11.088008 22038 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:11.101425 26693 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:11.110539 26684 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:11.112088 26509 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.095846 21467 rpcz_store.cc:276] 0709 13:12:09.917740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.918213 (+   473us) service_pool.cc:224] Handling call
0709 13:12:09.918699 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.932826 (+ 14127us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:09.933234 (+   408us) log.cc:844] Serialized 14 byte log entry
0709 13:12:10.359622 (+426388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:10.359675 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:10.359720 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.082179 (+722459us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400216954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:11.082226 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.082358 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":920,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":2465,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":24598,"spinlock_wait_cycles":31547136,"thread_start_us":425798,"threads_started":1,"wal-append.queue_time_us":639208}
I20260709 13:12:11.114463 26509 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:11.115005 26693 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.115399 26676 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.123660 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.123805 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:11.076732 26431 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:11.143838 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 92445.7us
I20260709 13:12:11.151407 21387 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:11.099937 26510 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:11.174669 26690 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:12:11.174458 26698 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:12:11.177764 26279 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.178782 26406 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:11.180104 26431 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:11.180246 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:11.181456 26682 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:11.181636 21317 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:12:11.178401 26424 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.173435 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:11.187517 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:11.189143 21387 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:11.198534 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.200912 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:11.202459 26688 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:11.200994 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:11.203347 26685 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:11.192945 26484 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:11.193463 26682 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:11.206116 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.206023 22002 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:11.204911 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 53111.3us
I20260709 13:12:11.219120 26688 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:11.226843 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.204552 26701 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:11.228657 26701 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:11.228868 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:11.229286 26701 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:11.208676 26677 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:11.213934 26551 raft_consensus.cc:2764] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:12:11.213521 26279 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:11.231596 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:11.235256 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.236954 26686 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:11.237941 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.238487 21389 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:11.240413 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.241182 26682 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.241854 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.241863 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.242776 21395 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:11.243958 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.244773 21387 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:11.235414 26574 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:11.245980 21465 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:11.250805 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:11.255540 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1222) took 1105 ms. Trace:
I20260709 13:12:11.256551 22041 rpcz_store.cc:276] 0709 13:12:10.144109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.144303 (+   194us) service_pool.cc:224] Handling call
0709 13:12:11.249682 (+1105379us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400647654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:11.249798 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815714048}
I20260709 13:12:11.210021 26685 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.261248 26694 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:11.262053 26424 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.257952 26406 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.284153 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.252679 26574 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:11.278353 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.298103 21465 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:12:11.274708 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:11.288972 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.302300 21389 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
W20260709 13:12:11.303529 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49345.7us
I20260709 13:12:11.259563 26170 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:11.304527 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:11.271055 26694 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.307551 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:11.309064 21465 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:11.310807 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:11.312458 21470 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:12:11.277648 26674 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:12:11.308526 26424 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:11.304005 26693 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:11.316952 26648 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:11.309016 26694 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:11.298535 26406 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.340715 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 791) took 1198 ms. Trace:
I20260709 13:12:11.341526 26714 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:11.342752 26688 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:11.343372 26713 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.343827 26685 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.309223 26574 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.326783 26686 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:11.347280 21468 rpcz_store.cc:276] 0709 13:12:10.142150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.227215 (+ 85065us) service_pool.cc:224] Handling call
0709 13:12:10.227529 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:10.519288 (+291759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:10.519319 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:10.519367 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:10.519396 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.340447 (+821051us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54001a7cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:11.340498 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.340649 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670507392}
I20260709 13:12:11.316534 26170 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.354065 26693 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.359498 26681 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.382275 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:11.366099 26648 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:11.374451 26686 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.368460 26574 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:11.372547 26714 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:11.368866 26700 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:11.393087 26700 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.394256 26406 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.395416 26700 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.389906 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:11.396462 26706 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:12:11.396556 26571 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:11.397145 26571 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:11.397508 26571 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:11.397631 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.398955 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.383424 26681 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.377934 26688 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:11.400856 26688 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.400787 26714 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.391814 26309 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.404300 26309 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:11.406980 26704 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:12:11.380793 26713 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.412225 26510 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:11.414068 26713 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.389348 26686 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:11.416473 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.420003 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.423614 26309 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.425770 21433 leader_election.cc:400] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15.
I20260709 13:12:11.427924 21321 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:11.437129 21433 leader_election.cc:403] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:12:11.447340 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.448308 21316 raft_consensus.cc:2410] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:12:11.447997 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 140524us
I20260709 13:12:11.468865 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:11.461866 26531 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.011s	sys 0.031s
I20260709 13:12:11.442734 26672 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15.
I20260709 13:12:11.470784 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.476728 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:11.478163 26689 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:11.478863 26689 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:11.468820 26646 consensus_meta.cc:287] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.001s
I20260709 13:12:11.467056 26170 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.466821 26487 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.479931 21387 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:11.476409 26531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.011s	sys 0.031s
W20260709 13:12:11.496479 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 185738us
I20260709 13:12:11.473898 26432 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.498065 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.498730 21316 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:11.498723 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.500664 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.501037 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.501241 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.501573 26646 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:11.502986 21315 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:11.496881 26487 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.482779 26574 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.504825 26574 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:11.505553 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 269092us
I20260709 13:12:11.505913 26487 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:11.506665 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.511016 26649 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:11.485690 26317 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.512627 26317 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.514706 26317 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:11.506889 26574 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:11.517544 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.525331 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.525983 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:11.528097 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 46816.2us
I20260709 13:12:11.499902 26689 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.550621 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.554728 21313 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:11.517001 26432 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.562461 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:11.498184 26648 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.563822 26432 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:11.564136 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.566550 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.567202 21469 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:11.562500 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.563864 21467 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:11.572016 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:11.584967 26701 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:11.616617 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44682.4us
I20260709 13:12:11.617800 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:11.621215 26713 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.621810 26713 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.625231 26713 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:11.625258 26701 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:11.629449 26689 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.570927 26681 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:11.632403 26676 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:11.632479 26693 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.584276 26202 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:11.648466 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 193922us
I20260709 13:12:11.651292 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:11.652730 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:11.655261 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.650391 26406 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:11.666705 21387 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:11.667907 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.668537 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.669211 21318 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:11.677196 21436 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:11.658885 26317 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:11.659010 26685 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.658915 26582 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:11.623522 26686 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:11.696539 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 144219us
I20260709 13:12:11.697748 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.699213 26692 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:11.703048 26432 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:11.703523 26432 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.703914 26432 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:11.667644 26571 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.664299 26721 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:11.722908 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.689236 26582 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.732929 26582 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:11.741401 26729 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.757576 26729 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.746987 26432 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.765867 26432 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:11.744580 26571 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:11.723501 26674 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:12:11.767406 26686 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.768335 26431 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.768950 26431 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.771591 26431 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:11.774140 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.774971 21387 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:12:11.776532 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.778657 26729 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.782279 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:11.749467 21315 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:11.749910 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.755131 21313 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:11.756392 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.784868 21321 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
W20260709 13:12:11.800894 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 110847us
I20260709 13:12:11.802320 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:11.806406 21387 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:11.806969 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.807324 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.808200 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:11.809475 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.812343 26582 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.814706 26582 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:11.816119 26675 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:12:11.718927 26685 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.821965 26685 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:11.825790 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.829959 21312 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:11.835644 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:11.836270 21314 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:11.835501 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.840921 26674 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:11.841674 26202 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:11.842507 26202 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:11.843263 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.843516 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.843873 26202 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.845794 21467 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:11.831274 26686 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:12:11.849583 26317 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.850203 26317 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.853323 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:11.854849 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:11.858078 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:11.859128 26317 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:11.842260 26694 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.863782 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:11.860900 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 273865us
I20260709 13:12:11.861057 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:11.873813 21314 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:11.875936 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.878435 26713 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:11.883460 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:11.884460 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:11.889760 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.890978 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.892669 21467 pending_rounds.cc:85] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 7
I20260709 13:12:11.891775 21469 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:11.900568 26692 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:11.901108 26692 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.902724 22041 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:11.903215 26692 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.904693 26693 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.894202 26509 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:12:11.897543 26726 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:11.898347 26493 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.889456 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:11.912981 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:11.870831 26701 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.907218 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:11.917692 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.918321 21390 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:11.887426 26317 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:11.913913 21436 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:11.893060 21467 pending_rounds.cc:107] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:12:11.914803 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.907703 26693 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.915091 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.939819 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.940423 26693 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.940537 21393 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:11.941160 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.941883 21394 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:11.942099 26431 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:11.916189 21312 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:11.942601 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.943729 26688 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:11.946448 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.947161 21465 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:11.948405 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:11.952116 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:11.952683 21470 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:11.953362 21468 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:11.953362 21394 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:11.954643 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.907918 26713 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:11.915642 26686 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.955416 21394 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:12:11.955718 26686 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:11.956255 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.942617 26431 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:11.952701 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.957373 26431 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.957933 26686 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.960906 21463 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:11.916150 22042 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:12:11.962543 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:11.963888 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:11.964179 26736 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:11.964919 26279 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:11.965758 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.966840 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.967428 21312 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:11.933022 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:11.967970 26701 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.911553 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:11.957396 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:11.969177 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 57702.7us
I20260709 13:12:11.969920 21392 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:11.935988 21315 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:11.970150 26701 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.936312 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.971029 22040 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:11.971402 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.915606 26681 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.971971 21389 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:11.936483 21387 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 18. Ops: []
I20260709 13:12:11.972416 26681 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.970096 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.973727 21394 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:11.937345 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:11.974601 26681 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.932183 26493 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:11.977456 26493 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:11.978029 26493 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:11.978528 26493 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:11.979961 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.935693 26683 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:11.980652 26683 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:11.981021 26683 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:11.968743 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:11.984376 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:11.986572 21468 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:12:11.986711 26566 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:11.987020 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:11.987190 26566 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.987638 26566 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:11.987689 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.988458 26581 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:11.967981 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.993144 21467 raft_consensus.cc:2889] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:11.993633 21467 pending_rounds.cc:107] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:12:11.993865 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.994735 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:11.993928 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.995374 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:11.889932 26582 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:12:11.994172 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:11.997418 26736 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:11.997488 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:11.998136 21389 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:11.998777 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.993963 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.001048 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.001809 21392 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:12.001853 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:12.003050 21469 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:12.003719 26681 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:12.004257 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 84419us
I20260709 13:12:12.004765 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.005699 21393 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:12.006825 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:12.007543 21312 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:12:11.932248 26317 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:12.008471 26317 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:12.008555 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.009848 21359 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.993911 21467 raft_consensus.cc:2889] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:12.012518 26681 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:12.013876 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:11.993884 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.014055 26566 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.014559 21284 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:12.001170 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.024657 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:12.025096 26693 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:12.025911 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:12.026150 22036 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:12.027179 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:12.028090 26566 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:12.031144 21470 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:12.031798 26713 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:12.032243 26713 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:12.032583 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.033244 26714 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:12.033653 26714 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:12.033905 26686 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:12.034016 26714 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.034350 26686 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.034771 26686 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:12.032609 26713 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:12.039778 26649 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:12.040939 26279 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:12.041338 26279 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:12.029381 26694 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:12.042151 26279 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.043335 26279 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:12.025218 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.044566 26649 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:12.045827 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.047170 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.048477 26721 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:12.048655 26649 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:12.048871 26721 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:12.049310 26721 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:12.006932 21393 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:12:12.051215 21393 pending_rounds.cc:85] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 5
I20260709 13:12:12.051499 21393 pending_rounds.cc:107] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:12:12.051769 21393 raft_consensus.cc:2889] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:12.053933 21461 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:12.056141 21390 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:12.056704 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.059525 21395 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:12.062531 21389 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:11.979377 26493 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:12.064954 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73843.1us
I20260709 13:12:12.067193 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:12.068173 26676 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:12.088769 21312 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:12.064427 26681 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:12.088897 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:12.083339 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:12.082104 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.072007 21396 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:12.095538 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:12.075870 21395 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:12.098474 21392 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
W20260709 13:12:12.098662 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 107728us
I20260709 13:12:12.083760 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:12.102965 21388 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:12.089250 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:12.103920 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.104780 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:12.069231 21393 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:12:12.107829 21465 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:12.110338 21396 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:12:12.110219 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.111884 21391 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:12.111940 26669 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:12.112663 26631 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:12.112813 26669 consensus_queue.cc:1243] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:12.113186 26631 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.113595 26631 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:12.114223 26179 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:12.114741 26179 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.116870 26179 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:12.123208 26317 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.128160 21468 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:12.127633 26631 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.131667 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.132395 21393 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:12.132893 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.131747 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.133541 21388 raft_consensus.cc:2376] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15. Re-sending same reply.
I20260709 13:12:12.133821 21391 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:12.134629 26531 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:12.136230 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.136796 26582 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:12.137516 26582 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:12.138002 26582 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:12.138584 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.138923 26582 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.139847 26581 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:12.140215 26738 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:12.140678 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.142753 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:12.144345 21321 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:12.146409 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.136835 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.153077 21388 raft_consensus.cc:2368] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
W20260709 13:12:12.133070 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43929.3us
I20260709 13:12:12.165611 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.167253 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.167768 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.154721 21393 raft_consensus.cc:2376] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18. Re-sending same reply.
I20260709 13:12:12.167555 21461 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:12:12.167974 21391 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:12.171413 21393 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:12.171916 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:12.105403 26692 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:12.105334 26685 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:12.208017 21465 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:12.164832 26631 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:12.191623 21389 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:12.192716 21468 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:12.164877 26571 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:12.210319 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.073132 26722 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.129s
I20260709 13:12:12.145915 26688 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:12:12.075644 26713 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.075747 26714 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.220463 26692 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:12.080260 26686 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.187911 26700 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.227351 26726 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:12.185047 26730 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:12.204342 26685 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.167491 26574 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:12:12.168761 26649 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:12:12.313879 26686 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:12.176298 26683 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.233902 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:12.315217 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 81433.3us
I20260709 13:12:12.315909 26683 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:12.288448 26566 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.315753 26730 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.316701 26566 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.318163 26730 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:12.318768 22034 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:12.256351 26510 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:12.321036 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.304574 26692 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.305145 26721 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.308629 26714 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:12.309890 26713 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:12.312126 26317 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:12.266569 26487 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:12.321938 21389 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:12.320567 21388 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:12.326941 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.318594 26685 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:12.328555 26730 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:12.328910 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.336489 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:12.361434 21396 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:12.337263 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 189542us
I20260709 13:12:12.329363 21394 pending_rounds.cc:85] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 7
I20260709 13:12:12.316268 26669 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:12.367884 22036 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:12.359086 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.362984 21394 pending_rounds.cc:107] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:12:12.370605 21394 raft_consensus.cc:2889] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:12.364701 21321 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:12.378177 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 212683us
I20260709 13:12:12.293160 26700 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.395836 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.377023 26317 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:12.402010 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 187091us
I20260709 13:12:12.390327 26714 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:12:12.400475 26493 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:12:12.410256 26493 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:12:12.417552 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 226987us
I20260709 13:12:12.396126 26713 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:12:12.404613 26566 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:12.427778 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.430186 21321 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:12.410640 26493 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:12.400450 26729 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:12:12.444418 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:12.447006 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:12.455102 26493 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.458748 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:12.459758 26721 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:12.465308 21314 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:12.475605 21321 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:12.476197 26754 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:12.477424 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:12.483295 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:12.484912 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:12.486436 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:12.487433 21461 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:12.490870 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.492364 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:12.492712 26677 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:12.492444 26676 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:12.493247 26677 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:12.462381 26741 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:12:12.494199 26677 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.495487 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:12.497150 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:12.497805 22038 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:12.500505 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:12.501168 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:12.501332 21468 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:12.502605 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:12.501775 21469 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:12.503593 21463 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:12.506709 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:12.507323 21463 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:12.513808 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:12.515740 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 88025.7us
I20260709 13:12:12.520251 21285 leader_election.cc:400] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
I20260709 13:12:12.522611 26751 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:12.523347 26729 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:12.524487 26750 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:12.524874 26750 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:12.525530 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48189.7us
I20260709 13:12:12.525724 26750 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.527724 26649 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:12.528158 26649 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.528504 26649 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:12.534149 21469 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:12:12.547757 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73755.9us
I20260709 13:12:12.523852 26729 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:12.551246 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:12.552297 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:12.562126 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.579773 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:12.580811 21465 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:12.553953 26493 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:12.588567 21395 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:12.598724 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.564867 26669 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:12.579928 26646 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:12.625814 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 184762us
I20260709 13:12:12.628652 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.597951 26431 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:12.590459 26713 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:12:12.645254 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 81693.7us
I20260709 13:12:12.646054 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:12.646615 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.655632 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.662492 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.614205 26674 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:12:12.613847 26510 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:12:12.645442 26431 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.652299 26714 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:12.667748 26763 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:12.645053 26646 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.623629 26729 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.667768 26581 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:12.669826 26431 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:12.671554 26713 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:12.695772 21321 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:12.681921 26726 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:12.677506 26714 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:12.684075 26693 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:12.643982 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:12.704913 21396 raft_consensus.cc:606] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:12.705343 21396 raft_consensus.cc:614] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:12.705883 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 43501.4us
I20260709 13:12:12.707047 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.677753 26694 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:12.710748 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.709339 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:12.699615 26432 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.720166 22042 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:12.711323 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.707176 26582 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:12:12.720532 26432 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.710657 26650 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:12:12.728374 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:12.750519 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.717123 21388 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:12:12.730309 21463 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:12.733785 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:12.747236 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:12.757460 21465 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:12.746404 26571 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:12:12.692190 26755 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:12:12.764253 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:12.765928 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 97378.2us
I20260709 13:12:12.747587 26768 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:12.776896 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:12.707649 26722 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:12:12.764253 26752 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:12.787429 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:12.797518 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 85265.8us
I20260709 13:12:12.801967 21312 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:12.764834 26754 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:12:12.795872 26763 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:12.817796 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.784602 26713 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:12.849151 26770 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:12:12.849418 26771 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:12:12.817765 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 55024.8us
I20260709 13:12:12.852008 21318 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:12.856710 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:12.803458 26714 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.861945 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:12.862382 26432 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:12.878091 26780 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:12.880311 26762 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
W20260709 13:12:12.881669 26761 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:12:12.890019 26649 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:12.895381 26649 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:12.847975 26768 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.896524 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:12.806818 26688 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:12:12.860286 26769 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:12:12.920513 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 151503us
I20260709 13:12:12.836894 26685 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.866775 26646 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:12.860211 26309 consensus_queue.cc:1059] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:12:12.936156 26748 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.393s	user 0.003s	sys 0.000s
I20260709 13:12:12.938261 22036 raft_consensus.cc:2368] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19.
I20260709 13:12:12.920416 26768 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:12.964864 26309 raft_consensus.cc:3055] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:12.995935 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68837.9us
I20260709 13:12:12.962858 26754 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:12.999564 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:13.000644 21462 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:13.002866 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.008464 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:13.009099 21462 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:13.012116 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45171.9us
I20260709 13:12:13.011920 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:13.007697 26753 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.016574 21313 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:12.996131 26309 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:13.049620 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:13.050395 21396 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:12.988431 26431 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.021301 26202 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:12:13.051683 26676 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:13.138211 21470 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:13.011904 26754 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:13.020918 26753 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.163830 21462 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
W20260709 13:12:13.260906 26788 log.cc:927] Time spent T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:12:13.272666 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 257346us
I20260709 13:12:13.249485 26309 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.277217 26650 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:13.272771 26685 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:13.284003 26759 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:12:13.284337 26784 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:12:13.286095 21462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:13.326867 21462 raft_consensus.cc:606] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:13.299000 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:13.287271 21388 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:13.291955 26431 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:13.294807 26650 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:13.382368 26650 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:13.387362 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:13.403975 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.404752 21318 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:13.407228 21465 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:12:13.323063 26754 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:13.413403 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:13.316905 26753 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:13.320497 26768 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:13.427688 21461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40320a19af04e62afc637834ab759b2"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:13.428465 21461 raft_consensus.cc:606] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:13.428807 21461 raft_consensus.cc:614] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:13.450637 26722 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:13.451282 26722 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.453508 26722 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:13.426163 26531 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:12:13.456857 26745 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.932s	user 0.002s	sys 0.007s
I20260709 13:12:13.459569 26685 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:13.460430 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 786) took 1454 ms. Trace:
I20260709 13:12:13.460209 26685 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.460804 21315 rpcz_store.cc:276] 0709 13:12:12.005817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.005934 (+   117us) service_pool.cc:224] Handling call
0709 13:12:12.006252 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:12.006613 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.006649 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:12.007220 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 13:12:12.368238 (+361018us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:12.597828 (+229590us) log.cc:844] Serialized 14 byte log entry
0709 13:12:12.598282 (+   454us) log.cc:844] Serialized 14 byte log entry
0709 13:12:12.630875 (+ 32593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.630980 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.456218 (+825238us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:13.460210 (+  3992us) raft_consensus.cc:1685] finished
0709 13:12:13.460235 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.460377 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32293,"prepare.queue_time_us":422442,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":17744,"raft.queue_time_us":40601,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":21803,"spinlock_wait_cycles":24242048,"thread_start_us":554302,"threads_started":2,"wal-append.queue_time_us":516926}
I20260709 13:12:13.462378 26685 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:13.456974 26756 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.807s	user 0.000s	sys 0.008s
I20260709 13:12:13.471019 26683 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:13.471496 26683 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:13.472378 26683 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:13.471840 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.473676 26683 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:13.491204 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1971) took 1329 ms. Trace:
W20260709 13:12:13.529994 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.032s	sys 0.051s
W20260709 13:12:13.530565 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.032s	sys 0.051s
I20260709 13:12:13.520771 21391 rpcz_store.cc:276] 0709 13:12:12.162304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.171374 (+  9070us) service_pool.cc:224] Handling call
0709 13:12:12.353777 (+182403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:12.357665 (+  3888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.357694 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:12.358162 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:12:12.562585 (+204423us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:12.562628 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.562692 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:12.884099 (+321407us) raft_consensus.cc:1685] finished
0709 13:12:12.884121 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.490916 (+606795us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540020e9d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:13.491112 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18437,"raft.queue_time_us":3567,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":14164,"spinlock_wait_cycles":418747136,"thread_start_us":167542,"threads_started":1,"wal-append.queue_time_us":292288}
W20260709 13:12:13.531437 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 519569us
I20260709 13:12:13.547159 21470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:13.548087 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1385) took 1370 ms. Trace:
I20260709 13:12:13.548328 21470 raft_consensus.cc:606] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:13.548475 22034 rpcz_store.cc:276] 0709 13:12:12.159749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.159972 (+   223us) service_pool.cc:224] Handling call
0709 13:12:12.185541 (+ 25569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.319858 (+134317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.530189 (+1210331us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540045c254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:13.530371 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305944960}
I20260709 13:12:13.506964 26317 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:13.492465 26729 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.484035 26750 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.514031 26179 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:13.559726 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:13.562283 22031 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:13.530180 26649 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:13.564013 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:13.532466 26676 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:13.547741 26674 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:13.567652 26676 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.570132 26772 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:13.570751 26786 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:12:13.532719 26669 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:12:13.576107 26755 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:13.576577 26755 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:13.576927 26755 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:13.555338 26317 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:13.577955 26317 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:13.579330 26317 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:13.565935 26179 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:13.581171 26700 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:13.568248 26649 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:13.582525 26179 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:13.556546 26406 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:13.583328 26406 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.584168 26649 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:13.585305 26804 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:12:13.546989 26683 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:12:13.596241 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.017s	sys 0.022s
W20260709 13:12:13.596632 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.017s	sys 0.022s
I20260709 13:12:13.597553 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:13.598220 21391 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:13.599661 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.600103 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:13.602027 26692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.008s	sys 0.019s
I20260709 13:12:13.610071 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.600589 26752 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:12:13.625713 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 346270us
I20260709 13:12:13.597568 26674 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.633104 21391 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:13.607322 26700 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:13.602353 26649 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.626123 26692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.008s	sys 0.019s
W20260709 13:12:13.644742 26812 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:12:13.626318 26683 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.646530 26813 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:12:13.625834 26677 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:13.628640 26752 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:13.649780 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.656656 26726 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:13.668274 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.668941 21312 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:13.672758 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:13.678742 26566 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.680246 26432 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:13.680717 26432 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:13.681104 26432 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:13.666010 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 110151us
I20260709 13:12:13.666564 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:13.692570 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.694655 22031 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
W20260709 13:12:13.699888 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.685490 26752 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.704181 26752 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:13.688911 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.710480 26698 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:13.712216 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 61890.7us
I20260709 13:12:13.679466 26566 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.669623 26674 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:13.674185 26726 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:13.650050 26649 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:13.744711 21387 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:13.745927 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:13.746572 21387 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:13.747471 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:13.754035 26432 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:13.755156 21469 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:13.757088 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:13.758121 21394 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 15 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:13.667102 26683 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.763908 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:13.765456 21362 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:13.672062 26677 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.768392 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:13.780833 26683 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:13.782545 26649 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:13.778683 26751 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:13.783282 26751 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.783654 26751 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:13.784149 26566 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:13.787499 26406 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:13.743239 26763 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:12:13.791625 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:13.792506 22042 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:13.799350 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:13.822331 21393 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:12:13.861085 21392 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:13.862497 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:13.863873 26763 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:13.864500 26763 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:13.865623 26763 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.867026 21391 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:12:13.868515 26432 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:13.869190 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 131382us
W20260709 13:12:13.869968 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 80209.1us
I20260709 13:12:13.871672 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:13.872560 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 75486.9us
I20260709 13:12:13.875072 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:13.738842 26755 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:13.889506 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:13.890518 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:13.874761 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 98013.1us
I20260709 13:12:13.891875 22042 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:13.898205 21391 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:13.898321 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 99095.3us
W20260709 13:12:13.876556 26822 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:12:13.913075 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:13.867306 26763 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:13.893967 26698 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:13.936389 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61430.7us
W20260709 13:12:13.937134 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.938069 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:13.942011 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:13.924578 21314 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:13.946223 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:13.948098 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:13.948632 21470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
W20260709 13:12:13.955551 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52913.7us
I20260709 13:12:13.949375 21470 raft_consensus.cc:606] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:13.919287 26754 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:13.914321 26649 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:13.947742 26752 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:14.004002 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 241643us
W20260709 13:12:14.008739 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52501.8us
I20260709 13:12:13.939024 26566 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:14.014659 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.015398 21391 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:14.012715 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:13.996595 26784 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:12:13.955081 26714 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:14.025168 21391 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:14.006088 26754 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.012624 26752 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:13.986595 26574 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:12:14.019213 26566 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.014384 26510 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:13.991770 26722 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:12:14.005999 26581 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:12:14.021581 26818 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:13.949224 26698 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:14.168114 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 218185us
W20260709 13:12:14.199047 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.219374 21467 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:14.222411 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:14.273146 21468 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:14.223171 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:14.223340 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:14.277839 21466 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:12:14.283448 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 273378us
I20260709 13:12:14.216120 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:14.219132 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:14.256654 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 337262us
I20260709 13:12:14.281611 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:14.228382 26698 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:14.258172 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:14.284305 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.150139 26754 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:14.270040 26726 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 13:12:14.295346 21465 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:12:14.296380 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.160498 26820 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:12:14.250797 26821 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.246s	user 0.002s	sys 0.002s
I20260709 13:12:14.240716 26566 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:14.357033 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:14.318848 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:14.346467 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:14.217428 26829 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:14.297255 26681 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:14.354938 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:14.178421 26818 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:14.161123 26677 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:14.237932 26309 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:14.362941 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 76336.4us
W20260709 13:12:14.232647 26826 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:12:14.228668 26755 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.316385 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:14.168165 26510 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:14.168984 26814 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
I20260709 13:12:14.249935 26676 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:14.371456 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 64338.2us
I20260709 13:12:14.292476 26688 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.162390 26752 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.168902 26493 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:14.375590 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 155610us
I20260709 13:12:14.365299 26829 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:14.367457 26768 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:14.347177 26726 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.159303 26751 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.292865 26649 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:14.392088 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:14.386206 21396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.001s	sys 0.017s
W20260709 13:12:14.413139 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 128926us
I20260709 13:12:14.418992 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:14.409535 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 241928us
W20260709 13:12:14.417173 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 113469us
I20260709 13:12:14.421779 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:14.422113 21396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.002s	sys 0.017s
I20260709 13:12:14.370738 26681 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:14.433604 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 126930us
I20260709 13:12:14.393985 26795 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:14.436424 21312 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:14.409165 26493 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.440568 26829 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.450067 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:14.451359 26581 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:14.452454 21433 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.454984 26828 raft_consensus.cc:993] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:12:14.430313 26698 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:14.483793 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.437215 26582 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:14.457516 22036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1240) took 1962 ms (client timeout 1668 ms). Trace:
W20260709 13:12:14.458190 21392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 1975) took 1747 ms (client timeout 2090 ms). Trace:
I20260709 13:12:14.408260 26688 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.455459 26724 raft_consensus.cc:993] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:12:14.485324 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:14.469741 26726 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:14.488320 21392 rpcz_store.cc:269] 0709 13:12:12.710982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.711099 (+   117us) service_pool.cc:224] Handling call
0709 13:12:14.458020 (+1746921us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001c3754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:14.458113 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548221696}
W20260709 13:12:14.487706 22036 rpcz_store.cc:269] 0709 13:12:12.495086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.495230 (+   144us) service_pool.cc:224] Handling call
0709 13:12:14.457323 (+1962093us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:14.457448 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016552192}
I20260709 13:12:14.411121 26768 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.455492 26772 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:14.483422 26779 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:14.486702 26837 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:14.490268 26431 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:14.523392 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.502161 26582 raft_consensus.cc:1081] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:12:14.532307 21461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:14.562358 21461 raft_consensus.cc:606] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:14.562884 21461 raft_consensus.cc:614] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.487262 26676 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:12:14.534426 21465 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:12:14.535013 26785 raft_consensus.cc:1081] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:12:14.535401 26830 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:14.539496 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:14.540120 26581 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.542289 26566 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:14.550714 21393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 955) took 1901 ms (client timeout 1752 ms). Trace:
I20260709 13:12:14.574285 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.505544 26510 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:14.557575 26681 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.533233 26493 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.564533 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:14.517622 26431 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.610746 26431 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:14.509178 26772 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:14.554904 26669 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:14.616472 26669 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.618841 26669 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.620975 26836 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:14.525725 26837 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.634449 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:14.576853 26830 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.638125 26830 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:14.520732 26779 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.649493 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.650175 21389 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:14.656848 26688 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.657593 26768 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.492486 21466 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:14.577490 26676 consensus_queue.cc:1243] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:14.659668 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:14.661058 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:14.661631 22038 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:14.438453 26818 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.673403 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.675984 26774 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:14.684702 21462 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:14.479655 26795 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.585999 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.489732 26649 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:14.576668 21393 rpcz_store.cc:269] 0709 13:12:12.649485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.655370 (+  5885us) service_pool.cc:224] Handling call
0709 13:12:14.550439 (+1895069us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540017edd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:14.550587 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479743872}
I20260709 13:12:14.518894 26677 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.588179 26566 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.588490 26581 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.592691 26751 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.597414 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.598964 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.585089 26780 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:12:14.698505 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:14.704948 21314 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:14.708143 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:14.647781 26779 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:14.729976 22038 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:14.736583 21396 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:14.737689 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:14.635854 26837 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:14.743646 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:14.698446 26829 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:14.753921 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:14.754750 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:14.759063 22040 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:14.765942 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.764890 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:14.768874 22038 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:14.697829 26650 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:12:14.696175 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:14.771209 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.777395 21395 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:14.774199 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.757777 26753 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:14.739820 26785 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:12:14.785373 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 89282.8us
I20260709 13:12:14.764567 21314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:12:14.793032 21314 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:14.793485 21314 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:14.789223 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.796294 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:14.796962 21316 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:14.799642 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:14.800525 21315 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:14.795033 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:14.805981 26797 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.806766 26797 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.807818 26755 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:14.809520 26797 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:14.785432 26753 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:14.817580 26753 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:14.820403 26487 raft_consensus.cc:993] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:12:14.822470 26566 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.783794 26694 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:14.823186 26694 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:14.823465 26795 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:14.825688 26752 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.829432 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:14.830718 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50769.5us
I20260709 13:12:14.843721 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:14.846138 21320 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:14.846369 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46833.2us
I20260709 13:12:14.782835 26842 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:14.792094 26650 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:14.842639 26791 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:14.866206 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:14.866477 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 92375.6us
I20260709 13:12:14.867169 21315 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:12:14.859089 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 471196us
I20260709 13:12:14.849628 21314 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.872375 26581 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:14.886399 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.872375 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:14.894093 21395 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:14.852672 26685 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:14.896554 21316 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:14.897939 21362 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:14.874301 26509 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:14.864961 26791 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:14.904335 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 419355us
I20260709 13:12:14.869418 26779 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:12:14.910038 26693 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:14.895704 26692 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:14.875952 26688 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:14.873824 26487 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:14.896082 26685 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:14.874603 26757 raft_consensus.cc:1081] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:12:14.874758 26669 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:12:14.877444 26650 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:14.940462 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 141269us
I20260709 13:12:14.940799 26650 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.941550 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:14.874603 26752 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:14.918818 26791 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:14.916211 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:14.930824 21314 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:14.928625 26781 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.939539 26693 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:14.900785 26509 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:14.951067 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:14.950251 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:14.956758 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 333505us
I20260709 13:12:14.960353 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:14.949177 26754 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.579s	user 0.003s	sys 0.008s
W20260709 13:12:14.968531 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52416.9us
I20260709 13:12:14.968919 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:14.971980 22042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42358
I20260709 13:12:14.945087 26685 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.932276 26688 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:14.887673 26772 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.884744 26694 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:14.965608 26752 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.974179 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:14.972591 22042 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:14.995360 22042 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:14.993643 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:14.968914 26834 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:14.975757 26786 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:15.006908 21389 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:14.979503 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 1989) took 1106 ms. Trace:
I20260709 13:12:14.981348 21314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:12:14.932441 26692 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.000628 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:14.980105 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:14.978952 26843 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.957369 26781 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.022202 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:15.028673 26835 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:12:15.029707 21215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 287) took 12427 ms (client timeout 15000 ms). Trace:
I20260709 13:12:15.003445 26694 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:15.029608 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:14.975323 26754 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.001013 26782 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:15.002676 26406 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:15.007252 26786 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.976449 26830 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.011096 26834 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:15.027251 26636 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.061440 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:15.061659 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.061915 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.060765 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.007782 21394 rpcz_store.cc:276] 0709 13:12:13.873468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.876213 (+  2745us) service_pool.cc:224] Handling call
0709 13:12:13.905479 (+ 29266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.905742 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:14.606342 (+700600us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b18003a9660. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2c2c103c7 00007fc2bf2229a7 00007fc2bf2320bf
0709 13:12:14.606489 (+   147us) log.cc:844] Serialized 14 byte log entry
0709 13:12:14.977768 (+371279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:14.977841 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:14.979265 (+  1424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.979343 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.979450 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13758,"prepare.queue_time_us":32516,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":9302,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":18319,"spinlock_wait_cycles":14037248,"thread_start_us":446329,"threads_started":2}
I20260709 13:12:15.032404 26795 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.075268 21321 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:15.028740 26847 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.067005 21388 pending_rounds.cc:85] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 10
I20260709 13:12:15.085713 21388 pending_rounds.cc:107] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:12:15.086052 21388 raft_consensus.cc:2889] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:15.032922 21215 rpcz_store.cc:269] 0709 13:12:02.595464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.595733 (+   269us) service_pool.cc:224] Handling call
0709 13:12:15.022844 (+12427111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:10.795536 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:10.860576 (+ 65040us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:10.860632 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:12:10.860654 (+    22us) tablet.cc:662] Decoding operations
0709 13:12:10.862569 (+  1915us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:10.862665 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:10.862693 (+    28us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:12:10.930519 (+ 67826us) tablet.cc:701] Row locks acquired
0709 13:12:10.930566 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:12:11.011377 (+ 80811us) write_op.cc:270] Start()
0709 13:12:11.023670 (+ 12293us) write_op.cc:276] Timestamp: P: 1783602730939511 usec, L: 0
0709 13:12:11.023717 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:12:11.024510 (+   793us) log.cc:844] Serialized 9222 byte log entry
0709 13:12:11.266851 (+242341us) op_driver.cc:464] REPLICATION: finished
0709 13:12:11.491090 (+224239us) write_op.cc:301] APPLY: starting
0709 13:12:11.491192 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:11.815497 (+324305us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:11.815625 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:12.367178 (+551553us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b180027df00. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bef570ec 00007fc2bef59af7 00007fc2bef5afb0 00007fc2c2c6f1bb 00007fc2c2cb65d4 00007fc2c2b628da 00007fc2c2b653cb 00007fc2c2b64fd3 00007fc2c2c63e34
0709 13:12:12.898426 (+531248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:12.899038 (+   612us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:12:12.899112 (+    74us) write_op.cc:312] APPLY: finished
0709 13:12:12.900044 (+   932us) log.cc:844] Serialized 204 byte log entry
0709 13:12:13.255840 (+355796us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.272986 (+ 17146us) write_op.cc:454] Released schema lock
0709 13:12:13.387592 (+114606us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:13.436852 (+ 49260us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.438207 (+  1355us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":141993,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":213526,"apply.run_cpu_time_us":60869,"apply.run_wall_time_us":1925437,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100543,"num_ops":23,"prepare.queue_time_us":526550,"prepare.run_cpu_time_us":13722,"prepare.run_wall_time_us":348403,"raft.queue_time_us":96356,"raft.run_cpu_time_us":33205,"raft.run_wall_time_us":234971,"replication_time_us":222007,"spinlock_wait_cycles":9086720,"thread_start_us":912309,"threads_started":5,"wal-append.queue_time_us":410544,"wal-append.run_cpu_time_us":11511,"wal-append.run_wall_time_us":2154071}]]}
I20260709 13:12:15.078495 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:15.080520 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 275101us
I20260709 13:12:14.998219 26509 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.082769 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.098451 21393 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:15.011546 26431 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.102749 21465 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:15.081779 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.058706 26674 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:15.070966 26785 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:15.067131 26786 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:15.030445 26843 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.107455 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.127288 21387 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:15.075941 26818 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:15.088678 26803 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.099803 21219 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 6 to 7, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 7 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.144104 26772 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.134049 26818 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.109037 26844 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:15.145018 26844 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:15.146368 26818 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.145953 26844 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.110363 26487 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:15.050788 26693 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.167795 21314 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.088470 26795 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.168367 21314 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:15.153249 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:15.152263 21316 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:15.176203 26830 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.149111 26487 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:15.181066 26487 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.186043 26834 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.187934 26844 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:15.190536 26685 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.197351 26843 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:15.198418 26688 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.200023 26791 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.200870 26431 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.201908 26754 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.202610 21219 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 6 to 7, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 7 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.206288 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:15.216516 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 152801us
I20260709 13:12:15.217552 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:15.206650 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.206825 22042 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.207031 21314 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.209960 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:15.203007 26753 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.212917 26692 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.213892 26781 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.136404 26803 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.221719 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.225694 21465 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:15.219935 21320 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:15.149093 26714 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:12:15.207084 26676 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:15.228657 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:15.228828 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:15.232525 21467 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:15.237493 21466 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:15.237490 22042 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.239344 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:15.239523 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:15.240357 21320 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:15.235749 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 147368us
I20260709 13:12:15.241660 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:15.222470 26832 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:15.245021 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:15.245911 21360 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:15.242851 26676 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.250595 26685 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:15.251080 22034 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 4.
I20260709 13:12:15.254009 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:15.254761 21469 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:15.257025 26795 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.260762 21219 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 6 to 9, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 9 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.262612 26752 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:15.264329 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:15.265049 21312 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:15.265112 26768 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:15.265673 26768 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.269464 26753 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.272392 26803 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.252928 26782 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.273054 26782 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.276346 26782 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.279178 22002 leader_election.cc:400] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:15.279572 22002 leader_election.cc:403] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:15.280171 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:15.280743 26818 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:15.255112 21469 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:15.263545 21219 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 8 to 9, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 9 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.283757 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.284013 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:15.285579 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.286394 21390 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 5.
I20260709 13:12:15.243846 26677 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:15.288439 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:15.289076 21393 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:15.285856 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.290328 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:15.290218 21396 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:15.291927 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.292018 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:15.292603 21470 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:15.292986 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.246047 26692 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:15.253518 26847 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.294523 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:15.295034 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:15.295938 22042 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:15.303157 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:15.303524 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:15.287699 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:15.298491 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:15.298621 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.267827 26768 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.299768 21470 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:15.293087 21469 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.299826 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:15.305897 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.307185 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:15.292666 21219 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 6 to 9, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 9 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.249379 26844 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:15.350741 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:15.351305 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48230.3us
I20260709 13:12:15.351783 26753 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:15.352782 26801 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:15.353178 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.301928 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:15.355437 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.356217 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:15.356930 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.357138 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.400002 21317 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:15.400132 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.312613 21463 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:15.305773 21390 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:15.365305 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:15.386797 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.402173 21467 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:15.402583 21467 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:15.288385 26179 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.394861 21219 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:15.402343 21468 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:15.396368 21393 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:15.399111 21315 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 5.
I20260709 13:12:15.293736 26677 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:15.410890 21387 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:15.365396 26685 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.413237 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2878) took 1033 ms. Trace:
I20260709 13:12:15.410722 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:15.414276 21321 rpcz_store.cc:276] 0709 13:12:14.380081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.381873 (+  1792us) service_pool.cc:224] Handling call
0709 13:12:14.382174 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.077410 (+695236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.413008 (+335598us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54003c8cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:15.413174 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593413504}
I20260709 13:12:15.419269 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:15.420497 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:15.412528 26179 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.426726 26509 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:15.428169 26179 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:15.415091 26677 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:15.431156 26722 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:15.431722 26722 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.432206 26722 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:15.434234 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.446201 21320 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:15.416366 21467 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.448079 21467 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:15.449046 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:15.449862 21316 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:15.398260 26801 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.450604 21470 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:15.451442 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.455334 21317 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:15.364804 26786 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.486934 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.500922 21393 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 5.
W20260709 13:12:15.482896 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 62498.4us
I20260709 13:12:15.504071 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:15.443719 26780 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:15.511725 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:15.480008 26845 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:12:15.513252 21219 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 3 to 11, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 11 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.516379 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.443383 26676 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:15.412091 26824 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
W20260709 13:12:15.522428 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.489173 26801 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:15.445266 26685 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.508754 26493 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:15.552506 21461 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:15.559067 21462 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:15.521916 21219 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.502646 26650 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:15.567816 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.569552 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.544530 26849 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:15.520306 26780 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:15.598620 26853 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.384s	user 0.002s	sys 0.000s
I20260709 13:12:15.602295 21314 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.608189 26791 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.610966 26722 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:15.582876 26694 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.005s
I20260709 13:12:15.617861 26677 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.620714 22041 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
W20260709 13:12:15.623602 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43916.6us
I20260709 13:12:15.631740 21467 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:15.620551 26780 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.635545 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:15.631331 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55816.3us
I20260709 13:12:15.621767 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:15.643996 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:15.636953 26848 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:15.664521 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:15.665103 21468 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:15.665661 26757 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:15.685704 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:15.650966 26432 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.668675 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:15.689199 21394 raft_consensus.cc:2393] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:15.682562 21319 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:15.686443 21468 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:15.667085 26855 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:15.690937 21468 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:15.693852 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:15.680133 26861 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.698899 21314 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:15.663367 26849 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:15.679744 26848 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:15.680462 26677 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.694113 21468 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.685303 26832 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:15.702966 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:15.704555 21468 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:15.693181 26855 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:15.709554 26864 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:15.706634 26832 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:15.723198 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:15.702445 26861 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:15.717515 26872 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:12:15.730008 26801 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.738433 26722 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.706048 26574 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:12:15.748366 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.749333 21319 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:12:15.754524 26818 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13.
I20260709 13:12:15.740242 21314 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:15.766738 26722 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:15.767421 22035 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:15.767315 26722 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.768246 26849 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.769495 26722 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.737643 26832 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.774489 21468 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:15.740903 26864 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:15.775156 21312 raft_consensus.cc:2368] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15.
I20260709 13:12:15.788514 26861 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:15.741118 26848 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.789990 26848 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:15.777103 26786 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:15.804193 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 407964us
I20260709 13:12:15.808144 21314 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:15.808933 26847 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:15.809510 26847 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.812412 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:15.812736 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 453742us
I20260709 13:12:15.813088 21394 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:15.816335 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:15.817705 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 515815us
I20260709 13:12:15.819684 26692 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:15.820262 26768 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:15.822650 26844 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.828099 21389 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:15.828763 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.830354 21362 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:15.830493 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:15.831974 21387 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:15.832202 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:15.838840 21391 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:15.833421 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:15.839633 21390 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:15.834417 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.835042 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.840659 21395 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:15.836297 26835 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:12:15.844358 26780 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:15.847416 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 104836us
I20260709 13:12:15.848922 26795 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:15.850044 26782 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:15.851176 21362 leader_election.cc:400] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15.
I20260709 13:12:15.851495 26768 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:15.852703 26864 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.774003 26855 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.869297 26487 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.870923 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:15.933629 21388 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:12:15.872223 26685 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.873100 26844 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:15.873971 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43536.6us
I20260709 13:12:15.941907 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:15.874482 26875 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:15.944386 26693 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:15.944525 26875 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:15.945463 26875 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.875787 26781 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.948915 26781 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.887425 21469 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:15.950634 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:15.950984 26781 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.951243 21466 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:15.890882 21391 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:15.952946 21387 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:15.953629 26847 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:15.900629 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:15.912947 26817 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:15.955123 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 54617.5us
I20260709 13:12:15.955964 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:15.957243 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:15.899814 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:15.892689 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:15.958360 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 65761.3us
I20260709 13:12:15.958761 26786 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.959266 26650 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:15.959681 26862 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.958333 21462 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:15.961449 21396 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:12:15.962169 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.916116 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:15.905212 21390 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
W20260709 13:12:15.919802 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 68772.3us
W20260709 13:12:15.922801 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.924710 26782 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:15.969727 21316 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:12:15.924779 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:15.926167 26179 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:15.927879 26833 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:15.987613 21316 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:15.988071 26833 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.990419 26833 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.928375 26787 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:15.991204 26787 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.930897 26824 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:15.993474 26787 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.921964 26802 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:12:15.995831 26824 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:15.996285 26824 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:15.934454 26768 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:15.997285 26824 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:15.997285 26677 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:12:15.998705 26824 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:16.008136 26649 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:16.010456 21469 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:15.937752 21394 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:15.954972 26817 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.957743 26844 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.966387 21317 raft_consensus.cc:2368] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:12:15.966553 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:15.919595 26795 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.021961 26795 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.026786 26817 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:16.028491 26780 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.969310 26782 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:16.013767 26179 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.030164 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:16.022601 26837 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:15.973949 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:16.032416 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 58545.1us
I20260709 13:12:16.034392 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:16.035393 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:16.035431 21463 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:16.038625 26797 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:16.039155 26797 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:16.038981 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:16.038643 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:16.043666 21464 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:15.939472 26692 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.046656 26692 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.048790 26692 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:15.983538 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:16.049270 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:16.049477 21319 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:12:15.984246 26855 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:16.050917 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:16.013726 21462 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:12:15.914991 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:16.052531 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 137623us
W20260709 13:12:16.055308 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 112205us
I20260709 13:12:16.056749 26649 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:16.015282 21470 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:16.057219 26649 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.057602 26649 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.016482 21312 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:12:16.058691 21312 pending_rounds.cc:85] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 11
I20260709 13:12:16.059008 21312 pending_rounds.cc:107] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:12:16.059307 21312 raft_consensus.cc:2889] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:15.959811 26650 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:16.056017 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:16.061430 26650 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.062260 26779 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:16.062701 26779 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.063040 26779 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:16.064778 26751 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:16.065456 26751 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:16.065909 26751 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:15.914006 26801 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:16.070438 26847 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:16.071310 26844 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:16.029825 26782 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.072865 26782 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:16.075760 22035 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:16.031436 26832 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.080533 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:16.081081 22038 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.044845 26797 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:15.972841 21466 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:16.088717 26786 raft_consensus.cc:2764] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:12:16.090956 22038 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:12:16.019372 26833 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:16.092924 26833 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.094970 26833 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:16.018891 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52438.7us
I20260709 13:12:16.100970 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:16.102710 21466 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:16.107791 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:16.031615 26179 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:16.100354 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:16.121816 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:16.131732 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:16.134125 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:16.136153 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:16.138463 22002 leader_election.cc:400] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:12:16.139946 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:16.140259 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:16.141999 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:16.144989 21388 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:16.145961 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:16.148840 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:16.149742 21466 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:16.128393 21284 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:16.146317 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45422.8us
I20260709 13:12:16.162202 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:16.162631 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:16.168699 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:16.180248 26835 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:16.182104 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 53866.1us
I20260709 13:12:16.172509 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:16.187129 21465 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:16.188526 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.158506 26861 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:16.123740 26847 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:12:16.204107 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:16.202244 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46509.8us
I20260709 13:12:16.191376 26714 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:16.191560 26782 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:12:16.164268 26795 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.204206 26861 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:16.257160 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 68786.8us
I20260709 13:12:16.214416 26692 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:16.264624 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:16.258417 26861 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:16.250072 26714 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:16.263041 26694 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:16.302870 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:16.249218 26768 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:16.305861 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 133546us
I20260709 13:12:16.306303 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:16.309007 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:16.309171 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.310113 21391 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 6: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:16.312347 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.291209 26855 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:16.317436 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.273082 26797 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:12:16.320621 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:16.321218 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.323729 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:16.325687 21396 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:16.325918 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.330103 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.314814 26694 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:16.332890 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.314831 26842 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:16.334558 26669 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:16.330303 26855 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:16.342645 26855 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:16.345006 26649 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.331732 26832 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:16.360639 26714 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.363423 21396 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:16.326704 26730 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:16.370056 26694 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:16.371217 26694 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:16.326589 26817 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:16.379143 26879 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
W20260709 13:12:16.381826 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49045.2us
I20260709 13:12:16.381860 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:16.387027 22041 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 6: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:16.391172 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:16.321996 26774 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:16.334349 26179 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:16.384348 26795 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 6 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:16.388622 26669 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:16.398074 26844 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.432548 26768 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:16.400696 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73441.1us
I20260709 13:12:16.462201 26649 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:16.481448 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:16.487614 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:16.498243 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 291024us
I20260709 13:12:16.500116 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:16.479992 26779 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.518328 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:16.523993 21463 raft_consensus.cc:2368] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15.
W20260709 13:12:16.525642 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 340018us
I20260709 13:12:16.533078 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:16.533869 21396 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:12:16.533872 21391 raft_consensus.cc:2368] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:12:16.524806 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:16.548506 21464 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:16.556154 26681 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:16.720861 21469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.018s	sys 0.008s
W20260709 13:12:16.733210 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 427019us
W20260709 13:12:16.783492 21469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.018s	sys 0.012s
I20260709 13:12:16.782924 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:16.556061 26751 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:16.764995 26786 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.707237 26650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.009s	sys 0.017s
W20260709 13:12:16.770135 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 196148us
I20260709 13:12:16.562211 26754 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.782405 26832 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:16.765837 21319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.000s	sys 0.025s
I20260709 13:12:16.814786 26832 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.817498 26832 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:16.818183 26832 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:16.825331 26887 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:16.825946 26887 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:16.827421 26887 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:16.848598 26824 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.008s
W20260709 13:12:16.808281 26650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.010s	sys 0.020s
W20260709 13:12:16.856745 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 302520us
W20260709 13:12:16.832232 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 270841us
W20260709 13:12:16.859272 21462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.019s	sys 0.013s
W20260709 13:12:16.859807 21462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.019s	sys 0.013s
I20260709 13:12:16.860455 26875 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:16.863904 26875 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:16.867780 26875 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:16.869575 21360 leader_election.cc:400] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15.
I20260709 13:12:16.870262 21360 leader_election.cc:403] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:12:16.870987 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 83109.5us
I20260709 13:12:16.872329 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:16.881323 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:16.869755 26669 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.809249 26786 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.812175 26754 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:16.883597 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 75384.3us
W20260709 13:12:16.884980 21387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.009s	sys 0.015s
I20260709 13:12:16.885327 21469 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:16.889336 21392 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:12:16.890323 21387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.009s	sys 0.015s
I20260709 13:12:16.891716 21396 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:12:16.894508 26786 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:16.897667 26754 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:16.882077 26692 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:16.875205 26693 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:16.898651 26692 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:16.899288 26693 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.901643 26693 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:16.906486 26855 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.907123 26855 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:16.876291 26877 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15.
I20260709 13:12:16.910385 21396 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:16.921825 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:16.922109 26865 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:16.928488 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:16.933496 21467 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:16.928128 21997 leader_election.cc:400] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:12:16.934609 21997 leader_election.cc:403] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:12:16.936158 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:16.876942 26650 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:16.942365 21319 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:12:16.952952 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:16.974918 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.913774 26855 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:16.937492 26861 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 13:12:16.921900 26751 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:16.938181 26818 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 5. Current term is 6.
I20260709 13:12:17.000988 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:17.001884 21393 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:17.005302 26676 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:17.009618 26883 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:12:17.032909 26692 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:17.033769 26692 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.034404 26692 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.997140 26861 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.048967 26754 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.049815 26754 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.996894 26824 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.053042 26824 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:16.923719 26669 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.058787 26669 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:16.997432 21467 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
W20260709 13:12:17.068931 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 129890us
I20260709 13:12:17.073809 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:17.084678 21467 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:17.077725 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:17.055968 26824 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:17.088879 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:17.068557 26901 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:17.153333 26901 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.155452 21393 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:17.163010 26875 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.165675 26692 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:17.172230 26754 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:17.173082 26754 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:17.090040 26693 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:12:17.279057 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 281887us
W20260709 13:12:17.387981 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 296057us
I20260709 13:12:17.291424 26693 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:17.297551 26650 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:17.409998 26865 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:17.399811 26911 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:17.401371 26910 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.427968 26917 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:17.431320 26693 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.411823 26864 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:12:17.434094 26847 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:17.469441 26865 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:17.495967 26911 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.554147 26910 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.580492 26688 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.588889 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 188667us
I20260709 13:12:17.561812 26847 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:17.605367 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 216279us
I20260709 13:12:17.611622 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:17.612397 21314 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:17.613145 21316 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:17.591384 26688 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.602429 26918 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:17.621485 26875 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:17.620350 26729 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:17.651507 26779 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:17.656674 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:17.657424 21316 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:17.635774 26674 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:17.659250 26674 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.601266 26650 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.662263 26674 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:17.665864 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:17.675458 21387 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:17.678326 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:17.679575 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:17.637643 26692 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:17.680239 21395 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:17.691026 21316 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:17.680730 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:17.693691 21319 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:17.698448 26801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.001s	sys 0.010s
I20260709 13:12:17.702005 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:17.676514 26847 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:17.699913 21392 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:17.645980 26729 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.712787 26729 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:17.712163 26801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.001s	sys 0.010s
I20260709 13:12:17.714886 26887 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.721155 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:17.721804 21319 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:17.724812 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:17.635905 26918 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.725971 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:17.726656 21313 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:17.727622 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:17.728289 21315 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:17.703135 26692 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.729260 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:17.730439 26692 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:17.731438 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:17.707154 26781 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:17.724866 26911 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:17.708110 26910 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:17.709474 26688 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:17.728300 26918 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:17.698964 26795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.004s	sys 0.005s
I20260709 13:12:17.742103 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:17.745528 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:17.769410 21321 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:17.747825 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:17.750528 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:17.772264 21318 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:17.776772 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 76244.6us
W20260709 13:12:17.779599 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48250.6us
I20260709 13:12:17.742837 26927 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.739785 26729 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:17.792316 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:17.781575 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:17.795423 21396 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:17.795506 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:17.768803 26910 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:17.740963 26768 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:12:17.814366 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:17.815626 26688 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:17.804407 26886 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:17.816658 26693 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:17.817327 26920 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:17.805608 26927 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.832672 26886 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:17.860224 26934 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:12:17.871760 26937 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:17.872519 26937 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.873086 26937 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:17.877390 26920 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.886777 26886 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:17.857781 26940 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:17.905421 26901 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:17.908442 26920 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:17.910019 26861 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:17.910804 26861 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:17.911212 26938 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:17.911350 26861 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.911918 26938 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.927271 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:17.930112 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:17.932850 21388 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:17.841164 26693 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:17.817759 26910 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.850631 26674 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:17.952011 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:17.930069 26786 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.948097 26895 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.034s	user 0.015s	sys 0.000s
I20260709 13:12:17.935207 26942 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:17.951491 26901 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:17.961720 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 142737us
I20260709 13:12:17.945124 26922 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:17.936391 26795 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.944346 26941 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.946748 26693 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:17.971968 21315 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:17.935644 26927 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:17.951349 26832 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:17.935930 26835 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:17.985302 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1419) took 1667 ms. Trace:
I20260709 13:12:17.987373 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:17.978986 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 164681us
I20260709 13:12:17.993058 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:17.993906 26835 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.045372 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2593) took 1922 ms. Trace:
I20260709 13:12:18.045722 26835 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:18.045748 21462 rpcz_store.cc:276] 0709 13:12:16.122805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.122915 (+   110us) service_pool.cc:224] Handling call
0709 13:12:16.123294 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:16.190682 (+ 67388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.190712 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:16.208240 (+ 17528us) log.cc:844] Serialized 52 byte log entry
0709 13:12:16.860727 (+652487us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:16.860766 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.860856 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.874992 (+1014136us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:18.045052 (+170060us) raft_consensus.cc:1685] finished
0709 13:12:18.045074 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.045313 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66337,"raft.queue_time_us":61347,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":38988160,"thread_start_us":605638,"threads_started":1,"wal-append.queue_time_us":684500}
I20260709 13:12:18.039940 26837 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:18.048355 26837 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.049054 26832 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.991910 26917 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:17.979761 26942 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.055536 26574 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.056190 26574 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:17.971652 26786 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.043673 26910 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.057642 26779 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:18.058089 26779 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:17.986047 26901 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.058928 26779 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:17.985741 26754 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:17.957386 26674 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.062506 26938 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:18.059963 26754 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.051738 26917 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:18.042414 26931 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:12:18.079011 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.079864 21462 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:18.081878 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:17.997521 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:18.083647 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 130253us
I20260709 13:12:18.084326 21462 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:12:18.087927 21468 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:18.082121 22035 rpcz_store.cc:276] 0709 13:12:16.317901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.318092 (+   191us) service_pool.cc:224] Handling call
0709 13:12:16.318439 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:16.327643 (+  9204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.327689 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:16.328435 (+   746us) log.cc:844] Serialized 52 byte log entry
0709 13:12:16.806385 (+477950us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:16.806444 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.806537 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.871032 (+1064495us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b24002ea1f8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc169fb0 00007fc2bede0488 00007fc2bede0be8 00007fc2bedb8398 00007fc2bedb376a 00007fc2bedb2bb6
0709 13:12:17.978666 (+107634us) raft_consensus.cc:1685] finished
0709 13:12:17.978691 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.985199 (+  6508us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3109,"raft.queue_time_us":9837,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6383,"spinlock_wait_cycles":50305920,"thread_start_us":404358,"threads_started":1,"wal-append.queue_time_us":622638}
I20260709 13:12:18.060716 26779 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:18.111884 21470 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:17.980535 26946 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:18.112653 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:18.114964 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 127647us
I20260709 13:12:18.113289 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.115659 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:17.990720 26795 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.020316 26927 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:18.015964 26797 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:17.993171 26941 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.121960 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.127708 22038 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:17.989024 26922 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.133392 26574 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.115375 26832 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:18.111325 26833 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.107662 26948 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:12:18.134650 26833 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.136899 26833 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:18.137786 26941 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.138693 26941 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:18.139205 26941 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.140139 26947 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:18.140605 26947 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:18.140973 26947 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:18.146195 26487 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:18.146570 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.146725 26930 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.147446 26930 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.148384 26754 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.151010 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.132793 21463 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:18.152590 26942 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:18.153268 26930 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:18.161691 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46108.9us
I20260709 13:12:18.166812 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:18.168690 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:18.170461 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:18.171397 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:18.172986 21317 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:12:18.173532 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.114714 26946 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:18.180773 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 71568.2us
I20260709 13:12:18.114478 26938 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:18.183616 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.183779 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.185329 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.186084 21396 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:18.188519 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.107081 26910 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:12:18.194945 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.195076 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.197887 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.198398 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.198606 21465 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:18.205302 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.206230 22038 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:12:18.121057 26944 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:18.038339 26865 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:18.204195 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 405280us
I20260709 13:12:18.207752 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:18.208827 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.215261 22038 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:18.212733 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.212783 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.134693 26922 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.217965 21463 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
W20260709 13:12:18.224593 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 406941us
I20260709 13:12:18.227738 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.146799 26487 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.228269 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.131166 26927 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.231909 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:18.232918 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:18.228339 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:18.235666 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.247648 21465 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:12:18.231528 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.231246 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.193948 26946 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:18.248961 26948 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:18.229802 26887 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.212602 26574 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.262770 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.157804 26797 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.251523 22035 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:18.252478 21393 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:18.217226 26943 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.282829 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:18.306110 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 95670.8us
I20260709 13:12:18.206660 26949 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:18.207371 26938 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.302474 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:18.307260 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 93915.7us
I20260709 13:12:18.312979 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:18.288996 26650 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:18.321441 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.230237 26951 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.243153 26862 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:18.351248 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:18.352525 21319 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:18.250288 26939 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.263908 26786 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:18.245282 26917 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.334131 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.263017 26676 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:12:18.336896 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:18.497609 21469 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:18.337226 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 108894us
I20260709 13:12:18.264248 26674 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.278589 26901 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.347822 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.287006 26754 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:18.352607 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:18.548161 21317 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:18.347841 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:18.301620 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 96671.5us
I20260709 13:12:18.373493 22035 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:18.412381 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:18.322727 26919 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:18.487494 21388 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:18.335805 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:18.345178 26906 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:12:18.324613 26949 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.490322 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.222882 26944 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.336298 26650 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.350104 26933 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:18.603823 26933 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.606037 26933 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.384455 26945 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:18.606710 26945 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.608398 26751 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:18.608855 26945 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.302707 26887 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.608952 26751 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.557585 26674 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.612391 26674 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.322121 26574 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.614419 26674 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.614596 26574 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.450839 26837 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.615896 26938 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:18.617197 26927 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.592943 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:18.550285 26693 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.002s
I20260709 13:12:18.595391 26677 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:18.491753 26939 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.385025 26951 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.599828 26941 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.557652 26919 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.590418 26949 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:18.583297 26923 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.647950 21469 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:18.652138 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:18.662447 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 248899us
I20260709 13:12:18.328383 26943 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.664039 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:18.576946 26940 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:18.682129 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 224300us
I20260709 13:12:18.682341 26940 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.610994 26751 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.547720 26754 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:18.665246 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:18.674505 21469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:18.685787 26754 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:18.686264 21469 raft_consensus.cc:606] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:18.619210 26650 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:18.679960 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:18.702775 26650 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.713629 26650 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.611016 26887 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:18.711239 21463 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:18.706703 26754 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.651636 26801 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:18.658387 26919 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.804658 26865 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.809458 26797 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.810554 26649 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:18.811250 26649 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:18.711607 26685 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:18.812480 26685 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.812427 26649 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.814942 26685 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:18.782254 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 96656.7us
W20260709 13:12:18.711340 26937 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.837s	user 0.009s	sys 0.006s
I20260709 13:12:18.820420 26937 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.821812 26944 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.659178 26669 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:18.822621 26937 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:18.823096 26779 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.712s	user 0.006s	sys 0.000s
I20260709 13:12:18.822901 26669 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.826408 26487 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.658802 26714 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.168s
I20260709 13:12:18.654620 26677 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.664594 26795 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.829116 26677 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.651961 26693 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.830616 26943 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.449956 26862 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.782678 26927 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:18.833375 26862 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.618117 26917 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:12:18.678849 26955 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:18.641463 26948 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.130s
W20260709 13:12:18.771834 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 119801us
I20260709 13:12:18.831022 26774 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:18.809549 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 144397us
I20260709 13:12:18.837455 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:18.837149 26955 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.708546 26923 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.837342 26774 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:18.916368 26848 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.917111 26848 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:18.919943 26848 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:18.831766 26693 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:18.929461 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.930514 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:18.931182 22034 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
W20260709 13:12:18.931619 21359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.508s (SENT) [suppressed 10 similar messages]
I20260709 13:12:18.932152 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:18.970912 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:18.972909 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:18.974701 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:18.983777 21465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.029s	sys 0.049s
W20260709 13:12:18.984277 21465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.029s	sys 0.049s
W20260709 13:12:18.913048 26835 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.867s	user 0.009s	sys 0.002s
W20260709 13:12:19.027693 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 55031.5us
I20260709 13:12:18.887086 26865 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.033105 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:18.970589 26955 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:18.926784 26944 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.043670 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:19.046060 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 71477.8us
I20260709 13:12:19.047087 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.041096 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:18.951788 26833 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:19.062285 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 224915us
I20260709 13:12:19.026970 26581 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:19.027879 26779 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.031385 26930 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.035563 26787 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:19.088784 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45211.8us
I20260709 13:12:19.093219 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.094501 26948 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:19.082449 26779 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.091779 26917 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:12:19.106864 26779 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.109367 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:19.109642 26946 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.819s	user 0.008s	sys 0.000s
I20260709 13:12:19.110208 26946 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.111577 26941 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.112792 26754 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.034180 26835 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.115173 26835 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.100188 26930 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.116348 22038 raft_consensus.cc:2368] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
I20260709 13:12:19.116961 26774 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.116205 22041 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:19.117799 26930 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.118350 26669 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.041971 26865 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.120079 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.120766 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.120847 26779 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:19.121336 26865 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.121352 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.122432 26919 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.123325 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:19.123508 21467 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:19.127933 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.128729 21467 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:19.129495 26886 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.242s	user 0.008s	sys 0.007s
I20260709 13:12:19.129598 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.130021 26886 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.130766 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.136605 26886 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.138386 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:19.139189 26669 raft_consensus.cc:993] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower bfcd9560f8f44414b25f8069384c5a73 to start an election
W20260709 13:12:19.139703 26947 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.998s	user 0.008s	sys 0.004s
I20260709 13:12:19.139775 26669 raft_consensus.cc:1081] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Signalling peer bfcd9560f8f44414b25f8069384c5a73 to start an election
I20260709 13:12:19.140300 26947 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.142596 26947 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.145388 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:19.145643 21461 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:19.147069 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.147818 21469 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:19.072757 26833 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.125587 26861 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.124873 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:19.148991 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.159300 21469 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:19.131769 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.072592 26955 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:19.173182 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.161442 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:19.154762 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 62311.7us
I20260709 13:12:19.164546 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:19.165632 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.166505 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:19.175550 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:19.172014 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:19.176746 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:19.173810 21312 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:19.178289 21317 raft_consensus.cc:2368] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:19.178512 21314 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:19.067641 26944 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.182297 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.102324 26948 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.158792 26795 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:19.212728 26779 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:19.213199 26779 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:19.213580 26779 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:19.216344 26795 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:19.216893 26985 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.217041 26795 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.218003 26923 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.218732 26956 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:19.219153 26956 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.219295 26795 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.219540 26956 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:19.222333 26833 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.223048 26779 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.224537 26959 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:19.225447 26779 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.177762 26920 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:19.216259 26960 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:19.228263 26946 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.135804 26949 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.246511 21466 raft_consensus.cc:2368] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:19.206369 26948 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:19.177538 26977 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:19.249265 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.249552 22036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:42358
I20260709 13:12:19.250048 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:19.235164 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 303548us
I20260709 13:12:19.285686 22036 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:19.286334 22036 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:19.289577 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.160066 26886 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:12:19.262032 21312 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:19.262648 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.264192 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.205648 26927 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:19.225211 26959 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.341956 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:19.377971 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.378422 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.433302 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.436873 21388 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:19.437394 21320 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:19.438187 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.240298 26975 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:19.344439 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.338632 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.448648 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:19.245436 26960 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.292430 26779 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.444979 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:19.472177 21388 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:19.454972 21387 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:12:19.451828 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.341089 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.474057 22034 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:19.338574 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.453501 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.474706 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:19.479310 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.480304 21391 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:19.252137 26754 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:19.478871 22036 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.487314 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:19.483531 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 306875us
I20260709 13:12:19.484745 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.261492 26714 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:19.338280 26669 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.291988 26574 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:19.447597 26975 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.493361 21315 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:19.513804 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:19.260670 26937 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:19.495810 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.313510 26977 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:19.500963 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:19.506572 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.509924 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:19.523599 21316 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:19.511443 26983 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:12:19.547686 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 793) took 1039 ms. Trace:
I20260709 13:12:19.548125 22031 rpcz_store.cc:276] 0709 13:12:18.508325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.508553 (+   228us) service_pool.cc:224] Handling call
0709 13:12:18.770258 (+261705us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b5800011198. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:12:18.770491 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.770780 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.770806 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.771251 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.067561 (+296310us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:19.067627 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.067744 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.547394 (+479650us) raft_consensus.cc:1685] finished
0709 13:12:19.547419 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.547623 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11093888,"thread_start_us":295951,"threads_started":1,"wal-append.queue_time_us":436043}
I20260709 13:12:19.552266 26941 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.553505 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2608) took 1218 ms. Trace:
I20260709 13:12:19.512925 26669 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.553912 21466 rpcz_store.cc:276] 0709 13:12:18.335322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.335503 (+   181us) service_pool.cc:224] Handling call
0709 13:12:19.553321 (+1217818us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54002490d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:19.553450 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581751168}
I20260709 13:12:19.555462 26669 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.481948 26779 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.557279 26960 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.555187 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.558229 26779 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.558496 21466 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:19.530581 26940 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.559207 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.559832 21394 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:19.531584 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2934) took 1365 ms. Trace:
I20260709 13:12:19.560772 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 780) took 1568 ms. Trace:
I20260709 13:12:19.561064 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.560918 21318 rpcz_store.cc:276] 0709 13:12:18.165855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.167849 (+  1994us) service_pool.cc:224] Handling call
0709 13:12:18.168208 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.325625 (+157417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.325670 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:18.325728 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:18.325773 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.531285 (+1205512us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54003ae8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:19.531341 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.531514 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361314176}
I20260709 13:12:19.562269 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.562454 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.563416 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.563562 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2034) took 1482 ms. Trace:
I20260709 13:12:19.521673 26574 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.508388 26714 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:19.540693 26989 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:19.541815 26949 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.556372 21390 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:19.558573 21391 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:19.596709 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.597469 22031 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:19.559764 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.541337 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.524457 22036 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.598979 21469 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:19.599740 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.600441 21316 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:12:19.525497 26927 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:19.563947 21468 rpcz_store.cc:276] 0709 13:12:18.081410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.081546 (+   136us) service_pool.cc:224] Handling call
0709 13:12:19.563404 (+1481858us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b5400217d54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:19.563509 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11519360}
I20260709 13:12:19.604208 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:19.604792 21468 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:19.604836 21388 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:19.520205 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.594290 21463 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:19.560761 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.606129 21394 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:12:19.501663 26754 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.600282 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.521824 26975 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:19.595350 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2049) took 1407 ms. Trace:
I20260709 13:12:19.560761 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.526595 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:19.601577 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:19.596477 21314 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:19.598220 21387 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:19.606276 21464 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:19.578903 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54798.2us
I20260709 13:12:19.564113 22041 rpcz_store.cc:276] 0709 13:12:17.992620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.992806 (+   186us) service_pool.cc:224] Handling call
0709 13:12:19.560625 (+1567819us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004cac54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:19.560717 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2366588672}
I20260709 13:12:19.674714 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:19.673368 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2932) took 1930 ms. Trace:
I20260709 13:12:19.610363 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.675503 21467 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:19.677088 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:19.650801 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:19.688876 21388 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:19.689045 21394 raft_consensus.cc:2368] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
I20260709 13:12:19.686829 21313 rpcz_store.cc:276] 0709 13:12:17.743050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.743295 (+   245us) service_pool.cc:224] Handling call
0709 13:12:18.065225 (+321930us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800181298. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3eee 0000000000375939 00007fc2c41671e0 00007fc2c42300c4 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:12:18.065427 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.352299 (+286872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.352326 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:18.352363 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:18.352405 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.673053 (+1320648us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540021a7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:19.673118 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.673292 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661721216}
I20260709 13:12:19.673988 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:19.653422 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:19.698009 21312 raft_consensus.cc:2368] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
W20260709 13:12:19.698236 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44915.7us
W20260709 13:12:19.698997 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 97508.4us
I20260709 13:12:19.699862 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:19.609198 26956 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.703023 26956 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.704236 26676 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:19.704811 26676 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.707091 26676 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.710743 26649 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:19.711982 21469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:19.713340 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:19.714251 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.715023 22040 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:12:19.719825 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.720534 22040 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
I20260709 13:12:19.638919 21395 rpcz_store.cc:276] 0709 13:12:18.187507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.187642 (+   135us) service_pool.cc:224] Handling call
0709 13:12:18.193369 (+  5727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.193629 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:18.225302 (+ 31673us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.545488 (+1320186us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b18002f5ea0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287
0709 13:12:19.595031 (+ 49543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.595077 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:19.595116 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.595190 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.595297 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15446,"prepare.queue_time_us":32475,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":17168,"raft.queue_time_us":363013,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":39897,"spinlock_wait_cycles":37274368,"thread_start_us":82642,"threads_started":1}
I20260709 13:12:19.524547 26977 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:19.600046 26833 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:19.655090 26714 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.727550 26918 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:19.727456 26938 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:19.639529 26927 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.734253 26912 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:19.749095 26944 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.749415 21320 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:12:19.730734 21466 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:19.743631 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:19.742794 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:19.751492 22035 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:19.730108 26574 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.723775 21467 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:19.674140 26919 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.722241 26980 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:19.735504 21388 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:19.730260 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:19.761721 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:19.747542 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:19.766348 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:19.610868 26969 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.149s
I20260709 13:12:19.746292 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.674976 26904 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:19.711225 26649 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:19.766189 21467 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:19.595327 26937 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.758546 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:19.767819 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2047) took 1507 ms. Trace:
I20260709 13:12:19.741870 26959 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.776422 21467 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:19.791185 21467 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.749631 26912 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.770136 26574 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:19.596779 26795 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:19.726393 26754 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.776274 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:19.770498 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:19.759472 26944 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:19.765573 26980 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:19.796072 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2040) took 1612 ms (client timeout 1887 ms). Trace:
I20260709 13:12:19.787238 21465 rpcz_store.cc:276] 0709 13:12:18.260137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.260421 (+   284us) service_pool.cc:224] Handling call
0709 13:12:18.260876 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.984583 (+723707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.984614 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.027476 (+ 42862us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.158417 (+130941us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:19.158466 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.158544 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.767566 (+609022us) raft_consensus.cc:1685] finished
0709 13:12:19.767605 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.767765 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20863,"raft.queue_time_us":66962,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":16645,"thread_start_us":786925,"threads_started":2,"wal-append.queue_time_us":243753}
I20260709 13:12:19.796965 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 871) took 1563 ms. Trace:
I20260709 13:12:19.810019 26795 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.748703 26938 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.747041 26975 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.862432 26975 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.859675 26938 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.863400 26832 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:19.863970 26832 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:19.864454 26832 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:19.865310 26795 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.852332 21462 rpcz_store.cc:276] 0709 13:12:18.233335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.233476 (+   141us) service_pool.cc:224] Handling call
0709 13:12:18.233781 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.294147 (+ 60366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.294175 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:18.294224 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:18.294255 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.796745 (+1502490us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b540029a9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:19.796794 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.796913 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138358144}
W20260709 13:12:19.853744 26948 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.005s
I20260709 13:12:19.866312 26948 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:19.870383 22038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1425) took 1643 ms (client timeout 1508 ms). Trace:
W20260709 13:12:19.871177 22038 rpcz_store.cc:269] 0709 13:12:18.227303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.227464 (+   161us) service_pool.cc:224] Handling call
0709 13:12:19.870089 (+1642625us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54005055d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:19.870289 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996839680}
I20260709 13:12:19.853680 26980 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:19.854269 21461 rpcz_store.cc:269] 0709 13:12:18.183264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.183433 (+   169us) service_pool.cc:224] Handling call
0709 13:12:19.795861 (+1612428us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400217354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:19.795984 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210121600}
I20260709 13:12:19.846336 26944 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.767709 26914 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:12:19.785039 22035 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
W20260709 13:12:19.873734 21393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.040s	sys 0.096s
I20260709 13:12:19.873915 26949 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:19.881704 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:19.855918 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:19.787976 26904 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.801647 26574 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:19.873092 26833 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.816286 26676 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:19.896396 21465 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:19.743728 26977 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:19.901887 26994 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:12:19.897965 26574 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.946872 22038 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:19.904526 26833 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.875362 26649 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:19.896745 26949 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:19.955317 26990 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.420s	user 0.002s	sys 0.000s
I20260709 13:12:19.950907 26676 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:19.950196 26948 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.961452 26939 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.961036 26927 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.975834 21469 raft_consensus.cc:606] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:19.969938 26649 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.915870 26832 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:19.971822 22042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.009s	sys 0.041s
I20260709 13:12:19.969606 26676 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:19.980108 26904 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:19.982998 26977 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.975565 26937 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.976791 26912 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:19.993455 26949 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:19.993959 26920 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:19.994443 26920 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:20.000587 26980 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.002694 26951 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:20.003708 26980 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.012326 26801 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:20.013074 26801 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:20.014209 26801 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.021886 26944 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.043211 26919 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:20.043888 26919 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:20.044996 26919 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:19.767748 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:20.077639 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 309738us
I20260709 13:12:20.095324 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.097882 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.100389 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:20.106981 21219 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 185) took 54697 ms (client timeout 15000 ms). Trace:
I20260709 13:12:20.111392 21317 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:20.113637 21321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.007s	sys 0.007s
I20260709 13:12:19.804061 21315 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:20.115304 21389 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
W20260709 13:12:20.115984 21392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.000s	sys 0.011s
W20260709 13:12:20.116616 21396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.002s	sys 0.010s
W20260709 13:12:19.767851 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 118185us
W20260709 13:12:20.120328 21359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.012s	sys 0.016s
I20260709 13:12:19.976390 21469 raft_consensus.cc:614] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:20.125836 21465 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:19.973162 21468 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
W20260709 13:12:20.129400 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.132782 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:20.134168 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:19.978762 22042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.009s	sys 0.041s
W20260709 13:12:20.138669 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 380072us
I20260709 13:12:20.142175 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 865) took 1948 ms. Trace:
I20260709 13:12:20.116011 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:20.169842 21467 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:20.180663 26676 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.186015 26685 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.187373 26722 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:20.191310 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:20.193359 22034 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:20.196359 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52388.3us
I20260709 13:12:20.196861 26669 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:20.198055 26754 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:20.171725 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:20.206848 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:20.015916 26801 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.211759 26832 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:20.212803 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.214845 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.099895 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:20.217325 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.224639 26833 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:20.227240 26909 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:20.249480 21359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.012s	sys 0.016s
W20260709 13:12:20.254635 21392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.012s
W20260709 13:12:20.255071 21396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.003s	sys 0.010s
I20260709 13:12:20.282630 21464 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:20.254101 21321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.008s	sys 0.008s
I20260709 13:12:20.250602 26722 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:20.284399 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:20.284731 26722 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.284788 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:20.286329 22040 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:20.289026 26919 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:20.290061 26920 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.290655 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 820) took 1037 ms. Trace:
I20260709 13:12:20.284211 21319 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:20.234769 21470 rpcz_store.cc:276] 0709 13:12:18.182848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.182994 (+   146us) service_pool.cc:224] Handling call
0709 13:12:18.224446 (+ 41452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.280507 (+ 56061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.280537 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.281102 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:12:18.721676 (+440574us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b48001e0258. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:12:19.537799 (+816123us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b18002e7320. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:12:19.975630 (+437831us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:19.975701 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.975805 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.127864 (+152059us) raft_consensus.cc:1685] finished
0709 13:12:20.127904 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.130384 (+  2480us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b54000b8450. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:20.130605 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":221004,"raft.queue_time_us":60897,"raft.run_cpu_time_us":2515,"raft.run_wall_time_us":431467,"spinlock_wait_cycles":46606720,"thread_start_us":437600,"threads_started":1,"wal-append.queue_time_us":1755059}
I20260709 13:12:20.296365 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:20.298018 21316 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:20.301625 26956 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:20.303294 26676 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:20.304278 26669 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.304776 26757 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:20.295650 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:20.308269 21317 rpcz_store.cc:276] 0709 13:12:19.253338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.253468 (+   130us) service_pool.cc:224] Handling call
0709 13:12:19.253842 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:20.278730 (+1024888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.290357 (+ 11627us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540021acd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:20.290594 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970876288}
I20260709 13:12:20.324340 26688 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:20.324645 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 850022us
W20260709 13:12:20.229800 21219 rpcz_store.cc:269] 0709 13:11:25.409422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.409768 (+   346us) service_pool.cc:224] Handling call
0709 13:12:20.106723 (+54696955us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:15.947646 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:15.948220 (+   574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:15.948253 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:12:15.948269 (+    16us) tablet.cc:662] Decoding operations
0709 13:12:15.949146 (+   877us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:15.949222 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:15.949258 (+    36us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:12:15.949886 (+   628us) tablet.cc:701] Row locks acquired
0709 13:12:15.949903 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:12:15.950043 (+   140us) write_op.cc:270] Start()
0709 13:12:15.950150 (+   107us) write_op.cc:276] Timestamp: P: 1783602735949992 usec, L: 0
0709 13:12:15.950173 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:12:16.040987 (+ 90814us) log.cc:844] Serialized 3242 byte log entry
0709 13:12:16.497474 (+456487us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf213e28 00007fc2c2c4e581 00007fc2c2c4dd58 00007fc2c2c529f1 00007fc2c2c529a9 00007fc2c2c52939 00007fc2c2c52901 00007fc2c2c51b2d 000000000038f354 000000000038f199
0709 13:12:17.004661 (+507187us) op_driver.cc:464] REPLICATION: finished
0709 13:12:17.422160 (+417499us) write_op.cc:301] APPLY: starting
0709 13:12:17.422280 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:17.576520 (+154240us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:17.576574 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:17.712024 (+135450us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:17.712269 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:12:17.712320 (+    51us) write_op.cc:312] APPLY: finished
0709 13:12:17.712675 (+   355us) log.cc:844] Serialized 81 byte log entry
0709 13:12:17.712881 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:17.713044 (+   163us) write_op.cc:454] Released schema lock
0709 13:12:17.713110 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:17.728417 (+ 15307us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:17.728448 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3429194,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":417170,"apply.run_cpu_time_us":15817,"apply.run_wall_time_us":306234,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37663,"num_ops":8,"prepare.queue_time_us":276384,"prepare.run_cpu_time_us":129267,"prepare.run_wall_time_us":550045,"raft.queue_time_us":536529,"raft.run_cpu_time_us":12084,"raft.run_wall_time_us":401508,"replication_time_us":1054271,"spinlock_wait_cycles":49910144,"thread_start_us":1293803,"threads_started":4,"wal-append.queue_time_us":408860,"wal-append.run_cpu_time_us":15225,"wal-append.run_wall_time_us":2282196}]]}
I20260709 13:12:20.325179 26685 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.327090 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:20.332890 22040 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
W20260709 13:12:20.329162 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 229671us
I20260709 13:12:20.328310 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1434) took 1398 ms. Trace:
W20260709 13:12:20.355994 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 60035.7us
I20260709 13:12:20.364852 26685 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.366031 26978 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:20.366742 26978 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.367214 26978 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:20.359823 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2053) took 1017 ms. Trace:
I20260709 13:12:20.331028 26904 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:20.344950 26757 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.382957 26751 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:20.383625 26751 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:20.347347 22042 rpcz_store.cc:276] 0709 13:12:18.929742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.931807 (+  2065us) service_pool.cc:224] Handling call
0709 13:12:18.951251 (+ 19444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.951489 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:19.099089 (+147600us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.327253 (+1228164us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.327509 (+   256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:20.327575 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:20.327669 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.327782 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.328009 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18951,"prepare.queue_time_us":185876,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":51360,"thread_start_us":1203800,"threads_started":2,"wal-append.queue_time_us":935886}
I20260709 13:12:20.392196 26924 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:20.399654 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 113580us
I20260709 13:12:20.410144 26722 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:20.410934 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 239584us
I20260709 13:12:20.372962 21396 rpcz_store.cc:276] 0709 13:12:19.342365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.342486 (+   121us) service_pool.cc:224] Handling call
0709 13:12:19.342790 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.558976 (+216186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.559005 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.559480 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:12:20.282633 (+723153us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:20.282754 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.311178 (+ 28424us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540020f3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:20.311230 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.334350 (+ 23120us) raft_consensus.cc:1685] finished
0709 13:12:20.334379 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.359747 (+ 25368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45232,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":28167,"spinlock_wait_cycles":496417152,"thread_start_us":722430,"threads_started":1,"wal-append.queue_time_us":768807}
I20260709 13:12:20.327971 26909 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.353084 26754 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.401041 26751 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:20.432941 26980 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:20.433568 26980 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:20.433988 26980 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.437034 21314 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:20.437330 26669 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.438213 26754 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.439713 26909 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.439956 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:20.408243 26833 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:20.441526 26833 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.448576 26722 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.449352 26722 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:20.450220 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 154821us
I20260709 13:12:20.451153 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:20.453712 27008 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:20.454367 27008 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:20.455010 27008 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.446902 26964 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:20.456429 26964 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.456820 26964 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:20.472566 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 58011.9us
I20260709 13:12:20.443986 26833 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:20.467011 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.009s	sys 0.007s
I20260709 13:12:20.471293 21467 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
W20260709 13:12:20.478873 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:20.476234 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.007s	sys 0.010s
W20260709 13:12:20.483476 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.010s	sys 0.008s
W20260709 13:12:20.501399 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 688914us
W20260709 13:12:20.502149 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.509276 26685 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:20.511010 26685 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:20.511464 26685 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:20.513020 26685 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.514695 26757 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.515851 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:20.516945 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:20.518149 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:20.518630 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:20.520016 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:20.520984 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57898 (request call id 25) took 1309 ms. Trace:
I20260709 13:12:20.521412 21469 rpcz_store.cc:276] 0709 13:12:19.211815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.711854 (+500039us) service_pool.cc:224] Handling call
0709 13:12:20.520619 (+808765us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54000b8454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf212853 00007fc2c41e060a 00007fc2bd7667d4 00007fc2bd766762 00007fc2bd766691 00007fc2bd76660c 00007fc2bd7658c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:20.520761 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605376896}
I20260709 13:12:20.522349 26912 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:20.522811 26912 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:20.523180 26912 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:20.524896 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:20.527909 26757 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:20.528407 26757 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:20.528787 26688 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.529265 26688 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:20.530731 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.532802 26920 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:20.533164 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.514729 26685 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:20.544936 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.545849 21320 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:20.528407 26929 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:20.547761 26929 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.548182 26929 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:20.543953 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 217084us
I20260709 13:12:20.528820 26757 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:20.565251 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:20.559877 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:20.568989 21362 leader_election.cc:400] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:20.575070 21362 leader_election.cc:403] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:20.571794 21469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:20.579447 26956 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:20.580008 21469 raft_consensus.cc:606] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:20.580562 21469 raft_consensus.cc:614] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:20.580314 26956 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.574780 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2057) took 1259 ms. Trace:
W20260709 13:12:20.590183 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48171.3us
I20260709 13:12:20.584323 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:20.593559 26959 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:20.594409 26998 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:20.594341 26959 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.596325 26946 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:20.596735 26946 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.597123 26946 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.582104 21462 rpcz_store.cc:276] 0709 13:12:19.241289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.883863 (+642574us) service_pool.cc:224] Handling call
0709 13:12:19.884369 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.945157 (+ 60788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.945208 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.947728 (+  2520us) log.cc:844] Serialized 26 byte log entry
0709 13:12:20.467454 (+519726us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:20.475482 (+  8028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.481704 (+  6222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.481772 (+    68us) raft_consensus.cc:1685] finished
0709 13:12:20.481790 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.500838 (+ 19048us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23158,"raft.queue_time_us":63694,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3131,"thread_start_us":296909,"threads_started":1,"wal-append.queue_time_us":493650}
I20260709 13:12:20.592634 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:20.607839 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 2941) took 1442 ms. Trace:
I20260709 13:12:20.596757 26956 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.634328 26920 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:20.634976 26920 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:20.636062 26920 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:20.638533 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 75154.9us
I20260709 13:12:20.639814 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:20.640712 26946 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.626227 26729 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:20.642587 26729 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.630921 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:20.645617 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 105218us
W20260709 13:12:20.621592 26921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.011s	sys 0.028s
W20260709 13:12:20.651309 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 104388us
I20260709 13:12:20.626495 26956 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:12:20.652621 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 64101.5us
I20260709 13:12:20.652125 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:20.656668 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 114287us
I20260709 13:12:20.658519 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:20.664968 27019 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:20.665777 26948 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:20.666091 21360 leader_election.cc:400] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:20.666626 26948 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.667845 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:20.670121 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:20.678380 27013 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:12:20.678694 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.679703 21392 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:20.680258 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:20.684912 26956 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:20.685431 26956 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:20.685802 26956 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:20.688863 26959 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.689693 21997 leader_election.cc:400] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
I20260709 13:12:20.690068 21997 leader_election.cc:403] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:12:20.691062 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:20.691478 27008 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.692163 27008 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
I20260709 13:12:20.693130 27008 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:20.694087 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:20.654306 26649 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.016s
I20260709 13:12:20.697058 26685 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:20.698715 27010 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.266s	user 0.001s	sys 0.002s
W20260709 13:12:20.699390 26574 consensus_meta.cc:287] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.755s	user 0.003s	sys 0.015s
I20260709 13:12:20.700580 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2059) took 1458 ms. Trace:
I20260709 13:12:20.700656 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:20.702114 26669 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:20.701172 21463 rpcz_store.cc:276] 0709 13:12:19.241814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.911101 (+669287us) service_pool.cc:224] Handling call
0709 13:12:19.913990 (+  2889us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:19.950463 (+ 36473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.950492 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:19.951106 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 13:12:20.436276 (+485170us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:20.436332 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.436431 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.697966 (+261535us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:20.699990 (+  2024us) raft_consensus.cc:1685] finished
0709 13:12:20.700014 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.700322 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35988,"raft.queue_time_us":36198,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":10119,"spinlock_wait_cycles":27953024,"thread_start_us":444353,"threads_started":1,"wal-append.queue_time_us":479518}
I20260709 13:12:20.689502 26959 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:20.695921 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:20.707868 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:20.710495 27012 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:12:20.711978 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 828) took 1236 ms. Trace:
I20260709 13:12:20.712385 21313 rpcz_store.cc:276] 0709 13:12:19.475317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.719958 (+244641us) service_pool.cc:224] Handling call
0709 13:12:19.720274 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.720584 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.720610 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.722441 (+  1831us) log.cc:844] Serialized 26 byte log entry
0709 13:12:20.140305 (+417864us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b18000b5a80. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:12:20.569241 (+428936us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:20.569288 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.573564 (+  4276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.709782 (+136218us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:20.711603 (+  1821us) raft_consensus.cc:1685] finished
0709 13:12:20.711632 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.711813 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1197,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"spinlock_wait_cycles":26214656,"thread_start_us":397663,"threads_started":1,"wal-append.queue_time_us":851385}
I20260709 13:12:20.718298 26669 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.721271 26969 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.722167 26944 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:20.722754 26944 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.706722 27008 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:20.724808 27008 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.726161 26688 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.721901 26969 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.671413 26676 raft_consensus.cc:2764] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:12:20.610919 21321 rpcz_store.cc:276] 0709 13:12:19.161694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.163686 (+  1992us) service_pool.cc:224] Handling call
0709 13:12:19.163944 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.164151 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:20.283796 (+1119645us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.566178 (+282382us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.569602 (+  3424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:20.576554 (+  6952us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:20.586583 (+ 10029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.589656 (+  3073us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.604465 (+ 14809us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11649,"prepare.queue_time_us":881736,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":583,"raft.queue_time_us":6103,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":6355,"thread_start_us":1287217,"threads_started":2}
I20260709 13:12:20.736289 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.699827 26574 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.705691 26946 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:20.740382 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:20.748378 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:20.747848 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:20.752735 26688 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.753058 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.751904 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1029) took 1192 ms. Trace:
I20260709 13:12:20.755712 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2058) took 1462 ms. Trace:
I20260709 13:12:20.756121 21461 rpcz_store.cc:276] 0709 13:12:19.241557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.882758 (+641201us) service_pool.cc:224] Handling call
0709 13:12:19.883368 (+   610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.898806 (+ 15438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.898853 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.899461 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:12:20.363308 (+463847us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:20.647117 (+283809us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.651752 (+  4635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.655141 (+  3389us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.655178 (+    37us) raft_consensus.cc:1685] finished
0709 13:12:20.655189 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.703986 (+ 48797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3234,"prepare.queue_time_us":290076,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1175,"raft.queue_time_us":67449,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":1361,"spinlock_wait_cycles":52023296,"thread_start_us":746388,"threads_started":2,"wal-append.queue_time_us":488662}
I20260709 13:12:20.757756 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.758437 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.759179 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:20.759554 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.759963 21392 raft_consensus.cc:2368] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18.
I20260709 13:12:20.755368 26912 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.760196 26914 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:20.759997 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.760565 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.758533 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.754766 21389 rpcz_store.cc:276] 0709 13:12:19.556977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.592701 (+ 35724us) service_pool.cc:224] Handling call
0709 13:12:19.593021 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:20.280389 (+687368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.743775 (+463386us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54003426d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:20.749359 (+  5584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199674112}
W20260709 13:12:20.762938 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 67110.3us
I20260709 13:12:20.730636 26980 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.765601 21465 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:20.772321 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.773026 21393 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:20.775007 26669 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:20.778716 26944 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.779220 21470 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:20.784061 26722 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.784291 26574 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.784718 26722 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.787041 26722 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.788502 21319 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:12:20.789633 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.787900 21388 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
W20260709 13:12:20.792061 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 232230us
I20260709 13:12:20.796777 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:20.775769 26946 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:20.809581 26969 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:20.810738 26912 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:20.812587 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 72599.8us
I20260709 13:12:20.813539 22002 leader_election.cc:400] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14.
I20260709 13:12:20.816061 26980 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.771831 26948 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.825006 26729 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.794826 26978 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.832891 26964 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.834949 26978 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:20.835237 26964 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:20.837415 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:20.839661 26946 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:20.840437 21314 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:12:20.843715 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.845198 26751 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.846614 26929 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.847462 26751 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:20.848690 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 179505us
I20260709 13:12:20.854009 21465 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
W20260709 13:12:20.855445 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67144.4us
I20260709 13:12:20.857295 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:20.853753 21360 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:20.861407 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.865685 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:20.865963 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.866523 21319 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:20.872108 26950 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:20.867300 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:20.867987 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.873559 21395 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:20.877323 21314 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:20.873858 21316 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:20.857190 26909 raft_consensus.cc:2764] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:12:20.876183 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:20.885740 26757 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.888195 21467 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:20.907522 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.874866 26751 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:12:20.912020 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59191.9us
W20260709 13:12:20.914094 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 60648.6us
I20260709 13:12:20.914554 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.915666 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:20.918834 21321 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:20.921092 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:20.922753 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 71619.4us
I20260709 13:12:20.921725 21394 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:20.922885 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:20.928138 22034 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.932451 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:20.933234 21315 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:20.935117 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.938405 26685 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:20.942117 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:20.942920 22042 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:20.945150 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:20.947304 21466 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:20.947757 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:20.948541 21467 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:20.950205 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:20.951184 26964 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:20.953251 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:20.954869 27021 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:12:20.956240 26964 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:20.957175 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:20.958240 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:20.958462 26964 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:20.958982 26964 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:20.960008 26964 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.963925 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:20.964876 21470 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:20.964998 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.966840 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.967593 21396 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:20.969627 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.970091 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.970484 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:20.969313 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.971104 21392 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:20.971253 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.972397 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.973037 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.973206 21396 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:20.972455 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:20.973814 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:20.974170 21389 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:12:20.974408 21390 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:20.975358 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54921.5us
I20260709 13:12:20.976225 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:20.977070 26951 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:20.977537 26909 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:20.977676 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:20.987494 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:20.920826 26751 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:20.989661 26751 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:20.992383 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:20.993088 21317 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:20.993450 26956 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:20.995671 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.996685 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:20.996944 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:20.997627 21318 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:21.001314 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:21.001632 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:21.002158 21319 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:21.002184 21320 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:21.004383 21218 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:21.006016 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:21.006139 21218 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 7 to 8, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 8 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:21.008591 26950 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:21.016319 26950 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:20.919548 26757 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:21.016728 26950 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:21.001263 26929 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:21.021569 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.008374 22034 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:21.028053 21392 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:21.015004 21390 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:21.029618 21317 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
W20260709 13:12:21.054523 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 130812us
W20260709 13:12:21.032088 27024 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:12:20.995654 26956 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:21.028261 21315 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:21.060622 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:21.057461 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 78395.5us
I20260709 13:12:21.074204 21395 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:12:21.076483 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.076918 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.072325 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:21.078997 21467 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:21.080953 21321 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:12:21.080720 21318 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:21.082406 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.085901 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:21.086082 21463 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:21.086621 21316 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:21.087121 21465 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:21.087585 21470 raft_consensus.cc:2410] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:12:21.088210 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:21.069845 26978 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.087990 26909 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:21.094980 22031 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:21.080286 26956 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:21.094149 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:21.097584 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.098192 21470 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:21.093192 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.084910 26944 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:21.103075 21315 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:21.094596 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:21.086385 26998 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:21.105827 26998 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.094736 26980 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:21.108866 26980 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:21.109261 26980 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.109352 26998 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:21.105861 26950 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.112280 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:21.112996 21461 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:21.112998 26950 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:21.114998 22042 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:21.117890 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.119282 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.119750 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.120141 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.120486 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.120661 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.121251 21388 raft_consensus.cc:2368] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18.
I20260709 13:12:21.121589 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.122071 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.122298 21390 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:21.123910 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:21.124617 22031 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.124768 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:21.125440 22036 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:21.127161 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:21.127903 22036 raft_consensus.cc:2368] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:12:21.128229 26978 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.130358 26978 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:21.130892 26978 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:21.131392 26978 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:21.131242 26729 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:21.132814 27023 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:21.133253 27023 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:21.133549 26729 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:21.134372 27023 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.135097 26998 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:21.135665 26998 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:21.136961 26998 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.137941 27023 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:21.146342 26980 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.148808 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:21.153134 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.154021 26912 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:21.154687 26912 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:21.154012 21387 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:21.155143 26912 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.155637 26948 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.156297 26948 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.159627 26948 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:21.160214 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.162206 26944 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:21.163512 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.148914 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.165675 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.166672 21461 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:21.166589 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:21.163259 26944 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.167831 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.168740 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:21.169066 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:21.153923 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62765.1us
I20260709 13:12:21.170245 21462 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:12:21.170042 26978 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.171114 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:21.171844 21218 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 11 to 14, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 14 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.172775 21464 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:21.139699 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.174301 22031 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:12:21.152007 26998 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:21.176784 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.177659 26948 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:21.207005 26948 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:21.207427 26948 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:21.207888 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.208415 26946 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:21.208573 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 69014.3us
I20260709 13:12:21.178830 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:21.209947 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:21.210987 26946 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:21.211970 26921 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:21.212163 21284 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:21.212438 26921 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:21.212837 26921 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.213119 26574 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:21.213687 26574 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:21.213977 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:21.214102 26574 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:21.216104 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.198691 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:21.217257 21284 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:21.201040 26914 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:21.165752 21467 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:21.205264 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:21.219980 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:21.224407 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:21.225409 21470 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:21.228839 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:21.230679 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:21.234910 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:21.236424 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:21.232715 26722 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:21.239184 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:21.239769 21395 raft_consensus.cc:606] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:21.240193 21395 raft_consensus.cc:614] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:21.103782 26956 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.243050 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:21.243521 21218 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 10 to 12, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 12 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.246294 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:21.248466 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:21.250488 21315 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:21.253142 22040 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:21.245494 26722 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:21.232849 26929 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:21.198601 27019 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:12:21.262698 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.238346 26914 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:21.249497 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:21.242233 26969 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:21.282297 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:21.230428 26688 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:12:21.283748 22042 raft_consensus.cc:2368] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
I20260709 13:12:21.256516 26729 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.303323 21218 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 5 to 12, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 12 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:21.237079 26754 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:12:21.298550 26938 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:21.299090 26937 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:21.255080 26722 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:21.282048 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:21.335544 22038 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:21.314152 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:21.316779 26688 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:21.338691 21465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
W20260709 13:12:21.300257 27027 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:12:21.326715 27030 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:12:21.258132 26929 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:21.339668 22031 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:21.333514 21218 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 7 to 11, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 11 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.341881 22035 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:21.283095 26980 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:21.346699 22042 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:21.264402 26959 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 13:12:21.341921 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 98223.3us
I20260709 13:12:21.265576 26751 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.349682 26969 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:21.309599 26685 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:21.319978 26938 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.338305 26722 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:21.361609 21218 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 7 to 9, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 9 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.362314 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:21.334426 27019 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:21.350395 27020 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:21.337327 26688 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:21.252303 26948 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.358341 26929 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:21.383512 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 166314us
I20260709 13:12:21.337069 27023 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:12:21.373288 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.367686 26685 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:21.389391 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.396416 21470 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:21.319034 26729 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.375336 26938 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.399477 21284 leader_election.cc:400] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:12:21.383930 26754 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:21.382866 27020 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:21.403297 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 153917us
I20260709 13:12:21.403705 21284 leader_election.cc:403] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:21.400481 21218 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:21.404372 21466 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:21.413534 21395 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:21.414453 26729 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:21.415755 27029 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:12:21.415992 26688 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.416455 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.417375 26688 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:21.419047 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.419988 26751 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.422345 26751 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:21.424456 26757 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:21.376072 26980 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:12:21.410005 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.411738 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:21.431932 21390 raft_consensus.cc:2368] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:12:21.413322 26714 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:12:21.428879 26685 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.436988 26685 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:21.438083 26904 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:21.438537 26904 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:21.441655 26912 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.442878 21469 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:21.444389 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.409160 26801 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:21.446659 26801 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.447237 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.447909 21393 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.449429 26969 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.450487 21218 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 9 to 10, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 10 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:12:21.452507 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49348.5us
I20260709 13:12:21.429567 26669 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:21.461089 22035 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
W20260709 13:12:21.459648 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 63608.7us
I20260709 13:12:21.463089 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.468122 27031 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.452123 21218 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 9 to 11, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 11 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:21.435974 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:21.408787 26754 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:21.481673 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57880.9us
I20260709 13:12:21.482664 27037 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:21.483441 27037 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.484182 26751 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:21.483970 27037 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.484388 26978 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.484601 21394 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:21.484956 26978 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.486263 27037 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:21.487146 26978 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:21.487213 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:21.487838 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:21.488168 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52339.8us
I20260709 13:12:21.487213 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.488925 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:21.488998 21394 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:21.484754 26751 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.492087 26978 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:21.494095 26751 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:21.495604 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.496400 21388 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:21.495991 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:21.497124 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:21.475683 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 88202.2us
I20260709 13:12:21.500626 21218 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 7 to 10, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 10 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:21.503122 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:21.403880 27019 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:12:21.516357 21468 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:21.457100 26801 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:21.460603 26912 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:21.505635 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 86669.1us
I20260709 13:12:21.501927 26978 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:21.502432 26754 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:21.522725 26751 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:21.473935 27038 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.398912 26914 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.476105 26946 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 13:12:21.555862 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50906.2us
I20260709 13:12:21.583940 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.584808 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:21.518762 26956 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:21.588065 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.589507 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:21.584903 21464 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:21.444391 27020 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:21.601593 27043 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:12:21.604179 26959 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:21.608742 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:21.601593 26946 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:21.614152 27038 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.616362 21218 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 9 to 12, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 12 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:21.618090 26904 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.626204 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.626269 26574 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.627270 26929 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.628621 26904 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:21.628872 26574 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:21.564002 26722 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.632938 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:21.633754 21321 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:21.634776 21462 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:21.637405 26722 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:21.636873 21218 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:21.638872 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49453.2us
W20260709 13:12:21.640956 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 89903.7us
W20260709 13:12:21.641938 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 281256us
I20260709 13:12:21.645356 21393 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:12:21.649040 26929 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:21.649722 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.650182 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:21.650731 22042 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:21.652205 26948 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:21.621394 26669 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:21.653282 26669 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.653673 26669 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:21.647095 21218 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 11 to 14, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 14 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.656297 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:21.661078 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52410.9us
I20260709 13:12:21.661876 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.661875 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:21.667687 22042 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:21.624950 26946 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:21.624436 26959 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.670075 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.613021 26921 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:21.689826 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43991.5us
I20260709 13:12:21.690989 21218 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:12:21.694130 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.695573 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:21.688601 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 187028us
I20260709 13:12:21.668942 26751 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:21.705374 21462 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:21.704728 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.706614 21393 raft_consensus.cc:2368] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:12:21.706542 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:21.672138 26978 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:21.724295 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:21.724941 21392 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:21.688233 26959 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:21.723724 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:21.729082 21462 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:21.744235 21464 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:21.747673 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.696875 26909 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:21.750015 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 279936us
I20260709 13:12:21.759284 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:21.769981 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.779292 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:21.783602 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 84474.5us
I20260709 13:12:21.784684 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.786351 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:21.703198 27037 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:12:21.779183 26722 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:21.825212 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:21.826924 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.828961 26920 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:21.829468 26722 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:21.829775 27034 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:21.830895 26722 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.832634 27037 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:21.833070 27037 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:21.833179 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.833976 27037 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.834913 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.836256 27020 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:21.837005 27037 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:21.795750 27042 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:12:21.789736 26921 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:21.800323 26938 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:21.791759 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:21.840982 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 49348.6us
I20260709 13:12:21.841228 26938 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:21.730490 27049 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:12:21.842670 21359 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:21.814033 26946 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.843638 27036 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:21.844251 26951 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:21.817417 27031 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:12:21.836416 26948 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.714241 26729 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:12:21.781679 27010 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:21.845499 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:21.852819 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 129470us
I20260709 13:12:21.855731 26924 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.868628 26938 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:21.869144 26938 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:21.869029 26924 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:21.869606 26938 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.855497 26921 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:21.855759 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:21.829493 26920 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:21.856166 27049 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:21.896981 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 54400.1us
I20260709 13:12:21.902015 21997 leader_election.cc:400] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:12:21.903604 21997 leader_election.cc:403] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:21.902195 22042 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:21.905701 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:21.910140 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:21.911214 22042 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:21.845578 26998 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:12:21.922405 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 65759.1us
I20260709 13:12:21.923497 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:21.929375 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.902472 26920 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:21.898430 27023 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:21.940323 21465 raft_consensus.cc:606] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:21.946390 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 250942us
I20260709 13:12:21.927414 27008 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:12:21.963284 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:21.966650 21321 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.952615 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:21.926312 26751 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:21.970136 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 135351us
I20260709 13:12:21.968811 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:21.972426 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:21.942963 26946 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:21.913903 27052 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:12:21.938274 26978 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:21.942198 26924 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:21.924597 27019 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:12:21.960703 26912 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:22.019726 27058 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:12:21.982867 26980 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:21.983762 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 78173.5us
I20260709 13:12:22.023073 21359 leader_election.cc:400] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
I20260709 13:12:22.023397 21359 leader_election.cc:403] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:12:21.985034 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 55725.8us
I20260709 13:12:21.983116 22042 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:21.998878 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:21.973429 27036 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:22.002816 21320 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:22.003355 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.004006 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.000993 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.008674 27052 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:22.012622 26959 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.013075 21321 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:22.017577 26948 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:22.017287 26754 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.018922 27053 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:22.018522 27061 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:22.018870 26751 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.020144 26912 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:21.980967 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.021072 27058 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:21.957906 26729 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:21.921274 27049 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.033821 26669 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:22.036165 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56358.3us
I20260709 13:12:22.037091 26956 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
W20260709 13:12:22.039037 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 100318us
W20260709 13:12:22.044713 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.093492 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:22.046717 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:22.018087 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.024293 27038 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:22.075080 27032 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:12:22.077934 21319 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:22.081192 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.085650 21468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:22.061425 27052 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:22.089928 21321 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:22.051841 27036 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:22.043510 26938 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.095094 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.109342 21389 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:22.096712 21314 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:22.076762 27053 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:22.081945 27058 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:22.100313 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53695.8us
I20260709 13:12:22.103302 27049 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:22.105263 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.105922 26969 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:22.060860 27019 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:12:22.095757 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.101408 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:22.117225 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:22.117740 21392 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:22.113741 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.117971 21468 raft_consensus.cc:606] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:22.118412 21468 raft_consensus.cc:614] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:22.099901 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:22.123023 26669 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:22.112578 26729 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.125748 26959 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:22.126721 26912 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.072994 27023 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:22.134188 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:22.135383 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.136181 21390 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:22.137452 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.141333 27058 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.143079 27058 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.144327 26969 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:22.150533 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.116302 27053 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:22.156306 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51115.1us
I20260709 13:12:22.157586 26980 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:22.158272 27040 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:22.159458 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:22.145543 26729 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:22.132360 26924 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:22.160816 26754 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:22.161378 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 45172.2us
I20260709 13:12:22.161554 27054 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:22.162181 27054 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:22.148497 27060 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:22.162997 27060 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:22.163151 27054 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.163947 27060 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.164389 27044 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:22.157631 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.167045 27053 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.167724 21461 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:22.167982 26980 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:22.168831 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.160693 26959 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:22.169941 21320 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:22.170145 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.170423 27053 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:22.170672 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.219272 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.170818 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.190989 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:22.220674 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51909.2us
I20260709 13:12:22.221556 21434 leader_election.cc:400] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18.
I20260709 13:12:22.222368 21312 raft_consensus.cc:2368] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14.
I20260709 13:12:22.159458 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.222640 21395 raft_consensus.cc:2410] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:12:22.171821 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.172272 27036 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.173024 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.223577 21314 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:22.174540 27069 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:12:22.176523 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.172300 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:22.215345 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:22.184455 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.228346 21389 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:22.225457 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.225494 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.230918 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:22.185174 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.219738 21321 raft_consensus.cc:2368] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:12:22.232268 21390 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:22.225381 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.225739 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:22.233757 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61527.8us
I20260709 13:12:22.236224 21464 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:22.235930 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:22.236092 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.239058 21467 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:22.239851 21463 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:22.244716 21362 leader_election.cc:400] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14.
I20260709 13:12:22.245090 21362 leader_election.cc:403] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:12:22.219144 26924 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:22.248176 21319 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:12:22.247915 26924 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.250101 21319 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:22.251360 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:22.252410 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.202049 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.254271 26920 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.255266 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.255911 21320 raft_consensus.cc:2376] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15. Re-sending same reply.
I20260709 13:12:22.257263 22041 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:22.226892 27038 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:22.258626 27053 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:22.259001 27053 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.259323 27053 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:22.243989 26951 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:22.261298 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:22.262526 27071 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:12:22.264142 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 73284.1us
I20260709 13:12:22.149240 26978 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.264834 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:22.265760 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:22.265940 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:22.266501 21462 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:22.267375 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.180452 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.266525 21466 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:12:22.270597 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.267928 21462 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:22.283448 21359 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:22.268287 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:22.269536 21461 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:22.297996 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:22.263821 27038 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:22.303052 27062 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:22.303573 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:22.290714 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46144.7us
I20260709 13:12:22.254302 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:22.302012 21318 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:22.305370 22035 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
W20260709 13:12:22.298287 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 52782.9us
I20260709 13:12:22.245131 27020 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:22.287055 21316 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:12:22.309428 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:22.269913 26938 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:22.269119 26669 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:22.303938 27038 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:22.315380 22041 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:22.296370 26959 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:22.319133 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:22.323951 26938 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.324563 26938 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.327392 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:22.299451 26956 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:22.271085 26998 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:12:22.309397 27020 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:22.314999 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:22.232728 26969 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.318729 27038 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:22.343676 21390 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:22.363202 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:22.370107 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:22.362949 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 69816.8us
W20260709 13:12:22.372781 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 45468.2us
I20260709 13:12:22.354658 27020 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:22.375900 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.381976 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.386324 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.388278 27056 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:22.370627 26998 consensus_queue.cc:1243] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:22.376962 27054 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:12:22.375525 27019 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:12:22.353183 26904 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:12:22.377483 26751 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:12:22.392318 27057 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:22.392736 27037 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:12:22.393683 26801 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:22.394779 26801 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:22.395171 26801 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:22.400202 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.376155 27053 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.403116 27053 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:22.407400 26904 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:22.407886 26904 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:22.408785 26904 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.410017 26904 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:22.412673 27072 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:22.381138 27031 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:22.363579 27062 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:22.425500 21316 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:22.426771 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.411907 26959 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14.
I20260709 13:12:22.429272 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:22.417572 27019 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.421466 26980 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:22.426128 27044 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:22.444792 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.446122 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:22.448479 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 74604.8us
I20260709 13:12:22.449146 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.424904 26921 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:12:22.452639 21312 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:12:22.440960 27032 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:22.453454 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.442763 26722 raft_consensus.cc:2764] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:22.463135 21391 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:12:22.470765 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.418033 26801 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.464104 26929 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:22.477847 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.478571 21388 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:22.472755 27064 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:22.480692 27064 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.482824 27064 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:22.441586 27019 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.498728 21391 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:12:22.500725 21285 leader_election.cc:400] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 9 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 9. Current term is 10.
I20260709 13:12:22.501209 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.518827 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.532006 21391 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:22.532191 27054 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.532873 27054 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.533742 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.534986 27054 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:22.530139 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 148259us
I20260709 13:12:22.537302 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:22.537828 27073 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:12:22.539491 27044 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:22.539978 27044 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:22.540544 27052 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.542572 27057 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:22.530441 26946 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:22.492617 27037 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:22.540553 26924 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:12:22.544325 27037 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.547194 27037 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:22.535010 26920 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:22.547794 26948 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:22.548249 26948 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:22.548818 27008 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:22.549045 26948 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:22.550047 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 100957us
I20260709 13:12:22.550675 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:22.551170 26938 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:22.551335 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.551831 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:22.552385 21468 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:12:22.552609 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.535378 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.553300 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:22.554140 21315 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:22.525521 27020 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.502229 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:22.557139 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.559823 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.560967 21390 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:22.561666 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.563706 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.564437 21388 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:22.567896 22042 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:22.567180 21391 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:22.558269 26751 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.551362 27008 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:22.558374 27059 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.558182 26920 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:22.588449 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.589370 21387 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:22.590248 26669 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:22.596371 27032 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.596758 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.597239 27019 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:22.597038 27032 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.598078 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.599291 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.599529 27032 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:22.566177 26948 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:22.602687 26801 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:22.573102 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:22.501232 27064 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:12:22.604902 26669 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:22.605325 21395 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:12:22.605428 26669 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:22.606698 26574 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:22.606415 27008 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.607141 26574 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:22.607967 26574 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.608791 27008 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:22.608980 27085 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:22.609644 27085 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:22.610226 27036 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.610517 27085 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:22.581208 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.578154 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:22.588563 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.535619 27038 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.590396 27020 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:22.635591 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.635799 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.637113 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.614037 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.637751 21318 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:22.583434 21466 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:12:22.616497 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:22.574746 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 72557.9us
I20260709 13:12:22.619442 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.590298 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.630103 21394 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:12:22.630760 21468 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:12:22.613085 21395 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:22.641384 21390 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
W20260709 13:12:22.645252 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.634582 26938 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:22.649195 26938 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.649624 26938 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:22.649780 27052 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:22.565615 27023 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 13:12:22.662462 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48830.3us
I20260709 13:12:22.665441 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:22.609019 26574 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:22.668490 21388 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:22.575860 27031 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:22.668102 21389 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:22.670971 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:22.661696 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.673292 21394 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:22.669111 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:22.673775 21391 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:12:22.674873 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.651007 27034 raft_consensus.cc:2764] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:12:22.606519 26669 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.686724 21394 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:22.651474 26978 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:22.666788 27059 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.677699 26685 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:22.680701 21391 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:22.682803 26920 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:22.577318 26751 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.690850 21394 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:22.701049 26914 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:22.701748 26914 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:22.702324 26751 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:22.708199 21362 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:22.714358 26685 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:22.711833 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:22.715260 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97006.9us
I20260709 13:12:22.716084 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.718441 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:22.721716 26909 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:22.703050 26914 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.722491 26685 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.723990 26914 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.676749 26904 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:22.684010 26929 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:22.736614 26929 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.739605 26929 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:22.749063 21312 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:22.749711 21387 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
W20260709 13:12:22.758312 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83479.1us
I20260709 13:12:22.761435 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:22.693143 26722 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:22.777897 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59543.2us
I20260709 13:12:22.779521 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:22.720882 27062 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:22.786146 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.793632 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:22.772497 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57788.4us
W20260709 13:12:22.800467 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 170132us
I20260709 13:12:22.773865 26754 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:22.781080 26978 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:12:22.819096 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:22.801564 26909 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:12:22.811811 21467 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:22.713302 26950 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:12:22.682828 27044 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.815754 21464 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:12:22.792092 26912 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:22.817914 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.822654 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:22.823033 21313 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:22.829555 21316 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:22.774073 27061 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:12:22.842808 26929 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.848152 27044 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:22.848584 26929 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.849951 27061 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:22.850378 27061 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:22.850845 26929 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:22.851568 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.852676 26980 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:22.853735 22031 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:12:22.855350 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.856669 21315 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:12:22.842147 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61927us
I20260709 13:12:22.842962 26757 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:12:22.846611 27038 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:22.861881 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.843317 26754 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:22.869449 26904 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:12:22.876907 26904 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:22.877535 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.878160 22036 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:22.854032 27031 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:22.875195 26754 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.887905 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:22.892700 21321 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:22.892869 22041 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:22.873229 26751 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:12:22.871008 26912 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:22.907477 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:22.912205 26722 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:22.912741 27054 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:22.913142 27054 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:22.913393 26722 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:22.913558 27054 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:22.913892 26722 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:22.914793 26722 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.918200 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:22.919348 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:22.920665 21470 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:22.920925 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:22.886982 27031 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:22.923036 27031 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:22.923611 21395 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:22.923767 21462 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:22.900854 26912 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:22.924865 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:22.939440 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:22.940172 22035 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:22.932925 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:22.962692 22041 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:22.966851 21463 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:22.928288 26904 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:22.938719 26801 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.960832 26722 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:22.977005 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 162397us
I20260709 13:12:22.979001 26574 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:12:22.978818 26801 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.851603 27061 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:22.967864 26978 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:22.985159 21395 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:23.006946 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:23.007790 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:22.977666 26904 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:23.009860 26951 raft_consensus.cc:993] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:12:23.010509 26951 raft_consensus.cc:1081] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:12:23.009955 26904 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.016544 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:22.988703 26978 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.028190 22002 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:23.016063 27067 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.184s	user 0.001s	sys 0.002s
I20260709 13:12:23.031944 26801 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:23.027467 26978 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:23.033861 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:23.012265 26938 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.047979 21392 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:23.069877 21466 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:23.071190 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:23.025283 26959 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:12:23.144889 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.144941 26946 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.164413 21314 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:23.143111 27085 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:23.076293 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:23.121902 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56249.4us
I20260709 13:12:23.138926 26938 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:23.123652 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 49322.8us
I20260709 13:12:23.023784 26948 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:12:23.045150 26914 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:23.050287 27061 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:23.148499 27110 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:12:23.050557 26801 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:23.242782 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:23.310537 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:23.070412 27083 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.184s
I20260709 13:12:23.271755 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:23.328409 21318 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:23.329499 21319 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:12:23.316488 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 170511us
I20260709 13:12:23.340523 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:23.284152 27066 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:12:23.243952 26904 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:23.315407 27067 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:12:23.283797 27052 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.234575 26998 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:23.347836 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 202153us
I20260709 13:12:23.270031 21317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:12:23.352012 21317 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.352439 21317 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.352157 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:23.188833 26751 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:23.315611 27062 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.320328 27019 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.320431 27032 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:23.362095 21321 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:23.269207 27044 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:12:23.361413 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:23.283658 26946 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.366681 27019 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.381326 21321 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:23.370272 27084 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:23.402014 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 325785us
I20260709 13:12:23.345628 27031 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.395464 21317 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.358166 26998 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.413885 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:23.355173 26904 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.355818 27052 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.364886 27023 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:12:23.384558 27032 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.361519 26751 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.364559 27062 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.438954 27062 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.439370 26751 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.380960 27059 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:23.430987 21317 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.435390 27044 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:23.436055 21320 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:23.436977 26904 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.436757 26948 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:23.425913 27036 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.815s	user 0.009s	sys 0.004s
I20260709 13:12:23.416410 27103 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.475040 21393 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
I20260709 13:12:23.382999 27084 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.459164 21388 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:23.433120 27032 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:23.458724 27054 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.545s	user 0.002s	sys 0.010s
I20260709 13:12:23.455904 27044 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.544261 27044 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:23.547004 26946 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:23.548197 27111 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:12:23.549783 26998 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.539355 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:23.540544 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 297842us
I20260709 13:12:23.534596 27103 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.563707 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:23.592293 21388 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:23.596438 22035 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:23.607158 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:23.608085 22042 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:23.561123 27113 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.431s	user 0.001s	sys 0.000s
I20260709 13:12:23.635192 21464 raft_consensus.cc:2410] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:12:23.649629 27052 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:23.650906 27115 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:12:23.556764 27054 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.654277 27054 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:23.655999 27116 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:12:23.665066 26722 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.000s
I20260709 13:12:23.666778 27084 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.667897 27019 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.673799 27103 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:23.645223 27122 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.677753 27122 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.688047 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:23.688999 22035 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:23.690943 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:23.696125 22035 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:23.698300 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:23.699741 22034 raft_consensus.cc:2410] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:12:23.701880 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 370055us
I20260709 13:12:23.709120 22042 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:23.710899 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:23.713956 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.703756 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:23.632233 26980 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 13:12:23.685077 26685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.003s	sys 0.018s
I20260709 13:12:23.697165 26938 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:23.685992 27068 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:23.647842 27085 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:23.725329 26938 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:23.722506 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 295734us
I20260709 13:12:23.696472 27084 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.714877 27040 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:12:23.720116 26685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.004s	sys 0.018s
I20260709 13:12:23.722779 27103 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:23.800297 27084 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.769586 27031 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:23.805944 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 84258us
I20260709 13:12:23.790798 27020 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:23.725947 27034 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:12:23.816555 21317 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:23.795267 26938 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:23.836326 21393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2088) took 1396 ms (client timeout 1672 ms). Trace:
W20260709 13:12:23.838197 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.817780 26920 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:12:23.820739 27085 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.823323 27040 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:23.840049 27040 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.794840 27068 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.810207 27020 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:23.845225 27068 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:23.834707 27109 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.790s	user 0.001s	sys 0.004s
I20260709 13:12:23.848922 21396 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:23.808148 27103 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:23.850569 27059 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:23.851504 27103 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:23.836980 21393 rpcz_store.cc:269] 0709 13:12:22.439725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.439840 (+   115us) service_pool.cc:224] Handling call
0709 13:12:23.836044 (+1396204us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000baed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:23.836217 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367772416}
W20260709 13:12:23.873415 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.010s	sys 0.034s
W20260709 13:12:23.873863 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.010s	sys 0.034s
W20260709 13:12:23.876785 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 631345us
I20260709 13:12:23.878201 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:23.882606 21320 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.891299 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:23.905303 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:23.906273 21315 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:23.907964 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:23.912461 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:23.913990 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:23.914317 27134 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.914746 21321 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:23.914927 27134 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.917524 27134 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:23.922544 27123 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:23.922801 27023 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:23.923467 21392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2085) took 1548 ms (client timeout 1781 ms). Trace:
W20260709 13:12:23.923911 21392 rpcz_store.cc:269] 0709 13:12:22.374640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.374751 (+   111us) service_pool.cc:224] Handling call
0709 13:12:23.923307 (+1548556us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54000f19d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:23.923414 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451947264}
I20260709 13:12:23.925583 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:23.926738 27134 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:23.927237 26998 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.927749 26998 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.930307 26998 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.930524 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:23.932803 21465 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:12:23.933573 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 369983us
I20260709 13:12:23.934437 27129 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:23.935665 27129 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:23.936501 27019 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:23.938328 27084 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:23.938941 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1062) took 1085 ms. Trace:
I20260709 13:12:23.939443 21390 rpcz_store.cc:276] 0709 13:12:22.853341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.853669 (+   328us) service_pool.cc:224] Handling call
0709 13:12:22.853932 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.864802 (+ 10870us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:22.879016 (+ 14214us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.023928 (+144912us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:23.830484 (+806556us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:12:23.831081 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:12:23.831306 (+   225us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:23.831612 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.938377 (+106765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.938503 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:23.938668 (+   165us) raft_consensus.cc:1685] finished
0709 13:12:23.938691 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.938864 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107888,"prepare.queue_time_us":23191,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":119617,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":22473,"spinlock_wait_cycles":2480896,"thread_start_us":104538,"threads_started":1,"wal-append.queue_time_us":122583}
I20260709 13:12:23.942989 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:23.926901 27114 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:23.944159 21463 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:23.944315 27114 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:23.945372 27114 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.946004 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:23.946657 27114 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:23.948840 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:23.952214 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:23.952289 26998 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.952926 21396 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:23.953336 26998 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.955497 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:23.956809 21390 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.958946 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:23.959714 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:23.962356 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 79112.6us
I20260709 13:12:23.963377 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2100) took 1046 ms. Trace:
I20260709 13:12:23.963740 21313 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:23.966557 21394 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:23.963781 21466 rpcz_store.cc:276] 0709 13:12:22.917139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.919136 (+  1997us) service_pool.cc:224] Handling call
0709 13:12:23.963181 (+1044045us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54001edcd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:23.963316 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344376576}
I20260709 13:12:23.969307 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:23.969933 21316 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:23.970392 21389 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:23.975201 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:23.979621 21320 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:23.982025 27112 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.982167 27020 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.982684 27112 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.983445 27020 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:23.984313 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:23.985116 26722 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.964774 26754 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.985656 26722 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.985770 26754 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.843711 27044 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:23.987845 26722 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:23.969959 21462 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:23.995232 21462 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:23.998237 21393 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:23.959365 26998 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.004531 21312 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:23.996399 21462 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:23.987957 26754 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.023866 27044 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.047772 21396 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:23.992328 27019 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:24.060695 27019 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.063197 27019 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.016549 27059 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:24.073086 27059 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.080526 27068 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.081274 27068 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:24.086319 27137 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:12:24.047786 21390 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:24.091584 26938 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:24.104139 26978 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.060s	user 0.011s	sys 0.003s
I20260709 13:12:24.003283 27122 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.075870 27059 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:24.002533 26801 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.184350 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.185078 21396 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 8.
I20260709 13:12:24.186385 21393 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:24.187808 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.196492 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.197644 21466 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:24.199738 26914 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.200520 26914 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.203156 26914 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.206156 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.213346 26938 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.175320 26801 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.222138 27112 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.223281 26801 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.230011 27068 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:24.144929 26978 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:24.223943 27032 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.001s
I20260709 13:12:24.255239 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:24.258642 22041 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:24.260821 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.261782 21390 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
W20260709 13:12:24.263985 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 300963us
W20260709 13:12:24.228309 26959 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.013s	sys 0.013s
I20260709 13:12:24.285136 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.285106 21313 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:24.268729 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:24.288066 21320 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:24.231642 26938 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.305415 21321 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:12:24.291882 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.310094 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.322378 21319 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:24.323779 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.323946 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.324445 21390 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:24.325911 21396 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:12:24.308554 21392 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:12:24.314461 21320 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
W20260709 13:12:24.297789 26959 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.014s	sys 0.013s
I20260709 13:12:24.310633 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:24.337031 21387 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:24.324577 21388 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:24.331063 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.330766 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.339128 21466 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:24.335404 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.340255 21396 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
W20260709 13:12:24.330717 21285 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.672s (SENT)
I20260709 13:12:24.284735 26801 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.288853 27061 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.347651 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:24.339576 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.304975 27034 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.355129 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:24.359202 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:24.323433 27044 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.317760 27040 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.356360 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.366071 21389 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:24.259986 27032 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.329020 27019 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:24.367333 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.341418 27122 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:24.371405 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:24.365075 21285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.781s (SENT) [suppressed 21 similar messages]
I20260709 13:12:24.369493 21319 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:24.317239 26914 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:12:24.385318 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.322731 26938 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.378367 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.389690 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.390964 21317 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:12:24.394973 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.375025 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:24.405354 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.406095 21316 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:24.381204 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.356827 27085 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:24.372445 21313 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
W20260709 13:12:24.383406 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.388715 21321 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:24.352182 27103 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:24.377239 21466 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:12:24.352360 26929 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:24.358291 26801 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.440893 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.415526 21319 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:24.362319 27034 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.361172 27061 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.369433 27044 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.390694 27122 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.404733 27059 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:12:24.459461 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 111884us
I20260709 13:12:24.375682 27040 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.376302 27068 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:12:24.463857 21315 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:24.459029 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:24.461977 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 106994us
I20260709 13:12:24.375948 27019 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.414149 27085 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:24.447460 27031 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:24.468333 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 117350us
W20260709 13:12:24.471248 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 106196us
I20260709 13:12:24.479316 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.480335 26722 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:24.480700 26722 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.481066 27034 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.481851 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.483271 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.469372 27085 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:24.485265 27114 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:24.488063 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.490775 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:24.481091 26722 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:24.474242 27031 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.501556 27159 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:24.505548 27044 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.506876 27147 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:24.485760 26978 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.475040 27059 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:12:24.471274 27038 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:12:24.539037 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:24.514132 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 165842us
I20260709 13:12:24.509817 22041 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:24.541329 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.541914 21465 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:12:24.492434 27112 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:24.496320 27117 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
W20260709 13:12:24.496554 27139 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:12:24.496451 27149 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:24.515374 27153 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:24.524884 27140 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:12:24.517568 27142 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:12:24.512645 27114 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:24.542799 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.485638 26914 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:12:24.545920 22035 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:24.498865 26929 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:12:24.558008 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.522449 27040 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:24.521420 26998 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.522157 27019 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.521268 26801 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.524402 27122 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.522244 27061 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.543515 27134 raft_consensus.cc:2764] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:12:24.548462 27147 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:24.547091 26757 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:24.565212 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 88483.7us
I20260709 13:12:24.572223 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:24.575017 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.588183 22041 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:12:24.562071 27153 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.560338 27112 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:24.543852 27044 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:12:24.570981 26921 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:24.649296 27059 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:24.651640 26921 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.652089 27059 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:24.590123 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.653749 21317 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:24.578722 26938 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:24.625932 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 53785.1us
I20260709 13:12:24.588433 27147 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.658490 27147 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:24.658942 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2107) took 1207 ms. Trace:
I20260709 13:12:24.659346 21468 rpcz_store.cc:276] 0709 13:12:23.451346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.452109 (+   763us) service_pool.cc:224] Handling call
0709 13:12:23.452498 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:23.801928 (+349430us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:23.802270 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:12:24.135639 (+333369us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:24.173845 (+ 38206us) log.cc:844] Serialized 26 byte log entry
0709 13:12:24.174050 (+   205us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:24.174087 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.174175 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:24.658728 (+484553us) raft_consensus.cc:1685] finished
0709 13:12:24.658750 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:24.658882 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2811,"prepare.queue_time_us":180,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":95329,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":12322,"thread_start_us":658470,"threads_started":2,"wal-append.queue_time_us":455139}
I20260709 13:12:24.607009 26757 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.581352 27040 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:12:24.575105 27149 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:24.576438 26904 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.618029 27148 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:12:24.581018 26998 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:24.680605 27151 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:12:24.681183 26998 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.641759 26959 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:24.682417 26904 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.682605 26959 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.684756 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:24.684963 26959 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.686352 27163 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:24.606879 27143 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:24.650446 27145 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:12:24.649582 27153 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.652138 26921 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:24.657538 27112 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.583461 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:24.632968 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 90214.4us
I20260709 13:12:24.676528 27158 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:12:24.699236 27044 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:24.677039 27031 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.677886 27036 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.700670 27161 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:24.700502 27036 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.701092 27161 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:24.701933 27161 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.702693 27036 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.641888 27038 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:24.703398 27161 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:24.703413 27038 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.704576 27107 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:24.704964 27107 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:24.639415 27114 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.705745 27107 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.707011 27107 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:24.705753 27038 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.693440 27163 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:24.710026 27163 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.712936 27163 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.693535 27054 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:24.716820 27054 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.719228 27054 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.720175 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.722999 27031 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:24.723416 27031 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:24.723789 27031 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:24.727974 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:24.692932 27148 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:24.649860 27144 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:24.714412 26929 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:24.729415 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.731398 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.765616 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.675554 26912 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:12:24.799260 26757 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:24.801031 27157 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:12:24.740978 27148 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:24.805266 27148 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:24.811321 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.814656 27085 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.815811 27062 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:24.816256 27062 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:24.817135 27062 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.818495 27062 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:24.820691 26714 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.821295 26714 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.827085 27130 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:24.692581 27143 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.769472 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.829530 21317 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:24.830199 27143 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.762909 27144 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:24.803774 27020 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.003s
I20260709 13:12:24.837044 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:24.837410 27144 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:24.838135 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 353679us
I20260709 13:12:24.841460 27124 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:24.840932 27059 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.842239 27124 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:24.845893 26959 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:24.846436 26959 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.847352 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.848004 21389 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:12:24.848229 27036 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.848549 26959 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.848718 27036 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.849020 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.849690 21393 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:24.845595 27020 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:24.850854 27036 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.851435 27036 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:24.849092 26959 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.856524 22042 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:24.851121 27020 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.859269 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.859937 22040 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:24.789748 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.840236 26714 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.866384 26948 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:12:24.857770 27036 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.871670 21462 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:24.873446 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 305108us
I20260709 13:12:24.877105 21313 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:24.872664 26722 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.881431 26669 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:24.881878 26669 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:24.882208 26722 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.882974 26951 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:24.884202 26951 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.886427 26951 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.882211 27036 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.872233 26921 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:24.890435 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.017s	sys 0.034s
I20260709 13:12:24.890575 26921 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.883610 21321 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:12:24.892475 27085 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:24.876310 27147 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:24.898281 27147 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:24.882726 26669 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.763767 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:24.902493 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.890806 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.017s	sys 0.034s
W20260709 13:12:24.905436 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 1.5353e+06us
I20260709 13:12:24.905352 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:24.908015 21462 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:24.901790 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.908712 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2109) took 1004 ms. Trace:
I20260709 13:12:24.909198 21462 rpcz_store.cc:276] 0709 13:12:23.904418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.904615 (+   197us) service_pool.cc:224] Handling call
0709 13:12:24.653005 (+748390us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b58009041d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21c27c 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c
0709 13:12:24.871312 (+218307us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b5400199c20. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18da1d 00007fc2bf1741a4 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21c27c 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591
0709 13:12:24.908654 (+ 37342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570086912}
I20260709 13:12:24.916468 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.917505 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.918068 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.918889 21318 raft_consensus.cc:2410] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:24.910655 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.924512 21468 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:24.917485 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:24.925493 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.929232 21462 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:24.933868 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:24.934839 21316 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:24.946480 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.947434 22042 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:24.931239 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.949198 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.950192 21465 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:24.952881 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.954471 22038 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:24.955319 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.953197 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.953678 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.921236 27124 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:24.956750 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.866308 26959 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:24.964923 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.965167 26959 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:24.957227 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.967141 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.968003 22041 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
W20260709 13:12:24.952559 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 188883us
I20260709 13:12:24.960567 21318 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:12:24.961790 21462 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:12:24.961033 27124 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.975265 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:24.925869 27171 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:24.973971 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:24.975121 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.992517 21465 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:24.992889 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:24.993768 21389 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:24.930594 27146 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:24.966171 21387 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
W20260709 13:12:24.981138 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.988572 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.983843 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:24.951195 27147 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:24.940652 26904 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.008400 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:25.009330 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:25.010681 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.040705 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:25.040915 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.044107 21389 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:12:25.046905 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:25.047812 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.989902 27124 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.971338 26929 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:24.976517 27135 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:24.991138 27171 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.011058 26921 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:25.049386 27145 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:25.042428 26722 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:25.010811 27054 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:25.098256 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:25.005110 27034 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.005245 27146 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:25.055977 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 72228.2us
I20260709 13:12:25.056695 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:24.947278 27148 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.043099 26757 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:25.104773 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.061034 26929 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.061193 27062 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:25.005759 27112 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:12:25.064700 26980 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.121760 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.097307 27114 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.058247 27169 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:25.137136 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.062724 27171 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:25.054589 27103 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:12:25.141911 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.145465 21318 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:25.121416 26998 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:25.113237 27146 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:25.164125 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:25.057848 27031 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.111204 27062 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.130686 26980 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.097868 26921 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.137158 27169 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.063911 27135 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.183769 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.188942 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.125344 26757 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.121510 27034 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.165985 26998 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.132573 27153 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.225405 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.143355 27114 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.208659 21462 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:12:25.211730 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.182912 27044 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:25.221087 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.226255 21467 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:25.173637 27020 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.232352 21468 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:25.212657 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.240535 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.241505 21464 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:25.238405 21470 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:25.242949 27160 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:25.243687 27160 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:25.244848 27160 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.205340 27165 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:12:25.248304 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.250692 27148 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:25.254482 26921 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.256382 27034 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:25.256456 21314 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:25.257369 27153 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.259511 27114 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.197415 27169 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:25.266673 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:25.270470 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.228428 26998 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:25.268060 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 140916us
W20260709 13:12:25.274325 27178 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:12:25.277909 27170 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:12:25.282258 27175 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:12:25.285178 27126 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:25.298918 26757 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.340782 21313 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:12:25.337585 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:25.327544 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.350803 21470 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:25.351060 21320 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:25.328020 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.340946 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:25.351924 21315 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:25.354004 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:25.338045 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:25.355126 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59240.9us
W20260709 13:12:25.356956 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 62397us
I20260709 13:12:25.313143 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3036) took 1304 ms. Trace:
I20260709 13:12:25.326413 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:25.359716 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:25.360602 21392 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
W20260709 13:12:25.317231 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50647.4us
I20260709 13:12:25.362046 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:25.362730 21392 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:25.364218 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:25.365120 21392 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:25.364403 21433 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:25.355819 21461 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:25.367395 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.363821 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.370852 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:25.372433 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:25.368160 21469 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:25.376619 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.377519 21314 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
W20260709 13:12:25.311546 27161 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.608s	user 0.006s	sys 0.006s
I20260709 13:12:25.381131 21390 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:12:25.382604 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.383828 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:25.387477 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:25.304020 27144 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.388137 22036 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:25.384748 21394 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:25.389735 27144 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.390166 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:25.327750 26998 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.391330 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:25.392199 27187 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.094s	user 0.004s	sys 0.000s
I20260709 13:12:25.392375 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:25.299938 27171 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.394518 26801 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:25.394963 26801 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:25.395378 26801 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:25.395491 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:25.308573 27135 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.341756 27122 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.397038 21388 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:25.398761 21470 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:25.397073 27122 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.315964 26669 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:25.395387 27171 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.392395 26998 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.414274 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.400856 27062 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.401115 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:25.404898 21392 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:12:25.415340 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:25.410238 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:25.399717 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:25.330102 27031 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.302402 27147 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:25.412783 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:25.329735 27032 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.400425 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:25.416210 22036 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:25.422748 21320 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:25.382745 26921 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:25.357641 21312 rpcz_store.cc:276] 0709 13:12:24.008529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.009376 (+   847us) service_pool.cc:224] Handling call
0709 13:12:24.009810 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:24.232627 (+222817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:24.232657 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:24.260315 (+ 27658us) log.cc:844] Serialized 26 byte log entry
0709 13:12:24.537963 (+277648us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:24.538012 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.312694 (+774682us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540015c2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:25.312761 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:25.312809 (+    48us) raft_consensus.cc:1685] finished
0709 13:12:25.312823 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:25.313079 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6600,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":21636,"spinlock_wait_cycles":496403840,"thread_start_us":200273,"threads_started":1,"wal-append.queue_time_us":270588}
I20260709 13:12:25.432463 21313 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:25.424831 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:25.428006 21393 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:25.428153 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:25.367432 27153 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 13:12:25.429869 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.005s
I20260709 13:12:25.446348 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:25.447508 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.331213 27146 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.462916 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:25.459314 21315 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
W20260709 13:12:25.460927 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.009s	sys 0.005s
W20260709 13:12:25.461126 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 187367us
I20260709 13:12:25.462338 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:25.462473 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:25.465598 21433 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:25.476732 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:25.439989 27147 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:25.478749 21470 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:25.442230 26921 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.477512 22032 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:25.499082 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:25.467038 27038 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:25.472590 26920 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:25.506645 27169 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.496958 21394 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:25.448117 26714 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:25.497802 27168 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:25.513283 21433 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:25.455358 27171 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:25.519945 21393 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:12:25.431737 27135 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:12:25.551507 21470 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:25.547168 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:25.509202 26921 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:25.520982 26920 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.569482 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:25.571527 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:25.514736 26998 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:25.562249 27139 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:12:25.521571 27038 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.562206 27020 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:25.467173 27124 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.560591 27148 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:25.576254 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:25.667645 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 91483.7us
I20260709 13:12:25.668903 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:25.551597 27062 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:25.551563 26757 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:12:25.664251 27191 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:12:25.664647 27183 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:25.665109 27163 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:25.562021 27171 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.485128 27186 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.218s
I20260709 13:12:25.562994 26714 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.565179 26574 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:25.574124 26920 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:25.638864 27153 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:25.576479 26904 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:25.675588 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:25.563409 27134 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.106s
W20260709 13:12:25.669860 27145 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:12:25.665843 27189 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:12:25.654431 27038 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.738185 21393 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:25.740126 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:25.740780 21396 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:25.701062 27040 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:25.744360 27040 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:25.744805 27040 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:25.745539 27171 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.671983 27020 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.701256 27188 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:25.702612 26714 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.653726 26914 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:25.666932 27148 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.674954 27052 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:25.703099 26574 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.725667 26904 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.677834 27062 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.727339 27034 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:25.672708 27144 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:25.724743 27153 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:25.725033 27167 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:25.681017 27183 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.734208 27169 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:25.736402 27124 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.741351 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:25.763845 26574 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:25.697088 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 183884us
I20260709 13:12:25.787122 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:25.680482 27163 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:25.643853 27031 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:12:25.644320 26998 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.573364 27147 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.817051 27147 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:25.817296 27062 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.703769 26722 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:12:25.723789 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48312.3us
I20260709 13:12:25.764161 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:25.770535 21396 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:25.750386 27122 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.758646 27054 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:25.766175 26904 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:25.755637 26912 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:25.761058 27148 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:25.781363 21393 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.742339 27159 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:25.761201 26914 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.820400 21315 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:25.757230 27188 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.818135 26938 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:25.822511 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:25.778745 27183 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:25.867189 27062 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:25.821655 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:25.870769 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 356656us
I20260709 13:12:25.889546 22002 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:25.781948 27146 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.776116 27034 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:25.887184 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 64785.3us
I20260709 13:12:25.867913 27054 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:25.897780 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:25.898236 21393 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
W20260709 13:12:25.901201 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 79663.8us
I20260709 13:12:25.902742 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:25.882699 27153 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.920672 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:25.922784 27020 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:25.926960 26929 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:25.928125 27084 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:25.928795 27084 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:25.929600 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.929767 27084 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.931440 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.933444 27188 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.934628 27054 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.935889 27054 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:25.879623 26912 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.938057 26912 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.941800 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:25.906447 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:25.948589 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45932.1us
I20260709 13:12:25.949919 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.957728 21469 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:25.897037 27171 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:25.923916 26669 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.002s
I20260709 13:12:25.873181 26801 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.962112 21315 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:25.905370 27186 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:25.967360 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.978708 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:25.980063 21464 raft_consensus.cc:2410] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:12:25.904225 26938 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.989938 26938 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:25.888422 27163 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.990231 27038 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:25.940577 27130 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:25.949991 26929 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:25.960129 27146 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:25.994145 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.958947 27169 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:25.999089 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 1080) took 1082 ms. Trace:
I20260709 13:12:25.900986 27062 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:25.963215 27107 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:26.032809 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.039140 21396 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:26.040295 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.041761 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.033841 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.047550 21461 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:26.047694 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:26.047696 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.048758 21389 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:26.049517 21393 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:26.027194 21387 rpcz_store.cc:276] 0709 13:12:24.917056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.917250 (+   194us) service_pool.cc:224] Handling call
0709 13:12:25.998915 (+1081665us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b54000f19d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:25.999023 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90743040}
I20260709 13:12:25.980937 27186 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.059582 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.002374 21319 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:26.063807 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.002339 27163 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:26.069463 21396 raft_consensus.cc:2376] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16. Re-sending same reply.
I20260709 13:12:25.964329 27040 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.073956 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:25.998783 26929 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:26.081622 27193 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:12:26.082690 27038 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.087764 26801 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.047247 27159 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.087885 26914 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.047246 26920 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:26.091391 26904 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:26.000942 27130 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:26.095199 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.037194 27171 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.048859 27169 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:26.098964 27107 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:26.063346 27186 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:26.113229 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:26.117009 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:26.130257 21464 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:26.118167 27148 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.120872 26998 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.108243 27159 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.139209 27159 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.102370 26929 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:26.151674 21469 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:26.157928 27159 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.158887 27159 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.162387 27159 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.165465 27148 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.169734 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:26.172838 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.173861 21464 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:26.175468 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.175730 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:26.176047 22042 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:26.176067 21387 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:26.177758 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.178330 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.178347 22038 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:26.178964 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.181705 21284 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:26.183992 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:26.191500 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2681) took 1122 ms. Trace:
I20260709 13:12:26.191998 21462 rpcz_store.cc:276] 0709 13:12:25.056306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.056428 (+   122us) service_pool.cc:224] Handling call
0709 13:12:26.178800 (+1122372us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400070154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:26.178910 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241979136}
I20260709 13:12:26.199527 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:26.200239 21465 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:26.200703 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2679) took 1156 ms. Trace:
W20260709 13:12:26.203207 27204 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:12:26.203718 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.205327 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:26.206605 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:26.211086 26980 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:26.201009 21465 rpcz_store.cc:276] 0709 13:12:25.043860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.044218 (+   358us) service_pool.cc:224] Handling call
0709 13:12:26.199420 (+1155202us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3eee 0000000000375939 00007fc2c41671e0 00007fc2c42300c4 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:12:26.200648 (+  1228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5402368}
I20260709 13:12:26.221654 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:26.222951 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:26.224298 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:26.232645 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:26.233752 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.110780 26921 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:26.173554 27148 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:26.239913 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:26.236745 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:26.242986 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 278382us
I20260709 13:12:26.193231 26998 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:26.195575 26801 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:26.128455 27171 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:26.248240 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:26.169907 27107 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.203234 27147 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:26.256601 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.260579 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.261623 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:26.263422 21391 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:26.238875 27143 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:26.264075 21321 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:26.247424 26801 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.330293 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:26.331240 22031 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:26.250784 27168 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:26.333088 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 71616.7us
I20260709 13:12:26.326061 27122 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.335400 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.339526 21391 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:26.253145 27188 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:26.337989 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:26.334479 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 81921us
I20260709 13:12:26.244302 26980 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:12:26.266497 27117 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:26.279918 27147 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:26.248217 27148 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.268450 26998 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:26.373832 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:26.375296 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:26.331771 26801 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:26.389102 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:26.384826 22031 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:26.378863 27117 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:26.390461 27117 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:26.390506 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:26.396384 27216 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:26.396202 27085 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:26.387648 21469 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:26.372318 27052 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:26.343933 27062 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.405334 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:26.412303 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:26.401975 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:26.408725 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:26.409775 27214 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:12:26.410447 27210 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:12:26.249903 27169 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.398640 27188 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:26.417169 21362 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:26.400374 26978 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:26.397029 27207 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.420790 21391 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:12:26.423221 27208 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 13:12:26.424187 27213 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:26.432474 27148 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.410912 27036 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:26.436189 26904 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.437717 27171 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.488896 27036 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:26.438320 27147 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.489359 27036 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:26.439291 26998 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:26.492386 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.440547 26921 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.440950 27107 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.442111 27020 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:26.442648 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:26.408290 27085 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.501359 26920 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:26.501456 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:26.502316 21461 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:26.502806 27085 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:26.447136 27040 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.504405 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:26.448549 21463 raft_consensus.cc:2410] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:12:26.449393 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.449661 27059 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:26.371728 27122 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.447881 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.451704 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.453302 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.454046 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:26.510466 21319 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:26.450819 26929 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.420491 27188 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.419480 27211 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:26.456743 21391 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:26.458369 26978 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:26.458801 26948 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.463997 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.464893 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:26.523315 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 58502.4us
I20260709 13:12:26.459306 27126 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:26.471210 26574 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.001s
I20260709 13:12:26.474361 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:26.480563 27117 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.488284 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.418124 27143 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:26.420780 27062 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:26.472364 27207 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.510620 21395 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:26.518838 27188 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:26.511103 26722 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:26.489367 27171 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:26.528573 21464 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
W20260709 13:12:26.601089 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 60536.3us
I20260709 13:12:26.601367 21470 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:26.531275 22032 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:26.530454 21469 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:26.510933 21387 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:26.518126 27211 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.536276 26920 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:26.612775 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:26.601133 27143 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:26.620903 27143 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.621310 27143 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:26.604691 26722 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.624837 27052 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:26.625468 27052 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:26.609977 27171 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.630767 27148 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:26.613101 27103 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:12:26.611250 27085 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:26.640902 27085 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:26.641749 27085 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.642755 27085 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:26.643801 27117 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.538281 26574 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.515897 27059 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:26.601924 27183 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.000s
I20260709 13:12:26.650820 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2676) took 1265 ms. Trace:
W20260709 13:12:26.654851 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52624us
I20260709 13:12:26.687498 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:26.720944 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.631435 27148 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.602099 27134 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.602347 27112 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.531634 26948 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.717316 21394 rpcz_store.cc:276] 0709 13:12:25.385090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.392139 (+  7049us) service_pool.cc:224] Handling call
0709 13:12:26.650546 (+1258407us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b5400388e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:26.650741 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213562624}
W20260709 13:12:26.745853 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.735111 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3052) took 1812 ms. Trace:
I20260709 13:12:26.613315 27211 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:26.750000 21316 rpcz_store.cc:276] 0709 13:12:24.922538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.935727 (+ 13189us) service_pool.cc:224] Handling call
0709 13:12:24.936142 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:24.942250 (+  6108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:24.942281 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:24.960728 (+ 18447us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.344317 (+1383589us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800403960. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:12:26.511546 (+167229us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:26.511591 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.511690 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.645766 (+134076us) raft_consensus.cc:1685] finished
0709 13:12:26.645798 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.735033 (+ 89235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5504,"raft.queue_time_us":5752,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10996,"spinlock_wait_cycles":24864512,"thread_start_us":138735,"threads_started":1,"wal-append.queue_time_us":1683515}
I20260709 13:12:26.537271 27126 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.772495 27122 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.774418 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.715763 27160 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:26.714363 27168 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:12:26.736833 27186 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.808463 22038 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:26.737092 27183 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:26.818522 27186 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.821012 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:26.826339 27117 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:26.827000 27117 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.827677 27126 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:26.829968 27183 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:26.830785 21468 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:26.830684 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.832149 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3062) took 1505 ms. Trace:
I20260709 13:12:26.795886 27160 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.832499 27117 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.834299 27160 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:26.760702 27134 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:26.837307 27134 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.760445 27112 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:26.840618 27112 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.843734 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:26.832499 21318 rpcz_store.cc:276] 0709 13:12:25.327203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.346955 (+ 19752us) service_pool.cc:224] Handling call
0709 13:12:25.373854 (+ 26899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.444801 (+ 70947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:25.444834 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:25.456504 (+ 11670us) log.cc:844] Serialized 26 byte log entry
0709 13:12:25.899027 (+442523us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:25.899096 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.831729 (+932633us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b540032b4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:26.831776 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.831818 (+    42us) raft_consensus.cc:1685] finished
0709 13:12:26.831836 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.832088 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4146,"raft.queue_time_us":7637,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10377,"spinlock_wait_cycles":152681856,"thread_start_us":384554,"threads_started":1,"wal-append.queue_time_us":515236}
I20260709 13:12:26.848323 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2137) took 1487 ms. Trace:
I20260709 13:12:26.806389 26929 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.852415 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2689) took 1057 ms. Trace:
I20260709 13:12:26.854846 21463 rpcz_store.cc:276] 0709 13:12:25.848705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.239662 (+390957us) service_pool.cc:224] Handling call
0709 13:12:26.846918 (+607256us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54002f2e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:26.852316 (+  5398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466569600}
I20260709 13:12:26.857008 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:26.875347 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.847978 26722 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.851424 21467 rpcz_store.cc:276] 0709 13:12:25.360875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.360999 (+   124us) service_pool.cc:224] Handling call
0709 13:12:26.180391 (+819392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.180721 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.180749 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.193899 (+ 13150us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.326304 (+132405us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:26.326349 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.326424 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.450066 (+123642us) raft_consensus.cc:1685] finished
0709 13:12:26.450087 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.794169 (+344082us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b5400070150. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:26.848256 (+ 54087us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":3400,"spinlock_wait_cycles":1883740416,"thread_start_us":80170,"threads_started":1,"wal-append.queue_time_us":197115}
I20260709 13:12:26.873325 27020 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:26.899849 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:26.900488 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.870716 27207 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.909834 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.911895 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.918051 21389 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:26.902910 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.919770 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.921130 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.921797 21393 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:26.920619 21395 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:12:26.925105 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.927178 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.927871 21396 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:26.890914 27112 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.939756 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:26.897967 26920 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:26.951579 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.901976 27122 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:26.898293 26722 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:26.913672 27107 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.987552 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:26.988773 21396 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:26.968844 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:26.891496 27171 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.933504 26978 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:26.973845 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2694) took 1006 ms. Trace:
I20260709 13:12:26.975245 21466 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:26.976753 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:26.915799 27034 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.914011 26757 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:26.941479 26801 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.005s
I20260709 13:12:27.033414 21359 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:27.030093 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:27.034909 21470 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:27.034925 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:26.970011 27117 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:26.965904 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 109011us
I20260709 13:12:26.927184 26904 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:26.991201 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3018) took 1578 ms. Trace:
I20260709 13:12:26.969403 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:26.973874 21393 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:27.002224 21468 rpcz_store.cc:276] 0709 13:12:25.967485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.169483 (+201998us) service_pool.cc:224] Handling call
0709 13:12:26.973667 (+804184us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b5400217d54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:26.973787 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518318976}
I20260709 13:12:26.943189 27059 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.000387 27207 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:27.028492 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:26.988538 27135 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:27.038148 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:27.031731 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:27.069645 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.053161 21321 rpcz_store.cc:276] 0709 13:12:25.394207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.412533 (+ 18326us) service_pool.cc:224] Handling call
0709 13:12:26.972938 (+1560405us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400415ad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:26.973083 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897471360}
I20260709 13:12:27.019706 26998 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:26.945823 27036 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.001230 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:27.060475 27160 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:27.002121 26978 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:27.023372 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.065027 21467 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:27.001325 27165 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:27.029501 26757 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:27.062510 27117 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.119541 27117 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:27.002223 26722 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.121793 26722 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.000559 27112 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.105276 27233 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:27.125587 27112 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:26.978122 26920 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.068267 26904 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.129786 26920 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.129997 26904 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.133842 27036 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:27.030548 27020 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.113794 26978 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:27.135685 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2688) took 1342 ms. Trace:
I20260709 13:12:27.136116 21461 rpcz_store.cc:276] 0709 13:12:25.794573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.502983 (+708410us) service_pool.cc:224] Handling call
0709 13:12:26.503323 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.503660 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.503692 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.512233 (+  8541us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.867692 (+355459us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:27.018803 (+151111us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.019077 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.019177 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.135445 (+116268us) raft_consensus.cc:1685] finished
0709 13:12:27.135465 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.135619 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19209,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":50933,"thread_start_us":481806,"threads_started":2,"wal-append.queue_time_us":453822}
I20260709 13:12:27.036618 27044 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:27.140426 27044 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.093608 27135 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:27.143165 27044 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.055603 27171 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.143682 27135 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.145082 27135 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:27.147046 26998 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:27.105774 27207 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.147723 26998 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.150168 27207 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:27.150210 26998 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:27.002696 27107 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.036373 26801 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.151048 26998 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.152824 27107 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:27.153439 26801 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:26.991623 27122 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.156287 27122 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:27.108021 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 69945.4us
I20260709 13:12:27.160240 21470 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
W20260709 13:12:27.162025 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.160665 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:27.179190 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2663) took 1812 ms. Trace:
I20260709 13:12:27.179772 21392 rpcz_store.cc:276] 0709 13:12:25.366361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.366469 (+   108us) service_pool.cc:224] Handling call
0709 13:12:25.366851 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.421081 (+ 54230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.178799 (+1757718us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b54001c7354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:27.179116 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86824320}
I20260709 13:12:27.180672 21359 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:27.182058 21465 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:27.204332 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:27.181650 27188 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.552s	user 0.014s	sys 0.000s
I20260709 13:12:27.225575 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2697) took 1079 ms. Trace:
W20260709 13:12:27.202173 27238 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:12:27.226068 21466 rpcz_store.cc:276] 0709 13:12:26.146527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.623874 (+477347us) service_pool.cc:224] Handling call
0709 13:12:26.974995 (+351121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.018292 (+ 43297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.225344 (+207052us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54001a77d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:27.225513 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669071616}
I20260709 13:12:27.194497 27036 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.147121 27233 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:27.203460 27171 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:27.235107 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.239813 21319 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:27.207901 27147 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.114745 27160 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.251451 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.226958 27114 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:27.255803 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:27.258106 22036 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:27.259436 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:27.177855 27165 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.268308 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.275147 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.278945 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.226806 27188 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.254928 27227 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.260417 27114 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:27.246968 27246 raft_consensus.cc:2764] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:12:27.290474 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:27.278008 27085 consensus_meta.cc:287] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.004s
I20260709 13:12:27.267845 27236 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:27.254817 27036 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.313107 27236 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:27.313676 27236 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:27.318619 27246 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:27.319298 27246 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.323382 27160 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:27.327602 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:27.328882 27211 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.000s
I20260709 13:12:27.329334 27211 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.329770 27234 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:27.330364 27130 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:27.330858 27234 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:27.331290 27234 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:27.331619 27211 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:27.308223 27165 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.332543 27114 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.332834 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:27.333575 27114 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:27.311462 27221 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.784s	user 0.003s	sys 0.014s
I20260709 13:12:27.339056 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1362) took 1133 ms. Trace:
W20260709 13:12:27.339520 27052 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.006s
I20260709 13:12:27.339581 22038 rpcz_store.cc:276] 0709 13:12:26.205576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.206341 (+   765us) service_pool.cc:224] Handling call
0709 13:12:27.338840 (+1132499us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b540061b2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:27.338967 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382214400}
I20260709 13:12:27.337817 27234 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.348574 27148 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.349612 26978 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.350118 27062 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:27.350586 27062 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:27.352586 27236 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.353364 21319 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:27.354676 21314 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:27.255028 27233 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.356420 27236 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.356827 26948 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.258008 27147 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.365501 27147 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.366204 21395 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:27.373158 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.355481 26757 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:27.375417 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.375952 21318 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:27.377000 26757 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:27.377420 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.377553 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 93520.6us
I20260709 13:12:27.382176 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.383109 27243 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:27.383704 27243 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.386039 27243 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.377703 27186 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:27.390936 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.391922 21315 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:27.370779 27143 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.007s
I20260709 13:12:27.370527 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:27.377362 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49880.5us
I20260709 13:12:27.420212 21316 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:27.421721 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2687) took 1628 ms. Trace:
I20260709 13:12:27.427440 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.422298 21464 rpcz_store.cc:276] 0709 13:12:25.793350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.244914 (+451564us) service_pool.cc:224] Handling call
0709 13:12:26.248531 (+  3617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.600006 (+351475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.421392 (+821386us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54003f07d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:27.421638 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643447680}
I20260709 13:12:27.435105 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.388914 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:27.414721 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.436673 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:27.438009 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67563.7us
I20260709 13:12:27.438180 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.438766 21319 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:27.440508 21319 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:27.397823 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.441591 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.442505 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.443348 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 941) took 1562 ms. Trace:
I20260709 13:12:27.443585 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.443967 21463 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:27.444252 21319 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:27.445792 21433 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:27.447247 21316 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:27.448316 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.447876 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:27.456393 21467 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:27.453688 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:27.451998 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:27.442799 27223 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.550s	user 0.005s	sys 0.000s
I20260709 13:12:27.389809 27052 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.453719 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.461254 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.466809 21389 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:12:27.457208 27227 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:12:27.449901 27253 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:27.436877 27134 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:27.460688 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.468565 21320 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:27.451937 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:27.460518 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.452770 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:27.470422 21395 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:27.471182 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.461726 22038 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:27.478072 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.479768 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.480538 21467 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 20: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:27.482709 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:27.430817 27143 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.486464 21390 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:27.474574 21316 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
W20260709 13:12:27.472558 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 216788us
I20260709 13:12:27.488691 21317 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:27.443723 21469 rpcz_store.cc:276] 0709 13:12:25.881308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.626370 (+745062us) service_pool.cc:224] Handling call
0709 13:12:26.626677 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.765055 (+138378us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:12:26.926254 (+161199us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.356319 (+430065us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180042d7e0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2c4141328 00007fc2c4138901 00007fc2c41388a7 00007fc2c4230288 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508
0709 13:12:27.386960 (+ 30641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.387013 (+    53us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:27.387056 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.443135 (+ 56079us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400249ad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:27.443188 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.443296 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67675,"prepare.queue_time_us":327695,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":28928,"raft.run_cpu_time_us":2500,"raft.run_wall_time_us":278637,"spinlock_wait_cycles":342025984,"thread_start_us":606161,"threads_started":3,"wal-append.queue_time_us":214896}
I20260709 13:12:27.493443 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.504516 21312 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:27.497879 21387 raft_consensus.cc:2368] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16.
I20260709 13:12:27.459476 27251 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
W20260709 13:12:27.501896 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.503324 21359 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:27.485853 27135 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:27.473929 27168 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:27.488235 27253 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:27.498602 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:27.513875 21359 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:27.516170 21470 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:27.516629 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:27.516389 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:27.511498 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:27.488348 27134 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.522047 27134 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:27.523042 27122 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:27.564426 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 65876.3us
W20260709 13:12:27.582229 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 65681.7us
I20260709 13:12:27.586855 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:27.590950 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:27.592231 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 75907.7us
I20260709 13:12:27.610669 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.607620 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:25.121253 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:27.517532 27226 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.634991 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.636684 21464 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:27.638865 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:27.640933 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:27.633471 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 108772us
I20260709 13:12:27.644007 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:27.646767 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52947.2us
I20260709 13:12:27.515950 27168 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.610773 27212 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:27.597311 27257 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.672791 27257 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:27.673386 27257 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.603325 27135 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:27.676234 27135 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.676785 27135 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:27.677942 27168 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:27.646703 27158 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:27.678870 27158 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:27.679306 27158 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:27.609961 27222 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:27.680300 27222 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:27.680711 27222 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:27.659106 27212 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:27.688623 27212 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:27.616219 27256 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:27.694537 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.694692 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 53877.9us
I20260709 13:12:27.652298 27147 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 13:12:27.663179 27254 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:12:27.663970 27237 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:12:27.665715 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.665518 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.667279 27253 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.647346 27169 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:12:27.694919 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.645756 26980 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:27.695807 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:27.714143 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48721.7us
I20260709 13:12:27.714319 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.700634 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:27.714901 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.715368 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.650466 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.692749 27257 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:27.707898 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.719168 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:27.719864 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:27.716327 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 65986.7us
I20260709 13:12:27.724797 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.729113 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:27.738596 21394 raft_consensus.cc:2368] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18.
I20260709 13:12:27.739374 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:27.742100 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:27.743176 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:27.743402 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.744571 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.703336 27186 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:27.706372 27040 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.708173 27249 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:27.718950 27211 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:27.738178 27248 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.737919 27122 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:27.769166 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.737258 26948 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.772656 21396 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:12:27.736485 27183 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:27.739578 26921 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.740468 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.744809 27230 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:27.739503 27207 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:27.787511 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:27.776278 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67034.2us
I20260709 13:12:27.746966 27168 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:27.787158 27226 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:27.788370 27251 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:27.791440 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.795444 21465 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:27.800267 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:27.800231 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 84927us
I20260709 13:12:27.803524 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:27.806124 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.836079 21389 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:12:27.806917 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 66540.3us
I20260709 13:12:27.770287 27052 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:27.773705 26980 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:27.813588 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.815186 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:27.816848 21316 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:12:27.817907 21320 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:27.769110 27254 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:27.790735 27122 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:27.842965 27122 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.786414 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:27.823819 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:27.801252 27143 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:27.844910 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 58619.2us
I20260709 13:12:27.848163 27038 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:27.848924 27038 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:27.850240 27038 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.864930 26980 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.865693 26980 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.874503 26980 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:27.878469 27237 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:27.825695 27190 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.772972 27249 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.813138 27211 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:27.918546 27269 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 13:12:27.920333 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.920780 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.921329 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.922600 21315 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:27.922848 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:27.881575 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44568.3us
W20260709 13:12:27.883816 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 60065.5us
W20260709 13:12:27.884090 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48998.9us
I20260709 13:12:27.887110 27257 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:27.829967 27226 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.889847 27143 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:27.896965 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:27.885536 27114 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.000s
I20260709 13:12:27.898314 27036 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.899725 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:27.949687 21391 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:27.900599 27233 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:27.819095 27207 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:27.954296 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2681) took 1053 ms. Trace:
I20260709 13:12:27.954747 21387 rpcz_store.cc:276] 0709 13:12:26.901318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.902665 (+  1347us) service_pool.cc:224] Handling call
0709 13:12:27.954054 (+1051389us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540017e8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:27.954234 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331179392}
W20260709 13:12:27.906847 27267 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:12:27.907545 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:27.909154 27265 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:12:27.912497 27188 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:27.916678 27264 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:12:27.917673 27268 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:12:27.926062 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:27.928164 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 139166us
I20260709 13:12:27.820487 27230 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:27.934067 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.940847 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.012946 21394 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:27.941843 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:27.950623 27269 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.937389 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.946624 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:27.947360 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.915706 27234 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:27.948709 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:27.948781 21389 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:27.952831 21314 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:27.885767 27052 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.020243 21312 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:27.963498 27207 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:28.023734 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 77188.2us
I20260709 13:12:28.024953 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:28.026335 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:28.027740 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:28.028307 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:27.959728 27272 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:12:27.986303 27226 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:27.980458 27237 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:27.987327 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.044437 21319 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:28.003739 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.008522 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:27.925374 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:28.045691 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 120374us
I20260709 13:12:28.011952 27186 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:28.045985 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.881669 27251 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:28.019470 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83608.9us
I20260709 13:12:28.047906 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.048517 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:28.049218 22036 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:28.049410 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:27.961905 21388 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:28.031495 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:28.036648 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:28.027873 27163 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:28.037652 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:28.038698 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:28.040575 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:28.042254 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 116280us
I20260709 13:12:28.052804 22040 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:28.053128 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:28.043224 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.045562 22038 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:28.046095 26929 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:28.021404 27257 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.055397 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.056238 21396 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:28.052134 22034 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:28.057654 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.026739 26574 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.059720 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.062674 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:28.066814 21464 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:28.063370 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:28.067421 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.067837 21469 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:28.065325 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:28.062677 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:28.069423 21465 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:28.071381 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.041905 27103 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:28.074175 21392 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 6.
I20260709 13:12:28.072851 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.076736 27259 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:28.077164 27274 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:28.077435 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:28.083348 22031 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:28.077749 27103 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:28.084748 27103 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:28.086213 27211 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:28.085815 27212 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.064193 27040 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:28.087750 27171 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.076563 27147 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.088321 27171 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.090255 22040 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:28.088611 27212 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.058775 27034 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:28.091380 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.091933 27222 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.094136 27222 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.094743 27222 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.095189 27222 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.095273 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.096210 27276 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:28.047294 27135 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.098845 27135 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.041273 27158 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.100111 21462 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:28.100893 21464 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:28.101202 27158 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.101814 27276 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.102874 27103 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.101831 22039 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:12:28.102506 27276 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.106133 27147 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:28.107764 27103 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.109627 27276 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.110431 27274 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:28.117673 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:28.119122 27259 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:28.123617 21285 leader_election.cc:400] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18.
I20260709 13:12:28.042886 27273 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:28.125208 21285 leader_election.cc:403] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:28.124920 27230 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.126879 27274 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:12:28.090569 27171 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:28.059589 27159 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:28.060169 27183 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:28.135519 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.054924 26929 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:28.146943 26929 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:28.073421 27052 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:28.065011 26948 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.068351 26801 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:28.146212 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.140360 27163 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:28.155769 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.059962 27186 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.170336 21396 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:28.178876 21312 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:28.180008 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.150485 27114 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:28.182103 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.076525 27257 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.153617 27159 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:28.140810 27168 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:12:28.160861 26574 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:28.161216 27052 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:28.163880 27163 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:28.181012 26948 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:28.207482 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 148368us
I20260709 13:12:28.197950 27163 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:28.219882 21319 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9.
I20260709 13:12:28.188560 26801 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:28.229573 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:28.234658 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 177083us
W20260709 13:12:28.237423 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 163551us
I20260709 13:12:28.240085 21434 leader_election.cc:400] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16.
I20260709 13:12:28.240289 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.240420 21434 leader_election.cc:403] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:28.243146 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:28.243062 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:28.267021 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.260501 27038 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:28.275918 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:28.284229 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.255712 27251 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:28.272362 27207 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:28.276692 27034 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16.
I20260709 13:12:28.289135 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:28.254470 27183 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:12:28.277101 27158 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:28.294358 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.277102 27227 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:28.287698 27038 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.315207 21319 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:28.292891 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.291430 27222 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.329066 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.243573 27159 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.294152 27207 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:28.290205 27289 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:28.333138 21319 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:12:28.336292 21313 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:28.333607 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44564.9us
I20260709 13:12:28.275054 27052 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.319000 27038 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:28.348785 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 114728us
I20260709 13:12:28.318032 27227 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.354943 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.355587 21466 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:28.357017 21395 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:28.339876 26948 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:28.358035 26948 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:28.358080 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.358544 26948 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:28.355602 21388 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:28.362249 27287 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:28.351823 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:28.380460 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 96084.8us
I20260709 13:12:28.362438 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.332396 27186 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.339807 27207 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:28.386037 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44847.2us
I20260709 13:12:28.340054 27289 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.350596 27257 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:28.350633 27285 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.391494 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:28.413328 27289 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:28.389050 27287 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:28.415277 27287 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:28.418531 27146 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:28.415983 27287 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:28.432125 27299 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:28.432710 27299 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.433080 27299 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:28.436990 26978 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:28.411999 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83004.4us
I20260709 13:12:28.419075 27146 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:28.445838 27280 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:12:28.446123 27286 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:28.446040 27146 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:28.464102 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 72711.9us
I20260709 13:12:28.466120 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.472640 26978 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:28.478930 26978 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.480800 26929 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.481356 26978 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:28.488310 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 105986us
I20260709 13:12:28.485960 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:28.494588 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.497151 21319 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:28.495491 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:28.532378 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.537336 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.510646 26978 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:28.546342 21464 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
W20260709 13:12:28.538534 27234 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.002s
I20260709 13:12:28.550580 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.535419 27274 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18.
I20260709 13:12:28.551216 21319 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:28.494040 27285 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 13:12:28.549849 27283 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:12:28.558314 27281 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:12:28.558195 27303 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:28.558224 27300 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:28.559103 26929 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.562269 27038 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.544663 27211 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.570955 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:28.572835 27290 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:12:28.577986 21321 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:28.584892 27289 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.586869 27300 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:28.588076 27300 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.581053 27303 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.552865 26978 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.577831 27135 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:28.604728 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.622282 27287 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.593873 27289 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.625089 21312 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:28.609858 27038 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.626103 26757 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.628440 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.626670 26757 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.631068 27303 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:28.608769 27297 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:12:28.632665 26757 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.607710 27207 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.636641 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.637334 21392 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.640519 27207 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.610083 26978 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:28.594424 27211 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.642623 27286 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:28.644387 27305 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.644999 27305 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.645751 27211 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.645884 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.646901 21395 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:28.647302 27305 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.648135 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.649240 27293 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:28.649631 27293 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.650004 27293 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:28.634325 26948 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.655405 21392 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 7.
I20260709 13:12:28.663100 27163 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.664994 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.665273 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.678113 21320 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:28.665851 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.656422 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:28.688591 21318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3073) took 1440 ms (client timeout 1705 ms). Trace:
I20260709 13:12:28.682200 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:28.689123 21318 rpcz_store.cc:269] 0709 13:12:27.248086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.248287 (+   201us) service_pool.cc:224] Handling call
0709 13:12:28.688316 (+1440029us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540032bed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:28.688513 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232182528}
I20260709 13:12:28.674499 26757 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.676335 26998 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.719336 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:28.720008 22038 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:28.630316 27135 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.726780 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:28.707631 27305 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.723260 26998 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.750844 26948 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.752781 26998 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:28.734879 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:28.754083 27246 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.711630 26757 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.764708 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 962) took 1036 ms. Trace:
I20260709 13:12:28.765107 21462 rpcz_store.cc:276] 0709 13:12:27.728189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.728359 (+   170us) service_pool.cc:224] Handling call
0709 13:12:27.728739 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:28.100563 (+371824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.764472 (+663909us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b540029a9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:28.764648 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853547904}
I20260709 13:12:28.763808 27315 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:12:28.758867 27158 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:28.761051 27207 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:28.769990 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50253.8us
I20260709 13:12:28.772724 21466 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:28.747318 27305 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.775269 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.775964 21392 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:28.764715 27287 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.787848 21392 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:28.771409 27299 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.791774 27318 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:12:28.796883 27318 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:28.797415 27318 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:28.798525 27305 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.798287 27318 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.799546 27318 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:28.801620 21462 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:28.802187 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:28.803073 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:28.803911 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:28.804944 21469 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:12:28.809407 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:28.809664 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:28.809801 21462 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:28.811724 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:28.812537 21464 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:28.812631 27135 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:28.819002 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.818917 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:28.819554 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.819979 21392 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:28.821442 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.821717 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.822052 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.823239 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.808633 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.826148 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.827003 21388 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:28.827121 21387 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:28.826023 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.829021 21390 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:28.831669 21394 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:28.830156 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.833850 21394 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:28.834519 21388 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:28.834823 21387 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:28.838742 21318 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:28.839742 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.843673 21469 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:12:28.810636 27163 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.844937 21464 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:28.845852 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.846199 21388 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:28.841763 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.826880 27114 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.848973 21464 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:28.849670 22038 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:28.828944 27044 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:28.854776 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.855504 26998 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:28.855970 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.857095 21387 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
W20260709 13:12:28.845134 27319 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:12:28.851845 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.869925 21388 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:28.870548 21464 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:28.837750 27234 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.862186 27122 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:28.865722 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.845284 27294 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:28.881508 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.876928 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:28.842262 27207 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:28.887017 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.887840 27294 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:28.892460 27294 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.887977 27293 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.897154 26757 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.858839 27114 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.899312 27230 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:28.899761 27230 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:28.917057 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:28.916914 27230 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.917721 21387 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:12:28.918298 27230 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:28.904796 27190 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:28.920210 27190 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:28.900329 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.921391 21318 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:28.921058 27190 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:28.922053 27190 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:28.922533 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.905598 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.899792 27044 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:28.923569 27040 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:28.923629 27044 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:28.924091 27040 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.906761 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3039) took 1212 ms. Trace:
I20260709 13:12:28.895969 27293 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:28.908463 27168 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:28.900182 27256 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:12:28.925187 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2708) took 1031 ms. Trace:
I20260709 13:12:28.932614 21396 rpcz_store.cc:276] 0709 13:12:27.893994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.926945 (+ 32951us) service_pool.cc:224] Handling call
0709 13:12:28.925019 (+998074us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b54003f4b54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:28.925127 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97475328}
I20260709 13:12:28.926896 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3042) took 1113 ms. Trace:
I20260709 13:12:28.934123 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:28.929299 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.890197 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:28.934402 21317 rpcz_store.cc:276] 0709 13:12:27.813600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.814846 (+  1246us) service_pool.cc:224] Handling call
0709 13:12:28.926699 (+1111853us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b540015c7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:28.926817 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205441280}
I20260709 13:12:28.936327 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.937186 21317 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:28.938377 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.939172 21317 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:28.934149 21392 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:28.925014 21314 rpcz_store.cc:276] 0709 13:12:27.694148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.694669 (+   521us) service_pool.cc:224] Handling call
0709 13:12:28.906534 (+1211865us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400228b54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:28.906674 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550522240}
I20260709 13:12:28.924531 27040 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:28.954479 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:28.929610 27135 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:28.956394 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.928200 27168 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.957230 21314 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:28.958148 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.959482 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.960079 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.947167 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:28.962870 21312 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:28.957171 27168 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:28.967555 21317 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:28.968595 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.970072 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.967803 27284 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:28.971216 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.971801 21312 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:28.961102 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:28.882282 27234 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:28.956512 27135 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:28.899843 27114 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:28.988232 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.964452 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.990543 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.924871 27233 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:28.959328 27257 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.973266 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:28.995555 21312 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:28.997191 21312 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
W20260709 13:12:28.964619 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 74558.8us
I20260709 13:12:28.951675 21387 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:28.999410 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:28.977303 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.924228 27044 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:29.001091 21314 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:29.001127 21317 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:28.980875 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:28.988071 21313 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:28.978575 27226 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:28.960872 27256 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:28.999733 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:28.967489 27147 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:29.022603 21312 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:29.006451 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:29.006494 21396 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:29.007337 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:29.011524 27256 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:29.009300 27286 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:29.016242 27207 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.007809 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:29.005520 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 801785us
I20260709 13:12:29.030880 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:29.047606 21318 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:28.993340 27233 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:29.049343 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:29.055181 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.009326 27034 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:29.005339 27226 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:29.035655 27289 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:29.057828 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.038261 27165 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:29.022148 27284 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:29.035362 27160 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:29.075213 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2706) took 1181 ms. Trace:
I20260709 13:12:29.063706 27295 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:29.056509 27300 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:29.084731 27236 consensus_queue.cc:1059] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:29.063508 27285 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:12:29.086540 27040 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.089250 27234 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:29.051429 26978 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:12:29.058156 27233 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.051723 27163 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:12:29.099233 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.009833 27257 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.101270 21393 rpcz_store.cc:276] 0709 13:12:27.893400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.896123 (+  2723us) service_pool.cc:224] Handling call
0709 13:12:27.896523 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.919718 (+ 23195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.919754 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.919798 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:27.919827 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.074742 (+1154915us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5400342bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:29.074858 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.075057 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52865280}
I20260709 13:12:29.037137 27114 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:12:29.040989 27291 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:12:29.074179 27226 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:29.106572 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:29.149248 21317 raft_consensus.cc:2410] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:12:29.078820 27289 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.125779 27256 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.051019 27052 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:12:29.061000 27274 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:12:29.102919 27211 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:12:29.123793 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:29.177474 27211 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:29.177906 27211 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:29.178110 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 54429.5us
I20260709 13:12:29.179353 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:29.061370 27311 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:12:29.105907 27284 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:29.180912 27241 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:29.181347 27241 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:29.128147 27316 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:12:29.182153 27241 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.181983 27284 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.183625 27241 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.140012 27257 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:29.144148 27163 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:29.147022 21461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:29.149243 21314 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:29.210443 21461 raft_consensus.cc:606] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:29.210886 21461 raft_consensus.cc:614] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:29.150266 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 85308.6us
I20260709 13:12:29.066210 27135 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.155316 27289 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.162366 27040 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:29.166559 27044 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.130991 27020 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.174063 27274 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:29.224198 27274 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:29.225106 27274 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.226338 27274 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:29.176453 27255 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.178399 27287 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:29.112898 27160 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:29.237150 27160 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.136366 27114 consensus_queue.cc:1243] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:29.239827 27249 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:29.184281 27324 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:12:29.185093 27168 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.189605 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:29.214356 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:29.221431 27044 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:29.222455 27020 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.253149 27020 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:29.233887 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:29.255038 27020 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:29.208431 26946 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:29.247967 27234 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:29.249056 27168 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:29.250597 27295 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:12:29.263561 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74078.4us
I20260709 13:12:29.256264 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:29.265906 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:29.261053 27234 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:29.268545 27212 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:29.269061 27211 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.270361 27211 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:29.272352 21461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:29.264223 27295 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:29.273169 21461 raft_consensus.cc:606] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:29.275115 21461 raft_consensus.cc:614] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:29.275473 27295 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.256211 27255 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.235103 27311 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:12:29.278951 27311 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:29.279312 27311 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:29.279520 27255 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:29.280154 27311 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.281392 27311 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:29.286636 27289 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.288305 21461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:29.247967 27163 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.267930 27234 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.276978 27295 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:29.300637 27226 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:29.301576 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45413.2us
W20260709 13:12:29.304045 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 91815.2us
I20260709 13:12:29.313015 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:29.307364 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:29.309379 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:29.309835 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3088) took 1378 ms. Trace:
I20260709 13:12:29.305146 21461 raft_consensus.cc:606] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:29.319890 21461 raft_consensus.cc:614] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:29.321712 21393 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:29.306311 27212 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.308326 27249 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:29.322993 21396 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:29.323175 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:29.324673 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.310738 27259 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:29.310467 27038 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:29.314730 27293 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:29.331698 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.333232 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:29.334040 27322 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:29.335711 27062 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.336846 27062 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:29.340488 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:29.321743 27114 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:29.329329 27212 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.324188 27040 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.327759 27169 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:29.345338 27040 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.346580 27212 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:29.346956 27038 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.348312 27227 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:29.350399 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:29.351125 21391 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:29.353209 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.355001 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:29.359820 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.360455 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.361801 22035 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:29.352512 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:29.369277 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.369711 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:29.371254 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:29.371949 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.372280 22035 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:29.373730 21396 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:29.324167 27234 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:29.374519 26946 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:29.380360 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:29.381160 22039 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:29.381453 22036 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:29.384069 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.384706 22041 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:29.341069 27253 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:29.349571 27117 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:12:29.388190 21465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:29.388844 21465 raft_consensus.cc:606] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:29.389101 27040 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:29.389799 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.349182 27038 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:29.390923 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.337518 27293 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:29.401317 27293 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:29.368450 27294 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:29.338999 27249 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:29.381402 27212 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:29.404728 27249 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.405287 27212 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.405706 27212 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:29.413141 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:29.389168 21465 raft_consensus.cc:614] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:29.431869 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.430418 27234 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:29.433573 27234 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:29.431945 27337 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:29.449084 22041 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:29.386742 27233 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.483103 22038 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:29.483001 22031 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:29.476084 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:29.485189 22034 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:29.489269 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:29.491294 27020 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:29.491010 27293 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.493677 27233 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:29.494551 21389 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:29.428658 27226 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:29.447264 27342 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.003s
I20260709 13:12:29.449745 27146 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:29.491035 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:29.519619 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.521576 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:29.421861 27163 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:29.423182 27253 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:29.628726 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.551515 21359 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:29.633208 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 81798.8us
I20260709 13:12:29.638947 22036 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:12:29.657652 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.522570 22039 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:29.524080 27226 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:29.706334 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 967) took 1272 ms. Trace:
I20260709 13:12:29.706806 21466 rpcz_store.cc:276] 0709 13:12:28.433797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.433967 (+   170us) service_pool.cc:224] Handling call
0709 13:12:28.434314 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:28.773729 (+339415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.702797 (+929068us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400216e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:29.706262 (+  3465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777847168}
I20260709 13:12:29.632426 26929 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.632365 27249 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:29.638087 27255 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:29.706032 27190 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:29.728261 21393 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:29.728706 21393 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:29.535790 27163 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.734777 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:29.729425 21393 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:29.740316 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.747344 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:29.755586 21387 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:29.722224 27249 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.739044 27168 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:29.772418 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.753856 27284 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:29.735312 27190 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.780285 21394 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:29.724597 26929 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:29.819813 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 72601.9us
I20260709 13:12:29.826488 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.828344 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:29.828704 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:29.829037 21321 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:29.831254 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:29.831805 21318 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:29.832492 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:29.832886 21318 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:29.833612 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:29.834060 21317 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.841871 22036 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:29.844518 21317 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:29.815402 27249 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:29.819204 27320 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.848699 21316 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:12:29.849401 21316 pending_rounds.cc:85] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 8
I20260709 13:12:29.850636 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:29.821043 27257 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.834640 27038 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:29.864601 27038 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:29.865809 27038 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.854700 21321 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:29.849638 21316 pending_rounds.cc:107] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:12:29.873045 21316 raft_consensus.cc:2889] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:29.820001 27168 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.879397 21395 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:29.861930 21318 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:29.814704 27212 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.863184 27257 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:29.848374 27284 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:29.854715 27320 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:29.881428 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:29.876554 27241 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.004s
I20260709 13:12:29.872853 27299 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:29.890875 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 567371us
I20260709 13:12:29.893957 27253 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:29.911839 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:29.918001 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:29.920930 21466 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:29.919200 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:29.924022 21461 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:29.895879 27114 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:12:29.901595 27293 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:29.931473 21465 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:29.893393 27284 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:29.924947 27276 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.946252 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:29.919958 27241 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:12:29.947124 21392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:29.951071 21392 raft_consensus.cc:606] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:29.951589 21392 raft_consensus.cc:614] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:29.939177 27163 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.000846 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:30.001788 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.002674 21317 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:30.004213 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:30.004374 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:30.005723 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:30.003731 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:30.008503 21317 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:30.003863 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:29.949342 27311 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:29.947396 26929 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:29.948922 27190 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.014441 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:30.030936 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.031770 21320 raft_consensus.cc:2376] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18. Re-sending same reply.
I20260709 13:12:30.015616 27146 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.956091 27274 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.947216 27276 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.044500 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.019690 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.045876 27350 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:30.046028 27295 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:30.046761 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:30.047407 21392 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:30.047513 27350 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:30.047931 27350 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:30.048751 27350 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.044157 21391 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:30.004722 27163 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.050812 21321 raft_consensus.cc:2376] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 9. Re-sending same reply.
I20260709 13:12:30.044468 21317 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:30.022543 27212 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:30.056290 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 144597us
I20260709 13:12:30.059399 21461 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:30.060719 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:30.041221 27241 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:30.065682 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.066275 21392 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:30.068292 21317 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:30.068794 21317 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:30.045226 27168 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.070839 21318 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:30.079347 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2159) took 1258 ms. Trace:
I20260709 13:12:30.081881 21319 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:30.079789 21395 rpcz_store.cc:276] 0709 13:12:28.821394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.821522 (+   128us) service_pool.cc:224] Handling call
0709 13:12:30.079154 (+1257632us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002ccc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:30.079277 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2403596032}
I20260709 13:12:30.084323 21396 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:30.085217 27284 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.088704 27289 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.090973 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:30.043499 27146 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.093490 27146 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.096197 27276 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.073161 27298 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.097573 27298 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.098927 26574 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:30.099464 26574 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:30.100135 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:30.100522 26574 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.098719 21214 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.103727 27259 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:30.104265 27259 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:30.104853 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:30.104727 21214 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:30.106362 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:30.108592 26929 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:30.109026 26929 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.109378 26929 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:30.109727 27347 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:30.107319 21214 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 7 to 10, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 10 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.113037 27259 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.116308 21387 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:30.119074 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 879) took 1707 ms. Trace:
I20260709 13:12:30.119447 21313 rpcz_store.cc:276] 0709 13:12:28.412100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.412295 (+   195us) service_pool.cc:224] Handling call
0709 13:12:28.987573 (+575278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.003178 (+ 15605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.118873 (+1115695us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b540032afd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:30.119013 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321969024}
I20260709 13:12:30.121476 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.122109 21313 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:30.122859 27284 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.123414 27284 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.125875 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.127379 21466 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:12:30.128484 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.128919 27284 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.129163 21462 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:12:30.129962 21464 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:30.130126 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.125784 21463 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:30.107759 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:30.115928 27259 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.133975 27309 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:30.138849 27302 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:30.139899 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.143409 21395 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:30.145009 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.145538 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:30.032632 27311 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.146157 21389 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:30.146494 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.147974 27311 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.148077 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.149003 21395 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
W20260709 13:12:30.150290 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.150866 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.057947 27163 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.154677 27163 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:30.155983 21362 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:30.157589 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:30.157919 27237 raft_consensus.cc:3055] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:30.158383 27237 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:30.162149 27246 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:30.162878 27246 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:30.163406 27320 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.163813 27246 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:30.165885 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.168551 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.168864 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:29.318397 21315 rpcz_store.cc:276] 0709 13:12:27.931299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.935984 (+  4685us) service_pool.cc:224] Handling call
0709 13:12:27.936282 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.936665 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:27.956907 (+ 20242us) log.cc:844] Serialized 14 byte log entry
0709 13:12:29.236998 (+1280091us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b1800303ca0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:12:29.309391 (+ 72393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:29.309450 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:29.309527 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.309661 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.309777 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19999,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":84,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2296,"spinlock_wait_cycles":6785920,"thread_start_us":72027,"threads_started":1}
I20260709 13:12:30.140741 21436 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:30.171382 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 102280us
I20260709 13:12:30.173211 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.174366 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.180632 21464 raft_consensus.cc:2410] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:30.068652 27241 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.183352 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:30.193336 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:30.119840 27257 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.195386 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.150738 21395 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:30.198325 21317 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.201265 21317 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:30.205852 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.204671 21389 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:30.214630 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.215904 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 75225.8us
I20260709 13:12:30.216930 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:30.159409 27237 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.225071 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.175123 27298 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:30.174611 27309 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:30.225626 27147 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:30.244258 21388 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:30.227352 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.195523 27241 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:30.229310 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.221444 27044 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:30.199014 27163 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:30.242373 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.246203 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.252240 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.225917 27230 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:30.243630 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:30.252887 21463 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:30.247315 21317 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:30.205204 27124 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:12:30.251335 27163 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.221836 27274 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:12:30.228375 27351 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:30.241662 27284 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:30.263180 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.267933 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.261842 21315 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:30.226308 27353 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:12:30.269709 21463 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:30.276738 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3099) took 1362 ms. Trace:
I20260709 13:12:30.277165 21312 rpcz_store.cc:276] 0709 13:12:28.913891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.045755 (+131864us) service_pool.cc:224] Handling call
0709 13:12:29.046106 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.086054 (+1039948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.086090 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:30.086132 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:30.086180 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.276481 (+190301us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540022d8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:30.276537 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.276682 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391159040}
I20260709 13:12:30.270995 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.254698 27237 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.278769 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:30.261919 27038 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:30.249243 27347 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:30.284994 21312 raft_consensus.cc:2368] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:30.281440 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.278769 21315 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:30.286345 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.287595 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:30.287917 21312 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:30.281322 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.293790 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:30.288184 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.297376 21315 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:30.298369 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.298564 21319 raft_consensus.cc:2410] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:12:30.295845 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:30.300849 21312 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:30.300391 21317 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:30.301256 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.307101 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:30.276875 27274 consensus_queue.cc:1243] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:12:30.280637 27234 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.285003 27038 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:30.313361 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.390702 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.266870 27249 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.421571 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.422490 21461 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:30.280715 26929 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.275722 27351 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.443256 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:30.435434 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.416301 27038 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:30.465013 21314 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:30.336941 27257 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:30.427410 27234 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:30.365032 21466 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:30.485275 21465 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:12:30.448204 27146 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:30.467928 21464 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
W20260709 13:12:30.475119 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 202047us
W20260709 13:12:30.342176 21394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2720) took 1501 ms (client timeout 1740 ms). Trace:
W20260709 13:12:30.486858 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 426185us
W20260709 13:12:30.488605 21394 rpcz_store.cc:269] 0709 13:12:28.840864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.841589 (+   725us) service_pool.cc:224] Handling call
0709 13:12:30.342038 (+1500449us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54001c4154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:30.342125 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144843008}
W20260709 13:12:30.490458 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.336849 27309 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.474151 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.495864 21461 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:30.346685 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.478472 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.474938 26998 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:30.475420 27226 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:30.488587 27289 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.514612 21393 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:30.494694 27163 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:30.525033 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.492452 27146 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.477308 27234 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.523587 27226 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:30.530088 27357 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:30.530835 27146 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:30.531469 27355 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:12:30.532793 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:30.533583 21465 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:30.535311 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.514354 26998 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.538159 27351 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.533762 27226 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.498689 27253 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:30.543227 27253 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.475697 27257 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.515029 27230 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:30.541973 27234 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.525588 21462 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:30.546904 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.538149 26998 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.563855 22032 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:30.526091 27284 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:30.256206 27352 consensus_queue.cc:1175] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfcd9560f8f44414b25f8069384c5a73" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:30.523694 27289 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.561429 27249 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.601265 27284 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.602694 27289 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.607988 27257 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:30.614240 27356 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:12:30.663010 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.662743 21214 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 9 to 12, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 12 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:30.665120 21312 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:30.666580 21214 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:30.667263 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.671446 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.673158 21314 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:30.674165 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.676761 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.678050 21319 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:30.681871 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:30.683110 21312 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:30.692746 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:30.700917 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:30.706692 21362 leader_election.cc:400] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:30.708513 21214 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 8 to 9, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 9 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:12:30.732421 21218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 186) took 46142 ms (client timeout 15000 ms). Trace:
I20260709 13:12:30.740259 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:30.741778 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 253368us
I20260709 13:12:30.750516 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:30.750797 21321 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:12:30.859201 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.001s	sys 0.001s
I20260709 13:12:30.753346 21318 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:12:30.859875 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.002s	sys 0.001s
W20260709 13:12:30.860334 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 666280us
I20260709 13:12:30.754050 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:30.775677 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.778564 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.781225 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:30.782462 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:30.864717 22031 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:30.864766 21392 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:30.784243 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.866461 22034 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:30.784384 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.785040 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.785722 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:30.869251 21396 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:30.787238 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.787168 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.795639 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.797981 21390 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:12:30.879402 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 75254us
I20260709 13:12:30.800724 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.801738 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:30.808687 26921 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:30.811859 26574 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.813063 26757 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:30.814203 26929 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:30.823370 26946 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.824378 26948 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:30.834219 26998 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:30.844576 21362 leader_election.cc:403] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:30.567142 27117 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:12:30.901921 27062 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:30.908869 26946 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.919390 27044 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.920148 27044 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.922207 27114 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.923009 27114 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:30.925947 27114 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:30.927631 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47001.3us
I20260709 13:12:30.928511 27234 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:30.929028 27234 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:30.929469 27234 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:30.930742 27197 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:30.932755 27230 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:30.933712 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 183541us
I20260709 13:12:30.936142 27276 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:30.936518 26929 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:30.937088 26929 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.937678 26929 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.937161 26948 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:30.939450 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.907651 27249 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.911991 21214 catalog_manager.cc:5697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 5 to 11, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 11 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:12:30.940321 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 78848us
W20260709 13:12:30.913538 27020 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.007s	sys 0.014s
I20260709 13:12:30.942425 26921 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:30.954595 21214 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:31.027328 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.948335 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 242609us
W20260709 13:12:30.948702 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 209254us
I20260709 13:12:30.972697 21316 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:30.955336 21321 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:12:30.955093 21435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.009s
I20260709 13:12:31.037838 21312 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:30.949699 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.022442 27117 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:30.943517 27134 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:12:31.045089 27117 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.046116 27134 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:31.046726 27134 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:31.048235 21435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.002s	sys 0.009s
I20260709 13:12:31.048424 27044 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.975857 26921 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:31.052208 26921 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.054665 26921 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:30.943480 21393 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:12:30.950342 27352 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.913543 26757 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.940497 27364 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 13:12:30.950076 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:31.060761 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 360361us
I20260709 13:12:31.062966 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:31.078425 27044 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:30.921195 26946 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.076504 21318 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:31.057627 21393 pending_rounds.cc:85] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 9
I20260709 13:12:30.972931 22042 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:31.079546 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 150050us
I20260709 13:12:30.944161 27124 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:30.933729 27165 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:12:31.057361 27298 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.047861 27134 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.126117 27298 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.126963 27134 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:31.130759 27287 consensus_queue.cc:1175] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d41c71e861344f0b90e8d44a8d0a3173" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 13:12:31.130383 21214 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 10 to 13, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 13 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:31.133347 27350 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:31.135264 27117 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.135977 26574 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:31.071384 27365 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:12:30.945988 27358 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.061079 27020 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.007s	sys 0.015s
I20260709 13:12:31.083338 21393 pending_rounds.cc:107] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:12:31.056977 27381 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.943117 27315 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:30.948766 27226 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:31.060263 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.141476 21393 raft_consensus.cc:2889] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:30.951900 27253 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:30.939986 26948 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:30.949519 27361 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:31.056957 27299 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.072067 27380 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 13:12:30.945616 27371 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:31.058120 27040 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:12:31.163149 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 103038us
I20260709 13:12:31.163516 27373 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:31.164343 27373 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.164863 27373 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:31.165870 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.166919 27168 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:31.061251 27163 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.055934 27038 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.582s	user 0.017s	sys 0.000s
I20260709 13:12:31.065635 26757 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.144850 21362 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.150903 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:31.061003 27302 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:12:31.079231 27044 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.156021 22038 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:12:31.158937 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:31.159205 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:31.156479 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 93625.1us
I20260709 13:12:30.954879 27062 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.936936 27276 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.169579 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.061359 27366 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:12:31.150410 27381 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.194453 27163 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.163552 27040 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:31.197644 27163 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.058125 27352 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.204131 27347 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:31.204602 27347 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.204954 27347 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:31.206030 27352 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.155038 27315 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:30.952761 27246 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.243s
I20260709 13:12:30.944157 27249 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.211918 27249 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.175189 27168 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:12:31.163642 27124 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.179782 27351 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:12:31.180361 27038 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.217238 27038 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.217142 27358 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:31.181322 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 98482.8us
W20260709 13:12:31.187417 27241 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.929s	user 0.018s	sys 0.001s
I20260709 13:12:31.190745 27299 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:31.218641 27237 consensus_meta.cc:287] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.933s	user 0.012s	sys 0.006s
I20260709 13:12:31.218923 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:31.219422 21319 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:12:31.191413 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.220491 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2738) took 1493 ms. Trace:
I20260709 13:12:31.220937 21393 rpcz_store.cc:276] 0709 13:12:29.727459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.727611 (+   152us) service_pool.cc:224] Handling call
0709 13:12:29.727895 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.514355 (+786460us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b58007dcfd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4
0709 13:12:31.183598 (+669243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.220424 (+ 36826us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871729920}
I20260709 13:12:31.222636 27299 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.218713 27241 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.223765 27044 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.162122 27371 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:31.225219 27241 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:31.230669 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47429.7us
I20260709 13:12:31.226923 27358 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:31.236256 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 64240.9us
I20260709 13:12:31.231295 27253 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.244315 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:31.261868 21317 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:31.268200 21320 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:31.273552 27249 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:31.274171 27249 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:31.274585 27249 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:31.275967 27358 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.276743 27371 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.276966 27358 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.278352 27371 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:31.280619 27241 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.280979 27234 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.281621 27241 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.283349 27234 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.284220 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:31.285473 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66682.4us
I20260709 13:12:31.286417 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:31.288398 27241 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:31.289053 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55069.6us
I20260709 13:12:31.292907 27299 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:31.293777 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:31.235832 27298 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.294842 26757 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:31.298194 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:31.236176 27364 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:12:31.289125 27358 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.246004 27226 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:31.310109 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.309031 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.298173 27276 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.302254 27234 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:31.316951 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.324769 21390 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:31.326880 27168 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:31.327445 27168 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:31.327865 27168 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:31.329497 27124 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.333514 27040 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.334947 27040 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:31.335920 21313 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:12:31.340399 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:31.341223 21461 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:31.341662 27284 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:31.340479 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 112217us
W20260709 13:12:30.858229 21218 rpcz_store.cc:269] 0709 13:11:44.597847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.618669 (+ 20822us) service_pool.cc:224] Handling call
0709 13:12:30.732069 (+46113400us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:22.126748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:22.127607 (+   859us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:22.127668 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:12:22.127693 (+    25us) tablet.cc:662] Decoding operations
0709 13:12:22.164642 (+ 36949us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:22.164765 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:22.164793 (+    28us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:12:22.166176 (+  1383us) tablet.cc:701] Row locks acquired
0709 13:12:22.166225 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:12:22.166383 (+   158us) write_op.cc:270] Start()
0709 13:12:22.166532 (+   149us) write_op.cc:276] Timestamp: P: 1783602742166322 usec, L: 0
0709 13:12:22.166574 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:12:22.167351 (+   777us) log.cc:844] Serialized 5944 byte log entry
0709 13:12:22.456285 (+288934us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bc10e0ac 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b
0709 13:12:22.645872 (+189587us) op_driver.cc:464] REPLICATION: finished
0709 13:12:22.825017 (+179145us) write_op.cc:301] APPLY: starting
0709 13:12:22.825145 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:22.878269 (+ 53124us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b180032fb60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf195190 00007fc2bf18eae7 00007fc2bf18ddd9
0709 13:12:23.660820 (+782551us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:23.660892 (+    72us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:23.803942 (+143050us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:24.017586 (+213644us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:12:24.056243 (+ 38657us) write_op.cc:312] APPLY: finished
0709 13:12:24.085091 (+ 28848us) log.cc:844] Serialized 139 byte log entry
0709 13:12:24.363853 (+278762us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.364071 (+   218us) write_op.cc:454] Released schema lock
0709 13:12:24.364165 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:24.456334 (+ 92169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.460347 (+  4013us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2112236,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":142910,"apply.run_cpu_time_us":53005,"apply.run_wall_time_us":1603138,"cfile_cache_hit":62,"cfile_cache_hit_bytes":67007,"num_ops":15,"prepare.queue_time_us":110963,"prepare.run_cpu_time_us":17543,"prepare.run_wall_time_us":442791,"raft.queue_time_us":42316,"raft.run_cpu_time_us":28068,"raft.run_wall_time_us":68678,"replication_time_us":479112,"spinlock_wait_cycles":34232448,"thread_start_us":752106,"threads_started":5,"wal-append.queue_time_us":816040,"wal-append.run_cpu_time_us":21600,"wal-append.run_wall_time_us":2346793}]]}
I20260709 13:12:31.346511 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.301892 27315 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.310858 27226 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.352584 27226 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:31.354916 27038 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:31.355428 27038 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:31.356789 27361 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:31.357244 27361 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:31.358246 27361 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.358794 21461 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:31.311553 26929 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.359943 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.360342 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.360523 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.360935 21466 raft_consensus.cc:2368] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
I20260709 13:12:31.361269 21394 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:31.358906 27062 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.361533 27381 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.362735 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.359414 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.358708 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.314936 21214 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 7 to 11, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 11 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:31.380383 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 76535.5us
I20260709 13:12:31.381549 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:31.382174 26757 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.383000 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3130) took 1121 ms. Trace:
I20260709 13:12:31.382823 26757 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.383237 27257 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:31.383428 21313 rpcz_store.cc:276] 0709 13:12:30.261197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.262883 (+  1686us) service_pool.cc:224] Handling call
0709 13:12:31.382778 (+1119895us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003ae3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:31.382927 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451854208}
I20260709 13:12:31.384212 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.381754 26929 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.387840 27276 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:31.392511 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.392951 27276 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.394471 26757 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.395226 27276 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.396246 21390 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:31.301441 27253 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.396284 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.370791 27315 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:31.402268 21461 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:31.392611 21396 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:31.406934 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.398653 21214 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 7 to 8, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 8 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.395218 27384 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:31.412218 27384 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.412658 27384 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:31.413136 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.414381 21390 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
W20260709 13:12:31.415999 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.416343 27289 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:31.416954 27289 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.421545 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2727) took 1143 ms. Trace:
I20260709 13:12:31.421983 21463 rpcz_store.cc:276] 0709 13:12:30.278084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.278990 (+   906us) service_pool.cc:224] Handling call
0709 13:12:31.421189 (+1142199us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54001a72d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:31.421352 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197686528}
I20260709 13:12:31.423337 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:31.392500 27372 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:12:31.427397 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.429728 21463 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:31.426097 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.431231 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.423745 27289 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.436695 27361 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:31.400352 27381 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:12:31.409175 27246 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:31.439801 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.440590 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.441511 27135 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:31.455456 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.460273 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.461030 21313 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:31.461404 22038 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:31.464182 21315 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:12:31.465991 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.466756 22042 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:31.467216 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 120825us
I20260709 13:12:31.436609 27315 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.468288 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.469085 27234 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:31.469966 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.470382 27315 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.470618 27257 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:31.474968 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.477517 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:31.477905 21395 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:31.478233 21317 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:31.478482 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:31.479125 21313 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:31.483525 27257 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:31.471019 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2717) took 1345 ms. Trace:
I20260709 13:12:31.468492 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:31.398576 27020 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:12:31.471465 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.467869 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.475152 27287 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:12:31.475824 27234 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.508541 27234 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:31.516400 21466 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:31.520354 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.521093 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.521117 21315 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:31.524473 27381 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:31.526120 27381 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:31.528487 21313 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:31.531335 21470 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:12:31.470624 27253 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.536906 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2719) took 1390 ms. Trace:
I20260709 13:12:31.537415 21470 rpcz_store.cc:276] 0709 13:12:30.146113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.157273 (+ 11160us) service_pool.cc:224] Handling call
0709 13:12:31.536573 (+1379300us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003facd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:31.536815 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3156240128}
W20260709 13:12:31.539013 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 70613.9us
I20260709 13:12:31.539590 27362 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.540206 27257 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.540380 27362 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.541039 27257 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.542166 27276 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.542752 27276 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.543445 27257 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.544608 27320 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.545264 27320 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.545644 27276 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.546190 27276 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:31.546693 27276 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.547207 27350 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.547369 27320 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.547677 21318 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:31.446857 27249 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.548238 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.549012 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.549817 21321 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:31.487003 21468 rpcz_store.cc:276] 0709 13:12:30.125075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.139624 (+ 14549us) service_pool.cc:224] Handling call
0709 13:12:31.470661 (+1331037us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000b8e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:31.470825 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3009194240}
W20260709 13:12:31.521986 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64603.6us
I20260709 13:12:31.501117 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.527709 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.418870 27373 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.555342 21392 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:31.555899 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.558925 21315 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:31.562726 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.563463 21314 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:31.564486 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.565100 21312 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:31.565743 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.566092 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.567052 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:31.559785 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53757.9us
I20260709 13:12:31.573242 22039 raft_consensus.cc:2410] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:31.576453 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.577178 22042 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:31.577436 27160 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:31.577971 27160 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:31.578450 27160 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:31.410197 27038 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.580530 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:31.582248 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.583039 22035 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:31.579139 27234 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:31.584302 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63321.3us
I20260709 13:12:31.585680 27234 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.585948 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.547725 27350 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.587246 27246 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:31.550665 27257 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:31.584322 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.590147 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.590315 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:31.592706 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.593026 27299 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.593312 21466 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:31.593845 27358 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:31.594323 27373 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.594678 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:31.594947 27373 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.595664 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:31.595906 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:31.596432 21470 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:31.598451 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.599081 21462 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:31.598923 27168 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.558557 27249 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.601388 21466 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:12:31.593668 27241 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:31.602581 27134 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:31.602968 27134 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:31.603322 27134 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:31.576637 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.606276 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:31.607034 22040 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:31.586786 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.593650 27299 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:31.616369 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50364.5us
I20260709 13:12:31.458698 27372 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:12:31.618808 21317 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:31.595518 27373 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:31.621793 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 70095.3us
I20260709 13:12:31.622864 27168 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.623175 27373 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.623935 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.624670 22031 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:31.625296 27253 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:31.625756 27253 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.625955 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.626672 22042 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:12:31.627271 27062 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:31.628593 27350 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.629192 27372 consensus_queue.cc:1243] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:31.629695 27299 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.626151 27253 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:31.631107 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.631877 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.593389 21464 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:31.635221 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:31.640326 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53617.4us
I20260709 13:12:31.644589 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:31.644735 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.630429 27020 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:31.647735 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:31.652383 21396 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:31.653404 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.653762 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.655357 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:31.656009 21396 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:31.656728 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.655681 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.619369 27241 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:31.659091 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:31.620093 27358 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:31.658231 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.669211 27241 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.663985 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:31.671515 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.658666 27362 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.672169 27351 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:31.672580 27362 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:31.672705 27351 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.673034 27362 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.673370 27351 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:31.673556 27362 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:31.676339 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.677392 21362 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:31.678009 27289 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:31.678493 27289 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:31.678938 27289 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:31.681694 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:31.683761 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:31.680935 22038 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:31.574237 27384 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.687772 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.695605 21388 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:31.702505 27168 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:31.702689 27134 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.709183 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:31.710108 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.722254 21314 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:31.710916 27160 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.711447 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:31.639259 27284 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:12:31.712998 27038 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:31.713986 27287 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:31.714581 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:31.715975 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 58729.8us
I20260709 13:12:31.657815 27135 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:31.716419 27299 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:12:31.748828 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 90700.8us
I20260709 13:12:31.723016 21467 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:31.725001 21318 pending_rounds.cc:85] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 10
I20260709 13:12:31.712023 21317 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:12:31.730490 22042 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:31.718664 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:31.758607 21318 pending_rounds.cc:107] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:12:31.732913 21312 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:31.734784 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:31.759088 21318 raft_consensus.cc:2889] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:31.737975 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:31.760125 21319 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:31.741115 27230 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:12:31.754793 22035 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:31.766225 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:31.682802 27124 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:12:31.741335 26921 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:31.738305 27246 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:31.737985 27234 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:31.784225 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:31.781792 27382 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:31.789949 27124 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:31.796471 27237 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:31.796648 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:31.799443 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:31.800231 27358 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:31.803354 21396 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:31.741197 27168 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:31.807224 27384 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.807948 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.742929 27249 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:12:31.809492 27134 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:31.810386 27257 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:31.748178 27276 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:31.747574 27135 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.810928 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:31.754525 27287 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.812345 27160 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:31.816681 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 98116.1us
I20260709 13:12:31.817554 26921 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:31.855058 27347 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.650s	user 0.016s	sys 0.000s
I20260709 13:12:31.777503 27299 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:31.856376 27234 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.827009 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:31.738718 27394 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:12:31.822252 27124 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:31.890560 26921 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:31.902602 27124 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.909188 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.910036 22042 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:31.849901 27362 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.839395 27237 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:31.898639 21394 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:31.881548 27135 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:31.900132 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:31.899797 26998 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:31.977118 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:31.907912 27124 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:31.778482 27226 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:31.988651 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:31.942795 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 101047us
I20260709 13:12:31.990283 27362 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:31.990576 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:31.991482 27163 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:31.991873 27163 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:31.992086 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 219206us
I20260709 13:12:31.993114 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:31.995966 27299 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:31.949254 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49236.5us
I20260709 13:12:31.916838 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:31.983593 27241 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:31.992298 27163 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:31.999698 22035 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
W20260709 13:12:32.002410 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.002894 27371 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:32.006717 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:32.007103 27289 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:31.913036 27347 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.010625 27347 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.011266 27347 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:32.012950 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:32.014284 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:32.014881 21313 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:31.857419 27246 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:32.018747 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:32.019510 21320 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:32.021575 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:32.018590 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:32.022454 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:32.021965 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:32.023927 22042 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:31.949301 27237 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:32.049085 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:32.028388 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:32.053705 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 254366us
I20260709 13:12:31.985762 27160 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:32.052639 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:32.059697 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:32.014767 27364 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:32.067363 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:32.070026 21312 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:32.073555 21320 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:32.073688 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:32.081215 22041 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:32.065809 21390 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
W20260709 13:12:32.086139 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 259286us
I20260709 13:12:32.093670 21433 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:32.059015 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:32.095412 22031 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:32.017467 27241 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:32.027361 27020 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:32.049947 27358 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:32.011910 27347 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:32.026846 27246 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:32.104643 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:32.111637 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.066699 27160 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:32.115097 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 318518us
I20260709 13:12:32.068617 27165 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:32.119431 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:32.118285 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:32.134752 21390 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:32.117348 27358 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:32.110800 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:32.120769 21466 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:32.135469 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:32.048729 27062 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:12:32.136438 21461 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:12:32.136900 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:32.167963 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 74375.5us
I20260709 13:12:32.137809 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:32.139385 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:32.049063 27163 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:32.097440 27298 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:32.116335 27241 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:32.181980 21313 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:32.191375 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:32.188832 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:32.127020 27246 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:32.132761 27160 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:32.217041 21393 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:32.140379 27361 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:32.173379 27249 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:32.176608 27358 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.139000 26929 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:32.184648 27298 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.210546 27364 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:32.128477 26921 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.292572 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:32.285543 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 205725us
I20260709 13:12:32.293262 21390 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:32.168843 27406 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.141s
I20260709 13:12:32.260212 27249 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.306847 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:32.268220 27020 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:32.120215 27168 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:32.314076 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 191402us
I20260709 13:12:32.318883 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:32.319743 21390 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:32.290584 27298 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:32.325510 21314 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:32.290061 27364 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.326083 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:32.331790 21394 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:32.327778 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:32.312403 27408 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.313053 27249 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:32.341863 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:32.328246 27350 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:32.347259 21312 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:32.349959 21394 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:32.326057 27287 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:32.306393 27361 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.333130 27364 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:32.384683 21360 leader_election.cc:400] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
I20260709 13:12:32.388814 21360 leader_election.cc:403] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:32.309911 26929 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.395740 21394 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:12:32.345585 27062 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:12:32.397989 27253 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.000s
W20260709 13:12:32.379417 27351 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.000s
I20260709 13:12:32.356468 27394 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:32.351248 27289 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:32.394275 27398 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
I20260709 13:12:32.438871 21394 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:32.344777 27299 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:12:32.379932 27350 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.413581 27384 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:32.400776 27062 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:32.426692 27253 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:32.352994 27408 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.473678 27163 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:32.441550 26929 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.496608 21388 raft_consensus.cc:2368] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20.
I20260709 13:12:32.476362 27420 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:12:32.477169 27416 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:32.478677 27038 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.736s	user 0.004s	sys 0.004s
I20260709 13:12:32.479214 26921 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.479207 27226 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.481405 22041 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:32.438297 27394 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:32.524900 27394 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:32.526293 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:32.527115 22041 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:32.529971 27350 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.535427 27424 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:32.490046 21390 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
W20260709 13:12:32.454146 27400 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:12:32.391952 27020 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:12:32.496184 27412 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.499655 27408 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.499894 27253 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:32.494807 27347 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:32.489636 26998 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:32.489815 27062 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:32.561702 27226 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:32.516263 27409 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:12:32.516808 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:32.538036 21320 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:32.539239 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:32.542160 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 448245us
I20260709 13:12:32.616304 22039 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:32.481953 27384 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:32.495285 27289 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
I20260709 13:12:32.619490 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:32.427626 27351 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.620389 27410 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:32.619935 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 235923us
I20260709 13:12:32.556965 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:32.565299 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 179299us
W20260709 13:12:32.597499 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.005s	sys 0.018s
W20260709 13:12:32.625519 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.005s	sys 0.018s
W20260709 13:12:32.515244 27401 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.396s	user 0.000s	sys 0.001s
I20260709 13:12:32.621977 27351 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.454793 27406 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:12:32.623461 21360 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:32.628213 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:32.614794 22040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.003s	sys 0.007s
I20260709 13:12:32.598788 27020 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:32.594609 27425 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.626334 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:32.633642 22040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.003s	sys 0.007s
I20260709 13:12:32.633231 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:32.612565 26998 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.667917 27165 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:32.668334 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:32.668524 27165 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:32.670158 27246 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.548928 27416 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:32.668576 27289 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:32.677191 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53851.5us
I20260709 13:12:32.561787 27412 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:32.686895 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.005s	sys 0.010s
W20260709 13:12:32.688877 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.006s	sys 0.010s
I20260709 13:12:32.689133 21468 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:32.693994 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:32.694329 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:32.637136 27350 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:32.694972 21313 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
W20260709 13:12:32.694041 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 67792.7us
W20260709 13:12:32.689543 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 671001us
I20260709 13:12:32.613647 27298 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.699415 27412 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.701120 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:32.737483 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.702064 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:32.703928 27124 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.003s
I20260709 13:12:32.665426 27020 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.707152 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:32.711292 26757 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.753417 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:32.750893 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.753140 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:32.719215 22039 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:32.720970 21320 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [13.10-14.11]
I20260709 13:12:32.729521 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:32.732609 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:32.633029 27253 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:12:32.626785 27226 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.739694 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.742089 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:32.761888 21396 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:32.743605 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2762) took 1090 ms. Trace:
I20260709 13:12:32.748020 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:32.752597 21390 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:32.697345 27361 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.721626 27350 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:32.766978 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:32.767963 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:32.769080 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:32.769618 21320 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:32.770185 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.770457 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.744334 27347 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:32.765848 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:32.770839 27362 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:32.774022 27237 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.000s
I20260709 13:12:32.774459 27237 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.770514 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1173) took 1279 ms. Trace:
I20260709 13:12:32.777297 21321 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:32.772008 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:32.782747 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:32.783759 21313 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:32.762673 21392 rpcz_store.cc:276] 0709 13:12:31.653082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.688510 (+ 35428us) service_pool.cc:224] Handling call
0709 13:12:31.731386 (+ 42876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.744270 (+ 12884us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:31.744309 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.776241 (+ 31932us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.052867 (+276626us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:32.052911 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.052980 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.743377 (+690397us) raft_consensus.cc:1685] finished
0709 13:12:32.743400 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.743549 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7410,"raft.queue_time_us":6983,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":17165,"thread_start_us":246380,"threads_started":1,"wal-append.queue_time_us":411958}
I20260709 13:12:32.784993 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:32.664574 27425 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:32.790897 21395 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:32.791970 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:32.793066 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.777197 21389 rpcz_store.cc:276] 0709 13:12:31.400694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.415950 (+ 15256us) service_pool.cc:224] Handling call
0709 13:12:31.442153 (+ 26203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.442596 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.442624 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.443172 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:12:31.741717 (+298545us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:31.741749 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.741805 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.679676 (+937871us) raft_consensus.cc:1685] finished
0709 13:12:32.679701 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.679814 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7982,"raft.queue_time_us":1195,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8978,"thread_start_us":298138,"threads_started":1,"wal-append.queue_time_us":401523}
I20260709 13:12:32.797483 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:32.776845 27124 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:32.778301 27038 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:32.800902 27431 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:32.801779 27434 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:32.783794 27246 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:32.803592 27257 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:32.803961 21316 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:32.772641 27350 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.814283 21321 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:32.791875 26921 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:32.830659 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.817268 21320 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:32.762727 26757 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:32.794343 27410 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:32.798894 27381 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:32.757781 27384 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.853598 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.844800 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:32.854563 21316 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:32.852214 22031 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.002s
I20260709 13:12:32.821761 27168 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:12:32.855819 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 58605.4us
I20260709 13:12:32.855387 22031 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:32.857770 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.832816 27412 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:32.831683 27257 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:32.834551 27284 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:32.825654 27431 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:32.851560 27381 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.799350 27364 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:32.890900 21997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.656s (SENT) [suppressed 5 similar messages]
I20260709 13:12:32.849490 27434 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:32.906477 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 205484us
I20260709 13:12:32.861124 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:32.913288 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52230.6us
I20260709 13:12:32.914132 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.856107 27351 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:32.855433 27038 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:32.860169 27320 raft_consensus.cc:2764] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:12:32.898255 27040 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:12:32.929510 26998 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:32.930933 21320 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:32.863544 27412 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.932324 22038 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:32.904433 27381 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:32.900701 27384 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:32.901216 27431 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:32.938530 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:32.948424 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 82777.2us
I20260709 13:12:32.954699 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:32.926685 27284 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:32.961234 27284 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:32.962399 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 71522.2us
I20260709 13:12:32.963613 27284 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:32.955466 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:32.861320 27419 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:12:32.978029 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:32.978919 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:32.945501 27412 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:32.947844 27410 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:32.978615 27421 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:32.949177 27428 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:32.979955 27432 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:33.014158 27432 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:33.014572 27432 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.019140 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:33.020834 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:32.993302 27168 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:32.987720 27298 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.043491 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:33.102340 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.015256 27237 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.011739 27428 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:33.011052 27416 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:33.131749 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:33.187060 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:33.036296 27424 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:33.177791 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.191381 21387 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:33.191803 21464 raft_consensus.cc:2368] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:12:33.181690 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3169) took 1177 ms. Trace:
I20260709 13:12:33.183760 27020 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.024515 27371 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:33.186810 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:33.198772 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 205133us
I20260709 13:12:33.125556 27040 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:33.195716 27135 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.173s	user 0.011s	sys 0.003s
I20260709 13:12:33.196151 27417 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:12:33.196699 27435 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:12:33.197209 27426 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:12:33.192526 21321 rpcz_store.cc:276] 0709 13:12:32.004593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.006410 (+  1817us) service_pool.cc:224] Handling call
0709 13:12:33.181513 (+1175103us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540022cc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:33.181634 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770534144}
I20260709 13:12:32.994633 27257 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:33.019795 27372 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.168s
I20260709 13:12:33.203126 21462 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:33.197620 27447 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:33.033592 27361 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.159s
I20260709 13:12:33.186817 27428 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:33.222357 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:33.265697 21396 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:33.226413 26998 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.196754 26757 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:33.228716 27441 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:12:33.229048 27438 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.205s
I20260709 13:12:33.229971 27453 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:33.126013 27434 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:33.231189 27405 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 13:12:33.231254 27358 consensus_meta.cc:287] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.928s	user 0.002s	sys 0.007s
I20260709 13:12:33.231671 27429 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:33.214897 27040 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.211585 27135 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:33.234751 27443 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:12:33.235690 27448 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:12:33.236756 27449 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.237175 27460 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:33.237471 27134 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:33.222792 27371 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:33.239928 26921 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:33.240345 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1513) took 1223 ms. Trace:
W20260709 13:12:33.241916 27433 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 13:12:33.242498 27373 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:33.248512 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:33.249328 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:33.211673 27020 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:33.253543 27364 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:33.253705 27439 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.328s	user 0.007s	sys 0.005s
I20260709 13:12:33.254130 27422 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:33.255622 21468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 979) took 1666 ms (client timeout 1656 ms). Trace:
W20260709 13:12:33.256945 27160 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.985s	user 0.011s	sys 0.001s
I20260709 13:12:33.261125 27362 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:33.262514 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:33.263422 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:33.264750 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:33.398658 27358 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.205271 27168 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.333038 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1419) took 1214 ms. Trace:
I20260709 13:12:33.265954 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2192) took 1155 ms. Trace:
W20260709 13:12:33.265097 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44381.2us
I20260709 13:12:33.354230 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:33.221154 27249 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.000s
I20260709 13:12:33.355177 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:33.212110 27417 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:33.356266 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 335518us
W20260709 13:12:33.472508 21316 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.615s	user 0.014s	sys 0.000s
W20260709 13:12:33.358166 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 380195us
I20260709 13:12:33.444526 22036 rpcz_store.cc:276] 0709 13:12:32.053213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.053969 (+   756us) service_pool.cc:224] Handling call
0709 13:12:32.098240 (+ 44271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:32.299273 (+201033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.299322 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:32.336184 (+ 36862us) log.cc:844] Serialized 52 byte log entry
0709 13:12:32.441105 (+104921us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:32.441148 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.441211 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.266854 (+825643us) raft_consensus.cc:1685] finished
0709 13:12:33.266885 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.267063 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":905,"raft.queue_time_us":252314,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":29570,"thread_start_us":208840,"threads_started":2,"wal-append.queue_time_us":257938}
I20260709 13:12:33.397362 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:33.397200 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:33.214663 27416 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:33.472901 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:33.173439 27038 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.413244 22038 rpcz_store.cc:276] 0709 13:12:32.016975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.017092 (+   117us) service_pool.cc:224] Handling call
0709 13:12:33.240089 (+1222997us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400614754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:33.240233 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1632264064}
I20260709 13:12:33.444610 21394 rpcz_store.cc:276] 0709 13:12:32.110455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.439956 (+329501us) service_pool.cc:224] Handling call
0709 13:12:32.440379 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.667231 (+226852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.667264 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:32.673953 (+  6689us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.933753 (+259800us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:33.056400 (+122647us) log.cc:844] Serialized 14 byte log entry
0709 13:12:33.056578 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.056631 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.265743 (+209112us) raft_consensus.cc:1685] finished
0709 13:12:33.265763 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.265900 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":447,"prepare.queue_time_us":306257,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":60687,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":74665,"thread_start_us":417666,"threads_started":3,"wal-append.queue_time_us":289547}
W20260709 13:12:33.413913 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 143894us
I20260709 13:12:33.417589 22041 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:33.407545 27452 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:33.401216 21204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d41c71e861344f0b90e8d44a8d0a3173 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:12:33.432427 21468 rpcz_store.cc:269] 0709 13:12:31.588977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.594432 (+  5455us) service_pool.cc:224] Handling call
0709 13:12:33.255415 (+1660983us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54000b8454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:33.255522 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120523136}
I20260709 13:12:33.266611 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:33.414717 27134 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:33.490931 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:33.472695 21434 leader_election.cc:400] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20.
I20260709 13:12:33.466831 21464 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:33.474187 21461 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.447533 21312 raft_consensus.cc:2368] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
W20260709 13:12:33.446616 27241 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.224s	user 0.012s	sys 0.001s
I20260709 13:12:33.214860 27425 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:33.407791 27429 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.479918 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:33.497110 21362 leader_election.cc:400] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
I20260709 13:12:33.497478 21362 leader_election.cc:403] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:12:33.483198 27472 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:12:33.474545 27362 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:33.485211 27459 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:33.426542 27020 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:33.504841 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3093) took 1168 ms. Trace:
I20260709 13:12:33.486397 27416 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.506536 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:33.489048 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:33.218083 27410 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.420198 26921 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.443816 27160 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.472868 21316 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:33.518800 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:33.501928 21468 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:12:33.502296 21285 leader_election.cc:400] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:12:33.501008 21466 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:33.505297 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:33.520908 21469 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:33.521095 21285 leader_election.cc:403] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:33.485745 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:33.507073 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:33.415059 27449 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.522646 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1514) took 1505 ms. Trace:
I20260709 13:12:33.529294 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:33.529898 21466 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:33.487664 27062 consensus_meta.cc:287] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.862s	user 0.008s	sys 0.000s
I20260709 13:12:33.505167 27394 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:33.514528 21318 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:33.515059 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:33.532055 22041 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:33.495050 27453 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:33.492511 21434 leader_election.cc:403] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:12:33.500990 21204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 149478us
I20260709 13:12:33.535832 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:33.510218 21315 rpcz_store.cc:276] 0709 13:12:32.333621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.333745 (+   124us) service_pool.cc:224] Handling call
0709 13:12:32.343359 (+  9614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.379771 (+ 36412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.379805 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:32.387684 (+  7879us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.663966 (+276282us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:32.664009 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.664098 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.501938 (+837840us) raft_consensus.cc:1685] finished
0709 13:12:33.501960 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.502078 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40386,"raft.queue_time_us":153724,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":39819,"thread_start_us":208746,"threads_started":1,"wal-append.queue_time_us":360138}
I20260709 13:12:33.528401 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:33.466814 27168 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:33.482870 27249 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.512858 27438 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:33.442783 27422 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.498507 27471 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:33.541041 21316 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:33.571659 22035 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:33.529682 22040 rpcz_store.cc:276] 0709 13:12:32.017304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.017619 (+   315us) service_pool.cc:224] Handling call
0709 13:12:32.021637 (+  4018us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.636741 (+615104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.636771 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:32.678257 (+ 41486us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.757959 (+ 79702us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:32.757991 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.758072 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.252826 (+494754us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:33.516232 (+263406us) raft_consensus.cc:1685] finished
0709 13:12:33.516253 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.522580 (+  6327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":227752,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":26214,"spinlock_wait_cycles":30107008,"thread_start_us":693500,"threads_started":2,"wal-append.queue_time_us":152426}
I20260709 13:12:33.578531 21461 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:33.504379 27241 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:33.483757 27417 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.603469 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:33.576514 27460 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:33.585187 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:33.586803 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:33.593626 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:33.502041 27371 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:33.509773 27276 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:12:33.598330 21462 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.533843 27289 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.601905 21464 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:12:33.581238 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 114606us
I20260709 13:12:33.494052 27452 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:33.606997 21388 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:33.611753 21470 raft_consensus.cc:2368] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13.
I20260709 13:12:33.613988 27040 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:33.615429 27381 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.000s
I20260709 13:12:33.583694 26998 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:33.594305 27438 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:33.592741 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:33.571979 27134 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:33.570590 27062 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:33.630959 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.805058 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1422) took 1169 ms. Trace:
W20260709 13:12:33.624280 21314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3088) took 1611 ms (client timeout 1589 ms). Trace:
I20260709 13:12:33.624243 21317 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:33.862337 21390 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:33.824887 21387 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:33.860853 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.878569 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:33.878883 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:33.878981 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:33.879447 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:33.776124 21434 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:33.879753 22041 raft_consensus.cc:2368] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13.
I20260709 13:12:33.874531 22035 rpcz_store.cc:276] 0709 13:12:32.635669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.635897 (+   228us) service_pool.cc:224] Handling call
0709 13:12:33.804814 (+1168917us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540052b054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:33.804983 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007507712}
I20260709 13:12:33.880210 22038 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:34.148201 21463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.028s	sys 0.020s
W20260709 13:12:34.342906 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.237663 21469 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.003s
W20260709 13:12:33.875720 21314 rpcz_store.cc:269] 0709 13:12:32.012571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.015339 (+  2768us) service_pool.cc:224] Handling call
0709 13:12:33.624053 (+1608714us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400089154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:33.624203 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695148800}
I20260709 13:12:33.776902 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2192) took 1702 ms. Trace:
I20260709 13:12:34.002543 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:33.722038 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.316826 21388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2194) took 1362 ms (client timeout 1695 ms). Trace:
W20260709 13:12:34.547472 21392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.016s	sys 0.016s
I20260709 13:12:33.990083 22042 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:34.103353 21389 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:34.047187 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:33.781528 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:34.698498 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 808294us
I20260709 13:12:33.799292 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:34.013384 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:34.703547 21392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.025s	sys 0.016s
I20260709 13:12:34.227842 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:33.999209 21320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.006s
W20260709 13:12:34.706825 21320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.262s	user 0.007s	sys 0.021s
I20260709 13:12:34.122745 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:33.996867 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:33.992955 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:34.328619 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:33.794010 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.876943 21362 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:34.095009 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:33.959524 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:33.883550 21462 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:34.056069 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:34.011659 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:34.702092 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 926068us
I20260709 13:12:33.890987 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:34.199975 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3170) took 2154 ms. Trace:
W20260709 13:12:34.700158 21463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.234s	user 0.032s	sys 0.021s
I20260709 13:12:34.701699 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:34.717123 21468 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:34.718240 22031 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:34.700914 21469 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:34.719933 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2753) took 1272 ms. Trace:
I20260709 13:12:34.724156 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:33.802626 27350 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.960s	user 0.009s	sys 0.003s
W20260709 13:12:34.726456 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 767006us
I20260709 13:12:34.723768 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2756) took 1159 ms. Trace:
I20260709 13:12:34.725051 22041 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:34.737989 21470 rpcz_store.cc:276] 0709 13:12:33.564873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.571977 (+  7104us) service_pool.cc:224] Handling call
0709 13:12:34.723708 (+1151731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.720422 21469 rpcz_store.cc:276] 0709 13:12:33.447392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.488304 (+ 40912us) service_pool.cc:224] Handling call
0709 13:12:34.719874 (+1231570us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:34.702764 21388 rpcz_store.cc:269] 0709 13:12:32.954197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.954389 (+   192us) service_pool.cc:224] Handling call
0709 13:12:34.316467 (+1362078us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540033fed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:34.316707 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480284544}
I20260709 13:12:34.724617 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3105) took 1106 ms. Trace:
I20260709 13:12:34.739527 21321 rpcz_store.cc:276] 0709 13:12:33.617809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.849161 (+231352us) service_pool.cc:224] Handling call
0709 13:12:34.724496 (+875335us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:33.757546 27466 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:12:34.714134 21316 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:12:33.836586 27431 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.004s
I20260709 13:12:34.741658 27431 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:33.608107 27460 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:34.742954 27460 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:34.744392 27431 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:34.737648 21466 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.207s	user 0.011s	sys 0.002s
W20260709 13:12:33.812644 27165 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.143s	user 0.011s	sys 0.004s
I20260709 13:12:34.736006 22032 raft_consensus.cc:2368] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:12:34.745111 27431 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:34.745262 27165 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.745678 27431 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.747670 27165 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:34.677484 26929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.190s	user 0.014s	sys 0.010s
W20260709 13:12:33.799527 27432 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.001s
W20260709 13:12:34.749305 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 950039us
I20260709 13:12:34.714639 21317 rpcz_store.cc:276] 0709 13:12:32.004873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.005025 (+   152us) service_pool.cc:224] Handling call
0709 13:12:32.005296 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.876895 (+1871599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.159124 (+282229us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54000fc154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:34.159398 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3722830720}
W20260709 13:12:34.108436 27467 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.629s	user 0.000s	sys 0.001s
I20260709 13:12:33.743436 27362 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.772610 27234 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:34.342667 27412 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.326s	user 0.015s	sys 0.001s
W20260709 13:12:34.493271 27394 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.952s	user 0.007s	sys 0.006s
W20260709 13:12:34.207952 27384 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.242s	user 0.004s	sys 0.008s
I20260709 13:12:34.753778 21466 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
W20260709 13:12:34.754894 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2749) took 1400 ms (client timeout 1677 ms). Trace:
I20260709 13:12:33.797183 27422 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:34.786682 21462 rpcz_store.cc:269] 0709 13:12:33.354219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.491083 (+136864us) service_pool.cc:224] Handling call
0709 13:12:34.754638 (+1263555us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b540029a4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:34.754812 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201429760}
I20260709 13:12:34.790357 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:34.791538 27447 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:34.792169 27447 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.793367 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 920) took 2102 ms. Trace:
I20260709 13:12:34.793483 27406 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.773394 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:34.794114 27406 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.793761 21313 rpcz_store.cc:276] 0709 13:12:32.691750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.790872 (+ 99122us) service_pool.cc:224] Handling call
0709 13:12:32.821663 (+ 30791us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:32.933750 (+112087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.933781 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:32.965060 (+ 31279us) log.cc:844] Serialized 52 byte log entry
0709 13:12:33.356146 (+391086us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:33.440486 (+ 84340us) log.cc:844] Serialized 14 byte log entry
0709 13:12:33.440700 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.441215 (+   515us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:34.793151 (+1351936us) raft_consensus.cc:1685] finished
0709 13:12:34.793173 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.793311 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17491,"prepare.queue_time_us":225911,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":73,"raft.queue_time_us":87550,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":35738,"thread_start_us":458474,"threads_started":3,"wal-append.queue_time_us":496641}
I20260709 13:12:33.971573 27381 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.763943 27364 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:34.796761 27364 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:34.796906 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3104) took 1314 ms. Trace:
I20260709 13:12:34.698241 27020 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:33.756765 27468 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:12:34.797278 27062 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:34.797652 27381 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:33.763670 27449 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.958571 27276 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:33.971982 27289 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.794214 27447 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:34.798393 27276 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.797863 27020 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:34.798895 27276 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:34.799319 27020 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:34.800288 27289 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:34.800462 27020 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.802459 27406 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:34.803303 27406 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:33.678546 27416 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:34.068326 27253 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.757201 27350 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.804754 27253 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.806265 27350 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:34.764431 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:34.051973 27134 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.681315 27417 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:33.680514 27241 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:34.775262 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:34.768673 27470 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:33.616840 27135 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:33.821333 27257 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:34.763096 21469 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:34.252682 27298 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.798486 27413 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:34.798918 27447 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.798295 27381 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:12:34.833580 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.834319 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.327831 27429 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.669847 27358 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.678606 26921 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.854600 27408 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:33.675132 27249 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:33.671260 27168 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:33.677161 27160 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:33.802402 27226 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:34.362721 27453 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:33.806744 27424 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:34.655180 27452 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:34.747772 27431 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:34.320125 27246 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:34.701148 21467 rpcz_store.cc:276] 0709 13:12:32.074244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.092090 (+ 17846us) service_pool.cc:224] Handling call
0709 13:12:32.130624 (+ 38534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.196334 (+ 65710us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:32.291386 (+ 95052us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.789330 (+497944us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b18002f6140. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:12:32.909884 (+120554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.909961 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:32.910035 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.776578 (+866543us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b540025ab54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:33.776639 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.776800 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35161,"prepare.queue_time_us":94869,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":8031,"raft.queue_time_us":47507,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6133,"spinlock_wait_cycles":130226432,"thread_start_us":120278,"threads_started":1,"wal-append.queue_time_us":820805,"wal-append.run_cpu_time_us":1415,"wal-append.run_wall_time_us":1119501}
W20260709 13:12:34.841724 27428 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.484s	user 0.015s	sys 0.002s
I20260709 13:12:34.725312 27373 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20.
W20260709 13:12:34.764196 26929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.269s	user 0.014s	sys 0.011s
I20260709 13:12:34.749012 27040 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:34.788237 21461 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:34.795428 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:34.803824 27406 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:34.807744 21470 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:34.797300 21313 rpcz_store.cc:276] 0709 13:12:33.482641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.796018 (+1313377us) service_pool.cc:224] Handling call
0709 13:12:34.796369 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.796578 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.796601 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:34.796644 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:34.796680 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.796736 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.796856 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.877775 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2203) took 1369 ms. Trace:
W20260709 13:12:34.786890 21466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2755) took 1271 ms (client timeout 1543 ms). Trace:
I20260709 13:12:34.813026 22039 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:12:34.798012 27062 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:34.880286 27406 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.797804 27468 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:34.878361 21466 rpcz_store.cc:269] 0709 13:12:33.515225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.529049 (+ 13824us) service_pool.cc:224] Handling call
0709 13:12:34.786796 (+1257747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.854388 27424 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:34.770396 27165 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:34.789951 27394 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16.
I20260709 13:12:34.829254 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2757) took 1234 ms. Trace:
I20260709 13:12:34.877018 27246 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.888370 27468 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.884516 27364 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.890525 21313 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:34.891254 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3191) took 1379 ms. Trace:
I20260709 13:12:34.891556 21313 rpcz_store.cc:276] 0709 13:12:33.511887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.878051 (+1366164us) service_pool.cc:224] Handling call
0709 13:12:34.890330 (+ 12279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.890970 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.891175 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.892069 27246 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:34.892204 27468 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:34.893524 27468 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.840775 27447 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.894057 27468 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.895920 27447 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:34.896416 27468 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:34.888574 27423 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.132s	user 0.033s	sys 0.042s
W20260709 13:12:34.897440 27423 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.033s	sys 0.042s
I20260709 13:12:34.836658 27470 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.776793 27234 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:34.279807 27438 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.843812 27408 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.835466 27298 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.827863 27253 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:34.844393 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.034s	sys 0.045s
W20260709 13:12:34.918550 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.034s	sys 0.045s
I20260709 13:12:34.851301 21316 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:12:34.920008 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3199) took 1115 ms. Trace:
I20260709 13:12:34.840696 27384 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.920542 21316 rpcz_store.cc:276] 0709 13:12:33.804315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.001607 (+197292us) service_pool.cc:224] Handling call
0709 13:12:34.919932 (+918325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.854753 21321 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:34.929729 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3189) took 1428 ms. Trace:
I20260709 13:12:34.930189 21321 rpcz_store.cc:276] 0709 13:12:33.501614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.839780 (+1338166us) service_pool.cc:224] Handling call
0709 13:12:34.854585 (+ 14805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.929391 (+ 74806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.929660 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:34.842231 27434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.403s	user 0.033s	sys 0.027s
I20260709 13:12:34.781253 27412 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.875855 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2759) took 1003 ms. Trace:
I20260709 13:12:34.876987 21314 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:34.788269 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:34.878430 22039 pending_rounds.cc:85] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 10
I20260709 13:12:34.939291 21317 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:34.939411 22039 pending_rounds.cc:107] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:12:34.939888 22039 raft_consensus.cc:2889] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:34.878183 21470 rpcz_store.cc:276] 0709 13:12:33.508247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.757910 (+1249663us) service_pool.cc:224] Handling call
0709 13:12:34.776422 (+ 18512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.877509 (+101087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.877715 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.885437 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:34.940888 21466 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
W20260709 13:12:34.939960 21315 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.011s	sys 0.028s
I20260709 13:12:34.872754 27428 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.896301 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:34.938670 21461 rpcz_store.cc:276] 0709 13:12:33.872662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.766988 (+894326us) service_pool.cc:224] Handling call
0709 13:12:34.787754 (+ 20766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.875506 (+ 87752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.875786 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.068419 27309 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:34.751711 26998 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.889881 21469 rpcz_store.cc:276] 0709 13:12:33.600218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.762407 (+1162189us) service_pool.cc:224] Handling call
0709 13:12:34.762826 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.828956 (+ 66130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.829178 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.768607 27432 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.842424 27413 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:34.934791 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3194) took 1417 ms. Trace:
I20260709 13:12:34.941098 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:34.976389 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:34.976791 21316 rpcz_store.cc:276] 0709 13:12:33.517686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.929316 (+1411630us) service_pool.cc:224] Handling call
0709 13:12:34.934059 (+  4743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.934318 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.934377 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:34.934450 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:34.934504 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.934578 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.934719 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:34.959331 21286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.009s	sys 0.009s
W20260709 13:12:34.978477 21286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.009s	sys 0.009s
I20260709 13:12:34.942165 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:34.815907 21468 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:34.951095 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:34.955101 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:34.855484 27453 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.961187 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3196) took 1441 ms. Trace:
I20260709 13:12:34.989398 21317 rpcz_store.cc:276] 0709 13:12:33.520270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.944540 (+1424270us) service_pool.cc:224] Handling call
0709 13:12:34.960545 (+ 16005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.960771 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.960815 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:34.960886 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:34.960944 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.961017 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.961136 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:34.991674 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3198) took 1457 ms. Trace:
I20260709 13:12:34.994978 21312 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:34.943187 27253 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.996809 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2205) took 1135 ms. Trace:
I20260709 13:12:34.997185 21468 rpcz_store.cc:276] 0709 13:12:33.861893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.761153 (+899260us) service_pool.cc:224] Handling call
0709 13:12:34.996744 (+235591us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:34.934643 27434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.496s	user 0.033s	sys 0.028s
W20260709 13:12:34.927697 27287 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.022s	sys 0.006s
W20260709 13:12:34.939901 27410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.009s	sys 0.008s
W20260709 13:12:34.955634 21465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.482s	user 0.023s	sys 0.058s
I20260709 13:12:34.911269 27165 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:34.975838 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:35.005633 22031 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:34.914822 27234 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.008777 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:34.941695 21315 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.011s	sys 0.028s
I20260709 13:12:34.983132 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.009615 21468 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:34.984501 21319 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:34.992019 21317 rpcz_store.cc:276] 0709 13:12:33.534403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.990764 (+1456361us) service_pool.cc:224] Handling call
0709 13:12:34.991175 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.991365 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.991391 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:34.991430 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:34.991466 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.991514 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.991627 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:35.003328 21465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.544s	user 0.023s	sys 0.058s
I20260709 13:12:34.958889 27422 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.004916 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 922) took 1985 ms. Trace:
W20260709 13:12:35.002660 27287 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.022s	sys 0.007s
W20260709 13:12:35.002702 27410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.009s	sys 0.009s
I20260709 13:12:34.935329 27384 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.011657 21320 rpcz_store.cc:276] 0709 13:12:33.019673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.021808 (+  2135us) service_pool.cc:224] Handling call
0709 13:12:33.022121 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:33.411184 (+389063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.411215 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:33.416378 (+  5163us) log.cc:844] Serialized 26 byte log entry
0709 13:12:34.707311 (+1290933us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:34.707359 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.707440 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:35.004695 (+297255us) raft_consensus.cc:1685] finished
0709 13:12:35.004716 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.004851 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38032,"raft.queue_time_us":214417,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":1540320,"threads_started":2,"wal-append.queue_time_us":1445635}
I20260709 13:12:34.984077 27468 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:35.001754 27447 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.025082 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 969066us
I20260709 13:12:35.027096 21317 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:35.038396 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3106) took 1164 ms. Trace:
I20260709 13:12:35.038954 21317 rpcz_store.cc:276] 0709 13:12:33.874271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.016189 (+1141918us) service_pool.cc:224] Handling call
0709 13:12:35.026649 (+ 10460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.038010 (+ 11361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.038286 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:35.027920 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:35.051095 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:35.054032 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 1.27251e+06us
I20260709 13:12:35.012485 27452 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.058506 27487 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:35.058415 27452 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.059166 27487 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.060587 27452 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:35.030460 27371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.015s	sys 0.006s
W20260709 13:12:35.055526 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 298104us
I20260709 13:12:35.057773 27434 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:35.003422 27253 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.067687 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1194) took 1269 ms. Trace:
I20260709 13:12:35.075250 27257 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:35.079058 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:35.095633 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.082015 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.083745 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.099604 21468 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:35.099540 21389 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:35.092644 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.100780 21467 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:35.090778 21392 rpcz_store.cc:276] 0709 13:12:33.798129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.798698 (+   569us) service_pool.cc:224] Handling call
0709 13:12:33.799024 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.799244 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:12:33.799575 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.057852 (+1258277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:35.067251 (+  9399us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:35.067329 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.067431 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.067606 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20500,"prepare.queue_time_us":608,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":90981,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"spinlock_wait_cycles":11434368,"thread_start_us":1237005,"threads_started":2,"wal-append.queue_time_us":1077414}
W20260709 13:12:35.101981 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 1.22505e+06us
W20260709 13:12:35.087857 27371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.016s	sys 0.006s
I20260709 13:12:35.097483 22031 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:12:35.097329 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.113760 21390 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:35.093051 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.20211e+06us
I20260709 13:12:35.104487 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:35.107785 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.112331 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.112385 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:35.015527 27422 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.083308 26998 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.114675 21394 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:35.127604 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:35.122287 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:35.125584 21469 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:35.131166 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.127074 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.131481 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.127161 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:35.037698 27468 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.132302 21391 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:35.051702 27447 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.133214 21467 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
W20260709 13:12:35.136004 21284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.014s	sys 0.026s
I20260709 13:12:35.099128 27298 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:35.134631 21387 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:35.159416 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.131739 27406 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.099540 27434 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:35.171979 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 233183us
I20260709 13:12:35.168449 21394 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:12:35.161826 21284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.014s	sys 0.026s
W20260709 13:12:35.170763 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66381.2us
I20260709 13:12:35.131163 27487 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.106218 27257 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.157716 27371 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.161478 27470 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.217267 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.237879 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.239089 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:35.240821 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.260087 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.164465 27488 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.177094 27358 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.164206 27494 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.263010 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 81783.3us
I20260709 13:12:35.267700 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.325001 21467 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:35.324218 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55566.6us
I20260709 13:12:35.330420 22041 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:12:35.287204 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.176970 27246 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:35.339530 21467 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:35.227059 27410 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.346676 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 128457us
I20260709 13:12:35.228104 27408 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:35.345791 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 257775us
I20260709 13:12:35.336333 21469 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:12:35.345518 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 331208us
I20260709 13:12:35.362988 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:35.265193 27040 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:35.363641 21284 leader_election.cc:400] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:12:35.364817 26929 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:35.238436 27168 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:35.242198 27241 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:35.266403 27412 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.379611 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.345377 27358 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.225214 27249 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.351229 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3203) took 1009 ms. Trace:
W20260709 13:12:35.346680 27483 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:12:35.200127 27406 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.391568 27384 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:35.384310 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 252724us
W20260709 13:12:35.342293 27276 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.003s
I20260709 13:12:35.342696 27432 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.405126 21317 rpcz_store.cc:276] 0709 13:12:34.341740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.056764 (+715024us) service_pool.cc:224] Handling call
0709 13:12:35.086598 (+ 29834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.086922 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:35.110880 (+ 23958us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.349829 (+238949us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.350009 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:35.350064 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:35.350856 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.350985 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.351152 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":658,"raft.queue_time_us":19524,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":15802,"thread_start_us":237359,"threads_started":1}
I20260709 13:12:35.470425 21317 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:35.266731 27350 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:35.382026 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:35.340755 27413 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.478101 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3204) took 1136 ms. Trace:
I20260709 13:12:35.478637 21317 rpcz_store.cc:276] 0709 13:12:34.342053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.469692 (+1127639us) service_pool.cc:224] Handling call
0709 13:12:35.470191 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.477725 (+  7534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.478022 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:35.344373 27309 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:35.344677 27246 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:35.418220 27241 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.424571 22041 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:35.425366 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.489308 22034 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:12:35.391041 27505 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:12:35.238336 27371 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:35.463512 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 58392.6us
W20260709 13:12:35.463934 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 87098.4us
I20260709 13:12:35.390861 27165 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.336827 27488 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.522032 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:35.464264 27453 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.527262 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:35.518663 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:35.525974 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.528810 21317 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:35.484400 27234 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.368314 27410 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.539394 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:35.490455 27246 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:35.393021 27168 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.545688 21359 leader_election.cc:400] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13.
I20260709 13:12:35.541760 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:35.468359 27284 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:12:35.337312 27494 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.463506 27249 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.480562 27276 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.553785 21359 leader_election.cc:403] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:35.546614 27062 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:35.492568 27350 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.526177 27381 consensus_queue.cc:1059] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:12:35.550277 27253 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.569165 27234 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:35.589053 27486 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:12:35.589578 27503 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:12:35.592801 27513 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:35.593390 27249 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.594070 27361 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:12:35.596410 27481 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
W20260709 13:12:35.597580 27499 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:12:35.599030 27424 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.702s	user 0.005s	sys 0.002s
I20260709 13:12:35.598881 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.578634 27062 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:35.567076 27289 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.599189 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:35.600427 21317 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:35.600406 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:35.604099 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1425) took 2358 ms. Trace:
W20260709 13:12:35.604956 21312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3098) took 2344 ms (client timeout 1717 ms). Trace:
W20260709 13:12:35.605448 27518 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:12:35.606164 27485 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260709 13:12:35.606971 27506 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:12:35.556958 27491 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:35.609813 21387 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:35.635030 27234 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.614641 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 261127us
W20260709 13:12:35.615142 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 216639us
I20260709 13:12:35.616559 27434 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:35.617287 27509 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:12:35.580961 21467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:35.622922 27257 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:35.623071 27134 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.808s	user 0.008s	sys 0.003s
I20260709 13:12:35.623318 27371 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.573758 27492 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 13:12:35.624843 27460 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.881s	user 0.012s	sys 0.000s
I20260709 13:12:35.628283 27488 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.578444 27040 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.616995 27160 raft_consensus.cc:3055] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:35.629290 27410 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.705402 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.552376 27496 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:12:35.578097 27519 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:35.611898 27447 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.631934 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2743) took 2366 ms. Trace:
I20260709 13:12:35.633438 27276 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.633689 27358 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.634227 27246 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.698061 27423 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.634732 27417 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.001s
I20260709 13:12:35.556535 27394 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:12:35.713974 21465 rpcz_store.cc:276] 0709 13:12:33.265486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.266137 (+   651us) service_pool.cc:224] Handling call
0709 13:12:33.354454 (+ 88317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:33.413324 (+ 58870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.413358 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:33.417320 (+  3962us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.013257 (+1595937us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:35.052518 (+ 39261us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.286292 (+233774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.286388 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:35.631654 (+345266us) raft_consensus.cc:1685] finished
0709 13:12:35.631677 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.631837 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30093,"prepare.queue_time_us":39464,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":287505,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":18368,"thread_start_us":1787734,"threads_started":2,"wal-append.queue_time_us":2196509}
I20260709 13:12:35.647894 21395 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
W20260709 13:12:35.647089 21388 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.002s
I20260709 13:12:35.731302 21388 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:35.651638 21316 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:35.731734 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:35.650420 22039 rpcz_store.cc:276] 0709 13:12:33.245609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.245865 (+   256us) service_pool.cc:224] Handling call
0709 13:12:33.246296 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.956081 (+1709785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.603782 (+647701us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54005c49d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:35.603989 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3602336512}
I20260709 13:12:35.732373 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.658865 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.613157 21320 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 13:12:35.733281 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.660427 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:35.649488 21312 rpcz_store.cc:269] 0709 13:12:33.260612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.504967 (+244355us) service_pool.cc:224] Handling call
0709 13:12:35.604717 (+2099750us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400229054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:35.604849 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3352621312}
W20260709 13:12:35.669138 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 129855us
W20260709 13:12:35.679548 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.652864 27062 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:35.634905 27494 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:35.690014 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.695199 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:35.655288 27513 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:12:35.696933 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 171483us
I20260709 13:12:35.685341 27234 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.701035 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.702987 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:35.658959 27253 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13.
I20260709 13:12:35.825007 27516 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:35.825691 27516 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:35.826826 27516 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.705982 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.828725 22041 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:12:35.631150 27495 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:35.652935 27424 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.833446 27134 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:35.833962 27424 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.834733 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.836156 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.836807 27543 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:35.837885 27394 consensus_queue.cc:1243] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:12:35.839691 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.716470 27020 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:12:35.842629 27350 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.716482 27491 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:35.843575 27491 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.845093 21388 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:12:35.847134 27434 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:35.847690 27434 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:35.708277 21433 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:35.713653 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:35.715979 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:35.657719 27289 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.695328 27406 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.634537 27468 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.635414 27309 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.729146 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.874455 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:35.888852 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.889103 21468 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 11.
I20260709 13:12:35.711402 27241 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.736748 27287 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.705554 27460 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.811924 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.811041 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:35.813702 27246 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.813930 27537 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:35.790089 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:35.821579 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:35.815704 27513 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:35.849500 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 144792us
I20260709 13:12:35.864476 21391 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:35.848984 22032 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:35.706230 27160 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:35.728520 27257 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.927939 27537 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:35.901434 27287 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.930413 27287 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:35.887593 26929 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:35.717639 27519 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.787824 27416 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.837917 27543 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:35.891177 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.939371 21468 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:12:35.940663 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.940814 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.942209 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.943166 27287 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.899610 21316 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
W20260709 13:12:35.935745 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 117597us
W20260709 13:12:35.936514 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 146537us
I20260709 13:12:35.889604 21465 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:35.945204 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:35.946004 21318 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:35.946580 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:35.948832 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:35.950246 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.950704 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:35.951398 21316 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:12:35.953866 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:35.954470 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:35.950295 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 125055us
I20260709 13:12:35.955448 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:35.962733 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.870128 27434 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.967259 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:35.968070 27434 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:35.968677 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:35.969431 21395 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:35.737414 27423 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.957634 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:35.957547 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 83182.5us
I20260709 13:12:35.954944 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:35.954702 21465 raft_consensus.cc:2376] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14. Re-sending same reply.
W20260709 13:12:35.973758 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.040s	sys 0.078s
W20260709 13:12:35.974270 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.041s	sys 0.078s
I20260709 13:12:35.965437 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:35.948488 27516 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:35.943708 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:35.949815 26929 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:35.974575 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:35.974623 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 562186us
I20260709 13:12:35.978117 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.927925 27540 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.006806 27540 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:35.980973 27160 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.009500 27160 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.013072 27234 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.964363 27038 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:36.015987 27495 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:36.016309 27038 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.016697 27495 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.017267 27495 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:35.949205 27257 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.982759 27544 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:35.982909 27519 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:35.983515 27460 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:35.951325 27416 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.989176 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:35.990619 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.029433 21387 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:36.029884 21388 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:35.992288 27491 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.979705 27522 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:12:36.037520 27257 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:35.996202 27534 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.996716 27527 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:35.997221 27533 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:35.998178 27537 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.964515 27494 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:36.000671 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.043074 21468 raft_consensus.cc:2376] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14. Re-sending same reply.
I20260709 13:12:35.992324 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:36.043076 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 88224.8us
I20260709 13:12:35.943920 27287 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.982034 21395 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:12:36.001770 27543 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:35.964201 27246 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:35.980386 27513 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:36.044706 21997 connection.cc:256] RPC call timeout handler was delayed by -1.4839799530000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
I20260709 13:12:36.009366 27540 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.016798 27038 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:35.979331 27289 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.017283 21390 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:35.974074 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:36.026849 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 209929us
I20260709 13:12:36.070063 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:36.068382 21997 connection.cc:256] RPC call timeout handler was delayed by -1.2229799530000491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 13:12:36.070660 21997 connection.cc:256] RPC call timeout handler was delayed by -1.2164657519999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:12:36.070716 21468 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:36.071404 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.071862 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.024379 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.037163 27521 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:35.993257 27523 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:12:35.981213 26929 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:36.038502 21312 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:36.041697 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.084959 21388 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:36.045204 27519 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.076166 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.086194 21316 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:36.086078 27519 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.087146 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.087702 21316 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:36.088213 27519 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.074599 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.078567 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.080276 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.088717 21316 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:36.089681 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.089977 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.090703 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.090745 21388 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:36.090948 27493 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:36.091398 27519 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.042801 27494 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:36.100008 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:36.100662 21314 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:36.100759 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.091372 21395 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:36.091883 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.068913 27246 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:36.104375 21388 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:36.106464 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.110114 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:36.092828 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 68638.2us
I20260709 13:12:36.093606 26929 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.117221 21389 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:36.106340 27246 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:36.128297 27482 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.210s	user 0.011s	sys 0.001s
I20260709 13:12:36.101426 27522 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:36.069057 27533 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.045291 27062 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.132335 27522 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.132797 27522 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:36.133912 27062 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.133942 27533 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.134488 27550 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:36.134946 27550 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:36.135360 27550 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:36.136705 27412 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.136962 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.137267 27412 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.139482 27371 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:36.139695 27412 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.108417 27543 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:36.111863 27540 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:36.105692 27537 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:36.160259 27540 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:36.160765 27540 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.162562 27434 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:36.163028 27434 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.163379 27434 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.164906 27373 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.165421 27373 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.165869 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.166429 21470 raft_consensus.cc:2376] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20. Re-sending same reply.
I20260709 13:12:36.167269 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.167543 27373 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.141785 27371 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:36.067502 27527 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:36.144445 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 762500us
I20260709 13:12:36.146405 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.146952 27432 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:36.149267 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3102) took 2887 ms. Trace:
I20260709 13:12:36.182062 27540 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.182765 21318 rpcz_store.cc:276] 0709 13:12:33.261713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.957377 (+695664us) service_pool.cc:224] Handling call
0709 13:12:33.957783 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.952684 (+1994901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.149017 (+196333us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54000fd554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:36.149200 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4572017536}
I20260709 13:12:36.149776 27165 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:36.151423 27428 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.184690 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.185873 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.186833 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.188160 27540 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.188531 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.189123 21392 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:36.189703 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.189862 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.190290 21391 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:36.191267 21391 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:36.153604 27547 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:36.154152 27452 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:36.155280 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3100) took 2894 ms. Trace:
I20260709 13:12:36.192652 27452 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.193912 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.195060 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.195803 27533 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:36.196413 27533 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:36.196736 27533 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:36.197073 27533 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.197240 27452 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.187755 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.202040 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.203555 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:36.203869 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.180586 27432 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.210175 27432 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.211362 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.211058 27495 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.193202 21315 rpcz_store.cc:276] 0709 13:12:33.261174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.617061 (+355887us) service_pool.cc:224] Handling call
0709 13:12:33.617415 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:33.681802 (+ 64387us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:35.014323 (+1332521us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.523931 (+509608us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.152245 (+628314us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:36.152888 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.153070 (+   182us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:36.153103 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.153181 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.155057 (+  1876us) raft_consensus.cc:1685] finished
0709 13:12:36.155084 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.155225 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":626545,"prepare.queue_time_us":715197,"prepare.run_cpu_time_us":185,"prepare.run_wall_time_us":7489,"raft.queue_time_us":660789,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":108215,"thread_start_us":1729434,"threads_started":3,"wal-append.queue_time_us":516238}
I20260709 13:12:36.213311 27287 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.213732 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.213894 27495 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.214919 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.215492 21315 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:12:36.155716 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.216332 21318 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:36.219969 21391 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:36.160283 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3193) took 2646 ms. Trace:
I20260709 13:12:36.104851 27494 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:36.243566 21313 rpcz_store.cc:276] 0709 13:12:33.513688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.892371 (+1378683us) service_pool.cc:224] Handling call
0709 13:12:34.904773 (+ 12402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:34.905252 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.905295 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:34.913568 (+  8273us) log.cc:844] Serialized 52 byte log entry
0709 13:12:35.218114 (+304546us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:35.218173 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.218237 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.153936 (+935699us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b2400135de8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc169fb0 00007fc2bede0488 00007fc2bede0be8 00007fc2bedb8398 00007fc2bedb376a 00007fc2bedb2bb6
0709 13:12:36.154599 (+   663us) raft_consensus.cc:1685] finished
0709 13:12:36.154628 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.160214 (+  5586us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":994,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":4639,"spinlock_wait_cycles":4612352,"thread_start_us":278666,"threads_started":1,"wal-append.queue_time_us":477648}
I20260709 13:12:36.244138 27371 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:36.245893 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2788) took 1130 ms. Trace:
W20260709 13:12:36.169370 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43845.6us
I20260709 13:12:36.170174 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.168428 27373 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:36.247292 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.246428 21396 rpcz_store.cc:276] 0709 13:12:35.115317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.117921 (+  2604us) service_pool.cc:224] Handling call
0709 13:12:35.137975 (+ 20054us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:35.138388 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:35.579705 (+441317us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.700271 (+120566us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:35.712944 (+ 12673us) log.cc:844] Serialized 52 byte log entry
0709 13:12:35.713110 (+   166us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:36.226930 (+513820us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b18003ece00. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:36.240253 (+ 13323us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.245147 (+  4894us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.245387 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.245574 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.245631 (+    57us) raft_consensus.cc:1685] finished
0709 13:12:36.245650 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.245811 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":594461,"prepare.queue_time_us":1027460,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":11679,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":26618,"spinlock_wait_cycles":7106816,"thread_start_us":420212,"threads_started":2,"wal-append.queue_time_us":215907}
I20260709 13:12:36.174196 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.182333 27527 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.041210 27544 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.157289 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:36.158128 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51707.4us
I20260709 13:12:36.226002 21314 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:36.274339 21388 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:12:36.229532 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.274376 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:36.210208 27038 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.232443 21390 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:12:36.233116 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.232900 27246 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.234750 22032 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:36.235006 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.235728 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.236248 27422 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.236148 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.237372 21394 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:36.237565 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.238968 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:36.147569 27522 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.240360 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:36.284075 22040 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:36.242501 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.247712 27373 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.288753 21394 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:36.290107 21394 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:36.290441 27373 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.292608 27168 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.245924 27371 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:36.293915 27371 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.295241 27371 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:36.281596 27496 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:36.296629 27496 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:36.297657 27038 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.297570 27496 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.298945 22035 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:36.248191 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.248893 27432 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:36.301779 27432 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.302150 27432 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:36.250026 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.304140 27470 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:36.304905 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.306015 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.307015 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.307538 21468 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:36.237416 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2786) took 1128 ms. Trace:
I20260709 13:12:36.169636 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.308509 21391 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:36.308902 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 139357us
I20260709 13:12:36.253430 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3188) took 2752 ms. Trace:
W20260709 13:12:36.256546 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 158523us
I20260709 13:12:36.309417 21319 rpcz_store.cc:276] 0709 13:12:33.501293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.838637 (+1337344us) service_pool.cc:224] Handling call
0709 13:12:34.838971 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.010753 (+171782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.253216 (+1242463us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003c91d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:36.253373 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325360000}
I20260709 13:12:36.270961 21395 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:36.270862 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.271462 21313 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:12:36.299749 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51635us
W20260709 13:12:36.276279 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46824.5us
I20260709 13:12:36.272974 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.276054 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.276494 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.313565 21362 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.285763 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.308198 21393 rpcz_store.cc:276] 0709 13:12:35.108704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.109670 (+   966us) service_pool.cc:224] Handling call
0709 13:12:35.131027 (+ 21357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:35.161340 (+ 30313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.161382 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:35.161939 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 13:12:35.366592 (+204653us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:35.693548 (+326956us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.236900 (+543352us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.237114 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.237182 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.237219 (+    37us) raft_consensus.cc:1685] finished
0709 13:12:36.237230 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.237345 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":800356,"prepare.queue_time_us":1405066,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":23883,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":21140,"thread_start_us":372957,"threads_started":2,"wal-append.queue_time_us":347500}
I20260709 13:12:36.316255 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.320369 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.321240 21390 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:12:36.286911 27544 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.286796 27550 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.331595 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.280609 27434 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.288339 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3197) took 2756 ms. Trace:
I20260709 13:12:36.301399 27495 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:36.231169 21316 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:36.312106 21313 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:36.280720 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.311010 21315 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:36.322729 27540 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:36.322899 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.340804 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.341298 22032 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:36.341593 21392 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:12:36.323287 27253 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:36.323494 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.325255 27246 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:36.324465 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.325592 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49159.7us
I20260709 13:12:36.325707 21395 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
W20260709 13:12:36.332439 21204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d41c71e861344f0b90e8d44a8d0a3173 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:36.335245 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.335155 21321 rpcz_store.cc:276] 0709 13:12:33.531516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.961762 (+1430246us) service_pool.cc:224] Handling call
0709 13:12:34.994928 (+ 33166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.031431 (+ 36503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.031463 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:35.031506 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:35.031534 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.288112 (+1256578us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b540022d8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:36.288164 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.288281 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83467008}
I20260709 13:12:36.332267 22035 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:36.348398 21466 raft_consensus.cc:2376] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12. Re-sending same reply.
I20260709 13:12:36.337538 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.323710 26929 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.369387 21468 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:36.370200 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46790.6us
I20260709 13:12:36.343801 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.344399 27495 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:36.340934 27540 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.344614 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.355551 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.361563 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:36.362649 27476 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.419s	user 0.007s	sys 0.014s
I20260709 13:12:36.376305 22040 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:36.332093 27168 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:36.378161 27168 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.378567 27168 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:36.337234 27062 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:12:36.366657 27522 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.368153 27434 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.331147 27020 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.371999 21394 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:36.376669 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.373425 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.371574 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.364573 27550 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:36.384688 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48703.3us
I20260709 13:12:36.376312 27452 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:36.389228 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.394505 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.395910 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.393419 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.398236 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.385485 27246 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:36.398604 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.399001 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.400063 27246 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.400475 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.401052 21466 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:36.394618 27020 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:36.401685 27020 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:36.396649 27165 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:36.401996 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.402269 27165 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:36.402678 27165 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.402621 27020 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.404505 27432 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.387111 27540 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:36.405969 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.406774 27432 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.407723 27544 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:36.408213 27253 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:36.408697 27487 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:12:36.409092 27487 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:36.409991 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2748) took 3138 ms. Trace:
I20260709 13:12:36.409938 27487 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.410669 27408 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:36.408207 27544 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:36.399130 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.410445 21463 rpcz_store.cc:276] 0709 13:12:33.272050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.272210 (+   160us) service_pool.cc:224] Handling call
0709 13:12:33.357117 (+ 84907us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:33.406571 (+ 49454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.406603 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:33.411962 (+  5359us) log.cc:844] Serialized 52 byte log entry
0709 13:12:33.793072 (+381110us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b48001e0258. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:12:34.716307 (+923235us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:35.216826 (+500519us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.225692 (+  8866us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.225878 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.225970 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.361686 (+1135716us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:36.409752 (+ 48066us) raft_consensus.cc:1685] finished
0709 13:12:36.409776 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.409933 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20559,"prepare.queue_time_us":256165,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":146,"raft.queue_time_us":711009,"raft.run_cpu_time_us":3064,"raft.run_wall_time_us":408191,"spinlock_wait_cycles":56499840,"thread_start_us":1689322,"threads_started":2,"wal-append.queue_time_us":1459425}
I20260709 13:12:36.413379 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.413941 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.414459 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.414992 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.414103 27495 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.391623 27470 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:36.416335 27470 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:36.417168 27470 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:36.403142 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.418375 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.418855 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.419727 21360 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.394490 27516 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:12:36.424834 27460 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:36.425186 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.426669 27533 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.427245 27434 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:36.427831 21394 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:36.395720 27384 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:12:36.428885 27384 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:36.429281 27533 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:36.430974 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.431403 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.433694 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3201) took 2092 ms. Trace:
I20260709 13:12:36.434124 21320 rpcz_store.cc:276] 0709 13:12:34.341110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.023951 (+682841us) service_pool.cc:224] Handling call
0709 13:12:35.053748 (+ 29797us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:35.733258 (+679510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.433420 (+700162us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54000fd054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:36.433631 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285732608}
I20260709 13:12:36.436257 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.436923 21396 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:36.424952 26929 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.403980 27020 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:36.434175 27540 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.441877 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.442554 27544 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.443038 27513 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:36.443699 22038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 910) took 2414 ms (client timeout 1733 ms). Trace:
I20260709 13:12:36.441838 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:36.447428 22038 rpcz_store.cc:269] 0709 13:12:34.029665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.724188 (+694523us) service_pool.cc:224] Handling call
0709 13:12:36.443500 (+1719312us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400648554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:36.443631 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675990400}
I20260709 13:12:36.373555 27494 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.447876 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.429211 27384 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:36.448628 27408 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:36.450687 27550 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:36.455070 27428 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:36.456208 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.457461 26998 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:36.449029 27460 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:12:36.390139 27522 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:12:36.474766 21470 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:36.447197 27434 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:36.452472 27487 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:36.461100 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.477484 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:36.461532 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.450950 27422 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:36.478251 21466 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:36.459663 27241 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:36.462431 27554 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:12:36.462602 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.481812 27550 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:36.483649 27422 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:36.483848 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.484637 21396 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:36.484766 27168 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.485419 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.446710 27432 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:36.466641 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2206) took 1047 ms. Trace:
I20260709 13:12:36.467702 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:36.468789 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.487180 22039 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.486972 21392 rpcz_store.cc:276] 0709 13:12:35.419275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.191492 (+772217us) service_pool.cc:224] Handling call
0709 13:12:36.191751 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:36.346651 (+154900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.466424 (+119773us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540017e3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:36.466588 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344085376}
I20260709 13:12:36.470427 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.482709 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.471447 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:36.489440 21461 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:36.489691 27168 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.489827 27135 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:36.490296 27135 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:36.463725 27408 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.471621 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.472951 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.493168 27246 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.493762 22002 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.480165 27470 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.494654 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:36.495684 27519 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.496389 27519 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:36.496505 27470 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.496762 27519 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.497273 27519 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:36.499337 27422 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.500380 27497 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:36.480741 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.480010 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.480841 27241 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.505421 21360 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:36.490671 27135 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:36.506742 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.508211 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.508543 22039 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:36.460279 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:36.513808 21462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 989) took 1740 ms (client timeout 2236 ms). Trace:
I20260709 13:12:36.516526 27516 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.463002 27543 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:12:36.517359 21465 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:36.500878 27497 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:36.518275 21462 rpcz_store.cc:269] 0709 13:12:34.773833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.790050 (+ 16217us) service_pool.cc:224] Handling call
0709 13:12:36.513575 (+1723525us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003f07d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:36.513733 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3013965056}
I20260709 13:12:36.524540 21468 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:36.519469 21392 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:36.513001 26998 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:36.525816 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.526218 27468 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:36.526575 21389 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:36.526863 27468 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.527675 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.528074 27497 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:36.528873 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.529448 21394 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:36.521175 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.536124 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.537218 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:36.553812 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48447.9us
I20260709 13:12:36.555846 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.517123 27241 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.512614 27432 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:36.557934 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.570909 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.572096 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.520808 27550 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:36.573776 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.576387 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.578670 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.549101 27468 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.559917 27470 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.583336 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.553017 27424 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:36.552709 26998 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:36.517166 27168 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:12:36.575654 27410 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:36.581079 27062 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:36.588160 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.561458 27253 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:36.569921 27432 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:36.530992 27516 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.608773 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.554898 27350 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:12:36.579206 27413 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:36.586182 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.600196 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:36.624495 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.593142 27543 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:36.618283 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.619124 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.575285 27488 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:36.619802 21465 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:36.519012 27384 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.584865 27554 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:12:36.621039 27424 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.613154 27468 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:36.630160 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:36.626304 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 166075us
I20260709 13:12:36.619040 27253 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.620560 27410 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:36.575768 27447 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.637284 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.649957 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.629240 27543 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.656903 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:36.652437 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.653653 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.628755 27413 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:36.631716 27412 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:36.658795 27543 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:36.672411 27135 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.675046 27135 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.654925 27453 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.656615 27494 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:36.680464 27410 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.684772 21467 raft_consensus.cc:606] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:36.685266 21467 raft_consensus.cc:614] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:36.687489 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57898 (request call id 33) took 1139 ms. Trace:
I20260709 13:12:36.687852 21467 rpcz_store.cc:276] 0709 13:12:35.558865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.566802 (+  7937us) service_pool.cc:224] Handling call
0709 13:12:36.687267 (+1120465us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002490d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf212853 00007fc2c41e060a 00007fc2bd7667d4 00007fc2bd766762 00007fc2bd766691 00007fc2bd76660c 00007fc2bd7658c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:36.687385 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302280448}
I20260709 13:12:36.689421 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.692444 27423 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.660426 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.694234 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.695415 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.695891 22036 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:36.698007 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.698611 27412 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:36.699052 27412 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.699437 27412 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:36.657625 21394 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:36.700237 27488 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:36.700961 27488 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:12:36.701301 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 479689us
I20260709 13:12:36.702026 27488 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:36.702117 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.702459 27488 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:36.702858 27488 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:36.703912 27135 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:36.707659 27498 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:36.663594 27489 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:36.648810 27062 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:36.728523 27062 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.731137 27062 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.664310 27538 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:12:36.658557 27160 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:36.732280 27538 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.732750 27538 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:36.732540 27160 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.733544 27165 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.734879 27160 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.668285 27424 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:12:36.668565 27561 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:36.736277 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.738334 27371 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:36.735853 27165 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.741104 27519 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.742671 22039 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:36.743132 27412 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.745661 27412 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.713536 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:36.711906 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.711287 27168 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:36.638324 27253 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:36.709182 27413 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.701332 21394 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:36.709192 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.703299 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:36.716269 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53391.8us
I20260709 13:12:36.759546 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.636970 27468 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.718344 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.760751 21314 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:12:36.720264 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.763979 22036 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:36.767105 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.768071 22031 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:36.769544 21396 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:36.771865 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:36.774313 21469 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:36.778115 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.725378 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.748165 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.655000 27540 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.587829 27434 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.784920 27516 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.788484 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.789400 21321 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:36.793316 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.793206 27497 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.794076 21389 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:36.757175 27470 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:36.796252 27519 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.796824 27135 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:36.797266 27135 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.797628 27135 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:36.797561 27364 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:12:36.799163 27558 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
I20260709 13:12:36.632889 27547 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:12:36.771028 27160 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:36.799844 21314 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:36.800480 27364 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:36.800958 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:36.801558 27364 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:36.801961 27364 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:36.802979 27364 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:36.803825 27564 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:12:36.648967 26998 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.654837 27358 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.797843 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:36.781618 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.721508 27498 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:36.816326 27498 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.817829 27498 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.750152 27168 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:36.806113 21467 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:36.806680 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:36.820640 21314 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:36.807150 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:36.821266 22036 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:36.808761 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.815050 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.823047 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:36.819763 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 94534.5us
I20260709 13:12:36.824790 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.765332 27452 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:36.759034 27371 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:36.832942 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:36.763896 27468 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:36.840366 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:36.850102 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.871347 21394 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:36.842470 27241 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.872768 21317 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:36.852836 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:36.831770 27358 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:36.850715 27447 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:36.851413 27510 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:36.874374 27510 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.874953 27160 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:36.874979 27406 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:36.875732 27160 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.876034 27406 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.877177 27510 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:36.872771 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.878432 27406 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.878494 27160 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.843434 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.878983 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:36.880157 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:36.880492 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:36.884316 21469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:36.887418 21469 raft_consensus.cc:606] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.887770 21469 raft_consensus.cc:614] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:36.888182 21464 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:36.883970 26929 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:12:36.892673 21394 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:36.895365 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:36.896909 21320 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:36.883291 21318 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:36.900116 21389 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:36.837230 27493 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:12:36.881125 27447 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.903817 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:36.836966 27371 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.895665 27358 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:36.870836 27519 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:36.921550 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:36.904592 27452 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:36.836917 27489 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:12:36.978833 27412 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.978477 27519 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.019377 27519 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.021867 27364 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.990428 21469 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:36.991380 27135 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:36.909652 27287 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.116s
I20260709 13:12:37.026219 27135 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:37.027504 21469 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:12:37.027889 27134 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:37.028323 27134 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:37.029207 27134 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.030462 27134 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:37.030910 27135 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:36.919152 27371 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:36.917294 27517 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:36.906383 27497 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:37.008945 27241 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:36.909838 27358 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:37.012923 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.007225 27488 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.015445 27373 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:36.979549 27470 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:37.018334 27412 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:36.994058 27432 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.045583 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.031612 27135 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.026641 27287 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:37.040659 27517 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:37.040088 27565 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
I20260709 13:12:37.055877 21318 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:37.060593 27568 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:12:37.054939 27287 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:37.062125 27287 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.047021 27373 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.064594 27373 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.065816 27373 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:37.050536 27470 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:37.067858 27488 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:37.069151 21321 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:37.071264 27517 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.072046 21393 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:37.073989 27567 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:37.044142 27358 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:37.068004 27470 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.087783 21316 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:12:37.063091 27412 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.095624 21392 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
W20260709 13:12:37.091095 22002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.021s	sys 0.025s
W20260709 13:12:37.096261 22002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.021s	sys 0.025s
I20260709 13:12:37.080184 27287 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:37.096705 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 563929us
I20260709 13:12:37.126761 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:37.127492 21318 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:37.054533 27253 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.133944 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:37.135175 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:37.135885 22032 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
W20260709 13:12:37.137418 21387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2204) took 1730 ms (client timeout 1733 ms). Trace:
I20260709 13:12:37.141175 21388 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:37.130409 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:37.138000 21387 rpcz_store.cc:269] 0709 13:12:35.407514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.658590 (+251076us) service_pool.cc:224] Handling call
0709 13:12:37.137166 (+1478576us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54003426d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:37.137326 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681056128}
I20260709 13:12:37.144577 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.146497 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:37.154956 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.132074 27422 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.165329 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.096354 27468 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.158818 21312 raft_consensus.cc:2393] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:37.090001 27543 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.157653 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.166568 21315 raft_consensus.cc:2393] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:37.159624 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.171576 21318 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:37.183373 27134 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:12:37.183756 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.186856 27517 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.166950 27422 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.189263 27468 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:37.191262 27527 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:37.173082 27538 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.192106 22042 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:37.196833 27135 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.204528 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.215346 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:37.223416 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 370499us
I20260709 13:12:37.202286 27134 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:37.209244 27527 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.205192 27510 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:12:37.260982 27134 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.232378 27361 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:12:37.271185 27135 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:37.297989 21314 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:37.279412 27253 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:37.274488 27519 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.319658 27432 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.320360 27361 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:37.320785 27361 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.321635 27361 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.289649 27371 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.309363 27517 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:37.316700 27573 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:12:37.324563 27361 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.297545 27527 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:37.330586 27575 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:12:37.343948 27578 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:12:37.340853 21318 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:37.350194 27422 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:37.370580 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 211050us
I20260709 13:12:37.358538 27527 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:37.357807 27538 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:37.378859 22002 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.383625 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:37.376288 27579 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:12:37.383630 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 158665us
I20260709 13:12:37.391932 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.392046 27468 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:37.393748 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:37.400665 27432 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:37.371380 27497 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:37.403882 21313 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
W20260709 13:12:37.405992 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.406142 21436 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.404557 21284 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:37.421962 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:37.425160 21466 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:37.425777 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.427022 22036 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:37.428298 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.428227 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:37.429494 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.432248 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:37.432875 22032 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:37.432966 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.380919 27571 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:12:37.444375 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:37.437714 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.444655 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.376978 27358 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:37.434202 27574 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:12:37.420905 27287 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:37.430289 27537 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.452379 27537 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.454857 27537 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:37.455891 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.456284 27593 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.456983 27384 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.456857 27593 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.457788 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.462366 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:37.469095 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.455922 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2220) took 1644 ms. Trace:
I20260709 13:12:37.469719 21464 rpcz_store.cc:276] 0709 13:12:35.811133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.275127 (+463994us) service_pool.cc:224] Handling call
0709 13:12:37.455721 (+1180594us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b5400259c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:37.455858 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919033728}
I20260709 13:12:37.470330 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:37.425040 27410 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:37.471908 21464 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:37.486209 27373 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:37.486907 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.487061 27373 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:37.489328 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2769) took 1542 ms. Trace:
I20260709 13:12:37.489570 27519 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:37.489799 21470 rpcz_store.cc:276] 0709 13:12:35.946704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.247458 (+300754us) service_pool.cc:224] Handling call
0709 13:12:37.489093 (+1241635us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540029b8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:37.489259 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365399424}
I20260709 13:12:37.490262 27519 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.490800 27519 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:37.491458 27584 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.132s	user 0.000s	sys 0.003s
I20260709 13:12:37.419894 27538 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:12:37.492342 21468 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:37.492769 27381 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:37.493135 27381 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:37.493979 27381 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.494673 27358 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:37.426940 27576 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:12:37.450269 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:37.497149 27373 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:37.497470 27410 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:37.498871 27410 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.459260 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.502401 21467 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:37.413826 27038 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:12:37.448282 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:37.496716 22032 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:37.471776 27575 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:12:37.510774 27373 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.511116 27586 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:37.495575 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:37.515859 27586 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.516263 22042 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:37.516963 27253 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:37.518010 27586 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.519591 27586 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:37.448668 27510 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.521394 27510 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.522485 21466 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:12:37.523624 27510 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.515465 27135 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:37.516830 27373 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.535722 27371 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:37.538322 27364 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.001s
W20260709 13:12:37.541261 27591 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:12:37.543372 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:37.583436 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.481561 27585 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:37.548441 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:37.548667 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:37.586814 21463 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:37.474761 27416 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.545758 27410 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.551673 27470 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.552724 27168 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.559587 22032 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
W20260709 13:12:37.559446 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 97191.7us
W20260709 13:12:37.561116 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 112043us
I20260709 13:12:37.600600 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:37.600721 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:37.566821 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 137407us
I20260709 13:12:37.441104 27583 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:37.459120 27593 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:37.585373 27373 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:37.483359 27284 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:37.569233 27406 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:12:37.594115 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.596676 21470 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:37.585958 27538 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:37.598646 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.617707 21462 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:37.616752 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:37.605755 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:37.602250 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.619539 21468 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:37.608542 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.604864 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:37.621037 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:37.623349 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.623528 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:37.624176 21467 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:37.624267 22039 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:37.616185 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.627393 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:37.610824 27595 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:37.615449 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:37.611024 27585 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:12:37.628491 27160 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:37.629128 27432 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:37.629392 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.629535 27432 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.602391 27287 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:37.586045 27428 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:37.598935 27358 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:12:37.643517 21462 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 24.
I20260709 13:12:37.611202 27253 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:37.630034 27589 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:37.656386 27589 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.656813 27589 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.638725 27135 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:37.663977 27135 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.665009 27135 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.666131 27470 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.666954 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:37.667578 21464 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:37.636323 27432 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.668910 21464 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:12:37.670123 21466 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:37.671113 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.612874 27168 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:37.672705 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.628661 27595 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:37.644171 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.644326 27284 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:37.630056 21315 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.675405 21467 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:37.645179 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:37.645576 27410 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.645777 27358 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:37.680071 27589 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.680542 27358 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:37.681406 27358 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.682189 27589 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:37.682838 27358 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.646733 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:37.684432 27519 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:37.685333 27284 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.686442 27284 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.613205 27134 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.648226 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:37.689148 22040 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:12:37.689682 27134 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:37.649605 27413 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:37.672019 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.691290 21319 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:37.641810 27510 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:37.692437 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:37.615007 27371 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:12:37.694104 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.677398 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.678252 21313 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:37.631098 27416 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:37.679313 27364 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:37.701360 21318 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 24. Ops: []
I20260709 13:12:37.679463 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.684547 27589 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:37.705488 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.675894 22039 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:37.692487 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:37.710636 21394 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:37.711421 21392 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:37.697002 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:37.700750 21395 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:37.703570 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:37.713421 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:37.713920 21390 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.704950 27589 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:37.715139 27589 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:37.702389 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.717691 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:37.718462 21466 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.719638 21321 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:37.711524 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:37.613746 27583 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:37.721207 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.687979 27284 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.692921 27595 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:37.701614 27510 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:37.731048 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.731678 21319 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:37.733471 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:37.707608 27593 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:37.742753 27593 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.720368 27567 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:37.744575 27567 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:37.744958 27567 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:37.745527 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:37.746394 21392 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.754657 27510 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.755137 27510 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.757784 27384 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:37.758627 27577 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.491s	user 0.001s	sys 0.001s
I20260709 13:12:37.720332 27371 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:12:37.711084 27586 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.778160 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:37.779117 21464 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:37.780463 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:37.772130 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.783531 21315 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:37.790305 21321 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:37.803193 21390 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:37.726713 27364 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:37.789233 21469 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
W20260709 13:12:37.814976 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 170546us
I20260709 13:12:37.835378 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.828794 21466 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:37.838176 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:37.838595 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.839421 21321 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:37.839207 21362 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.717s (SENT)
I20260709 13:12:37.840293 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.845641 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.846407 21321 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:37.847520 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:37.848651 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.850183 27571 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:37.850237 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.851167 21315 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:12:37.852178 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.852833 21315 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:37.853979 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:37.855201 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.856066 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:37.856894 27364 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.857617 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.857869 27364 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.858611 21315 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:37.860389 27597 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:37.860800 27597 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.861135 27597 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:37.861387 27583 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.861316 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:37.862895 27371 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:37.863282 27371 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.863631 27371 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:37.863668 27412 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:37.865185 27412 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:37.868856 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:37.869691 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:37.800458 27598 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:37.880335 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:37.875367 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47682 (request call id 4) took 1224 ms. Trace:
I20260709 13:12:37.877172 27571 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:37.890493 27571 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.883411 21389 rpcz_store.cc:276] 0709 13:12:36.651247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.901091 (+249844us) service_pool.cc:224] Handling call
0709 13:12:37.874986 (+973895us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54000f19d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21e735 00007fc2bf2169fa 00007fc2c41de4c9 00007fc2bd75ac54 00007fc2bd75abe2 00007fc2bd75ab11 00007fc2bd75aa8c 00007fc2bd759d42 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:37.875266 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319600896}
I20260709 13:12:37.894062 27583 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:37.875339 27597 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:37.879494 21321 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 13:12:37.904805 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59845.8us
I20260709 13:12:37.905885 21321 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:37.909395 21321 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:12:37.910288 21321 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:37.881906 27598 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.911810 21321 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: [16.8-16.8]
W20260709 13:12:37.911583 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 279277us
I20260709 13:12:37.912707 21462 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:37.913681 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:37.907496 21315 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:37.923049 27487 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:37.920936 27570 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.714s	user 0.003s	sys 0.000s
I20260709 13:12:37.920878 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:37.926204 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1542) took 1460 ms. Trace:
I20260709 13:12:37.874053 27595 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.926651 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:37.926589 22038 rpcz_store.cc:276] 0709 13:12:36.466309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.475571 (+  9262us) service_pool.cc:224] Handling call
0709 13:12:36.486406 (+ 10835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:36.486737 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.486768 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:36.487205 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:12:37.038026 (+550821us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:37.038090 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.038187 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.920266 (+882079us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:37.925920 (+  5654us) raft_consensus.cc:1685] finished
0709 13:12:37.925941 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.926145 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":3122944,"thread_start_us":480835,"threads_started":1,"wal-append.queue_time_us":635065}
I20260709 13:12:37.928584 27595 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:37.929207 27595 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:37.930038 27595 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:37.930073 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:37.921404 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.938714 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3205) took 1804 ms. Trace:
I20260709 13:12:37.939185 21317 rpcz_store.cc:276] 0709 13:12:36.134131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.467573 (+333442us) service_pool.cc:224] Handling call
0709 13:12:36.467849 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.873313 (+405464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.938428 (+1065115us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b540015c2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:37.938640 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930853120}
I20260709 13:12:37.930482 27595 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:37.940451 22038 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:37.977922 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.066066 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 152459us
I20260709 13:12:38.067538 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:37.911774 27160 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:38.070063 27160 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:37.973042 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:38.131929 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:38.132719 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.137312 21319 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:38.146107 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:37.912957 27598 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:38.155746 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:38.152731 27428 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:38.073238 27487 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:38.122915 27522 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:38.213697 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 58033.9us
W20260709 13:12:38.214350 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 241418us
I20260709 13:12:37.912351 27510 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.156787 27410 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:38.118562 27513 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.094s
W20260709 13:12:38.249038 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 321246us
I20260709 13:12:38.211903 27590 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.213275 27583 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:38.221871 27135 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:38.223091 27428 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:38.219434 27452 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:38.222087 27373 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:12:38.290970 21392 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260709 13:12:38.291710 21392 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:37.942137 27595 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.240007 27604 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:12:38.262115 27432 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.001s
I20260709 13:12:38.306697 27432 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:38.260203 27589 consensus_meta.cc:287] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 13:12:38.309744 27589 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.311856 27373 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:38.312626 27432 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.293777 27597 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:38.278349 27590 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.313251 27373 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:38.294991 27567 consensus_meta.cc:287] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.002s
I20260709 13:12:38.315927 27567 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.300607 27604 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.317726 27604 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:38.319196 27586 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
W20260709 13:12:38.319394 27284 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.001s
I20260709 13:12:38.319670 27586 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:38.301121 27527 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:38.302635 22038 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:38.336621 27527 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:38.303045 27612 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:12:38.337567 27527 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.338466 27612 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:38.338810 27527 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.304093 27428 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.304738 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:38.345314 22041 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.305773 22039 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:12:38.305907 27358 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
I20260709 13:12:38.302670 27510 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.281512 27452 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:38.236379 27522 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.325299 27410 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.326279 27589 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.280826 27583 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.328626 27543 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.374466 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 936) took 1656 ms. Trace:
I20260709 13:12:38.375033 21320 rpcz_store.cc:276] 0709 13:12:36.717545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.717666 (+   121us) service_pool.cc:224] Handling call
0709 13:12:38.374277 (+1656611us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540032afd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:38.374410 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310508416}
I20260709 13:12:38.375667 21312 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:38.349803 27612 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:38.378675 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 128432us
W20260709 13:12:38.361057 27168 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.006s
I20260709 13:12:38.362049 27613 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.363404 27452 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.363914 27604 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.364699 22041 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:38.366039 27522 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.367144 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:38.419714 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:38.367745 27614 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:38.359688 27358 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:38.354162 27432 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.331712 27487 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:38.374981 27410 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.376693 27595 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.401706 27612 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.367146 27615 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.356771 27586 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:12:38.424069 21466 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:38.415308 21467 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:12:38.425120 21467 pending_rounds.cc:85] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 14
I20260709 13:12:38.425355 21467 pending_rounds.cc:107] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:12:38.419643 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40320a19af04e62afc637834ab759b2"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:12:38.421052 21462 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:38.425575 21467 raft_consensus.cc:2889] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:38.425813 21395 raft_consensus.cc:606] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:38.421027 22039 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:38.426367 21395 raft_consensus.cc:614] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:38.428108 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:38.357964 27371 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.427693 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:38.436681 21315 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:38.438701 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.439649 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:38.440550 21320 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:38.377872 27510 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 13:12:38.423055 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 271965us
W20260709 13:12:38.442718 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 375279us
I20260709 13:12:38.422286 27452 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.449738 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:38.424453 27168 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:38.451865 21464 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:12:38.461570 21315 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:38.444123 27537 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:38.447432 27487 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.487301 21320 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:38.436538 27358 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.436980 27432 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:38.499691 27606 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:12:38.458699 27135 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:38.440416 27615 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.461108 27413 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.510318 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:38.489416 27537 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.490164 27168 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:38.518309 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 290928us
I20260709 13:12:38.493862 27364 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.519888 27537 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:38.549057 27364 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.556684 27604 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.557327 27604 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.557801 27604 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.558424 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:38.559113 21464 raft_consensus.cc:2368] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:38.558857 27364 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:38.559741 27604 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.495198 27487 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.560140 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:38.567318 21464 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:38.547339 27586 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.561636 27598 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.582208 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:38.562248 27612 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.562662 27618 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:38.563683 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.573577 27432 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.574942 27358 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.521618 27413 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.554275 27516 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.582962 21464 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:38.585911 27623 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:38.590864 21436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.717s (SENT) [suppressed 24 similar messages]
I20260709 13:12:38.592906 27253 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:38.541471 27621 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:38.601850 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.563701 27371 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:38.556684 27615 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.609266 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:38.615578 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.618252 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.618956 21464 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 24: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:38.619160 21317 raft_consensus.cc:2393] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:38.620862 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:38.621474 21316 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:38.623442 21464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
W20260709 13:12:38.624310 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 174657us
I20260709 13:12:38.624312 21464 raft_consensus.cc:606] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:38.625448 21464 raft_consensus.cc:614] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:38.629338 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.630066 21320 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
W20260709 13:12:38.629583 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.602437 27432 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.606657 27358 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.583781 27586 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.624073 27452 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:38.647640 21204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d41c71e861344f0b90e8d44a8d0a3173 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:38.619000 27616 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:38.644737 21315 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:12:38.654336 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:38.654937 21315 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.619665 27583 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:38.598863 27618 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.626345 27410 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.644905 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:38.615000 27612 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.665493 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:38.645810 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 135649us
I20260709 13:12:38.660321 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.667230 21319 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:38.668056 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.668886 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.669636 21315 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:12:38.670152 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.671116 21317 raft_consensus.cc:2368] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:38.609010 27516 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.672067 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.677887 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.678181 21317 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 24: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:38.678476 21396 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:38.672655 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.673518 21464 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:12:38.673683 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.674650 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.675614 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.676678 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.681663 21394 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:38.680773 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.682570 21389 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:38.681586 21316 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:12:38.685503 21390 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:12:38.686836 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.684303 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.690551 21393 raft_consensus.cc:2368] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20.
I20260709 13:12:38.691731 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.690623 21395 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:38.693737 21392 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 20: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:38.691269 21389 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:38.689769 21390 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:38.696707 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:38.697378 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:38.615327 27168 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.698076 21320 raft_consensus.cc:2368] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:38.692621 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.699795 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:38.701684 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.704463 21388 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.615152 27621 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:38.706594 27625 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:12:38.645277 27358 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.671430 27623 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:38.708608 27547 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:38.750972 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.709561 27598 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.708585 21396 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 24.
I20260709 13:12:38.699301 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:38.715615 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.704490 21387 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:38.726605 27487 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.727715 27413 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.729462 27618 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.704187 27410 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.661990 27452 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.641112 27432 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.735014 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:38.682526 27616 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:38.737393 27637 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.632431 27135 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.678582 27612 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.690057 27633 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.741783 27621 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.703277 27629 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.783056 27629 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.741815 27516 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.744942 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:38.784384 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.785187 27612 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.785328 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:38.786207 21466 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:38.787134 21466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:38.745174 27586 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:38.745518 27358 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.746032 27630 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:38.789441 27637 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.791177 27630 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.793270 27615 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:38.793638 27630 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.793838 27629 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.747521 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:38.794874 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:38.795032 27422 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:38.748482 21389 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:38.796171 27598 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.796721 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.796690 27598 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.798936 27598 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:38.799422 27160 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:38.793658 27615 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:38.800958 27615 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.802371 27615 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:38.795516 21390 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:38.804971 27627 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 13:12:38.805495 27593 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.806778 27593 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:38.795832 27422 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.809556 27422 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.809859 27432 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.810356 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:38.811048 27616 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.811884 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:38.813360 21462 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:38.752312 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 161412us
I20260709 13:12:38.768476 21393 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:38.766299 21388 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:38.774036 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.820297 21315 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:12:38.776988 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:38.780579 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.775136 27635 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.781636 27633 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.751029 27547 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:38.788885 21395 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:38.746779 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:38.837431 21392 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:38.837931 21360 leader_election.cc:400] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:38.838399 21360 leader_election.cc:403] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:12:38.841043 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:38.786230 27452 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.824718 21319 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:38.826975 21317 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:38.828467 22041 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:12:38.787803 21466 raft_consensus.cc:606] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:38.833890 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:38.848901 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.853993 21316 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:38.842026 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:38.851089 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:38.821399 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.855131 22038 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
W20260709 13:12:38.835450 27634 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:38.751696 27623 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.825362 27590 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:38.776762 27618 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:12:38.840199 27638 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:38.872838 27623 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.873124 27638 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.847193 27629 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:12:38.875321 27637 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.876421 27487 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:38.877017 27487 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.877511 27487 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:38.775566 27410 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.882540 27410 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.836004 27635 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.884639 27633 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.846544 27615 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:12:38.885984 27635 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:38.886610 27615 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:38.840189 27612 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:12:38.887108 27615 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:38.888398 27615 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.890527 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.891516 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3125) took 1224 ms. Trace:
I20260709 13:12:38.892052 21312 rpcz_store.cc:276] 0709 13:12:37.666991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.692498 (+ 25507us) service_pool.cc:224] Handling call
0709 13:12:38.375200 (+682702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.376285 (+  1085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.891247 (+514962us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540032afd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:38.891442 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517478272}
I20260709 13:12:38.909622 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.910826 21393 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:38.911561 21316 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
W20260709 13:12:38.913582 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.914438 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:38.917883 21394 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:38.859751 21320 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 6.
I20260709 13:12:38.861452 27613 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.862172 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.868508 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:12:38.918437 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.856858 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:38.924515 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 67877.4us
I20260709 13:12:38.925246 21396 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:12:38.931608 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:38.848383 27413 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:38.936234 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.935882 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3241) took 1225 ms. Trace:
I20260709 13:12:38.937656 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.938485 21317 raft_consensus.cc:2368] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:38.938351 21321 rpcz_store.cc:276] 0709 13:12:37.710211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.921600 (+211389us) service_pool.cc:224] Handling call
0709 13:12:38.072725 (+151125us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:38.460759 (+388034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.460793 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:38.461382 (+   589us) log.cc:844] Serialized 52 byte log entry
0709 13:12:38.648104 (+186722us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:38.752363 (+104259us) log.cc:844] Serialized 14 byte log entry
0709 13:12:38.935544 (+183181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.935630 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:38.935675 (+    45us) raft_consensus.cc:1685] finished
0709 13:12:38.935687 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:38.935825 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104761,"prepare.queue_time_us":152168,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":288739,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":18789,"thread_start_us":669343,"threads_started":4,"wal-append.queue_time_us":234107}
I20260709 13:12:38.949362 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:38.946110 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:38.953830 27371 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:38.953975 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:38.954311 27371 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.954677 27371 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.954888 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:38.955689 27516 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:38.955925 27620 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:38.956308 27516 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:38.956424 27620 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.956825 27620 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:38.957377 27516 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.958878 27586 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.960191 27586 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:38.966848 27620 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:38.969933 27586 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:38.976466 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.977146 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:38.978000 21466 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:38.991364 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:38.919605 27630 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.847592 27621 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:12:39.006266 21317 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:12:38.951227 27635 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:39.044864 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:38.940464 27613 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:39.054265 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:39.055140 21321 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.949656 27168 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:39.061746 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:38.949329 27629 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 24 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:38.994361 27615 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:39.042428 27628 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:39.041772 27586 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:39.057938 21317 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:39.060128 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.063737 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 364496us
I20260709 13:12:39.074536 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.045677 27583 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:39.076442 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.081514 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.082034 21321 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:39.082388 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:39.051199 27638 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:39.061326 27635 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:39.058275 27613 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:39.099877 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:39.102295 21317 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:39.075656 27253 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:39.067237 27160 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:39.114007 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:39.114202 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.056761 27371 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.100322 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.134562 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:39.035702 27547 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.136669 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.137089 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.077975 27628 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:39.126531 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.137822 21388 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:39.115294 21389 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
W20260709 13:12:39.119280 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.048687 27630 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.142697 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:39.143126 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.117882 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:39.097064 27635 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:39.154758 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:39.155576 21321 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:39.101703 27613 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:39.146610 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 327670us
I20260709 13:12:39.150653 22040 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:12:39.164923 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.167451 21390 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:39.116719 27253 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:39.170425 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.182430 21321 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:39.184311 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.189726 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:39.139055 27513 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.193046 21462 raft_consensus.cc:2410] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:12:39.115775 27168 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:39.201658 27647 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:39.202553 27647 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.203022 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:39.201543 27648 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:39.204468 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.204679 27648 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.206892 27648 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:39.208266 27647 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:39.208698 27620 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:39.205192 21390 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:12:39.095278 27583 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.211167 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.217825 21390 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:39.143050 27628 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:39.211359 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:39.221418 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:39.144230 27601 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:39.117121 27638 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:12:39.220011 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:39.213745 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:39.193029 27537 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.001s
I20260709 13:12:39.186511 27373 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:39.191941 27547 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:39.251091 22032 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:12:39.251549 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 107021us
I20260709 13:12:39.117561 27527 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.097s
I20260709 13:12:39.100980 27586 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.227628 21462 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:39.226411 27648 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:39.249657 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:39.260790 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 118201us
I20260709 13:12:39.261302 22040 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:39.226467 27620 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:39.218711 27616 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:39.141134 27629 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.224722 27516 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:39.256309 27583 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:39.256485 27527 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.257189 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.211874 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:39.313055 21321 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:39.226122 27647 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:39.260295 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.333550 21462 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
W20260709 13:12:39.212718 27652 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:12:39.262199 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 144419us
I20260709 13:12:39.267858 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:39.216575 27513 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.256862 27168 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.335271 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:39.227706 27537 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.381618 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:39.384774 27641 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:12:39.393019 22032 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:39.335422 27527 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:39.387629 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 52402.2us
W20260709 13:12:39.390894 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 201307us
I20260709 13:12:39.395080 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:39.396317 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1015) took 1974 ms (client timeout 2189 ms). Trace:
W20260709 13:12:39.304589 27644 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:12:39.396741 21469 rpcz_store.cc:269] 0709 13:12:37.421812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.430498 (+  8686us) service_pool.cc:224] Handling call
0709 13:12:39.396127 (+1965629us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54003fa7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:39.396257 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791388928}
W20260709 13:12:39.399796 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 132011us
I20260709 13:12:39.335497 27647 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.265026 27648 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:39.404991 27653 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:12:39.403090 27487 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260709 13:12:39.408473 27567 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:39.402573 27522 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:39.400187 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:39.414368 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:39.415200 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:39.438210 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:39.415540 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:39.379173 27620 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:39.335506 27642 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.390605 27241 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:39.439656 21469 raft_consensus.cc:2410] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:12:39.443615 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.412640 27633 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:39.445591 27371 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:39.445873 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.425115 27647 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:39.448832 27620 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.449662 27642 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.300050 27160 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.429008 27648 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:39.336952 27616 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.454236 27633 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.332505 27253 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.465675 27601 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:39.451220 27618 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:39.466867 27593 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.465721 27364 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:12:39.468225 27371 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.470588 21462 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:39.450439 27241 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:39.484542 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 104378us
I20260709 13:12:39.495762 27633 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:39.496690 27253 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:39.497589 27412 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.437616 27487 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:39.514200 27560 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 2.048s	user 0.009s	sys 0.015s
W20260709 13:12:39.540395 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 98718.1us
I20260709 13:12:39.551043 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2809) took 3231 ms. Trace:
I20260709 13:12:39.551507 21391 rpcz_store.cc:276] 0709 13:12:36.319461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.321590 (+  2129us) service_pool.cc:224] Handling call
0709 13:12:36.338713 (+ 17123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:36.368113 (+ 29400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.368152 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:36.368643 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:12:37.466028 (+1097385us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800442ea0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:37.536555 (+ 70527us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b1800442ea0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1
0709 13:12:37.536738 (+   183us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:37.536780 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.536871 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.483886 (+1947015us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:39.550804 (+ 66918us) raft_consensus.cc:1685] finished
0709 13:12:39.550830 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.550975 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":562,"raft.queue_time_us":428,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":26197,"spinlock_wait_cycles":83952640,"thread_start_us":15204,"threads_started":1,"wal-append.queue_time_us":15693}
I20260709 13:12:39.559655 27537 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:39.560784 27513 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:39.561378 27413 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.007s
I20260709 13:12:39.561936 27413 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:39.562681 21392 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:39.564010 27522 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:39.509620 27593 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.574028 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.578325 27616 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:39.579380 27527 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:39.581032 27527 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.581662 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:39.581583 27527 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.584384 27527 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:39.587203 27638 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.587888 27593 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:39.591404 21285 leader_election.cc:400] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20.
I20260709 13:12:39.594447 21285 leader_election.cc:403] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:12:39.597380 21314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3224) took 2765 ms (client timeout 1717 ms). Trace:
W20260709 13:12:39.597867 21314 rpcz_store.cc:269] 0709 13:12:36.832259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.832688 (+   429us) service_pool.cc:224] Handling call
0709 13:12:39.597178 (+2764490us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540015c7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:39.597290 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005712640}
I20260709 13:12:39.600617 27470 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20.
I20260709 13:12:39.587792 27638 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.606940 27135 raft_consensus.cc:993] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:12:39.607244 27638 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:39.610334 27642 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:39.610888 27630 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:39.515211 27371 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.587252 27613 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.612108 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:39.613207 27613 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:39.613586 22002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.985s	user 0.006s	sys 0.027s
I20260709 13:12:39.613806 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:39.614540 27666 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:39.615176 27666 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:39.615473 27666 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:39.615774 27666 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:39.621161 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.621898 21467 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:39.510161 27241 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:39.624366 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.625319 21467 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:39.635356 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:39.639441 21463 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:12:39.542069 27628 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.607443 27487 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:39.644461 27412 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:39.645495 27628 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:39.649624 22002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.022s	user 0.008s	sys 0.027s
W20260709 13:12:39.649973 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.650312 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 2.02288e+06us
I20260709 13:12:39.607524 27135 raft_consensus.cc:1081] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:12:39.654738 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.652011 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:39.652566 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:39.654314 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:39.594551 27586 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:39.658558 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.515466 27618 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:12:39.637434 27638 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.664179 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.666370 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.664887 22042 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:39.670610 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:39.671706 22032 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 8.
W20260709 13:12:39.662770 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 198027us
I20260709 13:12:39.595870 27635 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.676755 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.673702 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:39.679546 22031 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:39.659054 27629 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:39.685026 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.686290 22031 raft_consensus.cc:2410] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:12:39.697118 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:39.697947 22032 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:39.698628 22002 connection.cc:256] RPC call timeout handler was delayed by -1.4767261590000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 13:12:39.700464 22031 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:39.693635 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:39.704420 22031 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:12:39.705662 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.706853 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:39.707726 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:39.708360 22042 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:12:39.708837 22035 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:39.684187 27629 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.684715 27168 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:39.713936 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:39.715216 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.718025 21463 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:12:39.718408 21463 pending_rounds.cc:85] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 12
I20260709 13:12:39.718660 21463 pending_rounds.cc:107] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:12:39.718894 21463 raft_consensus.cc:2889] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:39.720834 27381 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:39.724411 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.725309 22036 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:12:39.726673 27646 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:39.727114 27646 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:39.727463 27646 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:39.733668 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.715615 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:39.734817 21316 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:12:39.672791 27638 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.737730 21321 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:39.741611 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:39.742159 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:39.711840 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 76561.8us
I20260709 13:12:39.738914 22032 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:39.738318 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:39.743659 21317 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
W20260709 13:12:39.703233 27614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.010s	sys 0.012s
I20260709 13:12:39.707916 27497 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:39.751698 27645 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:39.744774 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:39.716099 27629 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:39.714358 27168 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:39.757005 27614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.011s	sys 0.012s
I20260709 13:12:39.697405 27658 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:12:39.768239 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:39.778012 21318 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:39.775410 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.776499 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83326.6us
I20260709 13:12:39.777577 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:39.783192 21312 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:39.757611 27423 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:39.736675 27160 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:39.756783 27620 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.773073 27416 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:39.804352 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:39.805264 21312 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:39.775990 27168 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:39.788642 27614 consensus_queue.cc:1243] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:12:39.777791 27593 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:39.813704 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.813727 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70602.6us
I20260709 13:12:39.819016 21318 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:39.777340 27287 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:12:39.820068 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:39.795861 27645 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:39.811249 27615 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.001s
I20260709 13:12:39.809231 27416 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.791880 27498 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:12:39.777019 27648 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.776182 27647 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.834730 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:39.832480 27416 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:39.847069 27672 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:12:39.847582 27669 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:12:39.849082 27582 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 2.488s	user 0.000s	sys 0.020s
I20260709 13:12:39.850158 27371 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:39.851702 27635 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:39.837024 27660 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.854278 27660 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.855067 27633 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.856874 27660 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:39.856594 27645 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.820900 27513 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:39.857944 27513 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:39.862833 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2797) took 3232 ms. Trace:
W20260709 13:12:39.863451 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 474098us
I20260709 13:12:39.868105 27567 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.863269 21461 rpcz_store.cc:276] 0709 13:12:36.630468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.884982 (+254514us) service_pool.cc:224] Handling call
0709 13:12:36.885288 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:36.885540 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.885577 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:36.891200 (+  5623us) log.cc:844] Serialized 26 byte log entry
0709 13:12:37.261743 (+370543us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:37.261796 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.261889 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.848467 (+2586578us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:39.862511 (+ 14044us) raft_consensus.cc:1685] finished
0709 13:12:39.862534 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.862765 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308972416,"thread_start_us":370134,"threads_started":1,"wal-append.queue_time_us":440051}
I20260709 13:12:39.808316 27620 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:39.882900 22031 raft_consensus.cc:2393] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:39.876919 21312 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:39.884779 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:39.885886 21312 raft_consensus.cc:2368] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19.
I20260709 13:12:39.832665 27493 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.892830 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2809) took 1484 ms. Trace:
I20260709 13:12:39.834913 27537 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.007629 22034 raft_consensus.cc:2368] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12.
I20260709 13:12:40.006314 21468 rpcz_store.cc:276] 0709 13:12:38.408816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.410924 (+  2108us) service_pool.cc:224] Handling call
0709 13:12:38.411257 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.415015 (+  3758us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:38.425037 (+ 10022us) log.cc:844] Serialized 14 byte log entry
0709 13:12:38.425260 (+   223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:38.425310 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:38.425358 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.815951 (+390593us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18003efb60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419
0709 13:12:39.892498 (+1076547us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b540029a4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:39.892574 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.892751 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3194,"prepare.queue_time_us":9787,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":50,"raft.queue_time_us":3476,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5933,"spinlock_wait_cycles":37506688}
I20260709 13:12:39.837842 27423 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:39.998881 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 120913us
W20260709 13:12:40.028540 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 126845us
I20260709 13:12:40.032459 22039 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:39.822404 27593 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.037597 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.038961 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.039852 21318 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 21 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:12:39.871323 27527 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.041059 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.041606 21312 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:39.871596 26998 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:39.872756 27513 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:40.044135 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.890597 27616 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.028107 27630 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.036167 27547 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.783s	user 0.005s	sys 0.006s
I20260709 13:12:39.870814 27567 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.005093 27601 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:12:40.033329 27543 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.064868 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.083323 21318 raft_consensus.cc:2368] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12.
W20260709 13:12:40.077834 21204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d41c71e861344f0b90e8d44a8d0a3173 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:40.080628 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.048362 27668 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.075270 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:40.085036 21312 raft_consensus.cc:2410] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:12:40.052299 27487 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.088521 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:40.038704 27537 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.100076 27487 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.102561 27487 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:40.103709 27620 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.081125 27253 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:12:40.085834 27614 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:12:40.086019 27413 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:12:40.088462 27623 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:12:40.110800 27623 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:40.111171 27623 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:40.050216 27527 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.111943 27623 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.113050 27593 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.113737 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.114022 27527 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.034121 27493 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.114974 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.115633 21312 raft_consensus.cc:2368] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:40.116209 27638 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:40.116600 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:40.093065 27543 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.117494 22039 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:40.118129 22040 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:40.116294 27493 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:40.125684 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 50487.5us
I20260709 13:12:40.120541 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.058554 27618 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:40.214282 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:40.253460 27635 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.165798 27487 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:40.248106 27620 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:40.256137 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.247678 27428 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.174666 22039 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:40.184464 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:40.263902 27516 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:40.173617 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:40.216813 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.185479 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:40.182085 21468 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:40.317062 21463 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:40.165737 27628 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:40.287766 27241 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.647s	user 0.005s	sys 0.005s
I20260709 13:12:40.304893 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.317031 27516 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:12:40.327340 21320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3152) took 1552 ms (client timeout 1660 ms). Trace:
W20260709 13:12:40.327914 21320 rpcz_store.cc:269] 0709 13:12:38.774861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.775044 (+   183us) service_pool.cc:224] Handling call
0709 13:12:40.326988 (+1551944us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b540022d3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:40.327236 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171645312}
I20260709 13:12:40.329520 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.330582 21320 raft_consensus.cc:2393] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:40.210263 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:40.183396 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 103644us
I20260709 13:12:40.285547 27683 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:12:40.334580 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.335423 21320 raft_consensus.cc:2410] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:12:40.053195 26998 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.200481 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.339287 21393 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:40.165015 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.197270 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:40.113379 27623 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:40.072815 27630 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.319798 27628 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.067180 27616 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.168875 27646 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.350028 27646 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.255651 27416 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:40.304795 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 432453us
I20260709 13:12:40.351095 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:40.307978 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:40.351999 27416 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:40.352591 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44753us
I20260709 13:12:40.353585 22002 leader_election.cc:400] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19.
I20260709 13:12:40.354413 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:40.355528 22002 leader_election.cc:400] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12.
I20260709 13:12:40.355768 22002 leader_election.cc:403] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:40.352012 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:40.357342 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:40.358206 27630 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:40.358728 27648 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.359830 27135 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:40.360287 27135 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.360652 27135 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:40.311760 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.314119 21467 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:40.094008 27668 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.367308 27527 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:40.369201 21391 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:40.347476 27673 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:40.328503 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2848) took 1280 ms. Trace:
I20260709 13:12:40.170215 27537 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.310930 27413 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:40.329643 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.117513 27633 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:40.318230 27666 consensus_meta.cc:287] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
I20260709 13:12:40.371136 27648 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 11. Current term is 12.
I20260709 13:12:40.340160 21395 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:40.383927 27168 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.004s
I20260709 13:12:40.401026 27643 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:40.401603 27643 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:40.401026 27168 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.402518 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3255) took 1581 ms. Trace:
I20260709 13:12:40.402460 27643 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.403023 21316 rpcz_store.cc:276] 0709 13:12:38.820947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.948954 (+128007us) service_pool.cc:224] Handling call
0709 13:12:39.040884 (+ 91930us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.735403 (+694519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.402199 (+666796us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400228154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:40.402450 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595262848}
I20260709 13:12:40.403820 27643 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:40.405004 27668 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.407112 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.411489 21395 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:40.323136 27470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.000s	sys 0.020s
I20260709 13:12:40.344075 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.175316 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.313206 27620 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.321699 27638 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:40.345774 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.310110 27635 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.330585 27241 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.421451 27620 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.421980 27638 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:40.422435 27638 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:40.424312 27616 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:40.364485 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:40.365150 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:40.322620 27618 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.316695 27428 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.346952 27628 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:40.452179 27618 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:40.452955 27616 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:40.416886 27470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.000s	sys 0.021s
W20260709 13:12:40.318917 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 145394us
I20260709 13:12:40.362015 27647 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.377511 21394 rpcz_store.cc:276] 0709 13:12:39.048412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.048594 (+   182us) service_pool.cc:224] Handling call
0709 13:12:39.732387 (+683793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.732578 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.732623 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.732664 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:39.732699 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.732773 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.328313 (+595540us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54001c7350. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:40.328435 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571684608}
I20260709 13:12:40.460729 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.382776 21313 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:40.382817 22035 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:40.461318 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:40.368072 27364 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:40.371660 27422 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:40.412252 27168 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:40.371955 27547 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:40.385597 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:40.201740 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:40.390722 21396 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:40.340464 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.397046 26998 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:40.378280 27487 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:12:40.389335 27666 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.382210 27413 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:40.379915 27673 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:40.407879 21314 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:40.342834 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.413285 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.413537 21388 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:40.414094 21319 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:40.343309 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.370630 27630 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:12:40.378119 27527 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:40.418470 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:40.419090 21318 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:12:40.418324 27567 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:40.433473 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.434720 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:40.436107 27241 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:40.438750 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74335us
I20260709 13:12:40.441431 27635 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:40.462471 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:40.462144 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:40.462908 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:40.476985 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:40.477429 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.478231 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.480334 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.450289 27638 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.644111 21396 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:40.645287 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:40.644438 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 182042us
I20260709 13:12:40.645464 21394 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:40.645941 21470 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:40.647553 21390 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:40.647121 21392 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:40.644580 21389 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:40.646023 21314 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:40.650693 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.651484 21319 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:40.651887 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.652693 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.653194 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:40.653298 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:40.646641 21316 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:40.648314 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:40.645447 22041 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:40.653304 21313 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:40.646709 21393 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:12:40.658149 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:40.658674 21362 leader_election.cc:400] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:40.659016 21362 leader_election.cc:403] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:40.662797 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:40.664330 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:40.666496 21463 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:40.667320 27543 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.675022 21319 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:40.679458 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:40.693374 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.699956 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.702616 21390 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:40.467525 27364 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.668061 27621 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.649870 27423 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:40.702692 21396 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.517498 27428 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:40.705094 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:40.518129 27422 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:40.457598 27135 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.701118 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:40.812227 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.817090 21388 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
W20260709 13:12:40.817124 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 116085us
I20260709 13:12:40.657416 27618 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:40.816366 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3271) took 1077 ms. Trace:
I20260709 13:12:40.681102 27567 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:40.552227 27613 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.500315 27547 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.707739 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.829571 21314 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:40.732623 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.797689 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:40.831245 21316 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
W20260709 13:12:40.831424 21284 connection.cc:256] RPC call timeout handler was delayed by -1.614056722999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:12:40.659358 27645 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.798880 27168 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:40.809343 27470 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:40.692472 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:40.842110 21467 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:40.818692 21319 rpcz_store.cc:276] 0709 13:12:39.739158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.732557 (+993399us) service_pool.cc:224] Handling call
0709 13:12:40.815627 (+ 83070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.815895 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.815935 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:40.815996 (+    61us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:40.816073 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.816152 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.816294 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:40.821731 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:40.811383 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 106382us
I20260709 13:12:40.844389 21388 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
W20260709 13:12:40.843477 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 151066us
I20260709 13:12:40.815243 27373 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:40.833632 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:40.807843 26998 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:40.835904 21313 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:40.835968 21318 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:40.583005 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:40.864288 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3275) took 1117 ms. Trace:
I20260709 13:12:40.864769 21318 rpcz_store.cc:276] 0709 13:12:39.746947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.812806 (+1065859us) service_pool.cc:224] Handling call
0709 13:12:40.835729 (+ 22923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.863822 (+ 28093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.864201 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:40.669724 27648 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:40.838840 21284 connection.cc:256] RPC call timeout handler was delayed by -1.3414747870000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 13:12:40.881163 21284 connection.cc:256] RPC call timeout handler was delayed by -1.3289158140000836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 13:12:40.838037 21396 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:40.732674 27364 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:40.731318 27642 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:40.839112 27547 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:40.834818 22035 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:40.847307 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:40.848726 21314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:12:40.848847 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:40.841734 27637 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.849696 27487 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.841645 27428 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.850437 27630 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:40.855400 27616 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:40.857358 27135 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:40.862174 21316 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:40.945534 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 950) took 1174 ms. Trace:
I20260709 13:12:40.945897 21316 rpcz_store.cc:276] 0709 13:12:39.771203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.861457 (+1090254us) service_pool.cc:224] Handling call
0709 13:12:40.861815 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.945262 (+ 83447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.945479 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:40.947360 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3277) took 1158 ms. Trace:
I20260709 13:12:40.844848 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:40.948414 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 103626us
I20260709 13:12:40.949508 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:40.950260 27586 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:40.950613 27586 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.950953 27586 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:40.691489 27635 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:40.822477 27589 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:40.952481 27589 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:40.952641 27595 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:40.953133 27595 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.953467 27595 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:40.953414 27589 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.692102 27633 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:40.668479 27623 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:40.729534 27241 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.875875 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:40.957118 27241 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.957041 27623 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.957919 21388 raft_consensus.cc:2376] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17. Re-sending same reply.
I20260709 13:12:40.958860 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:40.959606 21388 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 21 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:12:40.879678 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:40.959721 27241 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:40.838693 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:40.799170 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 140608us
I20260709 13:12:40.965628 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:40.967389 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:40.928472 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 79703us
I20260709 13:12:40.929970 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:40.969395 22035 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:40.932397 21318 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:40.862250 27373 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:40.887105 27629 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.097s	user 0.005s	sys 0.008s
I20260709 13:12:40.815423 27673 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.704135 27683 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.203s
I20260709 13:12:40.882236 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:40.974823 21362 leader_election.cc:400] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
W20260709 13:12:40.978566 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 96424.2us
I20260709 13:12:40.979568 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:40.817150 27413 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.860915 27470 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:40.961606 27628 consensus_meta.cc:287] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 13:12:41.003152 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:40.971227 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 954) took 1195 ms. Trace:
I20260709 13:12:41.004309 21318 rpcz_store.cc:276] 0709 13:12:39.776060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.931717 (+1155657us) service_pool.cc:224] Handling call
0709 13:12:40.932161 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.970837 (+ 38676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.971109 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:40.847760 27621 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.959980 27623 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:40.907363 27648 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.843526 27423 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.839859 27168 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.922935 21396 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:12:41.019848 21396 pending_rounds.cc:85] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 11
I20260709 13:12:41.020241 21396 pending_rounds.cc:107] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:12:41.020519 21396 raft_consensus.cc:2889] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:41.021219 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2847) took 1984 ms. Trace:
I20260709 13:12:41.021584 21396 rpcz_store.cc:276] 0709 13:12:39.036745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.036967 (+   222us) service_pool.cc:224] Handling call
0709 13:12:39.059639 (+ 22672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.390610 (+1330971us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b5400407a20. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18fdc0 00007fc2bf21a1c0 00007fc2bf21b231 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c
0709 13:12:41.020942 (+630332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.021161 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732524800}
I20260709 13:12:40.974125 21392 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:40.933916 27668 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:40.952483 27635 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.019569 27168 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:41.029031 27604 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:12:41.028826 27635 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.031122 27635 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.032198 21390 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:41.032382 27470 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.032686 27460 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:41.033128 27460 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:41.033480 27460 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:41.033952 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:41.034552 21390 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:41.008898 27633 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:40.945125 27428 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:40.982052 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:40.883818 27619 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:40.933305 27422 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.018162 27673 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:40.947671 21316 rpcz_store.cc:276] 0709 13:12:39.789018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.946606 (+1157588us) service_pool.cc:224] Handling call
0709 13:12:40.946898 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.947062 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.947089 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:40.947128 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:40.947158 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.947207 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.947310 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.031152 27621 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:40.841856 27613 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:40.939254 27637 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.012895 21284 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:40.977468 27629 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.036198 27616 raft_consensus.cc:2764] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:12:40.972368 27373 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:41.024550 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:40.943493 27487 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.014881 27241 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:41.026396 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.129997 21396 raft_consensus.cc:2368] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18.
I20260709 13:12:41.131161 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:41.043068 21390 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:40.845269 27645 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:41.021389 27516 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.000s
I20260709 13:12:41.045176 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2241) took 3618 ms. Trace:
I20260709 13:12:41.009245 27683 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:41.051426 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 69457.2us
I20260709 13:12:40.945245 27630 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:41.146436 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.977669 27135 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:40.840178 27527 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.026963 27623 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:41.061846 27586 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.009605 27628 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.133160 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:41.134644 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.056875 27635 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:12:41.136178 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.138243 21465 rpcz_store.cc:276] 0709 13:12:37.427049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.471952 (+ 44903us) service_pool.cc:224] Handling call
0709 13:12:39.397092 (+1925140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.397284 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.397313 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.397380 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:39.397413 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.397481 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.044912 (+1647431us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54003fa7d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:41.045088 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4224125312}
I20260709 13:12:41.059391 27638 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.143460 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:41.159919 22041 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:41.161114 21390 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:41.162133 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.162760 21390 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 6.
I20260709 13:12:41.163576 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.146044 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:41.146168 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.146775 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:41.126209 27470 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:41.056658 27619 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.149441 27604 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:12:41.148336 27516 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:41.071781 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58984.9us
I20260709 13:12:41.047034 21312 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:41.069531 21313 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:41.045535 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 215147us
I20260709 13:12:41.013150 21318 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:41.142958 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:41.164201 21390 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:41.598654 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2863) took 1381 ms. Trace:
I20260709 13:12:41.599221 21390 rpcz_store.cc:276] 0709 13:12:40.216865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.163356 (+946491us) service_pool.cc:224] Handling call
0709 13:12:41.598364 (+435008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.601289 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.601670 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.573387 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3253) took 2753 ms. Trace:
I20260709 13:12:41.602818 21388 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:41.603749 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:41.563354 21219 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:41.604904 21389 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:12:41.599864 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.606140 21387 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:41.607288 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.605139 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:41.608156 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 955) took 1802 ms. Trace:
W20260709 13:12:41.596629 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.608630 21318 rpcz_store.cc:276] 0709 13:12:39.805989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.012416 (+1206427us) service_pool.cc:224] Handling call
0709 13:12:41.012896 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.607575 (+594679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.607946 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.609577 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.610498 21387 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:41.498610 27666 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.669600 27621 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:41.606278 21390 raft_consensus.cc:2393] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:41.612999 21392 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:41.613226 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 960) took 1494 ms. Trace:
W20260709 13:12:41.613241 21391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2862) took 1396 ms (client timeout 1728 ms). Trace:
I20260709 13:12:41.284475 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.578397 21319 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:41.565922 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3279) took 1738 ms. Trace:
I20260709 13:12:41.615211 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.188138 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.616169 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.227257 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:41.618746 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 471881us
I20260709 13:12:41.629475 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:41.257718 22034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 937) took 1603 ms (client timeout 1812 ms). Trace:
I20260709 13:12:41.291667 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:41.202483 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:41.257097 22040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1474) took 1876 ms (client timeout 1974 ms). Trace:
I20260709 13:12:41.203238 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:41.637387 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 491236us
I20260709 13:12:41.639346 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 953) took 1865 ms. Trace:
I20260709 13:12:41.652544 21467 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:12:41.654732 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:41.155203 27135 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.245051 27298 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:41.656834 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:41.657176 26998 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:41.657872 27160 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.670604 21312 rpcz_store.cc:276] 0709 13:12:40.118287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.046170 (+927883us) service_pool.cc:224] Handling call
0709 13:12:41.046573 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.612447 (+565874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.613014 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.658260 27422 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.300686 27460 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.322005 27487 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.659148 27527 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:41.206383 27571 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:41.659148 27543 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:41.408388 27615 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:41.657888 27371 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:41.350549 27547 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.660840 27601 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:41.719035 27601 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:41.337424 27586 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:41.720323 27615 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:41.721675 21389 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:41.336261 27618 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.663030 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3281) took 1300 ms. Trace:
I20260709 13:12:41.663692 21314 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:12:41.467392 27364 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
I20260709 13:12:41.200333 27428 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.256827 27423 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.731484 21314 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:41.663926 21219 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 17, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 17 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:41.666468 27619 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.495369 27413 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:41.602830 21315 rpcz_store.cc:276] 0709 13:12:38.820394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.820949 (+   555us) service_pool.cc:224] Handling call
0709 13:12:40.330998 (+1510049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.331235 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.331286 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:40.331345 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:40.331392 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.331466 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.555739 (+1224273us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540022d3d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:41.573155 (+ 17416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3472138112}
I20260709 13:12:41.657708 27470 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:41.354156 27643 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.950s	user 0.007s	sys 0.003s
W20260709 13:12:41.683235 22040 rpcz_store.cc:269] 0709 13:12:39.380977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.381336 (+   359us) service_pool.cc:224] Handling call
0709 13:12:41.256919 (+1875583us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400647654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:41.257038 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675176704}
I20260709 13:12:41.684474 21390 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:12:41.387708 27701 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:12:41.684592 27298 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.286986 27704 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.685532 26998 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:41.744172 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:41.685802 22034 rpcz_store.cc:269] 0709 13:12:39.654413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.654529 (+   116us) service_pool.cc:224] Handling call
0709 13:12:41.257539 (+1603010us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54005221d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:41.257666 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542152576}
I20260709 13:12:41.675670 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3280) took 1316 ms. Trace:
I20260709 13:12:41.745054 27298 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.745453 21319 rpcz_store.cc:276] 0709 13:12:40.358954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.575028 (+1216074us) service_pool.cc:224] Handling call
0709 13:12:41.575831 (+   803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.672227 (+ 96396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.675591 (+  3364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.349277 27645 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:41.746081 26998 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.686746 27160 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.746804 21320 raft_consensus.cc:2410] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:12:41.747409 27470 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.748667 27160 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:41.152918 27595 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.271273 27648 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.691666 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:41.153422 27623 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:41.751366 27595 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:41.751052 27623 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.201779 27637 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.441890 27629 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.150650 27630 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:41.670743 21391 rpcz_store.cc:269] 0709 13:12:40.216590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.255845 (+ 39255us) service_pool.cc:224] Handling call
0709 13:12:41.612704 (+1356859us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b540020f3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:41.612984 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132500736}
I20260709 13:12:41.674528 21313 rpcz_store.cc:276] 0709 13:12:39.774272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.871748 (+1097476us) service_pool.cc:224] Handling call
0709 13:12:40.872179 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.614059 (+741880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.638846 (+ 24787us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540021a7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:41.639165 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453428096}
I20260709 13:12:41.761639 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3288) took 1335 ms. Trace:
I20260709 13:12:41.762102 21313 rpcz_store.cc:276] 0709 13:12:40.426156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.760465 (+1334309us) service_pool.cc:224] Handling call
0709 13:12:41.760920 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.761272 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.761297 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:41.761362 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:41.761392 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.761444 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.761564 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.673203 21317 rpcz_store.cc:276] 0709 13:12:39.827680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.014266 (+1186586us) service_pool.cc:224] Handling call
0709 13:12:41.014661 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.020549 (+  5888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.020594 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:41.020653 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:41.020707 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.565091 (+544384us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b54000be5d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:41.565223 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.565666 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12927360}
W20260709 13:12:41.699844 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 70775.6us
I20260709 13:12:41.671741 27621 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:41.703384 22041 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:41.707793 27668 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:41.710829 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2274) took 1231 ms. Trace:
W20260709 13:12:41.512670 27624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.005s	sys 0.007s
I20260709 13:12:41.714823 27422 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.716095 27527 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.454476 27373 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.717528 27547 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:41.719460 21316 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.008s	sys 0.013s
I20260709 13:12:41.267233 27613 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.389415 27168 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.723363 21394 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:41.662339 27612 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:41.728788 21393 raft_consensus.cc:2410] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:12:41.729255 21396 raft_consensus.cc:2410] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:12:41.729229 21395 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 25 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:12:41.723470 27647 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:41.723974 27543 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:41.728317 27710 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.722851 27516 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.728482 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:41.727152 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 115209us
I20260709 13:12:41.711063 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:41.229698 27620 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:41.723280 22039 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:12:41.714890 27371 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:41.723685 27586 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:41.737550 27571 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:41.203812 27693 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260709 13:12:41.719746 27135 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.736840 27364 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.731267 21321 rpcz_store.cc:276] 0709 13:12:40.362917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.577092 (+1214175us) service_pool.cc:224] Handling call
0709 13:12:41.577561 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.661710 (+ 84149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.661749 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:41.661817 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:41.661898 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.662592 (+   694us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54003c87d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:41.662633 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.662816 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192681216}
I20260709 13:12:41.739073 21388 raft_consensus.cc:2410] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
W20260709 13:12:41.742033 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 54511.8us
I20260709 13:12:41.748853 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3166) took 1676 ms. Trace:
I20260709 13:12:41.738386 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:41.250342 27642 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:41.866479 21316 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.011s	sys 0.015s
I20260709 13:12:41.763876 21313 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:41.732583 27618 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:41.787707 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2265) took 1607 ms. Trace:
I20260709 13:12:41.768242 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2867) took 1535 ms. Trace:
I20260709 13:12:41.773454 21391 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 13:12:41.354476 27628 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:41.780761 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 553494us
I20260709 13:12:41.853245 21392 rpcz_store.cc:276] 0709 13:12:40.466349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.125621 (+659272us) service_pool.cc:224] Handling call
0709 13:12:41.694443 (+568822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.865357 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 1259) took 1477 ms. Trace:
I20260709 13:12:41.868645 21390 rpcz_store.cc:276] 0709 13:12:40.218774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.683351 (+1464577us) service_pool.cc:224] Handling call
0709 13:12:41.683890 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.740775 (+ 56885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.754522 (+ 13747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.863041 21320 rpcz_store.cc:276] 0709 13:12:40.072317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.342600 (+270283us) service_pool.cc:224] Handling call
0709 13:12:41.748557 (+1405957us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54004155d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:41.748754 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2527295232}
I20260709 13:12:41.869987 21394 rpcz_store.cc:276] 0709 13:12:40.387573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.615655 (+1228082us) service_pool.cc:224] Handling call
0709 13:12:41.865263 (+249608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.870996 21391 pending_rounds.cc:85] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 9
I20260709 13:12:41.871955 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2260) took 1532 ms. Trace:
I20260709 13:12:41.874181 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3289) took 1425 ms. Trace:
I20260709 13:12:41.880685 21313 rpcz_store.cc:276] 0709 13:12:40.448419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.763203 (+1314784us) service_pool.cc:224] Handling call
0709 13:12:41.763635 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.873795 (+110160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.874098 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.878415 21393 rpcz_store.cc:276] 0709 13:12:40.339229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.284100 (+944871us) service_pool.cc:224] Handling call
0709 13:12:41.871873 (+587773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.857661 27621 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:41.885185 21393 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:41.886749 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:41.887267 27422 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.887549 27648 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:41.779805 27460 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.888175 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2258) took 1549 ms. Trace:
I20260709 13:12:41.888989 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:41.891165 22035 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:41.867702 21461 rpcz_store.cc:276] 0709 13:12:40.180422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.182596 (+  2174us) service_pool.cc:224] Handling call
0709 13:12:40.182958 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:40.183373 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.183399 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:40.183877 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:12:41.631549 (+1447672us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b18003f0be0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:12:41.683638 (+ 52089us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:41.683686 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.686368 (+  2682us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.787113 (+100745us) raft_consensus.cc:1685] finished
0709 13:12:41.787143 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.787487 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1805,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":19713,"spinlock_wait_cycles":131846400,"thread_start_us":35848,"threads_started":1,"wal-append.queue_time_us":1556930}
I20260709 13:12:41.893468 27373 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:41.895351 21320 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:12:41.901634 21396 rpcz_store.cc:276] 0709 13:12:40.338741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.187767 (+849026us) service_pool.cc:224] Handling call
0709 13:12:41.875908 (+688141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.898034 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.896406 21315 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:12:41.869812 27623 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:41.895936 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 752907us
I20260709 13:12:41.908639 21312 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:41.896579 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 187684us
I20260709 13:12:41.904937 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2263) took 1554 ms. Trace:
I20260709 13:12:41.887811 21318 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:41.909726 21393 rpcz_store.cc:276] 0709 13:12:40.346890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.884513 (+1537623us) service_pool.cc:224] Handling call
0709 13:12:41.884990 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.900719 (+ 15729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.900935 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.904906 27648 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.911408 21393 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:41.912633 27460 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:41.912897 27648 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.917330 21320 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:12:41.916783 21219 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 12, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 12 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:41.920415 27648 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:41.921617 27619 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:41.922758 27619 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:41.923096 27527 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.924094 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.921514 27648 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.924954 21394 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:41.924887 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:41.926359 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:41.926972 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:41.927196 21394 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:12:41.927487 27628 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:41.927165 27648 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:41.928908 21390 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:41.929651 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1255) took 1588 ms. Trace:
I20260709 13:12:41.929870 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2270) took 1465 ms. Trace:
I20260709 13:12:41.930189 21388 rpcz_store.cc:276] 0709 13:12:40.341086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.883225 (+1542139us) service_pool.cc:224] Handling call
0709 13:12:41.928646 (+ 45421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.929263 (+   617us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:41.929292 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:41.929351 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:41.929388 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.929443 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.929574 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28672}
I20260709 13:12:41.931214 21313 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:41.932413 27715 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:41.932998 27642 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.934762 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:41.938097 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 49445.8us
I20260709 13:12:41.938493 21396 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:12:41.941733 27364 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:41.942728 27595 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:41.944264 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:41.905545 21467 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:41.947201 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:41.942631 27364 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:41.948155 21320 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 10.
I20260709 13:12:41.949774 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:41.923142 27619 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:41.953758 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:41.954600 21320 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:41.954939 27619 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.956310 27668 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.957046 21319 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:12:41.957877 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 969) took 1301 ms. Trace:
I20260709 13:12:41.958840 27668 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:41.930275 21390 rpcz_store.cc:276] 0709 13:12:40.464948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.928122 (+1463174us) service_pool.cc:224] Handling call
0709 13:12:41.928605 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.929634 (+  1029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.929819 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25856}
I20260709 13:12:41.961280 21314 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:41.877367 21391 pending_rounds.cc:107] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:12:41.985363 21391 raft_consensus.cc:2889] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:41.964673 27543 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.966317 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3282) took 1597 ms. Trace:
I20260709 13:12:41.867780 27371 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:41.985953 21315 rpcz_store.cc:276] 0709 13:12:40.368840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.757361 (+1388521us) service_pool.cc:224] Handling call
0709 13:12:41.757909 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.906887 (+148978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.966213 (+ 59326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.958205 21319 rpcz_store.cc:276] 0709 13:12:40.656124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.879338 (+1223214us) service_pool.cc:224] Handling call
0709 13:12:41.908480 (+ 29142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.957491 (+ 49011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.957713 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:41.883409 27647 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:41.967518 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:41.967875 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52361.6us
I20260709 13:12:41.963793 21320 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:41.967828 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2272) took 1446 ms. Trace:
I20260709 13:12:41.941787 27601 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.976739 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:41.976409 21219 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 12, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 12 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:41.977610 27571 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:41.978071 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 104565us
I20260709 13:12:41.752550 27704 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:41.979496 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52674.6us
I20260709 13:12:42.001363 27704 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:42.007506 27619 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:42.007529 21359 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:41.981184 27624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.007s	sys 0.009s
W20260709 13:12:41.981773 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 78553.3us
I20260709 13:12:42.021472 27422 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:12:42.023561 27422 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:41.777987 27615 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.852082 27586 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:42.024608 27714 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:42.024986 27615 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.025213 27714 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.025765 27714 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.024557 27422 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:42.026952 27620 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.027274 27422 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:42.028199 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 72113.7us
I20260709 13:12:42.028724 27422 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:41.988255 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 101998us
I20260709 13:12:41.994714 21388 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:12:42.029560 27620 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:42.025875 27586 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.016852 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2871) took 1796 ms. Trace:
I20260709 13:12:42.036055 27168 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:42.036269 21391 rpcz_store.cc:276] 0709 13:12:40.337762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.759643 (+1421881us) service_pool.cc:224] Handling call
0709 13:12:41.772866 (+ 13223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.016391 (+243525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.016722 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.017079 21362 leader_election.cc:400] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:41.982275 27547 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:41.963078 27612 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:41.988104 21393 rpcz_store.cc:276] 0709 13:12:40.465678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.910741 (+1445063us) service_pool.cc:224] Handling call
0709 13:12:41.911147 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.911802 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.912009 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.033280 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.034018 27601 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.036731 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:41.980724 22035 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:42.045171 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:42.050570 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 125790us
I20260709 13:12:42.060240 21395 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:12:42.062172 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.064977 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1254) took 1730 ms. Trace:
I20260709 13:12:42.053954 21219 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 14 to 19, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 19 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.064772 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2872) took 1726 ms. Trace:
I20260709 13:12:42.065347 21395 rpcz_store.cc:276] 0709 13:12:40.334802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.874528 (+1539726us) service_pool.cc:224] Handling call
0709 13:12:42.004627 (+130099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.060663 (+ 56036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.064924 (+  4261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.067857 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:42.067811 21392 rpcz_store.cc:276] 0709 13:12:40.338218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.883786 (+1545568us) service_pool.cc:224] Handling call
0709 13:12:42.044229 (+160443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.060110 (+ 15881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:42.060145 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:42.060180 (+    35us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:42.064546 (+  4366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.064610 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.064717 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.073159 21313 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:42.079873 21312 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
W20260709 13:12:42.076334 21214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 280) took 45199 ms (client timeout 15000 ms). Trace:
I20260709 13:12:42.082389 21389 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:42.081077 27718 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:42.087739 27647 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.092303 27160 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:42.093022 27160 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.094650 27630 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.095329 27160 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.095788 21387 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:42.096292 27571 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:42.096737 27571 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:42.097117 27571 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:42.099023 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 62530.5us
I20260709 13:12:42.100150 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:42.103500 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.103720 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:42.104125 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 105386us
I20260709 13:12:42.104492 21462 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:42.105080 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.105736 21467 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:42.106742 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.107530 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:42.047920 27710 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.108757 21461 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.109773 27710 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:42.110443 27371 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.112401 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:42.112509 27601 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:42.112957 22041 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:42.114424 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 137910us
I20260709 13:12:42.116134 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:42.116657 27586 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:42.072932 27460 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:42.118095 21285 leader_election.cc:400] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18.
I20260709 13:12:42.118048 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:42.118726 21285 leader_election.cc:403] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:42.119064 22036 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:12:42.118057 27460 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:42.081954 21219 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 14, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 14 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.058552 27618 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.120014 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:42.126701 21461 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
W20260709 13:12:42.125177 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.173530 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.174192 21468 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:42.133762 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.143133 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:42.148087 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1559) took 1764 ms. Trace:
W20260709 13:12:42.150393 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.137630 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:42.139214 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:42.137450 22040 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:12:42.121610 21219 catalog_manager.cc:5697] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 12 to 15, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 15 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:42.144243 22038 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:42.148743 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2865) took 1931 ms. Trace:
I20260709 13:12:42.161136 21314 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:42.136986 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 120196us
I20260709 13:12:42.185410 21463 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:42.133884 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:42.188506 21313 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:42.142251 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 88393us
I20260709 13:12:42.134785 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:42.177552 22039 rpcz_store.cc:276] 0709 13:12:40.383505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.383715 (+   210us) service_pool.cc:224] Handling call
0709 13:12:40.391186 (+  7471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:41.898554 (+1507368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.147722 (+249168us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540046aad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:42.147988 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3062146816}
W20260709 13:12:42.163187 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 55222.2us
W20260709 13:12:42.196398 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 114679us
I20260709 13:12:42.182317 21387 rpcz_store.cc:276] 0709 13:12:40.217578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.686657 (+1469079us) service_pool.cc:224] Handling call
0709 13:12:41.687299 (+   642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.096262 (+408963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.148501 (+ 52239us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540009f954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:42.148664 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939038592}
I20260709 13:12:42.135035 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:42.136624 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:42.120082 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:42.139511 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:42.205045 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 70346.9us
I20260709 13:12:42.142570 27428 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:42.206925 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.207882 22034 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:42.202380 21219 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 12 to 16, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 16 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:42.120468 27637 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18.
I20260709 13:12:42.149598 27630 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:42.146085 27618 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.120479 27460 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:42.142099 27613 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.212119 21321 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:42.141913 27612 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:42.211532 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45136 (request call id 3276) took 2443 ms. Trace:
I20260709 13:12:42.159785 27621 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.215314 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.141700 27629 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.217950 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:42.218981 22031 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:42.219573 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:42.205288 27710 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:42.218616 21319 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:42.217816 21314 rpcz_store.cc:276] 0709 13:12:39.775025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.848533 (+1073508us) service_pool.cc:224] Handling call
0709 13:12:42.159228 (+1310695us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54003c87d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf20fa3d 00007fc2c41dfcd0 00007fc2bd764254 00007fc2bd7641e2 00007fc2bd764111 00007fc2bd76408c 00007fc2bd763342 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:42.202833 (+ 43605us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701936512}
I20260709 13:12:42.228303 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:42.210968 27619 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:42.216995 21219 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.247294 21317 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:42.260288 21396 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:42.217260 27623 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:42.265269 21461 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: []
I20260709 13:12:42.268180 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.268285 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.237653 27470 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.269042 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.269805 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.276868 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.279563 22041 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:12:42.238592 27619 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.236500 27710 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:42.283885 21389 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:42.285735 27619 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.291791 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 970) took 1621 ms. Trace:
I20260709 13:12:42.292840 21317 rpcz_store.cc:276] 0709 13:12:40.663974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.897343 (+1233369us) service_pool.cc:224] Handling call
0709 13:12:42.042386 (+145043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.262891 (+220505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.281416 (+ 18525us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003aedd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:42.285504 (+  4088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444352384}
W20260709 13:12:42.294755 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44324.2us
W20260709 13:12:42.295635 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.296103 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.296787 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.295008 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.300835 21392 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.235172 27586 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:12:42.304651 21219 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 11, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 11 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:42.305490 21391 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:12:42.288005 27710 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:42.307158 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.367888 21394 raft_consensus.cc:2410] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:12:42.299683 21395 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:42.215934 27428 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.336872 27718 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:42.336611 27371 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:42.331051 27643 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.331104 27423 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:42.286144 27612 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:42.345271 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.335193 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:42.335892 27601 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:42.340260 27714 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.289196 27623 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:42.340273 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 220369us
I20260709 13:12:42.392311 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:42.393193 27642 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:42.393612 27642 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:42.394048 27642 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.394536 27423 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.395001 27423 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.397608 27718 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:42.398394 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:42.398838 27704 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:42.399372 27704 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:42.337370 27135 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:42.244753 27613 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.383105 21465 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:42.387611 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:42.400312 27704 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:42.401316 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 55148.1us
I20260709 13:12:42.403173 27714 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:42.404314 27647 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:42.404910 21390 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:42.404915 27647 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.405782 27647 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:42.390092 27428 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:42.408581 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.311852 27460 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.410737 27623 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.412397 21387 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:42.414113 27543 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.414752 27543 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.417179 21396 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:42.331207 27666 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:42.399832 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:42.421577 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:42.422499 27428 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:42.422590 27637 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:42.408514 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.370517 27547 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:12:42.294586 27629 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.424602 27637 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:42.424913 27428 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:42.426007 27637 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:42.422806 27666 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:42.426611 27637 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:42.426910 27629 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.427614 27637 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.427269 27666 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.429020 27637 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.426061 27428 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:42.432442 27428 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:42.433413 27428 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.434461 27428 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:42.437039 27718 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:42.438079 27718 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.439435 27718 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.304821 27470 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.442322 27470 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.445322 27621 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.447466 27613 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:42.448607 27642 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:42.403882 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 68772.8us
I20260709 13:12:42.451754 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.416946 21219 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 12 to 15, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 15 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:12:42.454077 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 242616us
I20260709 13:12:42.456918 21321 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:42.467176 21387 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:42.462220 21468 raft_consensus.cc:2410] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:12:42.463114 21392 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:42.472577 21467 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:42.472707 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.473841 21396 raft_consensus.cc:2410] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:12:42.473938 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.416957 27543 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.476678 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:42.478127 27724 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:42.478191 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:42.478686 27724 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:42.480654 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:42.417114 27612 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:42.488569 21390 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:12:42.485944 21219 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 13 to 16, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 16 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:12:42.503021 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 78355.5us
I20260709 13:12:42.483747 22031 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:42.499396 21463 raft_consensus.cc:1217] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Deduplicated request from leader. Original: 13.11->[14.12-14.12]   Dedup: 14.12->[]
I20260709 13:12:42.511245 21463 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:42.507081 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.513053 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.517984 21394 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:42.520445 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.524930 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.522814 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:42.516947 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:42.506019 27621 raft_consensus.cc:2764] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:12:42.531942 21465 raft_consensus.cc:2368] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19.
W20260709 13:12:42.082818 21214 rpcz_store.cc:269] 0709 13:11:56.855986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.856190 (+   204us) service_pool.cc:224] Handling call
0709 13:12:42.055561 (+45199371us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:32.116533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:32.435967 (+319434us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:32.457476 (+ 21509us) write_op.cc:435] Acquired schema lock
0709 13:12:32.461844 (+  4368us) tablet.cc:662] Decoding operations
0709 13:12:32.675924 (+214080us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:32.676046 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:32.676105 (+    59us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:12:32.677302 (+  1197us) tablet.cc:701] Row locks acquired
0709 13:12:32.677347 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:12:32.677537 (+   190us) write_op.cc:270] Start()
0709 13:12:32.677711 (+   174us) write_op.cc:276] Timestamp: P: 1783602752677454 usec, L: 0
0709 13:12:32.677747 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:12:32.678504 (+   757us) log.cc:844] Serialized 4420 byte log entry
0709 13:12:33.183846 (+505342us) op_driver.cc:464] REPLICATION: finished
0709 13:12:33.227756 (+ 43910us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21532a 00007fc2bf19af14 00007fc2bf19aec3 00007fc2bf19ae38 00007fc2bf19adf3 00007fc2bf19a0dc 00007fc2bf1c3e16 00007fc2bf1abcbb 00007fc2bf19639d 00007fc2bf199d75
0709 13:12:33.480060 (+252304us) write_op.cc:301] APPLY: starting
0709 13:12:33.497797 (+ 17737us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:33.751608 (+253811us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:33.751659 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:34.311338 (+559679us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b18001beb60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:34.901976 (+590638us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:34.902340 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:12:34.902408 (+    68us) write_op.cc:312] APPLY: finished
0709 13:12:34.902803 (+   395us) log.cc:844] Serialized 105 byte log entry
0709 13:12:35.060380 (+157577us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:35.060581 (+   201us) write_op.cc:454] Released schema lock
0709 13:12:35.060695 (+   114us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:35.111605 (+ 50910us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:35.111649 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2619026,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":240071,"apply.run_cpu_time_us":36554,"apply.run_wall_time_us":1614261,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50239,"num_ops":11,"prepare.queue_time_us":407976,"prepare.run_cpu_time_us":27581,"prepare.run_wall_time_us":688928,"raft.queue_time_us":244239,"raft.run_cpu_time_us":9868,"raft.run_wall_time_us":52189,"replication_time_us":505904,"spinlock_wait_cycles":92159488,"thread_start_us":398512,"threads_started":5,"wal-append.queue_time_us":395997,"wal-append.run_cpu_time_us":6533,"wal-append.run_wall_time_us":2486217}]]}
I20260709 13:12:42.521133 21219 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 16, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 16 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.479693 27724 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.536041 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 964) took 2360 ms. Trace:
I20260709 13:12:42.526959 27618 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:42.542712 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62174.5us
I20260709 13:12:42.543534 21219 catalog_manager.cc:5697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 14, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 14 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:42.513305 27160 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:12:42.553399 21391 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:42.553748 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.559823 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.558386 21219 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 11, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 11 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:42.544826 27168 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:42.562264 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:42.523592 27643 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:42.569980 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83337us
I20260709 13:12:42.574914 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:42.565752 27586 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:42.576193 27619 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.577932 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.576462 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:42.573803 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:42.581121 22031 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:42.579818 21219 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 15, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 15 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:42.563630 27168 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.568063 27645 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:12:42.588014 27613 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:42.596755 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.598065 21463 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:42.578063 27470 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:42.601616 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.602651 27613 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:42.594327 27168 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.593653 27586 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:42.602141 27724 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:42.616555 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.601400 27668 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:42.605715 27470 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:42.624145 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67248.1us
W20260709 13:12:42.618129 27571 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.002s
I20260709 13:12:42.623797 27642 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.631469 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.648524 21396 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.633782 21468 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:42.620106 27586 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.636727 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.644516 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.641103 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.641336 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.651204 21390 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.643926 21219 catalog_manager.cc:5697] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 14, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 14 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:42.651312 21389 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:42.642084 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.640515 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.652379 21392 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:42.616175 27735 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:42.654458 21219 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:42.658257 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:42.666260 21393 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:42.666453 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.635211 27470 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.669736 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.594024 27621 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:12:42.676244 21462 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:42.613511 27547 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:12:42.678120 21219 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:42.682248 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.651791 27668 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.614933 27647 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.680864 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.685148 27668 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:42.685403 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.686110 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:42.688302 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.688966 21465 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:42.692436 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:42.693164 21317 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:42.693624 27618 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:42.694113 27618 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.694154 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:42.695158 21321 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:42.696992 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.697995 21391 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:12:42.698784 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:42.698916 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 122562us
I20260709 13:12:42.699651 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:42.699975 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.700613 21387 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:42.701232 27735 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:42.701803 27735 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:42.702021 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.702818 27735 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.698805 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:42.704720 21391 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.704196 27642 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:42.705343 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.686138 21470 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:42.703464 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:42.707247 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.709643 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.709295 27642 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.712174 27601 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.714525 27619 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:42.715916 27601 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.717103 21387 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:42.718093 27601 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:42.718629 27734 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:12:42.720656 27668 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.718128 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.722627 21387 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:42.723587 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.724386 27543 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:42.724680 21387 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:42.725557 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.726688 27423 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.737874 27423 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:42.729115 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.708616 27704 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:42.782145 21465 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:42.782727 27704 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:42.783205 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.730414 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.784345 21466 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:42.783836 27704 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.785305 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.785887 21466 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:42.786568 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:42.787405 22031 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:42.787523 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:42.732604 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.733211 27613 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.788506 21464 raft_consensus.cc:2410] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:12:42.788718 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:42.789426 22040 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:42.730700 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.790206 22041 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:42.790338 21469 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:42.735855 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.790599 22041 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:42.791026 21462 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:12:42.791338 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.791893 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.792413 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.792966 21465 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.539448 21316 rpcz_store.cc:276] 0709 13:12:40.171041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.059180 (+888139us) service_pool.cc:224] Handling call
0709 13:12:41.059434 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.059615 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:12:41.883755 (+824140us) log.cc:844] Serialized 14 byte log entry
0709 13:12:42.499483 (+615728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:42.509287 (+  9804us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:42.516013 (+  6726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.523398 (+  7385us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.531281 (+  7883us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4363,"prepare.queue_time_us":841472,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":33899,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":26661,"thread_start_us":1166213,"threads_started":3,"wal-append.queue_time_us":535979}
I20260709 13:12:42.743315 27621 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:42.725837 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 85252.6us
I20260709 13:12:42.791929 21469 raft_consensus.cc:2376] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14. Re-sending same reply.
I20260709 13:12:42.796660 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:42.798058 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:42.798964 27620 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:42.799599 27620 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.799988 27620 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.800439 27620 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.805141 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:42.728153 27643 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.829834 21462 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:42.831190 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.749614 27642 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:42.648931 27571 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.724998 27543 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.791632 22041 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.761077 27601 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.771461 21396 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:42.775384 21219 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:42.777499 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:42.786690 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.789285 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.806648 21465 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:42.706826 21470 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:42.809091 21390 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:42.811503 21391 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
W20260709 13:12:42.742568 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 56549.6us
I20260709 13:12:42.726728 21387 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:42.884281 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.885387 21464 raft_consensus.cc:2368] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19.
I20260709 13:12:42.874709 21466 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:42.870338 21219 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 12 to 14, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 14 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:12:42.890350 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 214694us
I20260709 13:12:42.892938 21464 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:42.894580 21390 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:42.895067 27547 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:42.895668 27547 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.895897 27160 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:42.899039 21389 raft_consensus.cc:2410] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:12:42.828934 21393 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:12:42.832722 21462 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:12:42.748736 27710 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:42.910619 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.879683 27637 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.858764 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:42.859253 21315 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:42.861593 27571 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:42.862442 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:42.884506 27718 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.915585 21219 catalog_manager.cc:5697] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 6 to 15. New cstate: current_term: 15 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:12:42.919610 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 114598us
I20260709 13:12:42.851504 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:42.944903 21395 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:42.946460 21461 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
W20260709 13:12:42.947366 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 337425us
I20260709 13:12:42.870725 27470 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.884781 27619 consensus_queue.cc:1059] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:12:42.972750 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:42.907627 27422 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:12:42.916997 27601 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:42.992614 21391 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:42.992578 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:42.967847 21219 catalog_manager.cc:5697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 16, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 16 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.997507 21465 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 13:12:43.002171 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 101698us
I20260709 13:12:43.001287 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:42.978659 27571 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.082s
W20260709 13:12:43.063714 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62552.5us
I20260709 13:12:43.063668 21462 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:43.067512 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.067803 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 95186.7us
I20260709 13:12:43.061334 21219 catalog_manager.cc:5697] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 6, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 6 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:43.067647 27624 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:43.088609 27624 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.089118 27624 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:43.089417 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.091233 21470 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:43.092707 21470 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.102039 27620 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:43.107327 27613 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.108083 27613 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.109237 27470 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:43.111708 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.113569 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:43.127715 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 162520us
I20260709 13:12:43.061167 27619 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:43.133736 21219 catalog_manager.cc:5697] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 14, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 14 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:42.991430 27637 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.138356 21362 leader_election.cc:400] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:43.138092 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:43.138760 21362 leader_election.cc:403] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:43.139191 21393 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:43.132632 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.139842 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.140673 21462 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:43.143524 21389 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:43.149381 21312 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:43.150146 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:43.152606 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 257253us
W20260709 13:12:43.132474 27721 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:43.153815 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.154678 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.171763 21219 catalog_manager.cc:5697] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 8 to 13, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 13 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.173512 21219 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 3 to 11, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 11 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:43.178220 21219 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.132848 27547 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:43.181535 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.187779 21466 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:43.179756 21219 catalog_manager.cc:5697] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 6 to 10, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 10 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.188796 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:43.192160 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.192216 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:43.193711 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.194738 21466 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 23: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:43.196107 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.197181 27470 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:43.187353 27613 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:43.201094 27668 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:43.204478 27428 raft_consensus.cc:3055] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:43.205008 27428 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:43.205840 27428 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.207058 27428 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.204638 27543 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:43.208407 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.212306 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 62264.5us
I20260709 13:12:43.213721 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.213999 27666 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:43.208297 27647 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:43.215073 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:43.216708 27666 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:43.217222 27666 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.217650 27666 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:43.219038 27168 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.000s
I20260709 13:12:43.192327 27620 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:43.221206 27601 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:43.220373 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:43.223489 27710 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:43.214995 21466 raft_consensus.cc:2410] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:12:43.224349 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 73143.7us
I20260709 13:12:43.222935 27637 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:43.231596 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:43.227069 21219 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:43.175311 27612 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:43.219456 27168 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:43.241269 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:43.207950 27724 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.000s
I20260709 13:12:43.242998 21362 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:43.268540 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:43.270639 21465 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:43.269979 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 200691us
I20260709 13:12:43.272841 21316 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:43.276599 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:43.279462 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:43.280802 21393 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:12:43.296350 21465 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:43.310756 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:43.244347 27637 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:43.325201 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:43.326450 21396 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:43.315054 21312 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:43.328347 21316 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.336930 21316 raft_consensus.cc:2410] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:12:43.304788 27621 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:43.357216 27621 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:43.357704 27621 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.358529 21396 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:43.310959 27547 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.326251 27543 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.341024 27719 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:12:43.378083 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 186766us
I20260709 13:12:43.378808 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:43.378960 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:43.345860 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:43.379407 22039 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:12:43.381011 27749 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:12:43.382741 27754 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:43.383857 21468 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:43.302309 27618 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.006s
I20260709 13:12:43.348481 21470 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:43.349171 27135 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:43.394739 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:43.350893 22031 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:12:43.351331 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:43.228084 27571 consensus_queue.cc:1243] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:43.370756 21463 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:43.377759 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:43.343894 27736 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.682s	user 0.000s	sys 0.010s
I20260709 13:12:43.289240 27737 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
W20260709 13:12:43.384866 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.242360 27470 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:43.349820 27710 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:43.394316 27547 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.399576 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:43.377627 27543 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.395253 22039 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
W20260709 13:12:43.395704 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 68991.4us
I20260709 13:12:43.397745 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:43.375344 27637 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.368556 27624 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:43.419020 21317 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.414873 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:43.420140 22034 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:43.423004 27423 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:43.423458 27423 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:43.423763 27168 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:43.425855 27423 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.430660 27423 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.436385 27668 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:12:43.436805 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 168019us
I20260709 13:12:43.437934 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:43.415230 27637 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.438949 27624 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:43.436925 27668 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:43.392558 27719 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:43.445801 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:43.396409 27724 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:43.446667 21312 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:43.441329 27668 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:43.453934 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:43.511415 21320 raft_consensus.cc:2410] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:43.411993 27762 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:43.514770 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:43.396803 27615 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:12:43.515797 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 77342.9us
I20260709 13:12:43.500736 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:43.519450 27624 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:43.525353 27547 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:43.526176 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:43.526960 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.400239 27160 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 13:12:43.527081 21389 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
W20260709 13:12:43.528717 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 149858us
I20260709 13:12:43.529573 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:43.531394 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:43.531632 22041 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:43.532399 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:43.533875 27668 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:43.536414 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.396677 27618 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.545308 22041 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:12:43.546066 22041 pending_rounds.cc:85] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 12
I20260709 13:12:43.546370 22041 pending_rounds.cc:107] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:12:43.546671 22041 raft_consensus.cc:2889] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.547204 21321 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:43.550014 21315 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:12:43.556557 22039 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:43.466347 27470 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:43.446520 27460 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:43.506085 27645 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:43.442602 27571 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.103s
I20260709 13:12:43.569904 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:43.537658 27613 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.544735 27615 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:43.589015 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:43.597003 27624 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:12:43.580917 21313 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:12:43.568117 27601 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:43.610203 27645 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:43.513018 27612 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:12:43.614327 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:43.626595 21312 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:12:43.634249 27742 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:12:43.611888 27460 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.640261 21320 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
W20260709 13:12:43.647593 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.648813 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:43.649459 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:43.650086 21312 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.651491 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:43.664556 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.613780 27724 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:12:43.651019 27710 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:43.693565 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.693189 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.694552 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:43.609021 27613 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.658990 27735 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.703946 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:43.625222 27621 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:43.668519 27612 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:43.669377 27772 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:43.728603 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:43.717379 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:43.711270 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.691327 27762 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.729025 21465 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:43.701282 27710 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.736931 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:43.742695 27612 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.743710 27612 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.748140 27612 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:43.747926 21312 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:43.688732 27718 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:12:43.629484 27719 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.704924 27428 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.753192 27422 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:12:43.761817 27621 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:43.639914 27645 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:43.764524 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 53897.3us
I20260709 13:12:43.765731 27543 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:43.766114 27771 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:12:43.732796 27761 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.740813 27710 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:43.815636 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 75576us
W20260709 13:12:43.750223 21360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 2.908s (SENT) [suppressed 30 similar messages]
I20260709 13:12:43.754273 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:43.824020 21312 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:43.752216 27760 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:43.833369 21317 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:43.729662 27735 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:43.838855 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:43.839032 27741 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:12:43.840631 21470 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:43.739780 27547 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:12:43.709044 27470 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:43.740272 27762 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:43.906168 27735 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:43.906966 27762 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:43.891623 27586 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:43.908331 21315 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:43.867080 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:43.889467 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:43.753902 27757 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
W20260709 13:12:43.890064 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 135885us
I20260709 13:12:43.841874 27759 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:43.893062 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:43.914204 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:43.895148 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 144955us
I20260709 13:12:43.887117 27618 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:43.907753 27586 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:43.919416 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 52435us
I20260709 13:12:43.927354 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:43.903599 27756 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 13:12:43.922560 27770 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:12:43.928925 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:43.890347 27428 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.010936 27168 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:44.011260 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 479902us
W20260709 13:12:44.012090 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 84831.6us
I20260709 13:12:44.014958 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:43.922562 27778 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:12:43.916065 27759 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:44.031572 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.902772 27755 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.232s
I20260709 13:12:43.933183 27724 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:43.935225 27618 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.935984 27620 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:44.012509 27719 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:44.064703 27704 raft_consensus.cc:3055] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:44.087183 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.063621 27757 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.055383 27624 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:12:44.082621 27668 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.009s
W20260709 13:12:44.081718 27770 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:44.067443 27724 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:44.085991 27763 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:12:44.086987 27704 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:44.113867 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.095077 27718 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:44.118237 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.086277 27618 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.109185 27724 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:44.141402 27743 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:12:44.143061 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3313) took 1471 ms. Trace:
I20260709 13:12:44.106873 27781 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.143538 21318 rpcz_store.cc:276] 0709 13:12:42.671951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.679716 (+  7765us) service_pool.cc:224] Handling call
0709 13:12:42.685372 (+  5656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:42.685805 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:42.685838 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:42.686354 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:12:42.997565 (+311211us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:42.997603 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.997666 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:44.142803 (+1145137us) raft_consensus.cc:1685] finished
0709 13:12:44.142831 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:44.142993 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1193,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":310827,"threads_started":1,"wal-append.queue_time_us":1068703}
I20260709 13:12:44.144369 27781 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:44.145720 27423 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.002s
I20260709 13:12:44.146891 27781 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:44.101686 27757 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.148190 21469 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:44.149816 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.149981 27757 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:44.108599 27601 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:44.123431 27784 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
W20260709 13:12:44.125447 27637 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
W20260709 13:12:44.128667 27780 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:12:44.131734 27779 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:44.137063 27428 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:44.137943 27666 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.919s	user 0.008s	sys 0.005s
I20260709 13:12:44.179281 27762 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:12:44.179844 27762 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:44.180902 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.180702 27762 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.182138 27762 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:44.107157 27624 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:44.155463 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 226628us
I20260709 13:12:44.185459 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:44.179512 27666 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.186385 27668 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:44.186887 27668 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:44.187508 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:44.154368 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:44.187920 27666 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:44.187726 27668 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.188725 21319 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:44.165587 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 150766us
I20260709 13:12:44.190618 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:44.155505 27759 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.185050 27624 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.192396 21360 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:44.197543 21321 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:44.198563 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48817.5us
I20260709 13:12:44.196846 27759 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:44.208925 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:44.202787 27620 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:12:44.204629 27785 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:44.206346 27621 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:44.152261 27586 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.165802 27781 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:44.213815 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:44.200138 27784 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:44.242756 27784 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:44.242851 27795 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:44.243263 27784 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:44.217626 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:44.243557 27795 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.245050 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.246232 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.218814 27621 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:44.163401 27637 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.226334 27776 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:44.232409 27793 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:44.233103 27790 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
W20260709 13:12:44.247432 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.249269 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.254982 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.251515 27428 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:44.256742 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:44.257594 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:44.247352 27601 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:44.261359 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.167552 27704 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.248344 27621 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:44.265254 21318 raft_consensus.cc:2368] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19.
I20260709 13:12:44.251442 27779 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:44.252666 27795 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:44.268227 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 56094.3us
I20260709 13:12:44.253181 27643 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:12:44.251601 27612 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:44.261302 27666 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:44.262557 27781 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:44.278471 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:44.290318 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 76583.5us
I20260709 13:12:44.291042 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:44.298005 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.280350 27612 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:44.301254 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43734.1us
I20260709 13:12:44.304859 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.305642 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:44.310304 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.322019 21391 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:44.321059 21318 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:44.309253 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.292456 27779 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:44.306130 27612 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:44.332304 21362 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:44.337932 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:44.360982 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 69994.4us
I20260709 13:12:44.361575 21318 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:44.331960 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.297833 27776 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.362375 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:44.366871 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 86004.2us
I20260709 13:12:44.367566 21314 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:44.331048 27719 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:44.292403 27718 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:12:44.306759 27796 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:44.333362 27757 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.379544 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.380613 21462 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:44.380928 27814 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:44.334167 27613 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:44.363221 27618 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:44.332324 27805 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:44.398222 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.343731 27428 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:44.309473 27793 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:44.332403 27779 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:44.382982 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:44.388681 21468 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:44.389856 27615 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.390761 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.393054 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:44.394517 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.404057 21461 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
W20260709 13:12:44.394790 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 62937.3us
I20260709 13:12:44.404428 21312 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
W20260709 13:12:44.396461 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.398972 21318 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:44.405612 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.405879 21462 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:44.382340 27755 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:44.404722 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:44.406404 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.406282 21312 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:12:44.358048 27781 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:12:44.395356 27790 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:44.408702 27799 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:12:44.409569 27428 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.411439 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.412330 27613 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:44.383839 27796 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:44.406708 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:44.442133 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.442934 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.443498 21394 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:44.419670 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.444547 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.444877 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.422183 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.445348 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.414501 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:44.446089 21393 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:12:44.446576 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:44.447346 22039 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:44.448623 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.449584 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:44.451170 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.451892 21387 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:44.453563 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70652.5us
I20260709 13:12:44.371088 27776 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.456187 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:44.456386 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.457638 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.458130 21393 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:44.457927 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.458966 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.459266 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.460549 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:44.462971 27618 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:44.467844 27618 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.468297 27618 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:44.455420 27796 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:44.470453 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:44.471225 21318 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 7: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:44.471329 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.472178 21390 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 7: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:44.472100 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:44.472404 27647 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:44.472839 27647 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:44.473146 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.463542 27645 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:44.464522 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.464329 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:44.474871 21389 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:44.472946 21318 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:44.473275 27647 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:44.397722 27757 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.475199 21393 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:44.481973 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.463889 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.482972 21391 raft_consensus.cc:2368] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17.
I20260709 13:12:44.483055 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.454497 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:44.474429 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.466374 21468 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:44.485647 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.490657 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.491086 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:44.490657 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.491969 21316 raft_consensus.cc:2410] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:12:44.495273 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.491793 21313 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:44.497519 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.464233 27422 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:44.499874 21434 leader_election.cc:400] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17.
I20260709 13:12:44.501718 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.472182 27760 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:44.503921 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49526.4us
I20260709 13:12:44.506448 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:44.507313 21434 leader_election.cc:403] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:44.508358 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.509055 21393 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:44.509295 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.509858 21391 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.480702 27807 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.488920 27755 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:44.481251 27809 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:44.484068 27613 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:44.510412 27710 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.008s
I20260709 13:12:44.521199 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.496326 27601 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:44.507454 27615 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:44.439565 27790 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.526757 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:44.525074 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.531486 21391 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:44.537257 21390 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:44.537901 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.552457 21391 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:44.536852 21318 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 11: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:44.556713 21463 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:12:44.548931 21387 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:44.526440 27422 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:44.558969 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 94691.5us
I20260709 13:12:44.563964 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.561013 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 984) took 1065 ms. Trace:
I20260709 13:12:44.564965 21320 rpcz_store.cc:276] 0709 13:12:43.496938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.538710 (+ 41772us) service_pool.cc:224] Handling call
0709 13:12:44.560887 (+1022177us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b54000fcb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:44.560969 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127557504}
I20260709 13:12:44.543283 21389 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:44.567376 21393 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:44.547336 27810 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:44.574406 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.571951 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.548345 27737 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:44.528016 27710 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:44.595746 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 110568us
I20260709 13:12:44.532745 27779 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.595160 27428 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.604800 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.532516 27806 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.199s
I20260709 13:12:44.548281 27601 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.596434 21389 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:44.609046 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 276817us
I20260709 13:12:44.612088 27823 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:44.612677 27823 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.615640 27823 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:44.520742 27807 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.532385 27809 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:44.616369 27797 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.294s	user 0.004s	sys 0.000s
I20260709 13:12:44.527374 27793 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.575212 27810 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:44.617664 27826 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:44.626349 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:44.573565 27460 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:44.634502 27807 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:44.637837 21362 leader_election.cc:400] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19.
I20260709 13:12:44.639640 21394 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:12:44.640195 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:44.603564 27737 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.645829 21362 leader_election.cc:403] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:44.646412 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.648958 27422 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.651316 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.629998 27823 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.656337 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.657797 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:44.627562 27787 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:44.660457 21320 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:12:44.639576 27794 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:44.484143 27781 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:44.642908 27810 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:44.647701 27804 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17.
I20260709 13:12:44.664959 21318 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:44.665728 21394 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:44.610785 27428 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.635335 27612 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.608215 27724 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.666437 21320 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:12:44.648694 27737 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.648322 27460 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:44.646785 27547 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:12:44.654554 27422 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:44.684331 27781 consensus_queue.cc:1243] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:44.669663 27811 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:44.685398 27811 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:44.687235 27618 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.690776 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:44.641616 27796 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.675886 27826 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:44.699798 27547 consensus_queue.cc:1243] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:12:44.642712 27613 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.690840 27814 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:12:44.708405 27805 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:44.712641 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:44.713549 27762 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 13:12:44.714722 21391 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:44.667110 27813 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:44.720254 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:44.721411 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.701871 27758 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.744194 21391 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:44.663455 27823 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.721959 27755 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:44.724953 27601 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:44.779485 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 273140us
I20260709 13:12:44.780611 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:44.728144 27805 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:44.727211 27826 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:44.690138 27794 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.785990 21320 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:12:44.786545 21320 pending_rounds.cc:85] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 8
I20260709 13:12:44.786875 21320 pending_rounds.cc:107] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:12:44.787181 21320 raft_consensus.cc:2889] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:44.756374 27806 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:44.787708 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:44.759294 27813 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:44.793704 21360 leader_election.cc:400] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19.
I20260709 13:12:44.801716 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 987) took 1187 ms. Trace:
I20260709 13:12:44.804173 21315 rpcz_store.cc:276] 0709 13:12:43.614755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.750765 (+136010us) service_pool.cc:224] Handling call
0709 13:12:43.815464 (+ 64699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:43.908721 (+ 93257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.801477 (+892756us) spinlock_profiling.cc:243] Waited 92.5 ms on lock 0x7b5400089154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:44.801657 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212669184}
I20260709 13:12:44.783689 27755 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.784514 27757 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:44.786334 27819 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.802613 27762 raft_consensus.cc:2764] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:12:44.817408 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:44.803529 27710 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:44.813365 27755 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:44.758093 27758 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.841904 27810 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:44.844883 27828 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:12:44.884981 27819 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:44.831696 27826 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:44.889400 27821 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
I20260709 13:12:44.891814 27612 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:44.892263 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:44.892980 21461 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:44.892689 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.893803 27813 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:44.895516 27810 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:44.898963 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.899797 21394 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:44.908618 27809 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:44.909549 27784 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.003s
I20260709 13:12:44.910006 27784 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:44.910465 27758 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:44.911432 21394 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
W20260709 13:12:44.896287 27828 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:12:44.896831 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:44.912559 21390 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:44.914201 21316 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:44.915679 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:44.916944 21394 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:44.914315 27647 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:44.936308 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.911751 27618 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:44.973558 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:45.042645 22035 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:45.040925 22041 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:12:45.043076 21316 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:45.043079 21318 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:44.834144 27805 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.038723 27547 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.999632 27737 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.062019 27704 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:45.062564 27547 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.064076 27737 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:44.942663 27811 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:45.064949 27547 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:45.064914 27811 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.067710 27811 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.068408 27724 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.071322 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3329) took 1457 ms. Trace:
I20260709 13:12:45.035363 27794 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:44.943467 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:45.012383 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 354671us
I20260709 13:12:45.060536 27781 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:45.045352 27784 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.061913 27805 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:45.076155 21391 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
W20260709 13:12:45.076993 27838 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:12:45.071794 21319 rpcz_store.cc:276] 0709 13:12:43.614292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.614441 (+   149us) service_pool.cc:224] Handling call
0709 13:12:45.071087 (+1456646us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400228654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:45.071245 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233339776}
I20260709 13:12:45.089881 21394 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:12:45.075649 21321 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:44.978794 27823 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:45.081208 27621 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.004s
I20260709 13:12:45.085754 22031 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:44.992853 27428 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.091075 21391 pending_rounds.cc:85] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 14
W20260709 13:12:45.044683 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 227313us
I20260709 13:12:45.156617 21315 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:12:45.123041 21316 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:45.173480 21391 pending_rounds.cc:107] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:12:45.151389 21321 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:45.174692 21391 raft_consensus.cc:2889] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:45.151381 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51731.1us
I20260709 13:12:45.176528 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:45.176596 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:45.098202 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:45.124449 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:45.096815 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:44.943039 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:45.124922 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:44.943789 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:45.189540 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 65219.4us
I20260709 13:12:45.190739 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.192255 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:45.182142 22040 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:45.091042 27814 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19.
I20260709 13:12:45.199920 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.190719 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.179730 27737 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.211423 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:45.199259 27784 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:45.200753 27618 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:45.219650 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.217935 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:45.200603 27781 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:45.227741 21387 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:45.212393 27826 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:45.221768 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:45.216782 27806 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:45.242483 27776 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:45.239028 27612 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:45.244899 27612 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.245899 27796 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:45.247216 27612 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.215083 27841 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:45.248311 27841 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:45.248699 27841 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:45.253227 21314 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:45.239635 27755 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.255504 27755 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:45.237179 21392 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 13.
I20260709 13:12:45.187222 27621 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.264233 21396 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:45.228400 27810 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:12:45.268356 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46679.8us
I20260709 13:12:45.236243 27781 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.228646 27618 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.269855 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:45.225558 27811 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.286590 21392 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.217358 27845 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:12:45.290072 27819 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.292878 27819 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.271294 27784 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.281117 27781 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:45.235487 27737 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.284133 27618 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:45.264231 27621 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.267544 27806 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:45.269899 27810 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:45.281189 27612 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:45.284893 27776 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.347424 21392 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:45.340354 27810 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:45.335006 27850 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:45.354827 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:45.332504 27737 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.364521 27160 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:45.364982 27806 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.290421 27811 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.366259 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3189) took 1033 ms. Trace:
I20260709 13:12:45.376873 21320 rpcz_store.cc:276] 0709 13:12:44.333007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.682571 (+349564us) service_pool.cc:224] Handling call
0709 13:12:44.682888 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:44.787748 (+104860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.365934 (+578186us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000fc654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:45.366145 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236317952}
I20260709 13:12:45.340981 27612 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:45.296473 27784 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.353223 27776 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:45.371841 21997 leader_election.cc:336] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.806s (SENT)
I20260709 13:12:45.373987 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:45.381520 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2291) took 1668 ms (client timeout 2047 ms). Trace:
I20260709 13:12:45.372645 27841 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.381402 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:45.296000 27819 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:45.382555 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:45.382001 21469 rpcz_store.cc:269] 0709 13:12:43.709135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.709278 (+   143us) service_pool.cc:224] Handling call
0709 13:12:45.377793 (+1668515us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54000b7f54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:45.377912 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836771072}
I20260709 13:12:45.383749 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:45.374732 27160 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:45.385835 21389 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:45.386904 21387 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:45.386188 27423 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:45.381376 27612 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.390053 21392 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:45.387274 27160 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.396960 27784 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:45.399052 27811 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.400928 21394 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:45.408929 21390 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:12:45.409282 21390 pending_rounds.cc:85] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 9
I20260709 13:12:45.409564 21390 pending_rounds.cc:107] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:12:45.409848 21390 raft_consensus.cc:2889] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:45.412763 21390 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:45.416785 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:45.419596 21389 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:12:45.422544 21392 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:45.421870 21389 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:12:45.425264 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.428210 21392 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:45.429040 21389 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:12:45.429804 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.436492 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:45.437117 21317 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:45.436051 27547 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:12:45.439985 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.440752 21315 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:45.441736 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.442842 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.443095 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 994) took 1076 ms. Trace:
I20260709 13:12:45.443533 21318 rpcz_store.cc:276] 0709 13:12:44.366703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.082032 (+715329us) service_pool.cc:224] Handling call
0709 13:12:45.119791 (+ 37759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.186406 (+ 66615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.186453 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.197044 (+ 10591us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.333928 (+136884us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:45.333969 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.334042 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.442868 (+108826us) raft_consensus.cc:1685] finished
0709 13:12:45.442890 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.443034 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64734,"raft.queue_time_us":63977,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11561,"thread_start_us":100353,"threads_started":1,"wal-append.queue_time_us":167021}
W20260709 13:12:45.447718 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.448801 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:45.449447 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.422343 27811 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:45.452805 27809 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.412350 27805 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:45.453336 27809 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.453488 27805 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.453670 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.455437 27809 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:45.456022 27776 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:45.440049 27160 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:45.456588 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:45.456954 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47682 (request call id 6) took 1151 ms. Trace:
I20260709 13:12:45.457309 21468 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:45.457558 21388 rpcz_store.cc:276] 0709 13:12:44.305827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.305969 (+   142us) service_pool.cc:224] Handling call
0709 13:12:45.452582 (+1146613us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54000f19d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21e735 00007fc2bf2169fa 00007fc2c41de4c9 00007fc2bd75ac54 00007fc2bd75abe2 00007fc2bd75ab11 00007fc2bd75aa8c 00007fc2bd759d42 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:45.456845 (+  4263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887460608}
I20260709 13:12:45.460469 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:45.461122 21465 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.461923 21318 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:45.462306 21318 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:45.469822 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:45.467340 21318 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.490693 21468 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:12:45.489585 21318 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:45.471397 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:45.488830 21465 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:45.496636 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.501617 21389 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:45.503275 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:45.506098 21464 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:12:45.422693 27755 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 13:12:45.510520 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:45.509053 21467 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:12:45.512368 21317 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:45.416381 27781 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:45.512670 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 387825us
I20260709 13:12:45.455456 27805 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.518138 21464 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:45.489312 27794 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.470304 27842 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:45.519847 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:45.525609 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 76870.2us
I20260709 13:12:45.526170 21394 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:45.520481 27793 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:45.521494 27637 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:45.526786 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 55453.2us
I20260709 13:12:45.528314 21394 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:45.492004 27811 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:12:45.535290 21464 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:45.538405 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:45.521947 27718 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:45.543076 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:45.545225 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:45.514263 27719 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:12:45.529510 27724 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:45.550722 27620 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.559558 27808 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:45.533695 27802 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:45.518683 27645 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:12:45.523253 27618 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.582484 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.541929 27718 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:45.548695 27776 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.549167 27842 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:45.601409 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 71328.3us
I20260709 13:12:45.550966 27758 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:45.602347 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 54598.3us
I20260709 13:12:45.603152 21387 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:45.604709 21392 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:12:45.528393 27794 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.533545 27704 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.063s
W20260709 13:12:45.590396 22002 connection.cc:256] RPC call timeout handler was delayed by -1.0473067810000884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:12:45.615134 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:45.615778 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:45.601446 21317 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:45.559685 27620 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.621349 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:45.561199 27724 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.631363 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:45.597015 27816 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:45.635043 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:45.636214 27724 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:45.636051 21204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d41c71e861344f0b90e8d44a8d0a3173 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:45.637625 27810 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.638993 21394 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:45.631362 27759 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:12:45.634084 21467 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:45.646747 27724 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.601423 27784 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:45.608911 27718 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:45.650434 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 99120.9us
I20260709 13:12:45.652421 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:45.653623 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:45.653903 22041 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:45.649420 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:45.662894 21461 raft_consensus.cc:2376] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17. Re-sending same reply.
I20260709 13:12:45.652640 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.549959 27612 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.669812 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.600548 27802 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:45.655725 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:45.653517 27586 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:45.672562 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:45.672925 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:45.673696 22035 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 13: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:45.672598 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:45.678310 27810 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.678431 27858 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.678687 27586 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:45.679129 27586 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.678994 27858 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.679533 27586 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:45.681285 27858 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:45.682399 27724 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:45.683018 27724 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:45.683465 27724 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:45.630816 27793 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:45.684919 27793 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.623778 27841 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.656700 27784 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.699352 21390 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:45.698338 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 65654.6us
W20260709 13:12:45.693343 27839 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:45.667039 27816 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:45.628262 27758 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.622287 27776 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:45.698432 27829 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.908s	user 0.005s	sys 0.000s
I20260709 13:12:45.677672 27802 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:45.705335 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:45.650280 27807 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:12:45.649667 27813 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:12:45.710443 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:45.717824 27776 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.703752 27784 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:45.735921 27787 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:45.738211 27423 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:45.738687 27423 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:45.721088 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.722025 22038 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:12:45.740458 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1056) took 1321 ms. Trace:
I20260709 13:12:45.740924 21463 rpcz_store.cc:276] 0709 13:12:44.418751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.418894 (+   143us) service_pool.cc:224] Handling call
0709 13:12:45.740259 (+1321365us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54004303d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:45.740399 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255892352}
I20260709 13:12:45.725062 21387 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 11.
I20260709 13:12:45.726804 27620 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:45.749301 27862 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:45.749835 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44575us
I20260709 13:12:45.750133 27790 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.751046 27807 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:45.751319 27862 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:45.733188 27612 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.751574 27807 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:45.728497 27855 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:12:45.740469 21317 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:45.759505 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:45.695102 27808 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:45.765268 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.765879 27861 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:12:45.766240 27819 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:45.767089 27819 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.767488 27819 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:45.780298 21313 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:45.771520 21318 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:12:45.768935 27586 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.781955 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2905) took 1358 ms. Trace:
I20260709 13:12:45.782495 21393 rpcz_store.cc:276] 0709 13:12:44.423279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.572135 (+148856us) service_pool.cc:224] Handling call
0709 13:12:44.572484 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.608494 (+ 36010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.608528 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:44.609084 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.682353 (+ 73269us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:44.682400 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.682476 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.685579 (+1003103us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:45.781617 (+ 96038us) raft_consensus.cc:1685] finished
0709 13:12:45.781650 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.781869 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1616,"raft.queue_time_us":6182,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":16504,"spinlock_wait_cycles":119144832,"thread_start_us":22030,"threads_started":1,"wal-append.queue_time_us":92349}
I20260709 13:12:45.783342 27808 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.784974 27784 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.787335 27784 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.739532 27423 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.788846 27160 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:45.789249 27160 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:45.789572 27423 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:45.790131 27160 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.791747 22041 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:45.721410 27864 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:45.766492 27859 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:12:45.740928 27618 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:45.760300 27612 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.759483 27428 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.759938 27647 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:45.768909 27781 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:45.783285 27586 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:45.797818 27790 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:45.798365 27460 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:12:45.721275 27724 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:45.834976 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.722651 27816 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.721675 27842 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.831199 27864 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.830993 27784 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:45.806170 27612 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.837368 27790 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:45.810447 27428 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:45.871060 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 217512us
I20260709 13:12:45.879819 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:45.838233 27802 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.881839 21314 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:12:45.883198 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 172036us
I20260709 13:12:45.889453 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 991) took 1523 ms. Trace:
I20260709 13:12:45.892752 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1298) took 1581 ms. Trace:
I20260709 13:12:45.893326 21396 rpcz_store.cc:276] 0709 13:12:44.311582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.312159 (+   577us) service_pool.cc:224] Handling call
0709 13:12:44.312448 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:45.264746 (+952298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.892429 (+627683us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54002cdb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:45.892674 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188507904}
I20260709 13:12:45.890058 21312 rpcz_store.cc:276] 0709 13:12:44.366004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.710573 (+344569us) service_pool.cc:224] Handling call
0709 13:12:44.998653 (+288080us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.999156 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.999194 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:44.999737 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.187873 (+188136us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:45.213649 (+ 25776us) log.cc:844] Serialized 14 byte log entry
0709 13:12:45.215521 (+  1872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.215628 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.268820 (+ 53192us) raft_consensus.cc:1685] finished
0709 13:12:45.268841 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.889178 (+620337us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54003ca0d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:45.889358 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5806,"prepare.queue_time_us":25495,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":1925,"raft.queue_time_us":3621,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":34654,"spinlock_wait_cycles":661675776,"thread_start_us":187679,"threads_started":1,"wal-append.queue_time_us":236996}
W20260709 13:12:45.874131 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 203112us
I20260709 13:12:45.873618 27794 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:45.899890 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.870962 27784 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.907475 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.864073 27807 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:45.903926 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 153320us
I20260709 13:12:45.919731 21396 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:12:45.902176 27647 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:45.923736 21396 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:12:45.920233 27620 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:45.927270 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:45.929529 21396 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:45.932561 21393 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:12:45.905231 27586 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:12:45.905440 27645 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:12:45.938019 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:45.908454 27808 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:45.912189 27861 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:12:45.941116 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:45.910501 27794 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:12:45.943575 21391 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:45.914582 27819 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.924212 27647 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:45.934319 27620 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.947038 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:45.920111 27809 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:12:45.866695 27864 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:45.963081 21396 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:45.967602 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:45.968325 21312 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:45.970005 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:45.970304 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 68674us
I20260709 13:12:45.953318 27620 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:45.947913 27647 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:45.981844 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:45.990202 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1303) took 1102 ms. Trace:
I20260709 13:12:45.990788 21390 rpcz_store.cc:276] 0709 13:12:44.887827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.421687 (+533860us) service_pool.cc:224] Handling call
0709 13:12:45.421937 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:45.704233 (+282296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.986038 (+281805us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540017edd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:45.990114 (+  4076us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637586176}
I20260709 13:12:45.993350 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:45.996490 21391 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:12:45.996380 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:45.997851 21389 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.001428 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:46.004474 22038 raft_consensus.cc:1275] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:45.994239 21393 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:45.969301 27643 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.007237 27643 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:46.008330 27790 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:46.009312 27643 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:46.010095 27428 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:46.005236 27624 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:12:45.977872 27776 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:46.012006 27776 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.012598 27776 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:45.966728 27869 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:12:45.947496 27793 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:12:46.019006 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 95961.9us
I20260709 13:12:46.025342 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:46.025465 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:46.019721 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:46.026315 21312 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:45.906862 27866 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:12:46.033152 21319 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:12:46.033368 21388 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:46.022532 21396 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:46.028261 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:46.028434 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:46.025749 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43974.7us
I20260709 13:12:46.029227 21467 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:46.036911 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:46.030148 27867 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:46.044958 27867 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.045406 27867 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.045663 21312 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:46.046559 27804 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.047037 27804 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:46.050972 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3179) took 1795 ms. Trace:
I20260709 13:12:46.051425 21313 rpcz_store.cc:276] 0709 13:12:44.255916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.506636 (+250720us) service_pool.cc:224] Handling call
0709 13:12:46.050768 (+1544132us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54003f5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:46.050911 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862048512}
I20260709 13:12:46.052613 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:46.053716 27824 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:46.054142 27824 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:46.054208 21318 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:12:46.055078 27824 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:46.021250 27135 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:12:46.057785 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:46.058007 27135 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:46.058426 27135 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:46.058743 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:46.059080 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:46.031443 27870 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:12:46.006660 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:46.029953 27794 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:46.037621 22034 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:46.037679 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:46.038882 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:46.040091 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:46.059816 27811 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:46.042479 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:46.026930 27793 consensus_queue.cc:1243] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:45.977798 27718 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:46.064800 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.065910 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:46.066751 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:46.078469 21462 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:46.079319 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.079384 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 179554us
I20260709 13:12:46.080176 21469 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 7.
I20260709 13:12:46.081254 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.081384 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:46.053753 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:46.041591 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:46.059188 27135 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:46.069625 21317 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:46.095189 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.070708 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:46.068989 21389 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:46.096419 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.060129 27624 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.026741 27871 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.076299 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.077692 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:46.080629 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.094691 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.103138 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.103766 21467 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:46.104570 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:46.071651 27841 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:46.105484 21319 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:46.108942 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:46.109123 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:46.078471 27794 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:46.081179 27586 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:46.113874 21467 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:46.075853 27612 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:46.113906 21319 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:12:46.121819 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:46.097111 27824 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:46.132889 21461 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:12:46.133437 21317 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:46.123932 21436 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:46.124334 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.081576 27811 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:46.139629 21462 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:46.141405 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:46.111984 27871 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:46.143172 27811 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:46.144595 21468 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:46.145673 27871 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:46.129477 27612 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:46.146873 27612 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:46.147291 27612 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.148670 27794 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:46.127580 27784 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:46.129731 27618 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:46.184700 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:46.184836 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:46.113842 27547 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:12:46.231189 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:46.231899 21394 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:46.158818 27871 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:46.229358 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:46.180675 27868 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:12:46.110158 27624 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:46.242533 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.243845 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:46.155092 27620 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:46.284575 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:46.195281 27869 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:12:46.182057 27792 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:12:46.152879 27874 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:12:46.310967 21470 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:46.230610 27618 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:46.309962 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 174822us
I20260709 13:12:46.327833 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:46.332937 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 103549us
I20260709 13:12:46.343219 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:46.290627 27547 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:46.286160 27586 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:46.369400 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:46.297595 27864 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:46.375183 22040 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
W20260709 13:12:46.376736 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 49006.1us
I20260709 13:12:46.302986 27668 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:46.312265 27794 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:46.397553 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.373344 27875 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:46.415205 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:46.377864 27724 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:46.426996 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:46.433017 27814 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.433665 27814 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:46.391465 27884 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:46.437000 27879 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:12:46.437153 27816 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:46.438728 27887 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:12:46.439291 27618 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:46.413908 27668 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:46.440531 27883 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:12:46.441790 27423 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.002s
I20260709 13:12:46.442258 27668 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:46.442361 27620 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:46.444160 27547 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.444797 27547 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:46.445749 27758 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:46.447239 27547 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:46.447614 27801 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:12:46.448014 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:46.448987 27893 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:46.449805 27893 consensus_queue.cc:1243] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:12:46.436252 27704 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:46.433228 27878 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:12:46.482849 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:46.486877 22040 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:46.397691 27864 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:46.484454 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.485245 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:46.417626 27718 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:46.419885 27875 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:46.496338 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:46.497781 22032 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:12:46.536803 22034 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
W20260709 13:12:46.500749 27886 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:12:46.500819 27892 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:46.502358 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:47.944847 22042 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:47.945724 27918 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:47.946357 27918 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:47.948712 27918 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:47.952841 27918 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.509958 27804 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:47.954165 27918 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:47.955559 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.510550 27586 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:47.956152 27918 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:47.957265 22042 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
W20260709 13:12:47.958022 22042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1523) took 1475 ms (client timeout 1752 ms). Trace:
W20260709 13:12:47.958494 22042 rpcz_store.cc:269] 0709 13:12:46.482370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.482500 (+   130us) service_pool.cc:224] Handling call
0709 13:12:47.957912 (+1475412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:46.506348 27612 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:46.485869 27884 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:46.530242 27168 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:47.960687 27612 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:47.960855 27168 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:46.430279 27877 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
W20260709 13:12:46.499060 27882 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:12:47.962258 27884 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:46.502295 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:48.072813 21390 raft_consensus.cc:2410] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:12:48.073310 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 1314) took 1589 ms. Trace:
I20260709 13:12:48.073597 21390 rpcz_store.cc:276] 0709 13:12:46.483601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.483754 (+   153us) service_pool.cc:224] Handling call
0709 13:12:48.073250 (+1589496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.074245 27920 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.074805 27920 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.075814 27889 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.076376 27889 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.078167 27807 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:48.078748 27889 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.078718 27807 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:46.534711 22041 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:46.491181 27864 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.081992 27864 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:48.083122 22041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1584) took 2050 ms (client timeout 2080 ms). Trace:
I20260709 13:12:48.085812 27811 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.086369 27811 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.088287 27792 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:46.523941 22035 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:46.535291 22039 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
W20260709 13:12:48.171316 22039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1590) took 1976 ms (client timeout 1564 ms). Trace:
I20260709 13:12:46.529120 22040 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
W20260709 13:12:48.173784 22040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1594) took 1772 ms (client timeout 1575 ms). Trace:
W20260709 13:12:48.174139 22040 rpcz_store.cc:269] 0709 13:12:46.401436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.421943 (+ 20507us) service_pool.cc:224] Handling call
0709 13:12:48.173714 (+1751771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.175124 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:46.552174 27867 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.002s
I20260709 13:12:48.176421 27813 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:48.176942 27867 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.177073 27813 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.179138 27867 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:46.603382 27624 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:46.606765 27816 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:46.595428 27875 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:46.611537 27776 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
W20260709 13:12:48.171725 22039 rpcz_store.cc:269] 0709 13:12:46.194915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.195171 (+   256us) service_pool.cc:224] Handling call
0709 13:12:48.171126 (+1975955us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400614754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:48.171247 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477109504}
W20260709 13:12:47.137596 27601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.020s	sys 0.078s
I20260709 13:12:47.764640 27160 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:48.181854 27601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.549s	user 0.020s	sys 0.078s
W20260709 13:12:47.138165 27846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.018s	sys 0.081s
W20260709 13:12:48.183223 27846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.553s	user 0.018s	sys 0.081s
W20260709 13:12:47.801074 21388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.477s	user 0.007s	sys 0.016s
I20260709 13:12:47.821662 27865 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:47.836318 27863 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:47.827320 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:47.859134 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2867) took 1797 ms (client timeout 1903 ms). Trace:
W20260709 13:12:47.868566 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.693s	user 0.011s	sys 0.026s
I20260709 13:12:47.926970 27460 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.927904 27428 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:48.190488 21388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.867s	user 0.008s	sys 0.017s
I20260709 13:12:48.186683 27865 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:47.933192 27917 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.481746 27618 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.191366 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2936) took 2143 ms. Trace:
I20260709 13:12:47.953374 27802 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:47.960300 27919 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.192121 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1292) took 3890 ms. Trace:
I20260709 13:12:48.192068 27428 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:46.524233 27647 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.500s	user 0.004s	sys 0.006s
I20260709 13:12:48.192591 27919 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.193380 27647 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.195333 27919 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:47.961817 27168 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.186772 27863 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:48.196624 27168 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:48.197193 27858 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.197736 27858 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.198200 27841 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.198896 27428 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:47.963215 27757 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.197198 27863 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.199643 27757 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.200237 27863 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:48.201730 27784 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.202225 27784 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.204205 27884 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.204888 27884 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.191779 21388 rpcz_store.cc:276] 0709 13:12:46.048144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.070311 (+ 22167us) service_pool.cc:224] Handling call
0709 13:12:46.080676 (+ 10365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.242991 (+162315us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:46.243068 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.251859 (+  8791us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.190961 (+1939102us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:48.191008 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.191124 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.191164 (+    40us) raft_consensus.cc:1685] finished
0709 13:12:48.191175 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.191287 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699,"raft.queue_time_us":27356,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":16247,"thread_start_us":2014658,"threads_started":2,"wal-append.queue_time_us":852531,"wal-append.run_cpu_time_us":2070,"wal-append.run_wall_time_us":1008864}
I20260709 13:12:48.192953 27460 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.207175 27884 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.192644 21395 rpcz_store.cc:276] 0709 13:12:44.301628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.301842 (+   214us) service_pool.cc:224] Handling call
0709 13:12:44.335827 (+ 33985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.380086 (+ 44259us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:12:44.380400 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:12:44.503599 (+123199us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.843566 (+1339967us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b1800375d60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a
0709 13:12:48.158656 (+2315090us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:12:48.159104 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.176253 (+ 17149us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:48.176298 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.179812 (+  3514us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.191824 (+ 12012us) raft_consensus.cc:1685] finished
0709 13:12:48.191843 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.192060 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1104,"prepare.queue_time_us":1693,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":2621,"raft.queue_time_us":60179,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":7205,"spinlock_wait_cycles":68412672,"thread_start_us":183274,"threads_started":3,"wal-append.queue_time_us":205022,"wal-append.run_cpu_time_us":1480,"wal-append.run_wall_time_us":1050125}
I20260709 13:12:47.965492 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2935) took 1917 ms. Trace:
I20260709 13:12:47.972361 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2934) took 1925 ms. Trace:
I20260709 13:12:47.974359 27819 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:47.980293 27877 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:48.208694 27877 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:48.209540 22034 pending_rounds.cc:85] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 12
I20260709 13:12:48.207908 21392 rpcz_store.cc:276] 0709 13:12:46.047694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.054769 (+  7075us) service_pool.cc:224] Handling call
0709 13:12:46.055064 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.055464 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:46.055493 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.055946 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.122246 (+ 66300us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:46.122292 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.122371 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:47.965196 (+1842825us) raft_consensus.cc:1685] finished
0709 13:12:47.965226 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.965413 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1691,"raft.run_cpu_time_us":42,"raft.run_wall_time_us":42,"thread_start_us":24395,"threads_started":1,"wal-append.queue_time_us":131230,"wal-append.run_cpu_time_us":3458,"wal-append.run_wall_time_us":1361697}
I20260709 13:12:48.209851 22034 pending_rounds.cc:107] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:12:48.209717 27877 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:47.986903 27135 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:48.210721 27918 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:48.211011 27877 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:48.211251 27918 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:47.980737 27922 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.212294 27922 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.213796 27918 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.214365 27918 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.214586 27922 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.026995 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3207) took 2266 ms. Trace:
I20260709 13:12:48.039067 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2939) took 1960 ms. Trace:
I20260709 13:12:48.215333 21314 rpcz_store.cc:276] 0709 13:12:45.760983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.761209 (+   226us) service_pool.cc:224] Handling call
0709 13:12:45.792358 (+ 31149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:45.882298 (+ 89940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.026744 (+2144446us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b5400227c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:48.026934 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204882688}
I20260709 13:12:48.063323 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.215396 21394 rpcz_store.cc:276] 0709 13:12:46.078208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.232795 (+154587us) service_pool.cc:224] Handling call
0709 13:12:46.251619 (+ 18824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.330529 (+ 78910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.330779 (+   250us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.333424 (+  2645us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.378024 (+ 44600us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:46.378089 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.378213 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.038796 (+1660583us) raft_consensus.cc:1685] finished
0709 13:12:48.038817 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.038993 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":180838,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"thread_start_us":120150,"threads_started":2,"wal-append.queue_time_us":218259,"wal-append.run_cpu_time_us":2370,"wal-append.run_wall_time_us":1037852}
I20260709 13:12:46.501771 21463 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:48.244892 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1071) took 1761 ms. Trace:
I20260709 13:12:48.245265 21463 rpcz_store.cc:276] 0709 13:12:46.483074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.483243 (+   169us) service_pool.cc:224] Handling call
0709 13:12:46.501433 (+ 18190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.244596 (+1743163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.244829 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.092013 21462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:48.246359 21462 raft_consensus.cc:606] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:48.083587 22041 rpcz_store.cc:269] 0709 13:12:46.033066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.033218 (+   152us) service_pool.cc:224] Handling call
0709 13:12:48.082937 (+2049719us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:48.083055 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037480320}
I20260709 13:12:48.247402 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.248505 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.249063 22041 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:48.119622 27920 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.123054 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2315) took 2098 ms. Trace:
I20260709 13:12:48.250886 21468 rpcz_store.cc:276] 0709 13:12:46.024392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.026100 (+  1708us) service_pool.cc:224] Handling call
0709 13:12:46.028664 (+  2564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:46.144939 (+116275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.122770 (+1977831us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000b7f54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:48.122987 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265858304}
W20260709 13:12:48.125566 21359 connection.cc:256] RPC call timeout handler was delayed by -1.3111722699999291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:12:48.130903 21389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.809s	user 0.008s	sys 0.015s
I20260709 13:12:48.132194 27928 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.252332 27928 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:48.134052 21284 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.650s	user 0.016s	sys 0.032s
I20260709 13:12:48.136739 27927 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.140014 27930 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.147557 27931 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:48.148168 22002 connection.cc:256] RPC call timeout handler was delayed by -1.0191333499999473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:12:48.254035 21389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.947s	user 0.009s	sys 0.016s
I20260709 13:12:48.152969 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 2938) took 2075 ms. Trace:
I20260709 13:12:48.254992 21387 rpcz_store.cc:276] 0709 13:12:46.077917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.154811 (+ 76894us) service_pool.cc:224] Handling call
0709 13:12:46.195587 (+ 40776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.195917 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.195946 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.229994 (+ 34048us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.389066 (+159072us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:46.389187 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.389259 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.152703 (+1763444us) raft_consensus.cc:1685] finished
0709 13:12:48.152728 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.152905 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":184006,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":14225,"thread_start_us":63486,"threads_started":1,"wal-append.queue_time_us":198159,"wal-append.run_cpu_time_us":2408,"wal-append.run_wall_time_us":1107469}
I20260709 13:12:48.255982 27930 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:48.155485 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.970s	user 0.018s	sys 0.013s
W20260709 13:12:48.256901 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.071s	user 0.018s	sys 0.013s
I20260709 13:12:48.257319 27928 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.187235 22032 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:48.258208 27930 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.258432 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1528) took 1720 ms. Trace:
I20260709 13:12:48.258882 22032 rpcz_store.cc:276] 0709 13:12:46.537616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.826701 (+1289085us) service_pool.cc:224] Handling call
0709 13:12:48.258357 (+431656us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.258944 27927 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.260012 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:48.260936 27927 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.261436 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.262621 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:47.850065 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 1.31757e+06us
W20260709 13:12:48.187005 21470 rpcz_store.cc:269] 0709 13:12:46.061612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.094325 (+ 32713us) service_pool.cc:224] Handling call
0709 13:12:47.858895 (+1764570us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400248bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:47.859062 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469964032}
W20260709 13:12:48.188153 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.013s	user 0.011s	sys 0.026s
W20260709 13:12:48.265281 21284 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.781s	user 0.017s	sys 0.033s
W20260709 13:12:48.265661 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 1.78167e+06us
I20260709 13:12:48.210184 22034 raft_consensus.cc:2889] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:48.208168 21393 rpcz_store.cc:276] 0709 13:12:46.047346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.052140 (+  4794us) service_pool.cc:224] Handling call
0709 13:12:46.052487 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.052828 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.052856 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.053290 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.155957 (+102667us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:46.155996 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.156081 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:47.972088 (+1816007us) raft_consensus.cc:1685] finished
0709 13:12:47.972124 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.972291 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4083,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":102331,"threads_started":1,"wal-append.queue_time_us":187142}
W20260709 13:12:48.028925 27888 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.631s	user 0.003s	sys 0.001s
I20260709 13:12:48.029332 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3361) took 1982 ms. Trace:
I20260709 13:12:48.273130 27919 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:48.260342 27931 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.274264 27919 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.273331 21312 rpcz_store.cc:276] 0709 13:12:46.047151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.127377 (+ 80226us) service_pool.cc:224] Handling call
0709 13:12:46.127845 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:46.156173 (+ 28328us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:48.015513 (+1859340us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b180011a520. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2c2c103c7 00007fc2bf2229a7 00007fc2bf2320bf
0709 13:12:48.015704 (+   191us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.026771 (+ 11067us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:48.027369 (+   598us) log.cc:844] Serialized 52 byte log entry
0709 13:12:48.027528 (+   159us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:48.027563 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.027638 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.028984 (+  1346us) raft_consensus.cc:1685] finished
0709 13:12:48.029075 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.029265 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24812,"prepare.queue_time_us":215692,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":16965,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":7110,"spinlock_wait_cycles":10819456,"thread_start_us":204786,"threads_started":2,"wal-append.queue_time_us":9243}
I20260709 13:12:48.070456 21433 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:48.276203 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 205801us
I20260709 13:12:48.276746 27931 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.277303 27931 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.277530 27919 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.277761 27931 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.217731 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:48.280186 22040 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:48.197239 22031 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:48.191653 27917 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.219753 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.284899 22039 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 9.
I20260709 13:12:48.286937 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:48.223476 21469 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:12:48.207470 27460 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.208225 27612 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.463874 27819 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:48.464263 27612 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:47.962891 27755 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.466682 27755 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.469086 27755 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.180780 27776 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.198742 27841 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.472761 27776 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.130332 27645 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:48.475431 27645 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:48.195562 27647 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.117409 27807 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.118139 27811 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.479928 27811 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.480525 27811 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.141670 27814 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.191613 27865 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.222703 27757 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:48.150316 27872 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 2.239s	user 0.007s	sys 0.005s
I20260709 13:12:48.191761 27618 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.525446 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3206) took 2771 ms. Trace:
I20260709 13:12:48.199538 27428 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.526471 27618 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.526724 27428 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.525859 21321 rpcz_store.cc:276] 0709 13:12:45.753630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.753751 (+   121us) service_pool.cc:224] Handling call
0709 13:12:45.767037 (+ 13286us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:45.767432 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.767462 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:12:45.768168 (+   706us) log.cc:844] Serialized 78 byte log entry
0709 13:12:45.908042 (+139874us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:45.921982 (+ 13940us) log.cc:844] Serialized 14 byte log entry
0709 13:12:45.933896 (+ 11914us) log.cc:844] Serialized 14 byte log entry
0709 13:12:45.934102 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.934177 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.040984 (+106807us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b18004753c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1
0709 13:12:46.041565 (+   581us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18004753c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:46.291930 (+250365us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18004753c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240
0709 13:12:48.149693 (+1857763us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:48.525202 (+375509us) raft_consensus.cc:1685] finished
0709 13:12:48.525226 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.525383 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11486,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":21718,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":16198,"spinlock_wait_cycles":31218560,"thread_start_us":139451,"threads_started":1,"wal-append.queue_time_us":143087}
I20260709 13:12:48.207718 27884 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.528913 27428 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.239037 22038 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:48.529178 27884 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.249861 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:48.257483 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 2.07261e+06us
I20260709 13:12:48.531188 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.532305 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.533331 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:48.268826 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.534127 22041 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:48.535143 22041 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:12:48.535230 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.536343 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.536368 22041 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:48.167618 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 959) took 1679 ms. Trace:
I20260709 13:12:48.541997 22035 rpcz_store.cc:276] 0709 13:12:46.487942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.523263 (+ 35321us) service_pool.cc:224] Handling call
0709 13:12:46.523573 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.167247 (+1643674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.167540 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.214820 27918 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.544783 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:48.297351 21393 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:48.297242 21284 connection.cc:256] RPC call timeout handler was delayed by -1.7690072700000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 13:12:48.299422 21387 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:48.546883 21284 connection.cc:256] RPC call timeout handler was delayed by -1.6943072700000812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:12:48.547047 27460 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:48.547365 21284 connection.cc:256] RPC call timeout handler was delayed by -1.6339876629999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 13:12:48.547467 27460 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.547827 27460 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:48.548123 21284 connection.cc:256] RPC call timeout handler was delayed by -1.2640876630000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
I20260709 13:12:48.299544 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:48.548962 21395 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:48.301398 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:48.549723 22040 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:48.306665 21463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:48.309094 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.551116 22039 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:12:48.285979 27928 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.317652 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:48.551851 21316 raft_consensus.cc:2393] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:48.324497 27920 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:48.326722 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:48.554409 21388 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:48.327879 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:48.307806 27922 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:48.306248 27931 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:48.336301 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 72578.9us
I20260709 13:12:48.343508 27917 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.357883 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1522) took 2278 ms. Trace:
I20260709 13:12:48.347900 27934 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.347000 27937 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.350912 27808 raft_consensus.cc:2804] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:12:48.366844 21469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2873) took 2303 ms (client timeout 1575 ms). Trace:
I20260709 13:12:48.380748 27875 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:48.386340 27942 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.390026 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1310) took 2292 ms. Trace:
I20260709 13:12:48.391566 27858 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.395213 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:48.396534 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.397316 27863 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:48.573755 27863 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.576373 27942 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.578040 27863 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.405256 27816 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.407712 27947 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.409291 27948 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.410230 27160 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.413077 27168 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:48.582947 27168 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.414700 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.414821 27624 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.584299 21312 raft_consensus.cc:2410] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:12:48.551615 27807 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:12:48.584343 27816 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.585434 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.585978 21312 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:48.586655 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.587348 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.415383 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.416647 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.419672 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.419656 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.420662 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.429479 27813 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.437767 27784 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.588820 21320 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:48.585106 21218 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:48.456578 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1527) took 1947 ms. Trace:
I20260709 13:12:48.633432 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.633646 22034 rpcz_store.cc:276] 0709 13:12:46.509545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.208949 (+1699404us) service_pool.cc:224] Handling call
0709 13:12:48.209337 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:48.287878 (+ 78541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.287935 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:48.295845 (+  7910us) log.cc:844] Serialized 52 byte log entry
0709 13:12:48.362570 (+ 66725us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:48.451785 (+ 89215us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.452869 (+  1084us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.456249 (+  3380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.456339 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.456381 (+    42us) raft_consensus.cc:1685] finished
0709 13:12:48.456392 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.456527 (+   135us) inbound_call.cc:177] Queueing success response
0709 13:12:48.494050 (+ 37523us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b1800411e80. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
Metrics: {"mutex_wait_us":6645,"prepare.queue_time_us":64034,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":19054,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":7129,"spinlock_wait_cycles":4287360,"thread_start_us":117221,"threads_started":2,"wal-append.queue_time_us":76216}
I20260709 13:12:48.470705 27612 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:48.472877 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.474431 27841 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.557469 27928 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:48.482846 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 65068.7us
I20260709 13:12:48.644259 27928 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.644826 21387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:12:48.645388 21387 raft_consensus.cc:606] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Received request to transfer leadership
I20260709 13:12:48.645748 21387 raft_consensus.cc:614] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:48.644286 22041 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:12:48.497597 27811 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.503392 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:48.513072 21360 connection.cc:256] RPC call timeout handler was delayed by -1.7120995300000459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:12:48.646984 21360 connection.cc:256] RPC call timeout handler was delayed by -1.6058995299999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:12:48.647459 21360 connection.cc:256] RPC call timeout handler was delayed by -1.4870995300000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:12:48.647758 21360 connection.cc:256] RPC call timeout handler was delayed by -1.4402995299999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:12:48.648015 21360 connection.cc:256] RPC call timeout handler was delayed by -1.3241995299999871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:12:48.648306 21360 connection.cc:256] RPC call timeout handler was delayed by -1.2559729279998919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:12:48.648555 21360 connection.cc:256] RPC call timeout handler was delayed by -1.2413584739999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:12:48.648811 21360 connection.cc:256] RPC call timeout handler was delayed by -1.2179995300000428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:12:48.649063 21360 connection.cc:256] RPC call timeout handler was delayed by -1.186914283999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
I20260709 13:12:48.649293 27811 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.649857 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:48.649987 27811 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.650977 27841 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:48.651368 27841 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.651729 27841 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.515930 27865 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:48.600538 27947 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:48.652618 21204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d41c71e861344f0b90e8d44a8d0a3173 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:12:48.533325 22038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1585) took 2498 ms (client timeout 1833 ms). Trace:
W20260709 13:12:48.283742 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.537353 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.538254 21315 raft_consensus.cc:1217] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Deduplicated request from leader. Original: 15.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:12:48.542117 27428 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:48.546612 27918 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:48.548467 21284 connection.cc:256] RPC call timeout handler was delayed by -1.111115891000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:12:48.720578 21219 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 288) took 26638 ms (client timeout 15000 ms). Trace:
W20260709 13:12:48.720950 21284 connection.cc:256] RPC call timeout handler was delayed by -1.0085072699999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29950000000000004s for a response
W20260709 13:12:48.317970 21359 connection.cc:256] RPC call timeout handler was delayed by -1.0888722700000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:12:48.723374 21359 connection.cc:256] RPC call timeout handler was delayed by -1.0538299779999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 13:12:48.311643 27939 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.327083 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:48.725947 21390 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:48.555632 21396 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:12:48.727576 21470 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:48.728186 27135 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.728622 27135 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:48.555879 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.733332 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.734550 21467 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:48.556656 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.560421 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.736439 21316 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
W20260709 13:12:48.566804 22002 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.129s (SENT)
W20260709 13:12:48.566949 21469 rpcz_store.cc:269] 0709 13:12:46.063174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.081175 (+ 18001us) service_pool.cc:224] Handling call
0709 13:12:48.366534 (+2285359us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b5400216454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:48.366719 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4924119936}
I20260709 13:12:48.562924 22031 rpcz_store.cc:276] 0709 13:12:46.074761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.074907 (+   146us) service_pool.cc:224] Handling call
0709 13:12:46.075940 (+  1033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.280999 (+2205059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.352922 (+ 71923us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b540052b054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:48.353210 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4878140800}
I20260709 13:12:48.568197 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:48.570093 22040 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:48.531199 27884 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.572849 21391 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:48.403836 27945 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.570961 21389 rpcz_store.cc:276] 0709 13:12:46.097977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.305538 (+207561us) service_pool.cc:224] Handling call
0709 13:12:46.306035 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.254510 (+1948475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.254543 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.258312 (+  3769us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.338055 (+ 79743us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:48.338119 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.338201 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.389677 (+ 51476us) raft_consensus.cc:1685] finished
0709 13:12:48.389711 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.389938 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175078,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7923,"thread_start_us":2026280,"threads_started":2,"wal-append.queue_time_us":129550}
I20260709 13:12:48.553862 27618 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.554080 27862 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.557219 27935 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:48.588531 21317 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:48.588034 21314 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.756981 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.757758 21317 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:48.754343 27945 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.588541 21318 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:48.759095 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.760120 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.760838 21321 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:48.762817 21392 raft_consensus.cc:2410] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:12:48.590466 27168 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.561223 27757 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:12:48.581293 27942 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.456173 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1526) took 1962 ms. Trace:
I20260709 13:12:48.600538 21463 raft_consensus.cc:606] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:48.601536 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.579493 27937 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.124085 27864 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.771121 27935 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.495025 27645 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.585001 27808 raft_consensus.cc:697] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:48.649359 21360 connection.cc:256] RPC call timeout handler was delayed by -1.1545142839999016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 13:12:48.707257 21395 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:48.654249 27947 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:48.702278 22038 rpcz_store.cc:269] 0709 13:12:46.034697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.034811 (+   114us) service_pool.cc:224] Handling call
0709 13:12:48.533110 (+2498299us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54006c5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:48.533230 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4896752896}
W20260709 13:12:48.869024 21360 connection.cc:256] RPC call timeout handler was delayed by -1.1140119229999073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 13:12:48.869478 21360 connection.cc:256] RPC call timeout handler was delayed by -1.0589681399999336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:12:48.870205 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:48.720014 21315 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:12:48.738296 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:48.740686 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:48.741460 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.744380 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.722453 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:48.746276 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 178257us
W20260709 13:12:48.872450 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 150132us
I20260709 13:12:48.873363 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:48.746973 27135 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:48.747759 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.749645 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.745661 21218 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.875072 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:48.745040 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 135610us
I20260709 13:12:48.877090 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:48.877784 21395 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
W20260709 13:12:48.755540 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 205162us
I20260709 13:12:48.765702 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:48.767951 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.880577 21461 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:48.769353 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.770663 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.771587 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.883539 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.884394 21469 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
W20260709 13:12:48.721077 21219 rpcz_store.cc:269] 0709 13:12:22.002732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.003422 (+   690us) service_pool.cc:224] Handling call
0709 13:12:48.640949 (+26637527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:43.756107 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:44.110365 (+354258us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:44.116631 (+  6266us) write_op.cc:435] Acquired schema lock
0709 13:12:44.118388 (+  1757us) tablet.cc:662] Decoding operations
0709 13:12:44.196543 (+ 78155us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:44.196628 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:44.196663 (+    35us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:12:44.369769 (+173106us) tablet.cc:701] Row locks acquired
0709 13:12:44.369822 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:12:44.370016 (+   194us) write_op.cc:270] Start()
0709 13:12:44.370167 (+   151us) write_op.cc:276] Timestamp: P: 1783602764369942 usec, L: 0
0709 13:12:44.370192 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:12:44.414020 (+ 43828us) log.cc:844] Serialized 11929 byte log entry
0709 13:12:45.045287 (+631267us) op_driver.cc:464] REPLICATION: finished
0709 13:12:45.356743 (+311456us) write_op.cc:301] APPLY: starting
0709 13:12:45.356862 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:45.743945 (+387083us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:45.760545 (+ 16600us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:46.626325 (+865780us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:46.628640 (+  2315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:12:46.628711 (+    71us) write_op.cc:312] APPLY: finished
0709 13:12:46.629597 (+   886us) log.cc:844] Serialized 260 byte log entry
0709 13:12:48.183647 (+1554050us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:48.183873 (+   226us) write_op.cc:454] Released schema lock
0709 13:12:48.183952 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:48.184401 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:48.184442 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1428688,"reported_tablets":48,"spinlock_wait_cycles":434944,"child_traces":[["op",{"apply.queue_time_us":295247,"apply.run_cpu_time_us":147829,"apply.run_wall_time_us":2828947,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129887,"num_ops":30,"prepare.queue_time_us":336274,"prepare.run_cpu_time_us":33895,"prepare.run_wall_time_us":846534,"raft.queue_time_us":154286,"raft.run_cpu_time_us":53898,"raft.run_wall_time_us":164394,"replication_time_us":674927,"thread_start_us":1986272,"threads_started":5,"wal-append.queue_time_us":766717,"wal-append.run_cpu_time_us":25547,"wal-append.run_wall_time_us":2353383}]]}
I20260709 13:12:48.774340 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.772316 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.803138 21463 raft_consensus.cc:614] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:48.802765 21312 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:48.887598 21318 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:12:48.888337 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.888794 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.889613 21318 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:12:48.890642 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.891527 21318 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:48.749269 27863 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.815302 21317 raft_consensus.cc:2468] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:48.892737 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.599779 27624 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.574530 27934 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.599587 27160 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.900338 22042 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:48.801421 22036 rpcz_store.cc:276] 0709 13:12:46.493379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.977351 (+1483972us) service_pool.cc:224] Handling call
0709 13:12:47.977818 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.217986 (+240168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.218014 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.218505 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.304967 (+ 86462us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:48.305024 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.453707 (+148683us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54007e0c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:48.453787 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.453856 (+    69us) raft_consensus.cc:1685] finished
0709 13:12:48.453876 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.456102 (+  2226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23038,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":551434496,"thread_start_us":86048,"threads_started":1,"wal-append.queue_time_us":128016}
I20260709 13:12:48.817062 21314 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:48.905622 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.749027 27601 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:48.906948 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.907799 21318 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:48.908906 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.909587 21318 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:48.600725 27948 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:48.821931 21359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.564s (SENT) [suppressed 9 similar messages]
W20260709 13:12:48.915033 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44972.9us
I20260709 13:12:48.645340 27816 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.823288 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:48.826033 27937 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.828811 27811 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.860347 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.929869 21467 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:12:48.930204 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.931140 21462 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:48.862352 22032 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:48.865119 27945 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:48.849291 27864 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:48.754899 27807 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.754652 27939 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.746021 27428 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.756004 27618 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.759465 27862 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.965984 21394 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:48.810637 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:48.754432 27858 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:12:48.895679 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 328886us
I20260709 13:12:48.907292 27919 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:48.968967 21321 raft_consensus.cc:2368] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:12:48.970196 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:48.971117 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.971177 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.971802 22038 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:48.972016 22040 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:48.897307 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:48.896274 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:48.898063 21218 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.915858 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:48.916395 27960 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:48.863010 27928 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:12:48.951905 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 71262us
I20260709 13:12:48.933635 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.976228 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:48.958288 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 135927us
I20260709 13:12:48.899434 27920 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:48.961462 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 86460.2us
I20260709 13:12:48.883555 27958 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.879268 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:48.929349 27819 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:48.921872 21312 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
W20260709 13:12:48.994134 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 114945us
I20260709 13:12:48.994271 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.994791 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:48.995400 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.996192 21312 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:48.996601 27168 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:48.996985 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:48.997390 27168 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:48.997726 27168 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.883556 27932 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
W20260709 13:12:48.974939 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 78745.2us
I20260709 13:12:48.998095 27918 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:48.998260 27168 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:48.976769 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.998647 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.000063 21392 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:48.977382 21318 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 12.
I20260709 13:12:48.979857 21313 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:48.979265 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:48.961580 27794 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:48.989385 21284 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:48.991979 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 76193.7us
I20260709 13:12:48.907605 27863 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:48.997799 21312 raft_consensus.cc:2410] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:48.926565 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:49.001682 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:49.001636 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:49.009575 21393 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:12:49.004702 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.007362 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:49.007465 21315 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:12:49.015952 21320 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:49.019556 21218 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.002350 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.002715 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:49.022361 21396 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:49.008261 22031 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:49.007941 21321 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:49.022456 22039 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:49.003364 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:49.025769 21391 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:12:48.967957 27858 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:49.038594 21314 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:49.034324 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.040266 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:49.039951 21218 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:49.035406 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:48.973829 27919 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.895128 27808 consensus_queue.cc:237] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.974781 27928 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:49.034495 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:48.933974 27601 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:48.978838 27960 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:48.960863 27807 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.040524 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.042451 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:49.042044 21396 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
W20260709 13:12:49.079551 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 256308us
I20260709 13:12:49.056823 21321 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:49.006337 27958 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.192902 21396 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:49.193234 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:49.193533 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:49.193011 21317 raft_consensus.cc:2410] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:12:49.194734 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:49.198253 21313 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:12:49.198776 21313 pending_rounds.cc:85] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 11
I20260709 13:12:49.199051 21313 pending_rounds.cc:107] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:12:49.199350 21313 raft_consensus.cc:2889] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.140548 21218 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:49.181569 21392 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:49.194410 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:49.004204 27950 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:49.202450 27967 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:49.202982 27967 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:49.055241 21390 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:12:49.002748 27931 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:49.012887 27794 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:49.054816 27168 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:49.065232 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.224576 21391 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:49.206424 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:49.226083 21390 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:12:49.207167 21396 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:49.211025 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:49.222241 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.235541 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.236604 22042 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:49.238046 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.233292 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:49.186022 27460 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.002s
I20260709 13:12:49.246984 22032 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:49.190151 27959 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
W20260709 13:12:49.257375 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 264154us
I20260709 13:12:49.260380 21316 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:49.262535 21387 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:12:49.264523 27168 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:49.265245 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 275961us
I20260709 13:12:49.195060 27645 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:49.273231 21470 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:12:49.196161 27960 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:49.273854 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.274751 22035 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:12:49.234047 21218 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 14 to 16, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 16 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:49.044847 27945 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:49.252681 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 218257us
I20260709 13:12:49.057907 27919 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:49.207041 27931 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.269212 21317 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:49.270501 21394 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:12:49.141448 27917 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:49.068789 27811 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:49.132254 27865 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:49.044634 27858 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:49.205513 27918 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:49.272645 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:49.277441 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:49.294477 21462 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.057631 27937 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:12:49.278541 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.266554 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:49.248919 21313 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
W20260709 13:12:49.280159 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 45742.2us
I20260709 13:12:49.300527 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.035123 27819 raft_consensus.cc:697] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:49.285477 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 245018us
I20260709 13:12:49.290360 21393 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:12:49.290997 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 292455us
I20260709 13:12:49.207667 27792 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:12:49.186355 27968 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:12:49.265681 27950 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:49.246948 27965 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:12:49.287833 21218 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 7 to 10, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 10 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:49.298692 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 302799us
I20260709 13:12:49.302259 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.303112 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.255795 27460 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.209734 27794 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:49.204013 27967 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:49.617978 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 340633us
I20260709 13:12:49.327946 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.619711 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:49.422710 21316 pending_rounds.cc:85] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 7
I20260709 13:12:49.620709 21316 pending_rounds.cc:107] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:12:49.620803 22035 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:49.620927 21319 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:49.382315 27807 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:49.284366 27884 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:49.382851 27958 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:49.301836 27841 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.004s
I20260709 13:12:49.383435 27939 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:49.623268 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 999) took 1088 ms. Trace:
I20260709 13:12:49.282604 27931 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.282405 27811 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:49.467869 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.624774 27811 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:49.625288 22039 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.625988 27460 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:49.387204 27601 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:49.328586 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.627516 22034 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:49.306563 21313 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:12:49.623734 21319 rpcz_store.cc:276] 0709 13:12:48.535175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.537106 (+  1931us) service_pool.cc:224] Handling call
0709 13:12:49.623076 (+1085970us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b540015bdd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:49.623206 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112559872}
I20260709 13:12:49.298305 27918 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:49.629101 27918 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.290280 27865 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.629735 27865 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:49.629837 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:49.305171 27937 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:49.645808 27937 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:49.646354 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:49.630686 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.328119 27942 consensus_queue.cc:1048] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.303s
I20260709 13:12:49.388134 27948 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:49.648654 27948 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:49.649281 27942 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:49.304978 27945 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:49.650054 27945 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:49.328733 22063 debug-util.cc:398] Leaking SignalData structure 0x7b080033e660 after lost signal to thread 20202
I20260709 13:12:49.650527 27945 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:49.651505 22063 debug-util.cc:398] Leaking SignalData structure 0x7b08003600e0 after lost signal to thread 21253
W20260709 13:12:49.652866 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800307940 after lost signal to thread 21345
W20260709 13:12:49.653200 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800307920 after lost signal to thread 21346
I20260709 13:12:49.328344 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.635008 27968 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:12:49.654282 22063 debug-util.cc:398] Leaking SignalData structure 0x7b08003070c0 after lost signal to thread 21421
W20260709 13:12:49.584993 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.003s	sys 0.007s
W20260709 13:12:49.674109 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.003s	sys 0.009s
I20260709 13:12:49.674429 22039 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
W20260709 13:12:49.674827 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 909191us
I20260709 13:12:49.647924 27918 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.676647 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:49.327559 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.678541 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.678818 27918 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:49.547714 21314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.006s
I20260709 13:12:49.662505 27864 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:49.628242 27618 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:49.469125 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.637452 27958 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:49.619783 22038 raft_consensus.cc:2376] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20. Re-sending same reply.
I20260709 13:12:49.638020 27922 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.622903 27841 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:49.622043 27884 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.638198 27460 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:49.638622 27757 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.621042 21316 raft_consensus.cc:2889] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.642170 27794 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:49.643221 21313 pending_rounds.cc:85] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 8
I20260709 13:12:49.643635 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:49.702394 21313 pending_rounds.cc:107] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:12:49.702690 21396 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:49.702744 21313 raft_consensus.cc:2889] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.641597 21218 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 9 to 16, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 16 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:49.630642 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.364267 21462 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:49.649525 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:49.706885 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 76327.6us
I20260709 13:12:49.707756 21362 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.708935 21362 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.710527 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.656667 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.657357 22036 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:49.711834 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 55232.4us
I20260709 13:12:49.712962 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.304939 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:49.658141 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.328511 27928 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.622062 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:49.680344 21314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.003s	sys 0.008s
I20260709 13:12:49.724351 22035 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
W20260709 13:12:49.724658 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 458182us
I20260709 13:12:49.305924 27160 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:49.687176 27864 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.681293 21320 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:49.732283 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.681833 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.736819 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:49.683611 22063 debug-util.cc:398] Leaking SignalData structure 0x7b080033aa80 after lost signal to thread 21494
W20260709 13:12:49.681494 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.739240 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:49.385998 27624 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:49.686959 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.740628 22034 raft_consensus.cc:2376] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19. Re-sending same reply.
I20260709 13:12:49.592679 27919 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.618309 27935 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:49.743242 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3390) took 1099 ms. Trace:
I20260709 13:12:49.689594 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.743888 21313 rpcz_store.cc:276] 0709 13:12:48.643864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.305788 (+661924us) service_pool.cc:224] Handling call
0709 13:12:49.306141 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.742908 (+436767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.743166 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:49.744521 22039 raft_consensus.cc:2376] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17. Re-sending same reply.
I20260709 13:12:49.657972 27862 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:49.694907 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.747851 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:49.742738 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 93285.9us
I20260709 13:12:49.663208 27950 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:49.727124 21218 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 10 to 14, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 14 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.547158 27428 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:49.692361 27920 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.730798 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.731132 21395 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:49.688272 27978 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:12:49.691463 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.692560 27918 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:49.728820 27939 raft_consensus.cc:2804] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:49.766561 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:49.770208 21321 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:49.736230 27932 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:49.698964 27884 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:49.699867 27971 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:49.610152 27819 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:49.695690 27917 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:49.763362 21218 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:49.742509 27947 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:49.766372 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:49.746454 21396 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:49.723673 27948 raft_consensus.cc:2764] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:12:49.749037 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:49.729161 27934 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:49.763898 22038 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:49.780567 22036 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:49.742329 27864 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:49.699165 27618 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:12:49.785246 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46123.2us
W20260709 13:12:49.811826 27962 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 13:12:49.883530 27982 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:49.894793 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 205299us
I20260709 13:12:49.897410 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3219) took 1186 ms. Trace:
I20260709 13:12:49.897953 21320 rpcz_store.cc:276] 0709 13:12:48.711265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.559076 (+847811us) service_pool.cc:224] Handling call
0709 13:12:49.640011 (+ 80935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.731944 (+ 91933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.897077 (+165133us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54000fc654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:49.897334 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94285056}
I20260709 13:12:49.900401 27948 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:49.900959 27948 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:49.901408 27948 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:49.905858 27966 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:49.906502 27966 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:49.909030 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3381) took 1350 ms. Trace:
I20260709 13:12:49.909459 21321 rpcz_store.cc:276] 0709 13:12:48.558583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.191762 (+633179us) service_pool.cc:224] Handling call
0709 13:12:49.248424 (+ 56662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.770817 (+522393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.908752 (+137935us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b540022d8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:49.908963 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194582272}
I20260709 13:12:49.820163 27624 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:49.912726 27624 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:49.913568 27624 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.778110 27920 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.788134 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:49.752930 27928 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:49.791530 21218 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 10 to 15, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 15 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:49.820513 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.814666 22035 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:50.026288 22035 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:49.820704 27978 raft_consensus.cc:2764] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:49.752365 27950 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:49.727074 27757 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.700809 27922 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.833106 22031 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:49.732381 27958 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
W20260709 13:12:49.795360 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.827577 27932 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:49.749465 27968 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:12:50.043023 27935 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:50.043175 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3375) took 1490 ms. Trace:
I20260709 13:12:50.043459 27935 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:50.043576 21312 rpcz_store.cc:276] 0709 13:12:48.553198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.038622 (+485424us) service_pool.cc:224] Handling call
0709 13:12:49.038900 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.296002 (+257102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.296063 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.306955 (+ 10892us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.813124 (+506169us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:49.813239 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.813389 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.042953 (+229564us) raft_consensus.cc:1685] finished
0709 13:12:50.042973 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.043117 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":526593,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2125,"thread_start_us":548124,"threads_started":2,"wal-append.queue_time_us":705240}
I20260709 13:12:50.044420 27935 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:50.048336 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 407120us
W20260709 13:12:49.874933 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 573046us
I20260709 13:12:49.883946 22038 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:49.895835 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:49.921821 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 172864us
I20260709 13:12:49.880436 27802 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:49.790225 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:50.057485 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.921018 27841 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:49.939168 27983 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:12:49.927547 27858 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.002s
I20260709 13:12:49.811931 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:50.070181 22034 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:49.785988 22063 debug-util.cc:398] Leaking SignalData structure 0x7b08002da500 after lost signal to thread 22066
W20260709 13:12:50.049994 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 154258us
I20260709 13:12:50.050611 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:50.021611 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 233594us
I20260709 13:12:50.049108 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:49.921505 27645 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:12:49.960387 27960 consensus_meta.cc:287] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.003s
I20260709 13:12:49.907581 27966 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:49.915784 27811 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.061129 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:50.026508 27934 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:49.917403 27919 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:49.936642 27863 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:49.821007 27428 consensus_queue.cc:1059] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.218s
I20260709 13:12:50.067927 22041 raft_consensus.cc:2376] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21. Re-sending same reply.
I20260709 13:12:49.922034 27973 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:12:50.074155 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 363689us
I20260709 13:12:50.098542 27135 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:12:50.099051 27135 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:12:50.075284 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 362392us
W20260709 13:12:50.059163 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 312039us
I20260709 13:12:49.949110 27865 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.085664 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:50.086809 22038 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:50.088267 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.091500 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:49.873369 27918 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.196s
W20260709 13:12:50.096297 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.096942 21218 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 16 to 19, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 19 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.111073 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:50.111495 21218 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 7 to 9, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 9 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.099470 27135 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:50.105517 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:50.106168 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:50.119235 21390 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:50.063282 27968 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:12:50.126784 21218 catalog_manager.cc:5697] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 6 to 7, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 7 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.067212 27809 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:12:50.098768 27958 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:50.073422 27858 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.131768 22042 raft_consensus.cc:2368] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
W20260709 13:12:50.132333 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44183.8us
I20260709 13:12:50.132364 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:50.108119 27966 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:50.106777 27934 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:50.128295 27841 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.129846 27816 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:50.157745 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.173108 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:50.173658 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.197338 21470 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:50.197839 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:50.199316 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:50.159830 27135 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:50.111057 27802 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:12:50.147645 27428 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:50.129895 21218 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:50.180351 27963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.033s	sys 0.051s
I20260709 13:12:50.212772 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.213114 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.180797 27987 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:50.181440 27972 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:12:50.182302 27984 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:50.182443 27939 raft_consensus.cc:697] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:50.182703 27990 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:50.183079 28007 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:50.091104 27864 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.107411 27950 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:50.150719 21389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.014s	sys 0.036s
I20260709 13:12:50.064600 27917 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:50.122774 27862 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:12:50.191915 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 57804.1us
W20260709 13:12:50.200959 21393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.009s
I20260709 13:12:50.089568 27960 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:50.201556 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 69357.8us
I20260709 13:12:50.248562 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:50.158259 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.201752 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.193521 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:50.253159 21470 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 7.
W20260709 13:12:50.253270 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 59874.3us
I20260709 13:12:50.202005 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.254137 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:50.159277 21467 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:12:50.164209 27808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.005s	sys 0.014s
I20260709 13:12:50.223191 27428 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:50.208499 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.147239 27942 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:50.212452 21318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.013s	sys 0.019s
I20260709 13:12:50.131605 27792 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:12:50.212302 27135 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:50.219400 21218 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 11 to 15, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 15 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:50.294739 21315 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:50.212877 27963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.033s	sys 0.051s
I20260709 13:12:50.225209 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.233486 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.309226 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.309975 21312 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:50.310617 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.311496 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.234958 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.312816 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:50.313164 27971 consensus_meta.cc:287] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 13:12:50.313637 27971 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:50.313803 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.239207 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3385) took 1679 ms. Trace:
I20260709 13:12:50.314786 21316 rpcz_store.cc:276] 0709 13:12:48.559594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.286998 (+727404us) service_pool.cc:224] Handling call
0709 13:12:49.422376 (+135378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:49.704180 (+281804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.704210 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:49.704737 (+   527us) log.cc:844] Serialized 52 byte log entry
0709 13:12:50.074940 (+370203us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:50.075000 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.075092 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.238970 (+163878us) raft_consensus.cc:1685] finished
0709 13:12:50.238989 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.239149 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3132,"raft.queue_time_us":92400,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":59827,"thread_start_us":369859,"threads_started":1,"wal-append.queue_time_us":440826}
W20260709 13:12:50.316236 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.295866 21218 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 13 to 14, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 14 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.317772 21312 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:50.152840 27937 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:50.320394 27960 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:50.185796 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:50.242324 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 136229us
I20260709 13:12:50.321399 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:50.321712 27937 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.322497 27937 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:50.322886 27937 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:50.323269 27937 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:50.324303 21387 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:50.243372 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:50.244482 21389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.014s	sys 0.036s
I20260709 13:12:50.325121 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3376) took 1771 ms. Trace:
I20260709 13:12:50.325266 27922 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:50.325543 21314 rpcz_store.cc:276] 0709 13:12:48.553445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.039374 (+485929us) service_pool.cc:224] Handling call
0709 13:12:49.041057 (+  1683us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:49.724397 (+683340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.724425 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:49.725159 (+   734us) log.cc:844] Serialized 52 byte log entry
0709 13:12:50.174334 (+449175us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:50.219310 (+ 44976us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.219602 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.219686 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.324913 (+105227us) raft_consensus.cc:1685] finished
0709 13:12:50.324935 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.325058 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10790,"raft.queue_time_us":527474,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":44479,"thread_start_us":1085763,"threads_started":2,"wal-append.queue_time_us":491656}
I20260709 13:12:50.327342 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.328213 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.328868 27757 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.223737 27802 consensus_queue.cc:1243] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:12:50.246668 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 128512us
W20260709 13:12:50.247216 21393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.008s	sys 0.009s
I20260709 13:12:50.222348 27160 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:50.203944 27841 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:50.221952 27996 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:50.255782 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.230549 27977 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:50.206666 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.230899 28004 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:50.258922 22039 raft_consensus.cc:2368] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23.
I20260709 13:12:50.222117 28000 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:50.236291 27816 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:50.238870 27990 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:50.292058 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:50.271401 21318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.013s	sys 0.021s
I20260709 13:12:50.169122 27932 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:50.257954 27808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.005s	sys 0.015s
W20260709 13:12:50.294739 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 209130us
W20260709 13:12:50.258176 27931 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.634s	user 0.005s	sys 0.006s
I20260709 13:12:50.296489 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.447597 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:50.100244 27967 consensus_queue.cc:1175] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "058db415e9884ea0ba23f1e1ff59127a" responder_term: 19 status { last_received { term: 18 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:50.450176 27931 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.295204 27624 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:50.302037 27884 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.258774 27807 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:12:50.307271 27794 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.001s
I20260709 13:12:50.307744 27864 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.329042 21316 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:50.244480 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3391) took 1508 ms. Trace:
I20260709 13:12:50.293093 27948 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:50.259893 27945 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
W20260709 13:12:50.332131 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 283111us
I20260709 13:12:50.454820 22040 raft_consensus.cc:2368] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:50.455915 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.248711 28007 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:50.330929 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.256999 27918 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:50.344308 27168 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:50.344867 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 54606.4us
I20260709 13:12:50.332840 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:50.466908 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 134151us
I20260709 13:12:50.468456 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:50.345580 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:50.338649 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 220271us
I20260709 13:12:50.348996 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3226) took 1453 ms. Trace:
I20260709 13:12:50.372622 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.374390 27947 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:50.377864 21321 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:50.378921 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:50.375577 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 159705us
I20260709 13:12:50.317715 27865 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.448879 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:50.376354 27950 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:50.457024 21464 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:50.471323 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.470077 21320 rpcz_store.cc:276] 0709 13:12:48.895302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.908642 (+1013340us) service_pool.cc:224] Handling call
0709 13:12:49.909029 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.909288 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:50.184849 (+275561us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.348539 (+163690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.348611 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:50.348681 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.348769 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.348924 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":251025,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":152,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":438087,"threads_started":2,"wal-append.queue_time_us":261994}
I20260709 13:12:50.454811 21317 rpcz_store.cc:276] 0709 13:12:48.739034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.657359 (+918325us) service_pool.cc:224] Handling call
0709 13:12:49.659499 (+  2140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.659716 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:49.881191 (+221475us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.241105 (+359914us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.241181 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:50.241254 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.242814 (+  1560us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.244418 (+  1604us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":488792,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":781,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":1553,"thread_start_us":553111,"threads_started":2,"wal-append.queue_time_us":447011}
I20260709 13:12:50.380246 27977 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:50.447311 27974 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:50.454229 27807 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.447495 27990 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:50.476308 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:50.379978 27160 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:50.445361 27802 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:12:50.447588 28000 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:50.451292 27819 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.513666 27819 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:50.480306 21388 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:50.480751 21461 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:50.516546 28000 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:50.346711 27942 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.446096 27811 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:50.485107 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.487107 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.487425 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.453855 27624 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:50.524958 21320 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 7.
I20260709 13:12:50.480460 27794 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.447395 28004 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:50.483621 27977 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:50.490674 27935 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:50.490782 27160 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.493412 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3370) took 1952 ms. Trace:
I20260709 13:12:50.494670 27645 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.591331 27884 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:50.591619 27645 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:50.592437 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:50.593497 27920 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.546800 27794 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:50.601980 28027 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:50.602402 27794 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:50.544104 27816 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:50.603291 28013 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:12:50.604672 28007 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.544350 27811 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:50.496204 21321 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:12:50.465591 27945 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:50.447214 27972 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:12:50.497907 21469 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:50.500303 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 1005) took 1963 ms. Trace:
I20260709 13:12:50.500551 28016 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:12:50.500943 28031 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:50.501742 28018 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:50.502027 27931 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.294135 27934 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.505168 27948 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.509428 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:50.510663 27865 raft_consensus.cc:2764] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:12:50.511166 27976 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.528267 21320 raft_consensus.cc:3055] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:50.476586 27864 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:50.487856 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:50.662673 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 153309us
W20260709 13:12:50.663264 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 175494us
I20260709 13:12:50.530210 28003 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:50.538487 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 193001us
I20260709 13:12:50.666577 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:50.488409 27807 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:50.650527 27811 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:50.515938 27819 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.527042 27624 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:50.470791 28019 consensus_queue.cc:1059] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:12:50.587318 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:50.461308 27428 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:50.458416 27939 consensus_queue.cc:237] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:50.545471 27917 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.591004 21315 rpcz_store.cc:276] 0709 13:12:48.540837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.037732 (+496895us) service_pool.cc:224] Handling call
0709 13:12:49.043148 (+  5416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.297826 (+1254678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.493124 (+195298us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000bdbd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:50.493342 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878024960}
I20260709 13:12:50.607609 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:50.546581 27963 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:50.606168 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3223) took 1791 ms. Trace:
W20260709 13:12:50.641849 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.546458 28004 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:50.643702 21318 rpcz_store.cc:276] 0709 13:12:48.536858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.023448 (+486590us) service_pool.cc:224] Handling call
0709 13:12:49.023951 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.280968 (+257017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.281008 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.294023 (+ 13015us) log.cc:844] Serialized 26 byte log entry
0709 13:12:50.446287 (+1152264us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:50.446327 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.446402 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.500099 (+ 53697us) raft_consensus.cc:1685] finished
0709 13:12:50.500118 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.500245 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3190,"raft.queue_time_us":500567,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":16844,"thread_start_us":1162482,"threads_started":2,"wal-append.queue_time_us":776559}
W20260709 13:12:50.651526 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 175323us
I20260709 13:12:50.658664 21320 raft_consensus.cc:740] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:50.530777 28020 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.155s
I20260709 13:12:50.667691 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:50.744397 21393 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:50.717792 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:50.649488 27972 consensus_queue.cc:1243] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:50.647328 28016 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:50.668852 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.670001 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:50.672187 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:50.674678 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:50.735792 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.716542 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:50.680910 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 225075us
I20260709 13:12:50.489775 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.753834 21396 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:12:50.745265 21387 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:12:50.754959 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 86204.6us
I20260709 13:12:50.668305 27920 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:50.758783 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:50.747360 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 139834us
I20260709 13:12:50.753634 21388 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:50.746093 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:50.762321 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:50.742806 21320 consensus_queue.cc:260] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.763914 21320 raft_consensus.cc:3060] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:50.680291 28048 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:12:50.713493 28039 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:12:50.742125 21313 rpcz_store.cc:276] 0709 13:12:48.815137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.769747 (+954610us) service_pool.cc:224] Handling call
0709 13:12:49.770178 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.813949 (+ 43771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.813979 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.856217 (+ 42238us) log.cc:844] Serialized 26 byte log entry
0709 13:12:50.377568 (+521351us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:50.377787 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.378104 (+   317us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.605945 (+227841us) raft_consensus.cc:1685] finished
0709 13:12:50.605967 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.606113 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43218,"raft.queue_time_us":114251,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"thread_start_us":293283,"threads_started":1,"wal-append.queue_time_us":426541}
I20260709 13:12:50.667430 27976 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.680662 27841 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.673288 28025 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:12:50.779996 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 110043us
W20260709 13:12:50.780071 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 305167us
I20260709 13:12:50.755455 27982 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:50.755064 28016 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:12:50.818419 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 72446.3us
I20260709 13:12:50.715014 27757 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:12:50.810580 22036 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:50.810503 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:50.765949 27931 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:50.821190 22031 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:12:50.817241 21467 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:50.826488 21359 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:50.827414 21466 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:12:50.781451 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.827661 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:50.836606 28037 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:50.769291 27968 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:50.829990 21465 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:50.680397 27645 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.750790 27917 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.826454 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:50.841253 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59899.4us
I20260709 13:12:50.844786 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.840541 21359 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:50.844574 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:50.847235 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.848871 21393 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:50.854689 21468 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:50.854957 21467 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 21 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:50.818836 27982 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:50.772915 28048 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:50.832787 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74104.7us
W20260709 13:12:50.820529 27928 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.788s	user 0.012s	sys 0.000s
I20260709 13:12:50.827275 28025 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:50.856930 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.846391 27968 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.851825 28040 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:50.844367 28019 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:50.781311 27808 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:50.863751 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:50.972776 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 109095us
I20260709 13:12:50.973795 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.861855 28048 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:12:50.891865 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.775334 27958 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:12:50.910784 27858 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:50.912339 27917 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:50.914774 27819 raft_consensus.cc:3055] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:50.914443 28016 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.915776 27809 raft_consensus.cc:3055] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:50.849859 28046 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:50.816761 27811 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:50.861064 28021 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.131s
I20260709 13:12:50.922284 21465 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:50.924901 27942 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:50.929667 22040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1605) took 1625 ms (client timeout 1833 ms). Trace:
I20260709 13:12:51.021198 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.978972 27920 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:50.858552 28031 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:12:50.932546 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 106162us
W20260709 13:12:50.934087 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 76332.2us
I20260709 13:12:51.025655 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:50.933491 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 73201.2us
W20260709 13:12:50.946386 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 89532.1us
I20260709 13:12:50.859009 21359 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:51.029091 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 170169us
I20260709 13:12:51.029166 22031 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:51.029347 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.948694 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:12:50.859081 27948 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:50.861568 27931 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:50.859598 27982 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:50.982016 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:50.955240 27968 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:51.043314 27135 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:50.853621 27984 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.123s
W20260709 13:12:50.960634 27978 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:12:51.001663 21395 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:51.009856 21387 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:51.011811 21468 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:50.959496 28037 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:51.015337 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:50.955466 28020 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:50.955869 28040 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:50.918427 27976 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:51.021855 21318 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:12:51.021492 22040 rpcz_store.cc:269] 0709 13:12:49.304193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.662793 (+358600us) service_pool.cc:224] Handling call
0709 13:12:50.929432 (+1266639us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b540048b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:50.929596 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590546304}
I20260709 13:12:50.863267 22032 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:50.850317 27996 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:50.999636 28019 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.997023 27819 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:51.033743 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:51.039582 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:50.999012 27809 raft_consensus.cc:740] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:51.024866 27937 consensus_meta.cc:287] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.001s
W20260709 13:12:51.041472 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59668us
I20260709 13:12:51.039388 27942 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:51.055044 21313 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:51.057456 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:51.057284 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:50.985510 28000 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.062309 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3392) took 2316 ms. Trace:
I20260709 13:12:51.064857 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:51.065374 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 383549us
I20260709 13:12:51.068619 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.069227 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:51.069658 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.069566 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.054252 27920 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:51.040421 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:51.083603 21315 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:51.070897 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.071152 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.084780 21391 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:12:51.085872 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.074493 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.087277 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.074864 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.071774 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.091748 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.092175 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.031353 27808 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:12:51.074102 27645 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:51.099774 21389 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:12:51.101212 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.073589 21318 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:51.041474 27971 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:51.070659 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.045675 27934 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:51.074430 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.103554 21387 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:51.074728 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.076903 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.104125 21462 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:51.080739 21470 raft_consensus.cc:2368] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:51.079751 28037 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:51.115314 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.079203 21393 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:12:51.053946 27948 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:51.087823 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.088160 21394 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 12: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:51.071350 27135 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:51.123279 27135 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:51.123284 27168 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:51.123942 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:51.124121 27135 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.124594 21315 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:12:51.058522 28020 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:51.102552 27971 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.042244 28046 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:12:51.091089 27942 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:51.078685 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.141829 21388 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 11: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:51.141579 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:51.142220 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.142700 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.142839 21387 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:51.107630 21461 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 24. Current term is 25. Ops: []
I20260709 13:12:51.105306 28053 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:51.116240 21389 raft_consensus.cc:2410] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:12:51.116452 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:51.117530 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:51.118624 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:51.119225 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:51.167073 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49392.5us
I20260709 13:12:51.216710 22034 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 13: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:51.125605 21465 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:51.106761 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.063448 27816 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:12:51.138105 27135 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.123155 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:51.221067 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97995.5us
I20260709 13:12:51.146612 21396 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:12:51.074424 27937 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.090941 28019 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.147984 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:51.148692 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:51.079663 27889 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:12:51.051836 28025 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.095391 27980 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:12:51.106756 28021 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:12:51.262717 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1330) took 1160 ms. Trace:
I20260709 13:12:51.198058 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:51.263882 21316 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:51.265118 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:51.265928 21316 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:51.266911 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:51.199322 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:51.267904 21315 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
W20260709 13:12:51.136206 28041 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:12:51.223428 21313 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:51.272987 21313 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:12:51.243346 27935 consensus_meta.cc:287] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.660s	user 0.013s	sys 0.000s
I20260709 13:12:51.279402 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:51.280071 21391 raft_consensus.cc:2393] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:51.219384 27945 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:51.185940 28002 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:12:51.252540 27977 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.003s
W20260709 13:12:51.213775 27950 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.005s
I20260709 13:12:51.186244 28049 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.134s
I20260709 13:12:51.197727 27948 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.213114 28003 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:51.228669 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:51.229873 27963 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:51.230098 21387 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:12:51.272281 27816 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.222050 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:51.304359 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 82367.3us
I20260709 13:12:51.305328 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:51.306533 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:51.232635 27807 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:12:51.128684 27819 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:51.234815 27966 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.044s	user 0.010s	sys 0.002s
I20260709 13:12:51.128490 27809 consensus_queue.cc:260] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.320310 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:51.236840 27942 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.215134 27601 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:51.122308 27645 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.225358 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:51.324450 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 99161.5us
I20260709 13:12:51.324235 27645 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.325444 21362 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:51.326342 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:51.326535 27645 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:51.327149 27601 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:51.077987 21319 rpcz_store.cc:276] 0709 13:12:48.746165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.629145 (+882980us) service_pool.cc:224] Handling call
0709 13:12:49.629434 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.629617 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:49.813806 (+184189us) log.cc:844] Serialized 14 byte log entry
0709 13:12:51.016646 (+1202840us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b18003f1300. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2c2c103c7 00007fc2bf2229a7 00007fc2bf2320bf 00007fc2bf232038
0709 13:12:51.061744 (+ 45098us) log.cc:844] Serialized 14 byte log entry
0709 13:12:51.061971 (+   227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.062014 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:51.062076 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.062140 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.062256 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90166,"prepare.queue_time_us":1299113,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":4068,"raft.queue_time_us":56681,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":18362,"spinlock_wait_cycles":6664576,"thread_start_us":559165,"threads_started":3,"wal-append.queue_time_us":330952}
I20260709 13:12:51.328365 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:51.329097 21319 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
W20260709 13:12:51.329478 28060 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:12:51.190111 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:51.331113 28059 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:12:51.332062 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.332732 21394 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:12:51.333668 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:51.334053 27973 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:51.135191 27971 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:51.216131 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:51.204068 28052 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:51.278262 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.213896 28037 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:51.227515 27624 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.233498 28004 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.145675 28020 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:51.284935 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:51.291159 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.291179 21315 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:51.141724 27858 consensus_queue.cc:1059] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.136s
I20260709 13:12:51.291229 21317 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:12:51.295797 21389 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:51.369493 21317 pending_rounds.cc:85] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 10
I20260709 13:12:51.369915 21317 pending_rounds.cc:107] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:12:51.295763 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
W20260709 13:12:51.230279 27990 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.000s
I20260709 13:12:51.322005 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:51.232424 28055 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:51.313644 21463 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:51.317953 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.276371 28053 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.250451 27917 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:12:51.236016 28016 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:51.321480 21469 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:51.328076 27601 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.269564 21395 rpcz_store.cc:276] 0709 13:12:50.102629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.102800 (+   171us) service_pool.cc:224] Handling call
0709 13:12:50.110081 (+  7281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.052362 (+942281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.262379 (+210017us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b540017f2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:51.262630 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050004864}
I20260709 13:12:51.328320 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:51.407474 21387 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:51.340876 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:51.335072 21394 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:51.317235 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:51.301587 28003 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:51.348412 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 200864us
I20260709 13:12:51.349550 21461 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
W20260709 13:12:51.338212 21204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:12:51.349730 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:51.318557 27931 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:51.149690 28040 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.317625 27922 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:51.318439 27920 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:12:51.334460 27973 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:51.360138 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 144101us
I20260709 13:12:51.331153 27996 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:51.370227 21317 raft_consensus.cc:2889] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:51.272162 27960 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:51.376451 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 56472.4us
I20260709 13:12:51.349622 28046 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:51.349421 27950 raft_consensus.cc:2804] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:51.295696 27977 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.313899 27816 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.389707 22042 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:51.390586 21315 raft_consensus.cc:1240] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:12:51.321143 27807 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.354923 27819 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.391117 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:51.407860 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 117940us
I20260709 13:12:51.549466 27982 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.576928 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.577250 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.577612 27982 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:51.577837 22031 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:51.547420 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:51.578534 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.579288 21391 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:51.544876 21387 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:51.580327 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:51.581040 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 263920us
I20260709 13:12:51.574033 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:51.581645 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:51.582831 21204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 244653us
I20260709 13:12:51.583856 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:51.585023 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:51.436347 22039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1616) took 1763 ms (client timeout 2080 ms). Trace:
I20260709 13:12:51.408574 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:51.586115 22039 rpcz_store.cc:269] 0709 13:12:49.673195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.745443 (+ 72248us) service_pool.cc:224] Handling call
0709 13:12:51.436075 (+1690632us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:51.436270 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130234624}
I20260709 13:12:51.586138 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:51.507046 21463 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:12:51.575066 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:51.505374 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:51.439345 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:51.590713 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.592425 22035 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:51.594329 21389 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:51.591667 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:51.590646 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.551038 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.599156 21391 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:51.596903 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:51.600706 21394 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:51.601749 21360 leader_election.cc:400] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:51.601917 22038 raft_consensus.cc:1240] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:12:51.602118 21360 leader_election.cc:403] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:51.597416 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:51.606467 21359 leader_election.cc:400] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:51.639458 22035 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:12:51.662979 21359 leader_election.cc:403] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:12:51.611558 21394 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:12:51.660962 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:51.549180 28048 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.531s	user 0.004s	sys 0.005s
I20260709 13:12:51.389789 27757 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:51.594766 27996 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.629632 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:51.385861 28052 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.671028 22040 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:51.498754 27601 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:51.390585 28000 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:51.678426 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:51.668810 21395 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:51.384757 28055 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.595903 27939 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.546231 27937 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:51.689749 21389 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 23. Current term is 24. Ops: []
I20260709 13:12:51.605242 27945 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:51.372870 27968 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.597437 27794 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:51.553979 28023 raft_consensus.cc:3055] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:51.667366 27645 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:51.408461 27863 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:12:51.757949 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 156329us
I20260709 13:12:51.758940 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:51.445834 27858 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:51.662227 27920 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:51.596226 27917 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:51.580349 27918 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:51.696892 28019 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:51.605996 28046 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:51.732815 21395 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:51.667150 27950 raft_consensus.cc:697] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:51.665390 27922 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:51.733919 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:51.688412 27974 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.389231 27990 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.689678 28048 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.714740 28055 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:51.784608 27950 consensus_queue.cc:237] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.692636 28016 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:12:51.788337 27920 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.520608 28037 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.682675 27947 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:51.790388 27947 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.571653 27987 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:51.591594 27935 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.604760 27960 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.707283 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:51.697808 27996 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:51.733958 27757 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:51.734462 28056 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:51.767877 21320 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:51.782225 27974 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:51.815325 28069 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:12:51.741750 28007 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17.
I20260709 13:12:51.733686 27945 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:51.738859 28070 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.754611 27864 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:51.766861 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:51.746361 28023 raft_consensus.cc:740] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:51.754933 27645 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.784773 28048 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:51.792407 21468 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:51.764232 28018 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:51.757706 27863 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:51.800560 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 93389.6us
I20260709 13:12:51.777853 27918 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.807480 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2339) took 1334 ms. Trace:
I20260709 13:12:51.796499 27987 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:51.810614 27935 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:51.811208 28054 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.703s	user 0.002s	sys 0.000s
I20260709 13:12:51.814836 28071 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:12:51.769552 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 172195us
I20260709 13:12:51.850685 27945 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:51.713845 28052 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.851311 21321 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
W20260709 13:12:51.849073 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 250781us
I20260709 13:12:51.912602 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:51.917673 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:51.854995 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 88222.6us
I20260709 13:12:51.828230 27980 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:51.799367 28004 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:51.857288 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:51.771067 27858 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.883740 21466 rpcz_store.cc:276] 0709 13:12:50.473435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.473649 (+   214us) service_pool.cc:224] Handling call
0709 13:12:50.474100 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:50.836160 (+362060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.807117 (+970957us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400248bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:51.807416 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796097792}
I20260709 13:12:51.823653 27757 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:51.779665 27624 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:51.909075 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:51.883275 27937 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:51.854059 27645 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:51.741490 27973 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.913192 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:51.920562 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:51.921030 21359 leader_election.cc:400] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23.
I20260709 13:12:51.925698 27987 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.909647 28023 consensus_queue.cc:260] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:51.931408 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 74219.1us
I20260709 13:12:51.951015 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:51.955107 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:51.956519 28062 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:51.956740 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 327206us
I20260709 13:12:51.957134 28062 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.959518 28062 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:51.961164 28072 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
W20260709 13:12:51.964836 28078 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:12:51.911382 28046 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:51.929193 27807 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:51.911049 28071 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:51.967752 27980 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:51.850171 27922 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:51.929047 28081 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:51.991255 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:51.946981 28070 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:51.947149 21359 leader_election.cc:403] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:12:52.007997 27947 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:51.945021 27982 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:12:52.009486 28091 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.945465 28018 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:51.950852 27977 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:51.953989 27816 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:51.931352 28085 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:12:51.953706 28084 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.112s
I20260709 13:12:52.084903 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:52.086496 21466 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:52.050017 27934 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23.
I20260709 13:12:52.046795 28070 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:52.049908 28023 raft_consensus.cc:3060] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:12:52.089795 22032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1596) took 2789 ms (client timeout 2110 ms). Trace:
I20260709 13:12:52.052577 27974 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:51.948602 27863 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.091193 27864 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:52.070894 28071 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.077620 28091 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:52.048846 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 128992us
I20260709 13:12:52.016849 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:52.052829 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:52.061408 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:52.092830 22032 rpcz_store.cc:269] 0709 13:12:49.300192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.300303 (+   111us) service_pool.cc:224] Handling call
0709 13:12:52.089581 (+2789278us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400506ed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:52.089711 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3592614144}
I20260709 13:12:52.074982 27757 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.214996 21387 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:52.242312 21313 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:12:52.129509 28079 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:12:52.134968 27996 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:52.123926 28020 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.738s	user 0.006s	sys 0.002s
I20260709 13:12:52.263760 21470 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 13:12:52.264099 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.263669 28020 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.265753 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2348) took 1170 ms. Trace:
W20260709 13:12:52.266435 28063 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:12:51.062838 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:38956 (local address 127.19.185.194:41493)
0709 13:12:51.552503 (+489665us) server_negotiation.cc:207] Beginning negotiation
0709 13:12:51.552552 (+    49us) server_negotiation.cc:400] Waiting for connection header
0709 13:12:51.552630 (+    78us) server_negotiation.cc:408] Connection header received
0709 13:12:51.552849 (+   219us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 13:12:51.552887 (+    38us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 13:12:51.553269 (+   382us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 13:12:51.553555 (+   286us) server_negotiation.cc:227] Negotiated authn=SASL
0709 13:12:51.570316 (+ 16761us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0709 13:12:51.572630 (+  2314us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0709 13:12:51.576138 (+  3508us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0709 13:12:51.578082 (+  1944us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0709 13:12:51.761715 (+183633us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
0709 13:12:51.776673 (+ 14958us) server_negotiation.cc:882] Received SASL_INITIATE request from client
0709 13:12:51.781496 (+  4823us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
0709 13:12:51.849364 (+ 67868us) server_negotiation.cc:923] calling sasl_server_start()
0709 13:12:51.893217 (+ 43853us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
0709 13:12:51.911799 (+ 18582us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
0709 13:12:51.925738 (+ 13939us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38956: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":284188,"thread_start_us":172372,"threads_started":1}
I20260709 13:12:52.240522 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3398) took 1754 ms. Trace:
I20260709 13:12:52.229394 22035 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 23. Current term is 24. Ops: []
I20260709 13:12:52.267585 28020 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:52.104763 27863 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:52.272800 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.151342 27945 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.277459 28071 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:52.235388 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1559) took 1018 ms. Trace:
I20260709 13:12:52.278057 27922 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.218262 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:52.253643 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2888) took 1168 ms. Trace:
I20260709 13:12:52.253567 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1555) took 1436 ms. Trace:
I20260709 13:12:52.093425 28070 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:52.243903 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3413) took 1160 ms. Trace:
I20260709 13:12:52.235379 27428 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:52.247601 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:52.239192 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3405) took 1157 ms. Trace:
I20260709 13:12:52.219725 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:52.283286 21468 rpcz_store.cc:276] 0709 13:12:51.084999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.087479 (+  2480us) service_pool.cc:224] Handling call
0709 13:12:52.253154 (+1165675us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b5400217d54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:52.253420 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608478976}
W20260709 13:12:52.266224 28003 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.004s
I20260709 13:12:52.266229 21470 rpcz_store.cc:276] 0709 13:12:51.095281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.105678 (+ 10397us) service_pool.cc:224] Handling call
0709 13:12:52.263026 (+1157348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.264442 (+  1416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.265437 (+   995us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400217d50. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:52.265599 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2647567616}
I20260709 13:12:52.244675 27816 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:52.249817 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 294647us
W20260709 13:12:52.112967 28089 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:52.283845 22042 rpcz_store.cc:276] 0709 13:12:50.817091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.817275 (+   184us) service_pool.cc:224] Handling call
0709 13:12:50.844583 (+ 27308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.585137 (+740554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.252926 (+667789us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400693054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:52.253343 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253065088}
W20260709 13:12:52.118693 27971 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.001s
W20260709 13:12:52.118995 28088 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:12:52.269201 21317 rpcz_store.cc:276] 0709 13:12:50.486259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.488797 (+  2538us) service_pool.cc:224] Handling call
0709 13:12:50.495456 (+  6659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.582730 (+1087274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.239992 (+657262us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400088c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:52.240321 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817425792}
W20260709 13:12:52.098340 27819 consensus_meta.cc:287] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.001s
I20260709 13:12:52.242621 27794 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.293928 21316 rpcz_store.cc:276] 0709 13:12:51.083542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.275454 (+191912us) service_pool.cc:224] Handling call
0709 13:12:51.275767 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.444618 (+168851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.444650 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.444701 (+    51us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:51.444729 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.243323 (+798594us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540021acd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:52.243397 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.243697 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387852032}
I20260709 13:12:52.309624 27917 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.103483 27858 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:52.113358 28080 log.cc:927] Time spent T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:12:52.300757 21321 rpcz_store.cc:276] 0709 13:12:51.081237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.084113 (+  2876us) service_pool.cc:224] Handling call
0709 13:12:51.274779 (+190666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.916806 (+642027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.237587 (+320781us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54003f5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:52.238633 (+  1046us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54003f5cd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:52.238901 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763036672}
I20260709 13:12:52.316711 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:52.316988 27917 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.315112 27794 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:52.095827 27990 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:52.326546 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 984) took 1202 ms. Trace:
I20260709 13:12:52.327071 22040 rpcz_store.cc:276] 0709 13:12:51.120098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.321289 (+201191us) service_pool.cc:224] Handling call
0709 13:12:52.321709 (+1000420us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b5400613ad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:52.322054 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187062528}
I20260709 13:12:52.327900 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1091) took 1518 ms. Trace:
I20260709 13:12:52.297096 27922 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:52.331583 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.330926 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:52.328404 21463 rpcz_store.cc:276] 0709 13:12:50.809824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.809955 (+   131us) service_pool.cc:224] Handling call
0709 13:12:52.327417 (+1517462us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b5400249ad4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:52.327707 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096327552}
I20260709 13:12:52.338886 21391 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:52.341641 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:52.345243 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:52.346383 22034 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:52.278247 22038 rpcz_store.cc:276] 0709 13:12:51.216470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.662496 (+446026us) service_pool.cc:224] Handling call
0709 13:12:51.672401 (+  9905us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.897813 (+225412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.897860 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.912507 (+ 14647us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.088016 (+175509us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:52.088084 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.088165 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.234822 (+146657us) raft_consensus.cc:1685] finished
0709 13:12:52.234873 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.235199 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21540,"raft.queue_time_us":94526,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7037,"thread_start_us":352715,"threads_started":2,"wal-append.queue_time_us":190292}
W20260709 13:12:52.348435 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.355109 27968 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.336385 28003 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.356494 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:52.357096 21396 raft_consensus.cc:606] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:52.357582 21396 raft_consensus.cc:614] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:52.357766 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:52.362224 27982 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:52.362704 27982 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:52.363252 27982 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:12:52.362768 27964 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:12:48.816590 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.19.185.194:41493 (local address 127.0.0.1:38956)
0709 13:12:49.208706 (+392116us) negotiation.cc:107] Waiting for socket to connect
0709 13:12:49.208798 (+    92us) client_negotiation.cc:175] Beginning negotiation
0709 13:12:49.209329 (+   531us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 13:12:51.554139 (+2344810us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0709 13:12:51.554208 (+    69us) client_negotiation.cc:404] Received NEGOTIATE response from server
0709 13:12:51.554433 (+   225us) client_negotiation.cc:190] Negotiated authn=SASL
0709 13:12:51.569786 (+ 15353us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 13:12:51.569903 (+   117us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 13:12:51.573078 (+  3175us) client_negotiation.cc:281] Received TLS_HANDSHAKE NegotiatePB response
0709 13:12:51.573130 (+    52us) client_negotiation.cc:543] Received TLS_HANDSHAKE response from server
0709 13:12:51.574842 (+  1712us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 13:12:51.574912 (+    70us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 13:12:51.575347 (+   435us) client_negotiation.cc:564] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0709 13:12:51.679256 (+103909us) client_negotiation.cc:639] Initiating SASL PLAIN handshake
0709 13:12:51.679317 (+    61us) client_negotiation.cc:672] calling sasl_client_start()
0709 13:12:51.679437 (+   120us) client_negotiation.cc:830] callback for SASL_CB_AUTHNAME
0709 13:12:51.679684 (+   247us) client_negotiation.cc:262] Sending SASL_INITIATE NegotiatePB request
0709 13:12:51.916123 (+236439us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.19.185.194:41493: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":391097,"thread_start_us":160409,"threads_started":1}
I20260709 13:12:52.366014 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:52.365833 27971 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.367098 22034 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:52.367542 21469 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:52.369079 27976 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:52.369894 27976 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.371659 21470 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:52.379981 21315 raft_consensus.cc:2410] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:12:52.380697 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:52.110044 28055 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.103485 28087 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.374s
I20260709 13:12:52.383188 21314 raft_consensus.cc:1240] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:12:52.388597 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:52.393211 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:52.395478 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 1026) took 1282 ms. Trace:
I20260709 13:12:52.397548 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:52.399577 27960 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.401628 28052 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:52.402462 27945 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.403824 28053 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:52.404346 21394 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:12:52.378587 27971 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:52.350147 27816 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.425521 28091 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.480484 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:52.474701 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 95789.3us
I20260709 13:12:52.440346 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2329) took 1369 ms. Trace:
I20260709 13:12:52.456679 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3412) took 1373 ms. Trace:
I20260709 13:12:52.440492 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:52.396052 21314 rpcz_store.cc:276] 0709 13:12:51.111505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.335662 (+1224157us) service_pool.cc:224] Handling call
0709 13:12:52.382594 (+ 46932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.391961 (+  9367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.393685 (+  1724us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:52.447599 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3417) took 1361 ms. Trace:
I20260709 13:12:52.446413 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3235) took 1436 ms. Trace:
I20260709 13:12:52.461982 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:52.419747 27816 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:52.404191 27996 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.486260 21313 rpcz_store.cc:276] 0709 13:12:51.083276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.273789 (+190513us) service_pool.cc:224] Handling call
0709 13:12:51.274072 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.259131 (+985059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.456323 (+197192us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54004155d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:52.456603 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224992640}
I20260709 13:12:52.484566 21392 rpcz_store.cc:276] 0709 13:12:51.071118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.071558 (+   440us) service_pool.cc:224] Handling call
0709 13:12:52.439777 (+1368219us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54002e27d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:52.440123 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834636160}
I20260709 13:12:52.427875 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:52.439780 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:52.488564 21320 rpcz_store.cc:276] 0709 13:12:51.009768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.009922 (+   154us) service_pool.cc:224] Handling call
0709 13:12:51.010294 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.812157 (+801863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.445797 (+633640us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b540022d3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:52.446181 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741896576}
I20260709 13:12:52.432457 27917 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.526016 21316 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:52.433717 28055 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:52.488082 21318 rpcz_store.cc:276] 0709 13:12:51.086414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.682900 (+596486us) service_pool.cc:224] Handling call
0709 13:12:51.714649 (+ 31749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.795443 (+ 80794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.795487 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.795541 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:51.795594 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.447103 (+651509us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b540022cc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:52.447176 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.447418 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185228160}
I20260709 13:12:52.431756 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:52.490628 27922 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:52.543037 21465 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 20: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:52.544904 21319 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:52.545192 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:52.545800 28053 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:52.546190 21388 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:12:52.504491 27968 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:52.436190 27972 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
W20260709 13:12:52.548775 21267 auto_rebalancer.cc:893] Removing replace marker failed: Client connection negotiation failed: client connection to 127.19.185.194:41493: received 0 of 4 requested bytes
I20260709 13:12:52.549608 27972 consensus_queue.cc:1059] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:52.550988 27972 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:52.551304 27645 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.008s
I20260709 13:12:52.551818 27645 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.552333 27168 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:52.552757 27168 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:52.553898 21393 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
I20260709 13:12:52.554404 27645 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:52.559131 27428 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:52.545343 21319 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:52.549435 21267 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:12:52.563105 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:52.564059 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:52.434738 27971 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:12:52.553926 27168 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.566203 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1098) took 1032 ms. Trace:
I20260709 13:12:52.450749 28091 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 13:12:52.448169 27160 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 13:12:52.577749 21465 rpcz_store.cc:276] 0709 13:12:51.533498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.330003 (+796505us) service_pool.cc:224] Handling call
0709 13:12:52.566120 (+236117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:52.588871 27935 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.594980 22034 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:12:52.596628 27168 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:52.598858 22039 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:12:52.551716 27972 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.602835 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:52.593706 21267 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:12:52.591703 28020 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:12:52.608417 27862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.444s	user 0.015s	sys 0.014s
I20260709 13:12:52.617049 21317 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:12:52.628727 21319 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.629938 21319 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:52.629940 27920 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:52.630875 27920 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.631959 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:52.633215 27920 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.627187 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3243) took 1161 ms. Trace:
W20260709 13:12:52.636358 27601 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.904s	user 0.016s	sys 0.011s
W20260709 13:12:52.636780 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 276795us
I20260709 13:12:52.637784 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:52.636294 21317 rpcz_store.cc:276] 0709 13:12:51.462270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.396243 (+933973us) service_pool.cc:224] Handling call
0709 13:12:52.576759 (+180516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.623074 (+ 46315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.623399 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:52.639585 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:52.620214 27931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.008s	sys 0.030s
W20260709 13:12:52.642664 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 211103us
W20260709 13:12:52.624965 27862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.524s	user 0.015s	sys 0.015s
I20260709 13:12:52.641925 22038 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
W20260709 13:12:52.642727 27931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.008s	sys 0.031s
I20260709 13:12:52.642763 27428 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:52.647580 27935 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:52.661304 27935 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:52.681399 27935 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:52.684554 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 45173.4us
I20260709 13:12:52.685775 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:52.686870 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.667100 22038 raft_consensus.cc:1275] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:12:52.692127 21319 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:12:52.693238 21319 pending_rounds.cc:85] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 9
W20260709 13:12:52.675944 28107 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:12:52.673345 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:52.706578 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.712471 21320 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.714648 28064 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:52.715166 28064 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:52.716094 27996 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:52.716248 28064 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.716840 27996 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.717705 28064 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:52.717734 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:52.714344 28070 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.719118 27996 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.719699 21394 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:12:52.700428 21319 pending_rounds.cc:107] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:12:52.722218 21319 raft_consensus.cc:2889] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:52.720396 28070 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.723713 28031 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.724490 21391 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:52.724279 28031 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.726115 21388 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:52.726452 28031 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.728315 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3420) took 1137 ms. Trace:
I20260709 13:12:52.662456 27971 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:52.675215 27972 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:52.662209 27931 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:52.728696 21315 rpcz_store.cc:276] 0709 13:12:51.591268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.397832 (+806564us) service_pool.cc:224] Handling call
0709 13:12:52.408099 (+ 10267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.536986 (+128887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.537044 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.546566 (+  9522us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.581841 (+ 35275us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:52.581888 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.581953 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.728090 (+146137us) raft_consensus.cc:1685] finished
0709 13:12:52.728111 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.728231 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114385,"raft.queue_time_us":124677,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5644,"thread_start_us":34801,"threads_started":1,"wal-append.queue_time_us":112065}
I20260709 13:12:52.742838 21388 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:52.744604 27931 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.746069 27935 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.751729 21394 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:52.752343 27935 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.753592 21391 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:12:52.754390 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:52.755307 22038 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:52.739099 27982 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.756521 27928 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:52.756955 27928 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:52.757251 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 71687.9us
I20260709 13:12:52.757550 27428 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.758131 27928 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.759361 27928 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.758206 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:52.760365 27982 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:52.780227 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.808863 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3421) took 1027 ms. Trace:
I20260709 13:12:52.782200 21320 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:52.784950 27601 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:52.785401 27972 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:12:52.814038 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.809458 21319 rpcz_store.cc:276] 0709 13:12:51.781221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.463254 (+682033us) service_pool.cc:224] Handling call
0709 13:12:52.463778 (+   524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.808597 (+344819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.808802 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:52.779189 27428 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:52.823654 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 150511us
I20260709 13:12:52.829972 27918 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.830731 27168 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:52.831776 27168 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:52.832180 27168 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:52.811707 27601 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.811386 28070 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.832060 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:52.841468 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2900) took 1320 ms. Trace:
I20260709 13:12:52.841975 21468 rpcz_store.cc:276] 0709 13:12:51.520566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.341295 (+820729us) service_pool.cc:224] Handling call
0709 13:12:52.345126 (+  3831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.365985 (+ 20859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.366040 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.366702 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.494351 (+127649us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:52.576585 (+ 82234us) log.cc:844] Serialized 14 byte log entry
0709 13:12:52.576865 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.576939 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.841235 (+264296us) raft_consensus.cc:1685] finished
0709 13:12:52.841256 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.841394 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3145,"prepare.queue_time_us":153648,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":24646,"raft.queue_time_us":26124,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":4284,"thread_start_us":167425,"threads_started":2,"wal-append.queue_time_us":448416}
W20260709 13:12:52.841387 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83349.8us
I20260709 13:12:52.844234 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:52.845058 21395 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:52.845079 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:52.846129 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.847657 27982 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:12:52.848146 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.848448 27982 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:52.849152 28052 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.849776 28052 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.850401 27862 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:52.852126 21319 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:52.849958 28057 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:52.854290 28057 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:52.856739 28057 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.857944 28057 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:52.855618 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:52.863054 27862 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:52.864483 27991 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:52.865940 21318 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:12:52.868274 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2899) took 1348 ms. Trace:
I20260709 13:12:52.868712 21469 rpcz_store.cc:276] 0709 13:12:51.520239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.331585 (+811346us) service_pool.cc:224] Handling call
0709 13:12:52.343212 (+ 11627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.368099 (+ 24887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.867978 (+499879us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b540025b054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:52.868193 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55005056}
I20260709 13:12:52.872252 27991 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:52.875087 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 987) took 1754 ms. Trace:
I20260709 13:12:52.875813 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:52.877542 28003 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.878882 27991 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:52.880179 27864 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:52.880754 27864 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:52.881356 21461 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:52.838034 27601 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:52.883826 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.884670 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3419) took 1549 ms. Trace:
I20260709 13:12:52.885035 21321 rpcz_store.cc:276] 0709 13:12:51.334985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.470045 (+1135060us) service_pool.cc:224] Handling call
0709 13:12:52.470750 (+   705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.471311 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.471348 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.482919 (+ 11571us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.579142 (+ 96223us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:52.579164 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.579210 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.884422 (+305212us) raft_consensus.cc:1685] finished
0709 13:12:52.884441 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.884609 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":35234,"threads_started":1,"wal-append.queue_time_us":339357}
I20260709 13:12:52.886081 27809 raft_consensus.cc:3060] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:52.933547 21392 raft_consensus.cc:2393] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:52.933920 27973 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:52.944928 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:52.951682 28091 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:52.952201 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 76537.6us
I20260709 13:12:52.952569 28091 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:52.954656 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:52.955147 28091 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:52.957291 28087 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:52.959209 28087 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:52.959646 28087 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.889384 22031 rpcz_store.cc:276] 0709 13:12:51.120994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.578570 (+457576us) service_pool.cc:224] Handling call
0709 13:12:51.665728 (+ 87158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.777743 (+112015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.778183 (+   440us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.791868 (+ 13685us) log.cc:844] Serialized 26 byte log entry
0709 13:12:51.930854 (+138986us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:52.873770 (+942916us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b1800425020. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2c2c103c7 00007fc2bf2229a7 00007fc2bf2320bf
0709 13:12:52.873974 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 13:12:52.874431 (+   457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.874558 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.874632 (+    74us) raft_consensus.cc:1685] finished
0709 13:12:52.874743 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.874896 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":189118,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":39,"raft.queue_time_us":37187,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":5361,"spinlock_wait_cycles":9542016,"thread_start_us":297321,"threads_started":3,"wal-append.queue_time_us":234266}
I20260709 13:12:52.817128 27971 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:52.951767 27794 consensus_meta.cc:287] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 13:12:52.964658 27168 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:52.966008 27168 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:52.971009 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:52.972826 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:52.973583 21389 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:52.975319 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 147014us
I20260709 13:12:52.976648 27934 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:12:52.977231 27934 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:52.978318 21433 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:52.942940 28052 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:52.979041 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:52.982481 21395 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:12:52.998147 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:53.012945 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61322.6us
I20260709 13:12:52.981704 28087 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:53.036497 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:52.964685 27794 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:53.042788 21392 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:53.041397 21388 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:53.011507 28020 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:12:53.012964 27816 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:12:53.050220 27168 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.053081 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 98553.7us
I20260709 13:12:52.978343 27934 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.051637 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:53.040429 27991 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:53.070773 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:53.040271 28003 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:12:53.106649 27168 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.056725 28082 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:53.106621 21316 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:53.100003 21318 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:12:53.114692 21395 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:12:53.116017 21392 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:53.135388 27168 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:53.060308 28064 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:12:53.139544 27624 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:53.140221 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:53.147792 27937 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:53.148332 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.151167 28031 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:53.153848 28087 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.156394 21318 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:12:53.157387 21316 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:53.161162 27863 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:53.170528 21389 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
W20260709 13:12:53.170994 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 191183us
I20260709 13:12:53.184760 27971 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:53.170845 27948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.463s	user 0.016s	sys 0.019s
W20260709 13:12:53.186686 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 154265us
I20260709 13:12:53.192873 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:53.194299 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:53.196137 21315 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:53.166970 27624 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:53.201067 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 222928us
I20260709 13:12:53.202677 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:53.191578 27948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.643s	user 0.016s	sys 0.020s
I20260709 13:12:53.138630 28082 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:53.257045 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.343748 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:53.198499 27863 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:53.361183 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49116 (request call id 51) took 2076 ms. Trace:
I20260709 13:12:53.361671 21396 rpcz_store.cc:276] 0709 13:12:51.294107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.295595 (+  1488us) service_pool.cc:224] Handling call
0709 13:12:53.360805 (+2065210us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b540020e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf212853 00007fc2c41e060a 00007fc2bd7667d4 00007fc2bd766762 00007fc2bd766691 00007fc2bd76660c 00007fc2bd7658c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:53.361070 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268281088}
I20260709 13:12:53.362300 28131 consensus_queue.cc:1048] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:53.363154 21396 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:53.364832 28132 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:53.365242 28132 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:53.366364 28132 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:53.381090 27982 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:53.382259 28087 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:53.368003 28132 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:53.388892 27624 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.390889 27624 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:53.394147 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:53.396725 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 217396us
I20260709 13:12:53.411070 28071 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:53.412807 28070 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:53.414117 28070 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:53.414565 28070 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:53.416049 27918 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:53.416613 27918 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:53.417672 27918 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:53.419448 27918 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.419833 21312 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:53.422628 28082 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:53.422499 28070 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:53.427820 27794 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:53.429620 28025 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:53.430310 28025 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.435913 27863 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.441313 21318 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:53.314785 27931 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:53.214624 27864 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.503789 21392 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:53.506731 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:53.502615 27809 consensus_meta.cc:287] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.000s
W20260709 13:12:53.547447 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.517711 27794 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:12:53.539638 27601 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
W20260709 13:12:53.559355 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 368162us
I20260709 13:12:53.536949 28070 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:53.515055 27931 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:53.597287 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 392012us
I20260709 13:12:53.604154 28086 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.604959 21393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2338) took 2489 ms (client timeout 1897 ms). Trace:
W20260709 13:12:53.605434 21393 rpcz_store.cc:269] 0709 13:12:51.115899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.116836 (+   937us) service_pool.cc:224] Handling call
0709 13:12:53.604587 (+2487751us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002e31d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:53.604795 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537305984}
I20260709 13:12:53.606860 27973 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:53.607421 27973 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.609732 27973 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:53.579571 27601 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:53.611550 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1625) took 1050 ms. Trace:
I20260709 13:12:53.615163 22042 rpcz_store.cc:276] 0709 13:12:52.560848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.574087 (+ 13239us) service_pool.cc:224] Handling call
0709 13:12:53.611354 (+1037267us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540048b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:53.611487 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268964736}
I20260709 13:12:53.600072 28025 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:53.602358 28071 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.626943 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1096) took 2096 ms. Trace:
W20260709 13:12:53.653438 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.626754 27863 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.654721 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 389137us
W20260709 13:12:53.637190 27972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.010s	sys 0.023s
I20260709 13:12:53.695948 27864 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:53.697268 27601 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:53.604954 28086 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.711014 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:53.724192 28144 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:53.728574 21313 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:53.728281 28144 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:53.729216 28143 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:53.730013 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:53.730393 28144 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:53.644296 28071 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:53.729635 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:53.734834 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:53.726734 21318 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
W20260709 13:12:53.817448 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:53.828281 28149 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:12:53.829133 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:53.830009 21468 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 8: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:53.830078 28140 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:12:53.732308 28087 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:53.831583 28087 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.834054 28087 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:53.713507 28133 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.129s
I20260709 13:12:53.836320 21321 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:53.724567 27973 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.840711 27973 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.843143 27973 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:53.859961 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 145100us
I20260709 13:12:53.860273 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:53.697616 27931 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:53.736382 21465 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:12:53.860937 21316 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
W20260709 13:12:53.726564 21285 connection.cc:256] RPC call timeout handler was delayed by -1.538140369999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:12:53.885113 21285 connection.cc:256] RPC call timeout handler was delayed by -1.3419403699999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:12:53.887756 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2510403699999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:12:53.891690 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47030.6us
W20260709 13:12:53.894250 21461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1097) took 2351 ms (client timeout 1666 ms). Trace:
I20260709 13:12:53.896811 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:53.898855 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.004s	sys 0.012s
W20260709 13:12:53.899205 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.004s	sys 0.012s
W20260709 13:12:53.894790 21461 rpcz_store.cc:269] 0709 13:12:51.533201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.689168 (+155967us) service_pool.cc:224] Handling call
0709 13:12:53.732804 (+2043636us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b540029a9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:53.884321 (+151517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1985599744}
W20260709 13:12:53.899909 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 697757us
I20260709 13:12:53.712800 27863 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.883746 28087 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.917184 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:53.920297 21468 raft_consensus.cc:2410] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:12:53.923139 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:53.924489 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:53.925143 28148 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:12:53.927238 28139 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:53.927863 28139 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:53.930135 28139 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:53.936225 28086 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:53.937973 27918 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.003s
I20260709 13:12:53.944357 21313 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:53.945675 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:53.946332 21313 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
W20260709 13:12:53.958427 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 65950us
I20260709 13:12:53.938762 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:53.971197 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:53.994201 21465 raft_consensus.cc:1275] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:12:54.008206 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.945762 28020 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:12:54.022512 21470 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:12:54.020756 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:54.032912 21313 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:12:53.920151 27937 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:12:54.017756 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:54.036671 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.036798 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.039986 21321 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:12:54.046995 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.048046 21470 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 15: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:54.046964 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.049031 21463 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:54.048947 28147 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:54.024281 27918 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:54.053010 28071 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:54.052812 27918 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:54.022123 28153 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:12:54.048571 28142 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:12:54.046815 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 202321us
I20260709 13:12:53.959962 27972 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:12:54.059034 21318 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:54.059373 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.057610 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.060420 21463 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:53.932883 28087 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:53.945789 28065 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:12:54.017252 28146 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.057644 27816 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:54.067400 21390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2327) took 2996 ms (client timeout 2216 ms). Trace:
I20260709 13:12:54.068161 28087 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.074118 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:54.073727 21390 rpcz_store.cc:269] 0709 13:12:51.070531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.070650 (+   119us) service_pool.cc:224] Handling call
0709 13:12:54.067065 (+2996415us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b5400405954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:54.067228 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5287436672}
W20260709 13:12:54.077642 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 139014us
W20260709 13:12:54.068189 28132 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.006s
I20260709 13:12:54.060644 28156 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.040742 28145 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:12:54.080236 28082 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:12:54.086714 27976 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:54.086915 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.087551 21462 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:54.085129 27816 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.088449 27918 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:54.088925 27624 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.000s
W20260709 13:12:54.077170 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.576s (SENT) [suppressed 14 similar messages]
I20260709 13:12:54.089483 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.089779 21470 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:54.091248 21463 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:12:54.092435 21316 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:54.094379 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:54.095582 21464 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:54.101475 27816 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.102952 21320 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:54.109500 21468 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
W20260709 13:12:54.109808 21315 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.000s
I20260709 13:12:54.110253 21315 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:54.126467 21463 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:54.128319 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.129138 21316 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:54.129988 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.130532 21316 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:12:54.131322 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:54.131793 21316 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:54.135850 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.136919 21467 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
W20260709 13:12:54.137741 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.097344 28145 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.105541 27934 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.119663 27816 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.141736 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.141249 21313 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:12:54.145051 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.146277 28145 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.089310 28156 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.149775 28156 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:54.128345 28154 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:12:54.150877 28146 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:54.151437 28145 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.151744 28146 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:54.153184 21465 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:12:54.153538 27863 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.154729 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.155649 21465 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:54.155644 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1360) took 1054 ms. Trace:
W20260709 13:12:54.159744 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.160687 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.152132 28146 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:54.141425 28132 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:54.165562 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.167336 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.157575 21395 rpcz_store.cc:276] 0709 13:12:53.101794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.122859 (+ 21065us) service_pool.cc:224] Handling call
0709 13:12:53.168598 (+ 45739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.620451 (+451853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.620482 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.637009 (+ 16527us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.996074 (+359065us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:53.996151 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.996283 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.155425 (+159142us) raft_consensus.cc:1685] finished
0709 13:12:54.155445 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.155588 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63661,"raft.queue_time_us":451777,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":12962,"thread_start_us":722516,"threads_started":2,"wal-append.queue_time_us":376001}
I20260709 13:12:54.167936 22039 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:54.144218 21362 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:54.164727 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:54.169767 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.163357 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:54.172508 27863 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:12:54.173291 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 78991.3us
I20260709 13:12:54.174158 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:54.174969 21462 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:12:54.136219 28113 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:54.174907 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:54.180330 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.193212 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:54.193372 27972 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:54.194414 27972 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:54.195176 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:54.195245 27972 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:54.196532 22038 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:54.198148 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.200623 28156 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:54.200650 27991 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.201301 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.201484 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.202013 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.204545 21313 raft_consensus.cc:2393] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 13: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:54.176014 28132 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:54.201932 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.208177 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:54.208478 21465 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:12:54.198868 28154 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:54.213698 28154 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:54.214802 28154 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.216197 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.217145 21468 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 25.
I20260709 13:12:54.216991 28132 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.220209 27991 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.224936 28147 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:12:54.225580 28147 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:54.226090 28147 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:54.226845 21468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:54.227665 21468 raft_consensus.cc:606] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:54.230763 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.231894 21313 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:54.233058 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.234221 21313 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:12:54.235296 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.183557 27934 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.238590 27934 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.240540 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.185550 28003 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:54.162930 27816 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.244424 27918 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:54.185876 28113 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:54.244732 21360 connection.cc:256] RPC call timeout handler was delayed by -1.73204720800004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 13:12:54.248668 27918 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.264178 27168 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:12:54.264647 27168 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:54.245216 28146 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.250427 28055 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:54.250897 27971 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:54.251122 28052 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:54.210071 28020 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:54.276136 28020 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:54.276594 28020 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:54.246220 28003 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:54.256548 21360 connection.cc:256] RPC call timeout handler was delayed by -1.7203472080000211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 13:12:54.282972 21360 connection.cc:256] RPC call timeout handler was delayed by -1.6843472080000765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 13:12:54.283582 21360 connection.cc:256] RPC call timeout handler was delayed by -1.2100472079999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
I20260709 13:12:54.249791 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:54.252493 28148 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:54.275390 27918 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:54.280339 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.253381 27816 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:53.634895 21466 rpcz_store.cc:276] 0709 13:12:51.530714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.365039 (+834325us) service_pool.cc:224] Handling call
0709 13:12:52.397249 (+ 32210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.397675 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:12:52.541041 (+143366us) log.cc:844] Serialized 14 byte log entry
0709 13:12:53.592651 (+1051610us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b180044faa0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a
0709 13:12:53.618357 (+ 25706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:53.618412 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:53.626638 (+  8226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.626722 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.626860 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23997,"prepare.queue_time_us":212695,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":15896,"raft.queue_time_us":25733,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":14928,"spinlock_wait_cycles":19842944,"thread_start_us":209906,"threads_started":2,"wal-append.queue_time_us":237922}
W20260709 13:12:54.297961 21360 connection.cc:256] RPC call timeout handler was delayed by -1.1254472080000824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:12:54.304451 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:54.306427 27948 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:54.307116 27948 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.309674 27948 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.310159 27948 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.310585 27948 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.312247 27937 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:54.312671 27937 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:54.313023 27937 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:54.318010 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:54.319185 27934 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:12:54.320935 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:54.321954 27934 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:54.330580 21360 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:54.287143 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 89921.9us
I20260709 13:12:54.331553 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:54.332366 27862 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:54.332830 27862 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:54.333693 27862 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.339841 27948 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.274173 27971 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:54.348297 28146 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:12:54.348613 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 98918.8us
I20260709 13:12:54.349928 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:54.351565 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.352279 22040 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:54.352509 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.353355 22036 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:54.348347 27816 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:54.356680 27816 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:54.357764 28070 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.003s
I20260709 13:12:54.358835 27816 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:54.359503 27948 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:54.359913 27948 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:54.360302 27948 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:54.363205 28020 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.298497 28148 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:54.364933 28148 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.366225 28148 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:54.368790 28084 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:54.369381 28084 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:54.369911 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:54.370703 28031 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:54.370299 28084 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.376729 28086 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.377444 28086 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.381024 28003 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.382462 28003 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:54.385033 21466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "bfcd9560f8f44414b25f8069384c5a73"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:54.385856 21466 raft_consensus.cc:606] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Received request to transfer leadership to TS bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:54.386260 21466 raft_consensus.cc:614] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:54.386946 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.387923 22038 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:54.372624 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:54.389626 27168 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:54.394541 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 187455us
I20260709 13:12:54.353371 28004 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:54.425865 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.429221 27168 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:54.437084 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.441530 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.442235 22036 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 12.
I20260709 13:12:54.443630 21318 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:54.447664 21316 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
W20260709 13:12:54.449764 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 77212.9us
I20260709 13:12:54.433324 28143 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:54.428759 28004 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.452133 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.453266 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.456920 27937 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.458979 28020 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:54.459115 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.460453 27971 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.463737 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.475654 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:54.481070 21321 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 11.
I20260709 13:12:54.481767 22040 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 23. Current term is 24. Ops: []
I20260709 13:12:54.465806 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.434744 27816 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:54.477092 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.477123 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:54.450506 28146 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.480023 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.482895 21316 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:54.478703 28122 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.119s	user 0.004s	sys 0.011s
I20260709 13:12:54.432435 28156 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:54.483795 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3432) took 1620 ms. Trace:
I20260709 13:12:54.489099 21314 rpcz_store.cc:276] 0709 13:12:52.863072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.468912 (+1605840us) service_pool.cc:224] Handling call
0709 13:12:54.472621 (+  3709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:54.483456 (+ 10835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:54.483482 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:54.483532 (+    50us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:54.483571 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.483635 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.483738 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:54.489699 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 249737us
I20260709 13:12:54.490558 22040 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:54.471215 28004 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.493315 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.496809 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.492807 21436 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:54.487726 28133 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:54.504568 21313 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:54.513754 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.512424 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:54.501590 28086 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:54.516072 27971 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:54.517552 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.491722 28146 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.538081 21315 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:54.507409 28133 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.524387 28156 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.533113 27937 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:54.536878 22036 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:54.540918 28087 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.541543 28071 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.541803 28146 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:54.542323 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:54.614215 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 71981.9us
I20260709 13:12:54.614979 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:54.615302 21395 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:54.544003 21466 raft_consensus.cc:2410] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:12:54.511745 28154 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:12:54.548252 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.549082 28145 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.549556 27934 consensus_queue.cc:1048] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:54.549985 28164 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:54.549512 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:54.554796 27987 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:54.537822 28113 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:54.493896 27816 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.557647 27991 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.557962 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:54.687264 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.729100 21468 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:54.563928 21318 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:12:54.655102 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.567685 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 58660.8us
I20260709 13:12:54.568398 28091 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.571458 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:54.577772 28124 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.201s	user 0.003s	sys 0.030s
I20260709 13:12:54.578328 21461 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:54.578729 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.564577 28004 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.600857 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:54.735823 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3426) took 2311 ms. Trace:
I20260709 13:12:54.578366 28147 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.618223 21470 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:54.620396 21390 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:54.734915 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:54.585369 28133 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:54.628615 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:54.637889 22031 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:12:54.742231 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 113720us
I20260709 13:12:54.625566 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:54.743064 21388 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:12:54.601990 28003 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:54.744011 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:54.744277 28003 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.746825 28003 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:54.649340 28164 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.736478 21393 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:12:54.607671 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.739228 21314 raft_consensus.cc:2368] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22.
I20260709 13:12:54.736405 21312 rpcz_store.cc:276] 0709 13:12:52.420140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.427258 (+  7118us) service_pool.cc:224] Handling call
0709 13:12:54.730801 (+2303543us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b540015ccd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:54.730931 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017545472}
I20260709 13:12:54.650017 28070 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:54.749322 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 134433us
I20260709 13:12:54.733150 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:54.757344 21387 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:54.757431 21436 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:54.625470 27918 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:12:54.752871 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.754652 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 205215us
I20260709 13:12:54.758244 22040 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:54.618636 28071 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.758595 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:54.772326 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.772094 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:54.649179 27934 consensus_queue.cc:1243] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 19.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:54.727958 28031 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:12:54.751636 27991 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:54.797389 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:54.799229 28165 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.620055 28020 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.133s
W20260709 13:12:54.781888 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.800683 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.801112 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:54.787945 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.801699 21314 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
W20260709 13:12:54.801962 21997 connection.cc:256] RPC call timeout handler was delayed by -1.2437183800000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:12:54.755031 28164 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.753706 28154 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:54.808872 21469 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:54.627007 27948 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.626672 28087 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:54.803670 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.805176 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 61250.3us
I20260709 13:12:54.756592 28070 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:54.822063 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 76453.7us
W20260709 13:12:54.802325 21997 connection.cc:256] RPC call timeout handler was delayed by -1.2131498569999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 13:12:54.805073 27168 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:54.803966 21360 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:54.844246 27168 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:54.812768 21362 leader_election.cc:400] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22.
I20260709 13:12:54.844945 21362 leader_election.cc:403] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:12:54.773576 27918 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:54.740892 28091 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.817531 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2354) took 1108 ms. Trace:
I20260709 13:12:54.804559 28145 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:54.819588 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:54.820693 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:54.825901 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.849423 21469 rpcz_store.cc:276] 0709 13:12:53.708673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.713619 (+  4946us) service_pool.cc:224] Handling call
0709 13:12:54.804662 (+1091043us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3eee 0000000000375939 00007fc2c41671e0 00007fc2c42300c4 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:12:54.804815 (+   153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:54.809453 (+  4638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.817443 (+  7990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3152128}
I20260709 13:12:54.826026 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:54.795199 27991 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:54.817412 27792 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.837579 28154 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:54.826766 28070 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:54.799876 28003 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:12:54.860347 21468 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:54.859839 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:54.809301 27937 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:12:54.835958 28113 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.871840 27168 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.848788 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3431) took 1986 ms. Trace:
I20260709 13:12:54.799817 28165 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.852843 27918 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:54.847273 28082 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:54.877094 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:54.878559 21319 rpcz_store.cc:276] 0709 13:12:52.862765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.863228 (+   463us) service_pool.cc:224] Handling call
0709 13:12:52.863575 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.865728 (+  2153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.865759 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.866243 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.075690 (+209447us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:53.075733 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.075813 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.577180 (+1501367us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:54.835697 (+258517us) raft_consensus.cc:1685] finished
0709 13:12:54.835717 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.848713 (+ 12996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1722,"raft.queue_time_us":1886,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":78806400,"thread_start_us":202346,"threads_started":1,"wal-append.queue_time_us":488590}
W20260709 13:12:54.887132 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 127752us
I20260709 13:12:54.883409 27792 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.873184 27991 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:54.893592 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.903860 21461 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:54.896479 21393 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:54.898175 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:54.889475 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.874881 27807 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:54.902631 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.910180 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:54.875247 28136 raft_consensus.cc:3055] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:54.921108 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 141109us
I20260709 13:12:54.921314 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.854144 28179 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:12:54.922987 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:54.926622 28147 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:54.927059 28173 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:12:54.893249 28073 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.928457 28073 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.931169 28073 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:54.932336 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 93286.4us
I20260709 13:12:54.907668 27937 consensus_queue.cc:1243] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:12:54.935092 21319 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:54.933835 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:54.941720 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:54.942956 21468 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 21 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:54.936951 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:54.944001 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 124502us
I20260709 13:12:54.888867 28182 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:54.945784 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:54.933811 28023 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:54.925357 28084 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:54.900100 28113 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.923593 28065 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.908913 28021 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.132s
I20260709 13:12:54.886987 28154 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:54.936844 27934 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:54.919010 28136 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:54.973019 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:54.976540 21468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:12:54.989849 21468 raft_consensus.cc:606] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:54.990252 21468 raft_consensus.cc:614] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:54.952560 28143 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:12:54.979872 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 46113.5us
I20260709 13:12:54.941300 27928 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:12:54.966207 28185 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:54.969997 27937 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:54.996856 22038 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
W20260709 13:12:54.977113 28120 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.811s	user 0.019s	sys 0.008s
I20260709 13:12:55.000308 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:54.979074 28055 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:54.979372 28184 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:54.989450 28004 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:55.015529 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 142005us
I20260709 13:12:54.993327 28182 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:54.993633 28143 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:54.994349 28071 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:55.002319 28185 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.002122 27937 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:55.002578 28188 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.041508 27932 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:12:55.016993 28184 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:55.002461 27918 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:54.979625 28065 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.040267 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:55.040885 28185 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.050927 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:55.042438 27937 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:55.006950 28055 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:55.012724 28003 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.038592 21319 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:12:55.052942 21468 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:55.012567 28023 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.080274 28023 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:55.080825 28023 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.055840 21387 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:12:55.056428 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:55.056704 27757 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:55.091562 21465 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:55.056902 27967 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:55.047608 28184 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:55.057667 28178 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.001s
I20260709 13:12:55.051853 28189 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.049991 28087 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.053478 27816 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.061113 28113 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:55.086172 21468 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:55.077827 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:55.090490 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:55.060882 28199 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.102421 21315 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:55.106379 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:55.094457 28174 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:12:55.114359 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:55.112376 21359 connection.cc:256] RPC call timeout handler was delayed by -1.0830025689999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 13:12:55.088809 28071 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:12:55.115109 21997 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:55.094291 28031 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:55.093971 28004 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:55.087426 28091 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:55.087249 28003 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:55.126340 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:55.094762 27967 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:55.046638 28188 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:55.111068 28176 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260709 13:12:55.119184 28181 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:12:55.124765 28086 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:55.155556 27967 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.156836 27967 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:55.159837 28190 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:55.156144 27918 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.160115 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3245) took 2446 ms. Trace:
W20260709 13:12:55.153096 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 188782us
W20260709 13:12:55.167354 21467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2360) took 1234 ms (client timeout 1589 ms). Trace:
I20260709 13:12:55.114352 28194 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:12:55.167935 21467 rpcz_store.cc:269] 0709 13:12:53.932636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.946850 (+ 14214us) service_pool.cc:224] Handling call
0709 13:12:55.167146 (+1220296us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400216954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:55.167284 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272722176}
I20260709 13:12:55.169267 28192 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:55.172350 28040 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.172480 28192 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.174714 28192 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:55.176106 28194 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.176539 28194 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:55.119475 28199 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.099566 28143 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.181010 28143 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:55.181377 28199 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:55.181995 28205 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.112165 28189 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.186611 28189 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:55.187989 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:55.188727 22036 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:55.197495 28055 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.198632 28055 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:55.165745 21317 rpcz_store.cc:276] 0709 13:12:52.687571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.687754 (+   183us) service_pool.cc:224] Handling call
0709 13:12:52.688292 (+   538us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:52.738274 (+ 49982us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:52.738322 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:52.740589 (+  2267us) log.cc:844] Serialized 52 byte log entry
0709 13:12:53.041301 (+300712us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:53.041340 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.041402 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.835513 (+1794111us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:55.127213 (+291700us) raft_consensus.cc:1685] finished
0709 13:12:55.127235 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.134049 (+  6814us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36892,"raft.queue_time_us":48594,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":11128,"spinlock_wait_cycles":23336192,"thread_start_us":298677,"threads_started":1,"wal-append.queue_time_us":324066}
I20260709 13:12:55.200974 28065 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.201588 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:55.203663 27792 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.175827 28192 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:55.224082 28192 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:55.135571 28087 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:55.126937 28004 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:55.134984 28003 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.049822 28136 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.232266 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:55.233919 28023 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.236732 28023 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:55.229990 28087 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.242868 28087 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.248265 28154 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:55.252599 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3428) took 2405 ms. Trace:
I20260709 13:12:55.252985 21320 rpcz_store.cc:276] 0709 13:12:52.847027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.939885 (+ 92858us) service_pool.cc:224] Handling call
0709 13:12:52.940225 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:54.103444 (+1163219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.252353 (+1148909us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540032c3d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:55.252537 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2673652480}
W20260709 13:12:55.259850 28177 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 13:12:55.263216 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3264) took 1183 ms. Trace:
I20260709 13:12:55.265486 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:55.265856 28133 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.268332 21469 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:55.263597 21321 rpcz_store.cc:276] 0709 13:12:54.079702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.491510 (+411808us) service_pool.cc:224] Handling call
0709 13:12:54.502033 (+ 10523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.508311 (+  6278us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:54.508332 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.521195 (+ 12863us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.735127 (+213932us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:54.735185 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.735277 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.259171 (+523894us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:55.262942 (+  3771us) raft_consensus.cc:1685] finished
0709 13:12:55.262963 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.263160 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21459,"raft.queue_time_us":4865,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1524,"spinlock_wait_cycles":23057792,"thread_start_us":178256,"threads_started":1,"wal-append.queue_time_us":296953}
W20260709 13:12:55.276060 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.278424 28185 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.281940 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3266) took 1148 ms. Trace:
I20260709 13:12:55.282995 28188 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.282338 21316 rpcz_store.cc:276] 0709 13:12:54.133455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.518825 (+385370us) service_pool.cc:224] Handling call
0709 13:12:54.585138 (+ 66313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.609253 (+ 24115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:54.609300 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.627361 (+ 18061us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.208469 (+581108us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:55.208508 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.208576 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.281710 (+ 73134us) raft_consensus.cc:1685] finished
0709 13:12:55.281734 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.281879 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1105,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6064,"thread_start_us":457217,"threads_started":1,"wal-append.queue_time_us":548386}
I20260709 13:12:55.284184 28136 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:55.292847 28070 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.153448 27948 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.228958 28004 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.170588 28182 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.311065 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:55.311801 22039 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:55.313482 28132 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:55.313942 28132 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:55.314877 28132 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.316718 28192 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:55.320132 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.327359 28071 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.327864 28071 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:12:55.328269 28004 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.330430 28004 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:55.347436 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:55.279838 27934 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22.
W20260709 13:12:55.350082 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 223815us
W20260709 13:12:55.349995 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 182837us
W20260709 13:12:55.221872 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 276153us
I20260709 13:12:55.359476 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:55.359695 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.268020 28133 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.361608 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:55.362577 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:55.315982 28132 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:55.365968 22034 raft_consensus.cc:1275] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:12:55.366287 22034 pending_rounds.cc:85] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 15
I20260709 13:12:55.366488 22034 pending_rounds.cc:107] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:12:55.366688 22034 raft_consensus.cc:2889] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:55.367225 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.367200 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:55.368170 21321 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:55.324813 28082 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:55.354050 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 239760us
I20260709 13:12:55.371910 21319 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:12:55.369455 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:55.370604 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:55.373775 21321 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:55.361339 28031 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:55.362879 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:55.321414 28164 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.376154 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:55.376796 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:55.375743 28208 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:55.378458 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:55.349469 28070 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:55.457760 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.424880 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:55.417618 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49576.6us
W20260709 13:12:55.427211 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 64411.1us
I20260709 13:12:55.428408 28202 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:55.429561 28165 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:55.430753 21470 pending_rounds.cc:85] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 8
I20260709 13:12:55.463963 21470 pending_rounds.cc:107] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 19.9
I20260709 13:12:55.464339 21470 raft_consensus.cc:2889] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:55.459285 21318 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
I20260709 13:12:55.433749 28164 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:55.434556 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.435092 21461 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:12:55.435806 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:55.361822 28087 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:55.365273 27932 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:55.451804 21463 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:55.283039 27937 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.472818 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:55.480405 21467 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:55.473170 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:55.473925 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:55.474514 21468 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:55.427624 28194 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.364864 27991 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.444509 27807 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.490038 27807 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:55.492183 27987 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.756s	user 0.011s	sys 0.000s
I20260709 13:12:55.496769 22032 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:12:55.498298 21468 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:12:55.499832 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:55.500504 21465 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:55.478832 27932 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.462365 28202 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:55.507323 28202 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:55.478401 28064 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.512419 28064 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.478157 28087 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.513650 28087 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:55.497180 27809 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.484256 27918 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:12:55.516630 27918 consensus_queue.cc:1243] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:55.516554 27809 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.521842 28194 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.506784 27932 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:55.522948 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 62841.4us
I20260709 13:12:55.523594 21362 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:55.526772 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:55.528412 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:55.529136 21466 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:55.531642 27934 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:55.475411 28113 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:55.538214 21467 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:12:55.560125 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:55.565234 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:55.568624 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.515622 28003 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:55.565141 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:55.569916 21467 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:12:55.538498 28185 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:55.502074 27807 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:55.606848 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.556478 28084 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
W20260709 13:12:55.696000 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 344839us
I20260709 13:12:55.718840 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:55.675221 28211 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:12:55.771301 27168 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.772167 27168 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:55.714526 28186 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:12:55.864526 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.887311 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.940660 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:55.947017 21466 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:55.735103 28148 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:55.991750 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.993530 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:55.990139 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 273663us
W20260709 13:12:55.991834 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.996838 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.990844 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:56.002116 28210 log.cc:927] Time spent T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:12:55.715683 28209 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.423s
I20260709 13:12:56.010829 27168 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:12:56.015760 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.740512 27932 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.014775 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:56.026702 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.025560 27168 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.007987 28186 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:56.003273 27757 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:56.031386 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:56.028157 27168 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.043416 22034 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:12:56.022105 28136 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:12:56.049540 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:56.042721 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.054430 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.007858 28148 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.040217 27937 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.057472 28003 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.047034 27757 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.020402 27987 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:12:56.054195 28213 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:12:56.047904 28143 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:56.058569 27934 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:56.059068 28209 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:56.055287 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:56.040009 28147 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:12:56.065114 27168 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.046017 28215 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:56.112401 28215 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:56.113512 28215 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.113950 28148 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:56.115041 28148 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.054224 27991 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.065318 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:56.078778 27934 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:56.066757 28186 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:56.106216 28071 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.000s
I20260709 13:12:56.071003 27976 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:12:56.083871 27937 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:56.109297 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1571) took 1936 ms. Trace:
I20260709 13:12:56.039673 28200 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:12:56.122493 21204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:12:56.128022 27932 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.076378 28143 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:12:56.129537 28184 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.025s	user 0.003s	sys 0.007s
W20260709 13:12:56.132107 28202 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
W20260709 13:12:56.177505 28132 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.000s
I20260709 13:12:56.177639 28202 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.178347 21464 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:12:56.178131 28143 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.179486 28143 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:12:56.134138 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 661011us
W20260709 13:12:56.142423 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 77574.4us
W20260709 13:12:56.157054 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 630300us
I20260709 13:12:56.137475 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:56.160552 28182 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:56.159696 28219 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:56.176510 28184 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.164443 27937 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.175621 21318 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: []
I20260709 13:12:56.180759 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:56.194708 21312 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.160512 22042 rpcz_store.cc:276] 0709 13:12:54.172855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.181387 (+  8532us) service_pool.cc:224] Handling call
0709 13:12:54.197125 (+ 15738us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:54.197508 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:54.197536 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:54.200693 (+  3157us) log.cc:844] Serialized 52 byte log entry
0709 13:12:55.221032 (+1020339us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b18003f9ca0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:12:55.457114 (+236082us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:55.496874 (+ 39760us) log.cc:844] Serialized 14 byte log entry
0709 13:12:55.580403 (+ 83529us) log.cc:844] Serialized 14 byte log entry
0709 13:12:55.990146 (+409743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.990238 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.999007 (+  8769us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b18003f9ca0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:56.001464 (+  2457us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:56.109070 (+107606us) raft_consensus.cc:1685] finished
0709 13:12:56.109093 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:56.109238 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180527,"prepare.queue_time_us":125291,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":146744,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":11165,"spinlock_wait_cycles":244523008,"thread_start_us":235828,"threads_started":1,"wal-append.queue_time_us":1341569}
I20260709 13:12:56.180948 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:56.183000 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:56.184065 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.161718 21466 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
W20260709 13:12:56.184672 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47352.1us
I20260709 13:12:56.156682 28209 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:12:56.184656 28221 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:12:56.170893 28185 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:56.160979 27934 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:56.202353 21317 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:56.180341 27991 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.179971 28202 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.192109 28200 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:56.178123 28132 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.156581 28148 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.228247 21316 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:56.191211 28219 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:56.195806 27937 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:56.171653 28071 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.198671 28182 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:56.229089 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 193623us
I20260709 13:12:56.232805 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.232676 28185 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:56.184204 28055 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:12:56.255204 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.233417 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:56.256395 21395 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:12:56.225245 28086 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:56.269894 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:56.272274 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:56.279858 21391 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.191804 27932 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:12:56.281308 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:56.275063 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:56.284648 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:56.285434 21462 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:56.228317 28200 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.231566 28208 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:56.256714 28219 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:56.228966 28205 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:12:56.205351 28209 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:56.278221 28087 consensus_meta.cc:287] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.759s	user 0.012s	sys 0.000s
I20260709 13:12:56.229127 27991 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.234158 28132 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.288758 27976 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:56.330332 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 493326us
I20260709 13:12:56.296908 28200 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:56.295709 28031 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:56.271088 28003 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:12:56.342567 28071 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.345208 28064 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.346792 28232 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.347347 28232 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.327211 28087 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:56.349315 28212 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.701s	user 0.000s	sys 0.002s
I20260709 13:12:56.350077 28087 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.351171 28194 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.351933 28145 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:12:56.352356 28145 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:56.353163 28145 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.354395 28145 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:56.357977 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1634) took 1169 ms. Trace:
I20260709 13:12:56.358469 22041 rpcz_store.cc:276] 0709 13:12:55.188013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.217900 (+ 29887us) service_pool.cc:224] Handling call
0709 13:12:55.268389 (+ 50489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:55.268616 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.268647 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:55.269125 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.435993 (+166868us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:55.436045 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.436110 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:56.348576 (+912466us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:56.356107 (+  7531us) raft_consensus.cc:1685] finished
0709 13:12:56.356135 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:56.357758 (+  1623us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112797568,"thread_start_us":166494,"threads_started":1,"wal-append.queue_time_us":302511}
W20260709 13:12:56.361466 28217 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:12:56.362812 28182 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.365434 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:56.322393 28091 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:56.351639 28194 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.379061 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:56.429828 21387 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:12:56.394446 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2918) took 1021 ms. Trace:
I20260709 13:12:56.377657 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:56.412639 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:56.457808 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:56.594379 22031 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:56.430511 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:56.423475 21312 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:56.371943 21391 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
W20260709 13:12:56.451682 21463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1103) took 2316 ms (client timeout 1529 ms). Trace:
I20260709 13:12:56.597015 21387 pending_rounds.cc:85] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 16
W20260709 13:12:56.597267 21463 rpcz_store.cc:269] 0709 13:12:54.135285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.135424 (+   139us) service_pool.cc:224] Handling call
0709 13:12:56.451440 (+2316016us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400352fd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:56.451591 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2960564992}
I20260709 13:12:56.597942 21387 pending_rounds.cc:107] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:12:56.456699 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.334066 27987 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:56.593161 21464 rpcz_store.cc:276] 0709 13:12:55.372586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.372696 (+   110us) service_pool.cc:224] Handling call
0709 13:12:56.394230 (+1021534us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54001a77d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:56.394382 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612716800}
I20260709 13:12:56.599483 21387 raft_consensus.cc:2889] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:56.457453 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.612226 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:56.612705 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:56.613039 27928 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:56.442354 27937 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.613291 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:56.613497 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1637) took 1394 ms. Trace:
I20260709 13:12:56.613921 22036 rpcz_store.cc:276] 0709 13:12:55.218933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.612461 (+1393528us) service_pool.cc:224] Handling call
0709 13:12:56.613437 (+   976us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:56.614737 28216 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.490s	user 0.000s	sys 0.002s
I20260709 13:12:56.615166 27937 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.563745 28192 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:56.613940 22034 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.616335 28192 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.618636 28192 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:56.620139 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.434986 28219 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.621170 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:56.613068 22032 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:56.595259 21317 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:56.457111 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.336385 27976 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:56.387181 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:56.624897 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.611757 21396 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:56.627574 21395 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:56.627707 22034 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:56.625958 22041 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:12:56.386554 28187 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:56.413908 28071 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:56.380129 27809 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:56.563030 28136 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.639998 21388 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.456751 28205 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.381239 27991 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.384739 28184 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.563314 28087 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.399120 28003 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.634807 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.452399 28147 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.379810 28132 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:56.649652 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:56.377040 28031 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:56.397512 28209 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.385980 28232 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:56.387578 28148 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:56.340729 27932 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.296s
I20260709 13:12:56.629400 21391 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:56.613526 27928 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:56.629240 27976 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:56.765784 27928 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.609346 27987 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:56.768987 27987 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.439986 27934 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.656602 21390 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:56.736850 21321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.018s
I20260709 13:12:56.634529 28187 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:12:56.742426 21314 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.011s	sys 0.012s
W20260709 13:12:56.746767 22002 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.529s (SENT)
W20260709 13:12:56.771616 21321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.007s	sys 0.019s
I20260709 13:12:56.615787 27937 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:56.641770 28192 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.751787 28031 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:56.772574 22002 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.576s (SENT)
W20260709 13:12:56.772977 21314 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.011s	sys 0.012s
I20260709 13:12:56.750101 21389 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:12:56.377679 28185 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.783290 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:56.767755 27928 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:56.770691 27987 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:56.788062 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.791551 21388 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:12:56.640005 28071 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.648595 28136 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.793920 28187 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.795018 28187 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.795900 28136 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.720953 28147 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.796555 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.797446 21391 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:56.798965 21391 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 23. Current term is 24. Ops: []
I20260709 13:12:56.799238 28147 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.785820 28192 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.801600 21396 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:56.812456 28084 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:56.816327 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.649266 28205 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.657183 28087 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.713425 28003 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.864274 21391 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:56.871682 21395 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:56.875151 27976 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:56.876907 28071 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.877028 28003 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.877689 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:56.907173 21393 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:12:56.889356 28205 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:56.873274 27934 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.892374 28087 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.779953 28200 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.908434 21393 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:56.909973 28200 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.910718 21389 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:12:56.911795 28222 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.785s	user 0.007s	sys 0.005s
W20260709 13:12:56.893850 28230 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:12:56.897444 28147 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:56.897856 27757 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.898120 28136 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:56.900468 28194 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.860694 28219 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:56.904299 28220 log.cc:927] Time spent T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.779s	user 0.004s	sys 0.004s
W20260709 13:12:56.905742 28225 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.785s	user 0.001s	sys 0.002s
I20260709 13:12:56.786595 27937 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:56.910650 21393 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:12:56.896864 21359 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:56.918155 22031 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:56.946542 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 49752.2us
W20260709 13:12:56.924852 21287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.001s	sys 0.053s
W20260709 13:12:56.927484 21462 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 13:12:56.949566 21462 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
W20260709 13:12:56.950315 21287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.001s	sys 0.053s
I20260709 13:12:56.950098 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:56.953883 21317 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:12:56.951327 21392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.009s	sys 0.043s
W20260709 13:12:56.957394 21392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.009s	sys 0.043s
W20260709 13:12:56.951035 21434 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.020s	sys 0.015s
W20260709 13:12:56.960531 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.033s	sys 0.036s
W20260709 13:12:56.962059 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.033s	sys 0.036s
W20260709 13:12:56.964083 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.970978 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:56.985401 21434 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.020s	sys 0.015s
W20260709 13:12:56.986013 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 924954us
I20260709 13:12:56.990949 21462 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:56.991035 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:56.947127 28136 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:56.995810 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.016551 21469 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:12:57.016618 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:57.018169 22031 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:12:57.019413 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.020217 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.021757 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:57.024154 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.960018 27976 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:56.958681 28071 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:56.951555 28087 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.021070 21464 raft_consensus.cc:2376] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16. Re-sending same reply.
W20260709 13:12:57.045984 21998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.010s	sys 0.029s
I20260709 13:12:57.031117 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:57.046525 21998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.010s	sys 0.029s
I20260709 13:12:56.959578 27934 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:57.032408 21312 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:57.033483 21463 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:57.041657 21462 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:12:57.045202 21465 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:12:57.049242 21466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.006s	sys 0.023s
W20260709 13:12:57.050858 21466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.007s	sys 0.023s
W20260709 13:12:57.047433 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.987118 28003 consensus_queue.cc:1048] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.102s
I20260709 13:12:57.125597 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:57.157604 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:57.165146 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.178360 21317 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:57.178925 21315 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:57.022202 28073 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.107508 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:57.174852 21284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.025s	sys 0.019s
I20260709 13:12:57.174753 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1635) took 1968 ms. Trace:
I20260709 13:12:57.123746 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:57.179863 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:57.054667 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:57.181825 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.023s	sys 0.051s
W20260709 13:12:57.213722 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.023s	sys 0.051s
W20260709 13:12:57.175346 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.106565 21467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.006s	sys 0.035s
W20260709 13:12:57.215116 21467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.006s	sys 0.038s
W20260709 13:12:57.215459 21284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.025s	sys 0.019s
I20260709 13:12:57.211499 22040 rpcz_store.cc:276] 0709 13:12:55.206304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.255895 (+ 49591us) service_pool.cc:224] Handling call
0709 13:12:55.256260 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:55.569168 (+312908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.569199 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:55.573868 (+  4669us) log.cc:844] Serialized 52 byte log entry
0709 13:12:55.718648 (+144780us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:55.718710 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.718803 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:56.905000 (+1186197us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:57.163344 (+258344us) raft_consensus.cc:1685] finished
0709 13:12:57.163376 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.174677 (+ 11301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420988,"raft.queue_time_us":312627,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2290,"spinlock_wait_cycles":86413184,"thread_start_us":122297,"threads_started":1,"wal-append.queue_time_us":546250}
W20260709 13:12:57.087857 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.079s	sys 0.120s
W20260709 13:12:57.220135 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.089s	sys 0.151s
I20260709 13:12:57.124536 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:57.061415 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.042230 28086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.024s	sys 0.037s
W20260709 13:12:57.083762 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.218490 21312 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
W20260709 13:12:57.220450 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 921068us
I20260709 13:12:57.219050 27168 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:12:57.221220 27168 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:57.221642 27168 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:12:57.222136 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 1.02589e+06us
I20260709 13:12:57.044399 28232 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:57.227162 21284 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:57.217969 28186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.018s	sys 0.007s
W20260709 13:12:57.225128 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.217939 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:57.232409 21318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.008s	sys 0.016s
I20260709 13:12:57.053745 27757 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.098569 27976 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.223594 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:57.243548 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:57.157157 27809 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
W20260709 13:12:57.233178 28145 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.878s	user 0.015s	sys 0.000s
I20260709 13:12:57.054219 28087 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:57.265712 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:57.223063 28086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.024s	sys 0.037s
I20260709 13:12:57.053848 27934 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.240600 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:57.243290 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.245113 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.06422e+06us
I20260709 13:12:57.246948 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:57.234078 21318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.008s	sys 0.016s
I20260709 13:12:57.048715 28071 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:57.234997 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:57.289422 21393 raft_consensus.cc:2410] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:12:57.254695 28154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.013s	sys 0.021s
I20260709 13:12:57.264786 21396 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
W20260709 13:12:57.293157 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58276.4us
W20260709 13:12:57.235778 28186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.018s	sys 0.007s
I20260709 13:12:57.233673 27987 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.282306 21391 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:12:57.282735 21387 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:12:57.284631 21313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.015s	sys 0.011s
W20260709 13:12:57.277199 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.289847 27168 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:57.289086 21362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.013s	sys 0.021s
I20260709 13:12:57.294749 21389 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: []
W20260709 13:12:57.321053 21362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.013s	sys 0.021s
I20260709 13:12:57.228113 28084 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:12:57.217182 28073 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:57.255343 28182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.000s	sys 0.025s
W20260709 13:12:57.321398 21313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.016s	sys 0.012s
I20260709 13:12:57.323268 21315 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12.
I20260709 13:12:57.333796 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.334209 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:57.334486 21315 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:57.334827 21463 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:12:57.236151 28232 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.335410 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.337112 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:57.337636 21315 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:57.337642 21463 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
W20260709 13:12:57.300169 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.930s (SENT)
I20260709 13:12:57.327488 21316 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:12:57.338680 21316 pending_rounds.cc:85] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 12
I20260709 13:12:57.338936 21316 pending_rounds.cc:107] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:12:57.339214 21316 raft_consensus.cc:2889] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.340206 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:57.292927 28154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.013s	sys 0.021s
I20260709 13:12:57.340742 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.232009 28215 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:12:57.350673 28245 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:12:57.327682 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.011s	sys 0.019s
I20260709 13:12:57.287245 28086 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:57.352288 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:57.353567 28218 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.197s	user 0.000s	sys 0.004s
I20260709 13:12:57.353384 28086 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.354343 28148 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:57.354878 28148 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.355283 28148 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:57.357079 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.011s	sys 0.019s
I20260709 13:12:57.292959 27928 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:57.336956 28182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.000s	sys 0.026s
I20260709 13:12:57.330093 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.369223 21312 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
W20260709 13:12:57.369445 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.341847 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:57.343649 27168 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.290805 27934 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:57.330655 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:57.348006 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:57.347168 21393 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:57.252592 27757 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.374975 21465 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:12:57.375092 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2925) took 1997 ms. Trace:
W20260709 13:12:57.345343 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45229.3us
I20260709 13:12:57.288844 27937 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:57.266527 27976 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.382278 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.382944 21312 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:12:57.368358 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:57.316795 28238 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:57.374258 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.375520 21461 rpcz_store.cc:276] 0709 13:12:55.377819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.492315 (+114496us) service_pool.cc:224] Handling call
0709 13:12:55.492645 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:55.493026 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:55.493055 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:55.493557 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.578346 (+ 84789us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:55.578403 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.578487 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.108549 (+1530062us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:57.357706 (+249157us) raft_consensus.cc:1685] finished
0709 13:12:57.357739 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.375024 (+ 17285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4509,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":31794,"spinlock_wait_cycles":18537216,"thread_start_us":84431,"threads_started":1,"wal-append.queue_time_us":590627}
I20260709 13:12:57.378209 21315 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:57.344846 28209 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.381721 21469 pending_rounds.cc:85] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 8
I20260709 13:12:57.385896 21469 pending_rounds.cc:107] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:12:57.386183 21469 raft_consensus.cc:2889] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.386639 21389 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: [19.12-21.13]
I20260709 13:12:57.364605 28186 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.388056 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.391012 21315 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:57.329969 27987 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.392118 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.392691 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.332006 28187 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:12:57.392927 21315 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:57.393327 21312 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:12:57.395166 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:57.393824 21321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.008s	sys 0.021s
W20260709 13:12:57.396783 21321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.008s	sys 0.021s
I20260709 13:12:57.397660 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3285) took 1260 ms. Trace:
I20260709 13:12:57.398087 21321 rpcz_store.cc:276] 0709 13:12:56.136790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.157016 (+ 20226us) service_pool.cc:224] Handling call
0709 13:12:56.157408 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.157655 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:12:56.778815 (+621160us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.397242 (+618427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.397309 (+    67us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:57.397370 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.397461 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.397598 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12871,"prepare.queue_time_us":800906,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"thread_start_us":1217427,"threads_started":2}
I20260709 13:12:57.400722 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:57.401719 21315 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:57.375734 28249 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.388834 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:57.342496 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:57.406242 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:57.409008 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66660.6us
I20260709 13:12:57.385406 28205 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.408917 21463 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:57.414392 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:57.406277 21314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.004s	sys 0.025s
I20260709 13:12:57.412384 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.415477 21461 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:12:57.415930 21314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.025s
I20260709 13:12:57.416975 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:57.434703 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.435886 21468 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:57.437527 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:57.438946 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.440974 22040 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:12:57.441460 22040 pending_rounds.cc:85] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 14
I20260709 13:12:57.441816 22040 pending_rounds.cc:107] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:12:57.442099 22040 raft_consensus.cc:2889] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.441339 21463 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:12:57.436702 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.120s (SENT)
I20260709 13:12:57.435985 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:57.370507 28147 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.445672 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:57.468899 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.469058 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:57.469782 21312 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:12:57.469861 22041 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:57.407833 28192 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:57.479115 27757 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:57.442513 28205 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:57.474747 28237 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 13:12:57.445737 28084 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:12:57.491577 28136 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:57.491724 28205 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:57.434037 28194 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:57.623333 28194 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:57.518078 21395 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:57.625831 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.626878 21395 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:57.390328 28209 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:57.489409 28087 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:57.506326 28250 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:57.472314 28147 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.476226 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.632412 21464 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:57.477185 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:57.634428 21389 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:57.635236 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.635478 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.501703 28071 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:57.500234 28073 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.640767 28073 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.641295 28073 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:57.520684 21391 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:12:57.521437 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.407070 28186 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:57.643501 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.644745 28186 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:57.498664 27976 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:57.466439 27928 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:57.645645 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:57.646214 21389 raft_consensus.cc:2376] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10. Re-sending same reply.
I20260709 13:12:57.645795 27928 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.647043 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:57.503333 28232 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.494442 27987 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.644804 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.648787 21391 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:57.648895 27987 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:57.649860 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.650595 27987 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:57.651204 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.485607 21436 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:57.652382 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 166853us
I20260709 13:12:57.652478 28147 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.653743 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:57.654686 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:57.655503 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:57.492318 27937 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:57.656213 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.656805 27937 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:57.651973 21391 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:12:57.657424 27937 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:57.658247 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.658461 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3294) took 1263 ms. Trace:
W20260709 13:12:57.658936 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.537849 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.705981 21312 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 23: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:57.543203 21317 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:57.601902 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.492420 28136 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:57.710004 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 2999) took 1256 ms. Trace:
I20260709 13:12:57.710328 28136 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:57.710443 21394 rpcz_store.cc:276] 0709 13:12:56.453918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.456780 (+  2862us) service_pool.cc:224] Handling call
0709 13:12:57.709802 (+1253022us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000acdd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:57.709947 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440695552}
I20260709 13:12:57.711335 28136 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.685544 28238 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:57.492992 28145 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:12:57.604523 28164 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.476s	user 0.023s	sys 0.000s
W20260709 13:12:57.704345 28185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.012s	sys 0.000s
I20260709 13:12:57.481796 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.728024 21315 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
W20260709 13:12:57.728421 21285 connection.cc:256] RPC call timeout handler was delayed by -2.5248199669999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 13:12:57.728837 21285 connection.cc:256] RPC call timeout handler was delayed by -2.4843199669999194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 13:12:57.729167 21285 connection.cc:256] RPC call timeout handler was delayed by -2.4582199669999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:12:57.497774 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:57.729458 21285 connection.cc:256] RPC call timeout handler was delayed by -2.4258199669999385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:12:57.729784 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 232061us
I20260709 13:12:57.487936 28182 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.517567 28200 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:57.506093 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3284) took 1369 ms. Trace:
I20260709 13:12:57.485826 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.519668 21214 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.496940 27932 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:57.506342 27918 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:57.483922 21461 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 26.
W20260709 13:12:57.476776 28244 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:12:57.637132 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.637771 28194 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:57.639477 21320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.010s	sys 0.027s
W20260709 13:12:57.772593 21320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.012s	sys 0.028s
I20260709 13:12:57.657050 21395 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:57.562507 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2935) took 1290 ms. Trace:
I20260709 13:12:57.495473 28187 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.777406 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.778093 21317 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:57.777583 28187 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:57.778730 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.779035 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:57.779691 21317 raft_consensus.cc:2376] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17. Re-sending same reply.
I20260709 13:12:57.684639 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2936) took 1410 ms. Trace:
I20260709 13:12:57.661857 28245 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:57.781018 28084 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:57.781464 28245 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.780880 21467 rpcz_store.cc:276] 0709 13:12:56.274182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.274299 (+   117us) service_pool.cc:224] Handling call
0709 13:12:56.274579 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.274917 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.274944 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.278671 (+  3727us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.215693 (+937022us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:57.236465 (+ 20772us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.684330 (+447865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.684399 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.684451 (+    52us) raft_consensus.cc:1685] finished
0709 13:12:57.684464 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.684588 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7411,"prepare.queue_time_us":386367,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":189174,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"thread_start_us":1307469,"threads_started":2,"wal-append.queue_time_us":1052714}
I20260709 13:12:57.782935 28084 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:57.783468 28084 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:12:57.659533 21390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.013s	sys 0.020s
W20260709 13:12:57.784204 21390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.015s	sys 0.021s
I20260709 13:12:57.783931 28246 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:57.784408 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:57.784817 28246 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:57.785218 28246 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:57.785617 22032 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:12:57.785682 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:57.685765 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 240172us
I20260709 13:12:57.658600 27937 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:57.786628 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:57.786763 28250 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:57.787029 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:57.719233 28209 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:57.635950 21321 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:12:57.734382 21314 rpcz_store.cc:276] 0709 13:12:56.136481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.157877 (+ 21396us) service_pool.cc:224] Handling call
0709 13:12:56.169837 (+ 11960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.170087 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:56.785794 (+615707us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.503917 (+718123us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.505706 (+  1789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.505763 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:57.505817 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.505902 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.506027 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111391,"prepare.queue_time_us":975581,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":10240,"raft.queue_time_us":89486,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":123,"thread_start_us":1218460,"threads_started":2,"wal-append.queue_time_us":767944}
I20260709 13:12:57.788296 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.788728 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.789140 28132 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:57.789311 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.789556 28132 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:57.789953 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.790445 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.790577 21314 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 8.
I20260709 13:12:57.791002 21321 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
W20260709 13:12:57.689523 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.660050 27928 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:57.793419 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:57.787545 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:57.793917 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:57.794371 21321 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:57.796383 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:57.683894 21391 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:12:57.658811 21318 rpcz_store.cc:276] 0709 13:12:56.395189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.399277 (+  4088us) service_pool.cc:224] Handling call
0709 13:12:56.399635 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:56.400109 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:57.290039 (+889930us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.644877 (+354838us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:57.645548 (+   671us) log.cc:844] Serialized 52 byte log entry
0709 13:12:57.645699 (+   151us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:57.646142 (+   443us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.646541 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.648465 (+  1924us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.658256 (+  9791us) raft_consensus.cc:1685] finished
0709 13:12:57.658277 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.658402 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7540,"prepare.queue_time_us":756084,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":816,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":17830,"thread_start_us":1221988,"threads_started":2,"wal-append.queue_time_us":331505}
I20260709 13:12:57.698208 22038 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
W20260709 13:12:57.696950 21388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.012s	sys 0.008s
I20260709 13:12:57.697320 21465 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
W20260709 13:12:57.801213 21388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.012s	sys 0.008s
W20260709 13:12:57.701601 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.801903 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3003) took 1346 ms. Trace:
W20260709 13:12:57.802390 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.682179 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.692387 27934 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.711691 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:57.604228 21319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.000s	sys 0.015s
I20260709 13:12:57.714265 27168 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:57.802241 21388 rpcz_store.cc:276] 0709 13:12:56.455128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.845254 (+390126us) service_pool.cc:224] Handling call
0709 13:12:56.845711 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.855386 (+  9675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.855444 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.950929 (+ 95485us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.801605 (+850676us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:57.801642 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.801704 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.801739 (+    35us) raft_consensus.cc:1685] finished
0709 13:12:57.801749 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.801856 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9727,"thread_start_us":770646,"threads_started":1,"wal-append.queue_time_us":559551}
I20260709 13:12:57.804826 21362 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:57.810217 27168 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.810667 27168 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:57.691752 28232 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:57.698315 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 454847us
I20260709 13:12:57.517787 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:57.812652 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:57.814127 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3289) took 1653 ms. Trace:
I20260709 13:12:57.814728 21465 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:57.814504 21320 rpcz_store.cc:276] 0709 13:12:56.160989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.161306 (+   317us) service_pool.cc:224] Handling call
0709 13:12:56.185071 (+ 23765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.185273 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:12:56.595400 (+410127us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.813701 (+1218301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.813754 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:57.813802 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.813872 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.814072 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40668,"prepare.queue_time_us":846297,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"thread_start_us":1587084,"threads_started":2,"wal-append.queue_time_us":1010502}
I20260709 13:12:57.699126 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3286) took 1558 ms. Trace:
I20260709 13:12:57.725440 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:57.817683 21312 raft_consensus.cc:2376] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 12. Re-sending same reply.
I20260709 13:12:57.725605 22041 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:12:57.728992 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:57.819629 21315 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:57.516911 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:57.820551 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:57.729739 21285 connection.cc:256] RPC call timeout handler was delayed by -2.3943199670000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:12:57.726428 28164 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.594s	user 0.023s	sys 0.000s
W20260709 13:12:57.727824 28185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.013s	sys 0.000s
I20260709 13:12:57.718547 28269 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:57.748265 28283 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.748778 27932 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:12:57.749434 27757 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:57.750048 28086 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:57.753911 28276 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:57.754091 27918 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.755357 21214 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.865074 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:57.736617 27976 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:57.736414 28200 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:57.740636 28182 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.765614 28249 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:57.766908 28073 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:57.719475 28242 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:57.722560 28145 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:57.768775 28277 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.768707 28238 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.773362 21466 rpcz_store.cc:276] 0709 13:12:56.272501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.272618 (+   117us) service_pool.cc:224] Handling call
0709 13:12:56.272980 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.273397 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.273438 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.283942 (+ 10504us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.051350 (+767408us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:57.051401 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.051506 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.515045 (+463539us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:12:57.562145 (+ 47100us) raft_consensus.cc:1685] finished
0709 13:12:57.562169 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.562429 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73113,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":65372416,"thread_start_us":720627,"threads_started":1,"wal-append.queue_time_us":1090717}
I20260709 13:12:57.642431 28148 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.776417 21464 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:57.782975 28187 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.785982 28246 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.787276 27937 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:57.651744 27987 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:57.963121 27987 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:57.798563 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:57.809780 21389 raft_consensus.cc:2368] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:12:57.964025 28182 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.965138 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.965754 21389 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:57.966589 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.967653 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:12:57.810128 21319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.000s	sys 0.015s
W20260709 13:12:57.821533 21285 connection.cc:256] RPC call timeout handler was delayed by -2.3871199669999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260709 13:12:57.823151 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.968396 21465 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:57.968719 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3288) took 1809 ms. Trace:
I20260709 13:12:57.969071 21319 rpcz_store.cc:276] 0709 13:12:56.159071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.159264 (+   193us) service_pool.cc:224] Handling call
0709 13:12:56.173261 (+ 13997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.185210 (+ 11949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.185239 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.185708 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:12:56.893385 (+707677us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b1800386c80. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:12:57.968309 (+1074924us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:57.968349 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.968419 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.968472 (+    53us) raft_consensus.cc:1685] finished
0709 13:12:57.968483 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.968668 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15490,"raft.queue_time_us":12341,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6319,"spinlock_wait_cycles":12456320,"thread_start_us":1074729,"threads_started":1,"wal-append.queue_time_us":1391428}
I20260709 13:12:57.920547 28272 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:57.975250 21465 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:57.823729 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1588) took 1451 ms. Trace:
I20260709 13:12:57.976164 22038 rpcz_store.cc:276] 0709 13:12:56.372777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.372929 (+   152us) service_pool.cc:224] Handling call
0709 13:12:56.376645 (+  3716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.800795 (+1424150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.823523 (+ 22728us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54004696d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:57.823676 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038951680}
I20260709 13:12:57.977124 27934 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.977470 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:57.828486 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:57.977823 28200 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.979002 28200 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:57.979353 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:57.980396 27918 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.980456 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:57.844185 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.978137 22038 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:12:57.801330 27809 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:57.845964 21387 raft_consensus.cc:2368] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19.
I20260709 13:12:58.000684 21394 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:12:57.829327 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:57.848140 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:57.790586 28132 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.849241 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:12:57.849731 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.852097 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:57.854216 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 418300us
I20260709 13:12:57.854461 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.009585 21391 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:58.011405 21391 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:57.814478 28205 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:57.809249 28219 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:57.824129 28209 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:57.865471 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3010) took 1300 ms. Trace:
I20260709 13:12:57.921061 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:58.013301 22039 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:12:57.939311 21284 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:58.005970 21463 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 8.
I20260709 13:12:57.941670 22034 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: []
I20260709 13:12:57.944290 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:57.947979 21461 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:12:57.787326 28250 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:57.949218 21393 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:12:57.828112 28184 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:57.948853 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:58.017019 28282 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:58.017172 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68389.5us
I20260709 13:12:58.017829 28250 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:58.017562 28282 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.019471 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:12:58.020318 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 191064us
I20260709 13:12:58.020946 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:58.021745 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:58.022032 28147 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.022142 28154 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:58.022591 28154 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.022557 28147 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.023132 28154 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:58.023705 28186 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:57.952533 27168 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:57.956522 21467 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:57.845512 28031 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:57.860937 28086 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:57.978097 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:57.982853 21285 connection.cc:256] RPC call timeout handler was delayed by -1.9659199669999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 13:12:58.035913 21285 connection.cc:256] RPC call timeout handler was delayed by -1.7542256389999693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 13:12:58.036319 21285 connection.cc:256] RPC call timeout handler was delayed by -1.4401256390000299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:12:58.036590 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2189199669999198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29950000000000004s for a response
I20260709 13:12:57.978036 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:57.817384 21313 rpcz_store.cc:276] 0709 13:12:56.140322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.140556 (+   234us) service_pool.cc:224] Handling call
0709 13:12:56.163144 (+ 22588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.163394 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:12:56.580184 (+416790us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.332118 (+751934us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.332454 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.487744 (+155290us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b18003a2940. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2c30ec58f 00007fc2bc12b571 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd
0709 13:12:57.698570 (+210826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.698639 (+    69us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:57.698709 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.698797 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.699056 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99831,"prepare.queue_time_us":909382,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":10814,"raft.queue_time_us":215275,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":52746,"spinlock_wait_cycles":21880576,"thread_start_us":1502611,"threads_started":3,"wal-append.queue_time_us":969935}
I20260709 13:12:57.976797 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:57.995476 22042 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:12:58.038385 21464 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 12: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:57.961591 28073 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.968552 27928 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:58.004762 21468 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:12:58.013300 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 214801us
I20260709 13:12:57.864940 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.012405 28205 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:57.840250 28269 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.015935 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.028342 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.029129 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.048455 21321 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:58.028398 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:58.031796 21469 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:57.959640 28232 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:12:58.033591 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.019742 28282 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:57.955587 28145 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:58.013125 21390 rpcz_store.cc:276] 0709 13:12:56.565137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.843670 (+278533us) service_pool.cc:224] Handling call
0709 13:12:56.859932 (+ 16262us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:56.884268 (+ 24336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.884299 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:56.884932 (+   633us) log.cc:844] Serialized 52 byte log entry
0709 13:12:57.784597 (+899665us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:57.860491 (+ 75894us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.861652 (+  1161us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.865164 (+  3512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.865232 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.865272 (+    40us) raft_consensus.cc:1685] finished
0709 13:12:57.865282 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.865419 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3206,"prepare.queue_time_us":219674,"raft.queue_time_us":18995,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":88548,"thread_start_us":974824,"threads_started":2,"wal-append.queue_time_us":656671}
W20260709 13:12:58.041736 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 102563us
I20260709 13:12:57.852974 28283 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.082124 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.000994 27809 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.084813 27809 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:12:58.085394 28266 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:12:58.088513 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.089622 28258 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:12:58.092694 21388 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:58.094022 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:58.094777 21388 raft_consensus.cc:2376] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22. Re-sending same reply.
I20260709 13:12:58.045753 28249 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:58.050429 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.845525 28084 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.051059 28250 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:58.054003 27168 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:58.064487 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:58.052511 28132 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:58.024127 28186 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.024930 28209 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.102190 21387 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:58.031898 28246 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:58.051306 21214 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 10 to 20, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 20 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:58.035948 28192 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:58.035706 28245 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:58.066334 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:58.070624 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.076247 21391 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:58.049830 28215 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:12:58.080700 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.960549 28242 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.083076 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.014890 22039 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:58.082652 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.050870 28269 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.074996 27976 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:58.046347 28073 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.042435 27928 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:58.052855 28205 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:58.089618 21390 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:58.095749 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:57.960386 28277 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.033869 28219 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:58.252843 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.121825 28186 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:58.133431 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58548.9us
W20260709 13:12:58.077997 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 58589.2us
I20260709 13:12:58.134555 21395 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 23: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.138357 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:58.258092 21387 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:58.042721 28031 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:58.136982 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 70689us
I20260709 13:12:58.137143 27168 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:58.238643 21313 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:58.262425 27168 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.140604 21392 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:58.262820 27168 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:58.263224 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.244582 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.264150 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.136123 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3460) took 1144 ms. Trace:
W20260709 13:12:58.133021 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 77435.5us
I20260709 13:12:58.122066 28209 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.259168 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:58.100898 27757 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.144s
I20260709 13:12:58.125833 28192 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.134012 28245 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.261507 21316 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:12:58.279485 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.280432 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:58.262558 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:58.255975 21214 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 20, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 20 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:58.281093 22034 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:58.250748 21396 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:12:58.282998 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:58.134749 28084 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:58.264755 21388 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:12:58.267266 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:58.267355 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.286924 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.263485 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.264801 21314 rpcz_store.cc:276] 0709 13:12:56.991783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.791296 (+799513us) service_pool.cc:224] Handling call
0709 13:12:57.791578 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.791765 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:57.817231 (+ 25466us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.135664 (+318433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.135721 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:58.135777 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.135929 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.136067 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3002,"prepare.queue_time_us":25097,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":5878,"raft.queue_time_us":4672,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":99192,"thread_start_us":310291,"threads_started":1}
I20260709 13:12:58.126379 28250 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:58.142119 28270 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.266340 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:58.238862 28187 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:58.142287 28164 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.269304 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:58.125993 28194 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.134s
W20260709 13:12:58.295831 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.296358 28073 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:58.298386 28148 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:58.300323 21218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 188) took 26470 ms (client timeout 15000 ms). Trace:
I20260709 13:12:58.303177 28242 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:58.304374 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:58.305159 22034 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:58.305359 28302 raft_consensus.cc:2764] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:12:58.307817 21214 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 17, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 17 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:58.309403 28283 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:58.310918 28219 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:58.310537 21214 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 17, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 17 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.135901 28293 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:58.276237 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.136718 28147 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:58.254805 28294 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:58.284626 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.291303 22039 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:58.327980 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.291581 21387 raft_consensus.cc:2376] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15. Re-sending same reply.
I20260709 13:12:58.328570 21395 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 14.
I20260709 13:12:58.293143 21390 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:12:58.293730 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.294261 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.330353 21391 raft_consensus.cc:2393] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 12: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:58.308346 28299 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:58.337973 21396 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
W20260709 13:12:58.313668 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51186us
I20260709 13:12:58.277835 21359 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:58.275381 28192 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:58.354128 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.355113 21316 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.285750 28245 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.335625 21389 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:58.341873 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:58.300786 21218 rpcz_store.cc:269] 0709 13:12:31.669094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.669342 (+   248us) service_pool.cc:224] Handling call
0709 13:12:58.125971 (+26456629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:50.502689 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:50.503340 (+   651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:50.503389 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:12:50.503414 (+    25us) tablet.cc:662] Decoding operations
0709 13:12:50.504990 (+  1576us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:50.505063 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:50.505093 (+    30us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:12:50.506469 (+  1376us) tablet.cc:701] Row locks acquired
0709 13:12:50.506491 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:12:50.506657 (+   166us) write_op.cc:270] Start()
0709 13:12:50.506771 (+   114us) write_op.cc:276] Timestamp: P: 1783602770506605 usec, L: 0
0709 13:12:50.506794 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:12:50.507564 (+   770us) log.cc:844] Serialized 7102 byte log entry
0709 13:12:51.135882 (+628318us) op_driver.cc:464] REPLICATION: finished
0709 13:12:52.408851 (+1272969us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b18002d26e0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:52.409153 (+   302us) write_op.cc:301] APPLY: starting
0709 13:12:52.409282 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:52.795703 (+386421us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:52.795748 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:53.193618 (+397870us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:53.193991 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:12:53.194061 (+    70us) write_op.cc:312] APPLY: finished
0709 13:12:53.194588 (+   527us) log.cc:844] Serialized 164 byte log entry
0709 13:12:53.618086 (+423498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:53.637044 (+ 18958us) write_op.cc:454] Released schema lock
0709 13:12:53.654109 (+ 17065us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:53.828297 (+174188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:53.828327 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":713,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":378267,"apply.run_cpu_time_us":52941,"apply.run_wall_time_us":1419106,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79583,"num_ops":18,"prepare.queue_time_us":149968,"prepare.run_cpu_time_us":30022,"prepare.run_wall_time_us":271150,"raft.queue_time_us":170045,"raft.run_cpu_time_us":27797,"raft.run_wall_time_us":430795,"replication_time_us":596552,"spinlock_wait_cycles":139563904,"thread_start_us":1075436,"threads_started":5,"wal-append.queue_time_us":1065215,"wal-append.run_cpu_time_us":42882,"wal-append.run_wall_time_us":2328183}]]}
I20260709 13:12:58.380627 28147 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:12:58.341928 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 64208.4us
I20260709 13:12:58.383334 21314 raft_consensus.cc:2393] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.385165 21390 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:12:58.313005 28164 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:58.398299 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.398976 28164 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:58.401731 28269 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.412881 27928 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.332156 28270 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.418850 28270 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:58.420092 28184 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:58.420650 28184 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:58.420924 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.343478 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51845.9us
I20260709 13:12:58.347363 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.347604 21395 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:12:58.349049 27987 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.336985 28234 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:58.351065 21214 catalog_manager.cc:5697] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 14 to 17, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 17 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:12:58.284178 28282 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:58.442853 28282 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.442979 28293 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:12:58.312515 28187 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.334965 21462 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:58.356016 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.379585 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:58.382344 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.403815 28269 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:58.440068 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.455936 21314 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.383234 21396 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:12:58.465139 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:58.470753 21214 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 17, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 17 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:58.472699 21214 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 13, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 13 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:12:58.471342 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.480851 21314 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.481745 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.483031 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.483662 21314 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.492714 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.493878 21316 raft_consensus.cc:2393] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 10: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.485770 21436 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:58.499349 27168 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.497475 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.501394 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.501748 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.507375 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.443315 28282 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:58.443677 28234 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.389447 28147 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:58.520922 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:58.514827 28269 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:58.509893 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.389411 28277 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:58.512398 21314 raft_consensus.cc:2376] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19. Re-sending same reply.
I20260709 13:12:58.523571 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.519502 21395 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:12:58.481593 27932 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:12:58.530488 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.530699 27168 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:58.532610 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:58.533613 21468 raft_consensus.cc:2368] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:12:58.497080 28300 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:58.543610 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:58.555611 27168 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:58.552670 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:58.571489 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:58.541826 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.503744 28145 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.559037 28300 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.560190 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:58.565099 21468 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:12:58.566277 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.568084 21461 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:12:58.598678 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 75993.9us
I20260709 13:12:58.553203 27987 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.356642 28294 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.578308 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3477) took 1104 ms. Trace:
I20260709 13:12:58.602821 21315 rpcz_store.cc:276] 0709 13:12:57.473554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.843117 (+369563us) service_pool.cc:224] Handling call
0709 13:12:58.356417 (+513300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.356665 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.356705 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.356765 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:58.356819 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.356916 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.578087 (+221171us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540015c2d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:58.578242 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179746560}
I20260709 13:12:58.605047 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.605830 21315 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:58.560860 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:58.521543 28234 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:58.484212 28164 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:12:58.518667 28271 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:58.596215 21997 leader_election.cc:400] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:12:58.618207 21997 leader_election.cc:403] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:58.596611 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:58.384467 28250 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.600703 21314 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.621404 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:58.621548 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:58.628710 22031 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.630546 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.630752 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.631534 21396 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:12:58.601367 21470 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:12:58.390092 27976 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.641180 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:58.609820 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.611986 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:58.580441 28154 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
W20260709 13:12:58.617041 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.617300 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.591354 28301 log.cc:927] Time spent T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:12:58.646579 21321 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:58.646659 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.635531 21433 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:58.637651 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 116797us
W20260709 13:12:58.644507 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.648401 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:12:58.648934 21396 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.651664 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:58.651943 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.651998 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:58.652761 22034 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:12:58.653311 21314 raft_consensus.cc:2410] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:12:58.653826 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:58.655649 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.656340 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.656463 21319 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.657374 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.657832 21321 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.641939 22036 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:58.659216 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.659893 21312 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:12:58.668917 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:58.669236 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.601202 28283 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.620854 28242 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.712800 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:58.712970 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 77532us
I20260709 13:12:58.720259 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.572404 27932 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.713696 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.724700 21314 raft_consensus.cc:2410] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 23 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:12:58.730520 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.716929 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:58.713820 21315 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
W20260709 13:12:58.712970 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 63480.5us
I20260709 13:12:58.759809 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.765136 28145 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:58.767866 21315 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:12:58.768286 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.775779 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.777103 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.731086 28289 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:58.658526 28154 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.772755 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:58.773955 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:58.729816 28274 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:12:58.782995 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:58.723824 27932 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:58.727473 28283 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.788699 21470 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:12:58.778294 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:58.792626 28312 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:12:58.793497 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:58.794183 21466 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:12:58.795843 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:58.798005 21466 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:12:58.799785 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:58.792295 21317 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:12:58.640154 27918 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.130s
I20260709 13:12:58.777920 28192 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.803918 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:58.804850 21393 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:58.805356 28294 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:58.806917 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:58.807080 28192 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:58.808619 27809 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.723s	user 0.018s	sys 0.000s
I20260709 13:12:58.790165 21312 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:12:58.646042 28271 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:58.810070 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:58.810776 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48421.9us
I20260709 13:12:58.781241 21391 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:58.779541 21315 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
W20260709 13:12:58.816697 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 95922.3us
I20260709 13:12:58.818851 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:58.732733 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.834015 21319 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:58.834478 22039 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:12:58.835507 22040 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:12:58.668710 28306 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:12:58.629154 28293 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.888893 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:58.809144 27809 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.838044 28317 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:58.849062 28245 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.851233 28300 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:58.852676 28187 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:58.854503 28132 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.000s
I20260709 13:12:58.725497 27937 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:58.856767 28271 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:58.758863 28242 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:58.862943 28084 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 13:12:58.859699 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:58.828740 22002 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.534s (SENT)
W20260709 13:12:58.869848 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.958353 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 129652us
W20260709 13:12:58.845503 28307 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:12:58.891208 21396 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
W20260709 13:12:58.895289 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 218026us
I20260709 13:12:58.898926 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:58.895677 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 76910us
I20260709 13:12:58.964681 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:58.781049 28154 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:58.899842 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 81597.1us
W20260709 13:12:58.836571 28205 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:12:58.902174 21321 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 9.
I20260709 13:12:58.994329 21321 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:12:58.904932 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.923296 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 329935us
I20260709 13:12:59.009183 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:12:58.894974 28246 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.002s
I20260709 13:12:58.896059 28272 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:59.013835 22032 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:58.895864 28164 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:59.016291 28164 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.016762 28164 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:58.960712 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:59.021080 28184 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 13:12:59.021566 28184 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.022868 21316 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 15: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:12:59.024631 21314 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:12:59.028618 21315 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:58.965626 22038 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:12:58.965308 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:12:59.019899 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59275us
I20260709 13:12:58.851739 28147 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:58.995805 21321 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:59.010207 21393 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:59.037240 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:59.038546 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:58.973744 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:59.031278 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 62894.6us
W20260709 13:12:59.039819 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74252.7us
I20260709 13:12:59.040213 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:59.040479 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:59.041262 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:59.018852 27809 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:58.953011 27937 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.031376 21396 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:12:58.967013 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2374) took 1202 ms. Trace:
I20260709 13:12:59.033756 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:58.967280 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:59.042603 21389 rpcz_store.cc:276] 0709 13:12:57.764690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.967429 (+202739us) service_pool.cc:224] Handling call
0709 13:12:58.966842 (+999413us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54003430d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:58.966958 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746692480}
I20260709 13:12:59.052413 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:59.053601 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 86387.2us
I20260709 13:12:59.054519 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.012436 28132 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:59.057143 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.071636 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.073077 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.073844 21466 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:12:59.074823 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.060554 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.064702 28084 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:59.064996 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.065402 28283 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:59.066360 28315 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:59.070219 28245 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:59.089188 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 304744us
W20260709 13:12:59.092504 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55361.4us
I20260709 13:12:59.093794 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:59.094631 21389 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:12:59.041393 28154 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:59.081880 28219 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:59.086410 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 515031us
I20260709 13:12:59.112939 21461 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 25. Current term is 26. Ops: []
I20260709 13:12:59.054502 27937 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:59.039330 28246 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:59.079578 28289 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:12:59.127630 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 318235us
I20260709 13:12:59.128103 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:12:59.128537 21285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.544s (SENT) [suppressed 33 similar messages]
I20260709 13:12:59.086912 28300 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.107255 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:59.095781 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:59.078598 21466 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:12:59.134517 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:12:59.056633 28186 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.001s
I20260709 13:12:59.076150 28317 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:59.028275 28205 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.079743 28073 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:12:59.117390 28315 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:59.072254 28277 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:59.120481 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:59.054342 28316 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:59.139848 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.129280 28154 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:59.117805 27809 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.053215 28234 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.148357 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.149971 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:59.216616 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:59.217252 21395 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:12:59.152987 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:59.218603 21389 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:12:59.100488 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.130064 28289 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.126760 28003 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:59.149569 27934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.015s	sys 0.023s
W20260709 13:12:59.180096 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.112500 27932 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:12:59.181066 22038 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:59.181622 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:12:59.131125 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:59.240536 21387 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 14.
I20260709 13:12:59.184551 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:59.152968 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 501032us
I20260709 13:12:59.195255 21388 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:59.241446 22042 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:59.117800 28247 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:12:59.219579 21470 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:12:59.182003 28317 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:59.212477 28277 raft_consensus.cc:697] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:59.202855 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.260174 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.242874 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:59.261801 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.263392 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.247990 22035 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:12:59.184139 28073 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:59.251179 21469 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:12:59.194126 28316 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.146997 28300 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.254014 21387 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:59.150337 28186 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.289902 28277 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:59.290907 28316 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.291797 28186 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.292275 21396 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:12:59.292469 28186 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:59.257050 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.293975 28300 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.292307 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:59.295734 21470 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:12:59.258116 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:59.296602 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3484) took 1601 ms. Trace:
I20260709 13:12:59.297212 21461 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:12:59.298131 28250 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:59.298456 28182 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:59.298835 28182 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:59.258878 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:12:59.301250 22042 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:59.219576 28304 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:59.303323 28304 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.305548 28304 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.305984 27928 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:59.306741 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1385) took 1526 ms. Trace:
I20260709 13:12:59.307147 21388 rpcz_store.cc:276] 0709 13:12:57.780575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.356844 (+576269us) service_pool.cc:224] Handling call
0709 13:12:58.385348 (+ 28504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.241545 (+856197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.306494 (+ 64949us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54002ccc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:59.306681 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862179200}
I20260709 13:12:59.276926 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.253219 27918 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.308892 27918 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:59.310134 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2943) took 1461 ms. Trace:
W20260709 13:12:59.310451 22032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1649) took 1527 ms (client timeout 1892 ms). Trace:
I20260709 13:12:59.310580 21462 rpcz_store.cc:276] 0709 13:12:57.848892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.849010 (+   118us) service_pool.cc:224] Handling call
0709 13:12:59.309941 (+1460931us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540025dd54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:59.310071 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598570368}
I20260709 13:12:59.234532 28003 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:12:59.310976 22032 rpcz_store.cc:269] 0709 13:12:57.783237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.786389 (+  3152us) service_pool.cc:224] Handling call
0709 13:12:59.310229 (+1523840us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540048b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:59.310360 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2820295040}
I20260709 13:12:59.311686 28003 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:59.236400 28289 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:59.317133 28317 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:59.318847 28272 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:59.319594 28154 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.311336 27918 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:12:59.238698 27934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.015s	sys 0.023s
W20260709 13:12:59.320487 28321 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:12:59.322407 28031 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.289723 28319 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:12:59.324680 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47965.2us
I20260709 13:12:59.328090 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.329371 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.219084 27809 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.296967 21320 rpcz_store.cc:276] 0709 13:12:57.695584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.846451 (+150867us) service_pool.cc:224] Handling call
0709 13:12:57.853090 (+  6639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.126857 (+273767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.126901 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:58.239610 (+112709us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.499300 (+259690us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:58.499342 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.296268 (+796926us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54000fc154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:59.296311 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.296353 (+    42us) raft_consensus.cc:1685] finished
0709 13:12:59.296366 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.296551 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5320,"raft.queue_time_us":8739,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7654,"spinlock_wait_cycles":628562304,"thread_start_us":229114,"threads_started":1,"wal-append.queue_time_us":314011}
I20260709 13:12:59.331650 27168 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:59.295914 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:59.273301 28269 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:59.275223 28132 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:59.285297 27987 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:12:59.342334 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.345011 27168 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:59.346415 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:59.347690 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.272755 28314 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.065s
I20260709 13:12:59.353606 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:12:59.327281 28319 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:59.356285 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:59.358359 21320 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:12:59.359593 27168 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:59.360110 27168 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:59.360581 27168 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.362995 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:59.299638 28182 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.363583 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.342756 28272 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:59.336956 28316 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.347187 27987 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:59.379140 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83285.1us
I20260709 13:12:59.359128 28319 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:59.353827 28332 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:59.289793 28073 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.353770 28323 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:59.365239 28242 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.402429 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:59.380759 27987 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:59.380833 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:59.403034 28269 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:59.326757 28315 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:59.431509 28234 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.416812 28182 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:59.448918 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.447978 21320 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
W20260709 13:12:59.454676 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 346334us
W20260709 13:12:59.446278 28282 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.898s	user 0.004s	sys 0.007s
I20260709 13:12:59.508302 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3038) took 1463 ms. Trace:
I20260709 13:12:59.484536 22034 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:12:59.485450 21313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 1047) took 1427 ms (client timeout 1529 ms). Trace:
W20260709 13:12:59.575044 21313 rpcz_store.cc:269] 0709 13:12:58.057769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.268309 (+210540us) service_pool.cc:224] Handling call
0709 13:12:59.485204 (+1216895us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b540022d8d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:59.485357 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027105664}
I20260709 13:12:59.494333 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3316) took 1146 ms. Trace:
W20260709 13:12:59.465329 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 84583.7us
W20260709 13:12:59.481968 22035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1648) took 1699 ms (client timeout 2028 ms). Trace:
I20260709 13:12:59.507484 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:59.579938 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:12:59.483685 27168 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:59.488314 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 381051us
I20260709 13:12:59.576514 21315 rpcz_store.cc:276] 0709 13:12:58.347490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.818775 (+471285us) service_pool.cc:224] Handling call
0709 13:12:59.028250 (+209475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.029099 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.494073 (+464974us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540021a7d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:59.494256 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481039616}
I20260709 13:12:59.581969 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:59.582348 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:59.499081 22032 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:59.583698 21315 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:59.483948 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 1051) took 1243 ms. Trace:
W20260709 13:12:59.579072 22035 rpcz_store.cc:269] 0709 13:12:57.782917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.787306 (+  4389us) service_pool.cc:224] Handling call
0709 13:12:59.481711 (+1694405us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003188d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:12:59.481876 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2694513920}
W20260709 13:12:59.487216 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 359159us
I20260709 13:12:59.579841 22042 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.505318 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:59.584316 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:59.496624 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 376250us
I20260709 13:12:59.721175 27168 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:12:59.464320 28245 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.662395 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.570760 28322 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:12:59.638159 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:59.729400 21320 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:59.496846 27932 consensus_queue.cc:1243] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:12:59.430536 28003 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:59.712119 28318 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:12:59.569037 28242 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:59.584880 21312 rpcz_store.cc:276] 0709 13:12:58.240852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.762832 (+521980us) service_pool.cc:224] Handling call
0709 13:12:58.789540 (+ 26708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.824142 (+ 34602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.483592 (+659450us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b540035aaa0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18fdc0 00007fc2bf21ba02 00007fc2bf217dd6 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:12:59.483842 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120301824}
I20260709 13:12:59.573097 28332 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:59.497184 28215 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:59.435190 28205 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.573750 21391 rpcz_store.cc:276] 0709 13:12:58.044998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.357779 (+312781us) service_pool.cc:224] Handling call
0709 13:12:58.358189 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.818162 (+459973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.508008 (+689846us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54002cc754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:59.508212 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737530624}
I20260709 13:12:59.712862 28187 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:12:59.710839 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 128537us
I20260709 13:12:59.724725 28186 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:59.715716 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:12:59.505481 28184 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:12:59.712144 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 349126us
I20260709 13:12:59.771265 21320 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:59.721510 21393 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:59.719847 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:59.522259 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.711925 21362 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:59.724184 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.774848 21434 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:12:59.725045 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 140278us
W20260709 13:12:59.725099 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 219859us
W20260709 13:12:59.775353 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.778048 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:12:59.725793 21315 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:59.499571 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:59.731702 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:59.505245 28148 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.204s
I20260709 13:12:59.499905 28323 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:12:59.716799 28327 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.386s	user 0.003s	sys 0.004s
I20260709 13:12:59.733748 28293 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.740404 22031 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:12:59.798892 28341 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:59.798547 28293 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:59.712306 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 134770us
I20260709 13:12:59.802503 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:12:59.726858 28271 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:59.805507 28086 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.763486 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:59.779773 22002 leader_election.cc:336] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.211s (SENT)
W20260709 13:12:59.783228 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51642us
I20260709 13:12:59.783799 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:59.785020 22042 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:12:59.785606 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:12:59.786295 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.787161 21470 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:59.827076 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.744179 28234 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:59.789644 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:12:59.756666 28334 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
W20260709 13:12:59.793718 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 81868.4us
I20260709 13:12:59.793076 27168 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:12:59.772500 28339 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:12:59.742707 28242 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:59.763556 28215 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:12:59.587129 28282 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.754730 27809 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.726770 28276 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:59.803985 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:12:59.798947 28003 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.578346 28250 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:12:59.795095 27932 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:59.788717 28277 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:12:59.808795 28293 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:59.810353 28269 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:12:59.810544 28289 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.800104 27928 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.816241 28316 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.819823 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:12:59.734447 28245 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:12:59.828338 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48611.5us
I20260709 13:12:59.896055 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:12:59.879357 28333 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.464s	user 0.000s	sys 0.001s
W20260709 13:12:59.846707 21317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.015s	sys 0.032s
I20260709 13:12:59.899792 21284 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:12:59.799721 28205 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:59.804720 28184 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:59.773305 28187 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.857664 28215 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:12:59.856423 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 93073us
W20260709 13:12:59.857571 28145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.017s	sys 0.033s
I20260709 13:12:59.855185 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1133) took 1321 ms. Trace:
W20260709 13:12:59.851228 28284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.033s	sys 0.015s
I20260709 13:12:59.892599 21312 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:59.898085 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:12:59.889762 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1662) took 1240 ms. Trace:
I20260709 13:12:59.828596 22038 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:59.899817 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:59.895862 21320 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:12:59.904059 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:12:59.905198 21317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.015s	sys 0.033s
W20260709 13:12:59.819566 28337 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:12:59.905773 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:12:59.908753 21394 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:12:59.858038 28242 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:59.845901 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3315) took 1509 ms. Trace:
I20260709 13:12:59.940580 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:12:59.927004 27937 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.000s
I20260709 13:12:59.852589 28234 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:59.968266 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:59.889287 27932 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:12:59.979192 27932 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:59.965003 27976 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:59.983743 28205 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:12:59.984880 28205 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:59.985283 28205 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:12:59.890637 27918 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.986212 28205 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.986315 27918 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:59.987648 28205 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.848951 28294 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:12:59.894567 28348 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:59.892860 27809 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:59.948443 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50540.1us
I20260709 13:12:59.948645 22042 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.066968 28182 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:00.067541 28182 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:12:59.949229 21315 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:13:00.068821 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:59.949947 21464 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:12:59.878829 28324 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.948313 22041 rpcz_store.cc:276] 0709 13:12:58.649642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.654672 (+  5030us) service_pool.cc:224] Handling call
0709 13:12:58.726155 (+ 71483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.726382 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:12:58.771357 (+ 44975us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.115775 (+344418us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.493305 (+377530us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18004713a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:12:59.497646 (+  4341us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b18004713a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:12:59.889038 (+391392us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.889248 (+   210us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:59.889378 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.889512 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.889686 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":366216,"prepare.queue_time_us":57378,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":378979,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":11594,"spinlock_wait_cycles":44976896,"thread_start_us":723767,"threads_started":2,"wal-append.queue_time_us":483196}
I20260709 13:12:59.953313 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 1019) took 1221 ms. Trace:
I20260709 13:13:00.072052 22040 rpcz_store.cc:276] 0709 13:12:58.826590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.861788 (+ 35198us) service_pool.cc:224] Handling call
0709 13:12:58.862185 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.862435 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.862459 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:58.862998 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.132549 (+269551us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:59.132589 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.132655 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.953113 (+820458us) raft_consensus.cc:1685] finished
0709 13:12:59.953134 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.953253 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":269015,"threads_started":1,"wal-append.queue_time_us":489524}
I20260709 13:12:59.884601 28246 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 13:12:59.962090 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 1072) took 1196 ms. Trace:
I20260709 13:13:00.077435 21314 rpcz_store.cc:276] 0709 13:12:58.765834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.026315 (+260481us) service_pool.cc:224] Handling call
0709 13:12:59.026686 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:59.027126 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:59.027166 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:59.027701 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.350044 (+322343us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:59.350122 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.350285 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.961871 (+611586us) raft_consensus.cc:1685] finished
0709 13:12:59.961891 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.962034 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3993,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3795,"thread_start_us":316797,"threads_started":1,"wal-append.queue_time_us":435160}
I20260709 13:13:00.079548 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:12:59.947837 21467 rpcz_store.cc:276] 0709 13:12:58.533588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.534452 (+   864us) service_pool.cc:224] Handling call
0709 13:12:58.534772 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.559413 (+ 24641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.559443 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:58.559927 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.944354 (+384427us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:58.944395 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.302958 (+358563us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b540029a9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:12:59.303007 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.845431 (+542424us) raft_consensus.cc:1685] finished
0709 13:12:59.845452 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.855106 (+  9654us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1139,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":55728896,"thread_start_us":384014,"threads_started":1,"wal-append.queue_time_us":634598}
I20260709 13:12:59.963645 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:12:59.792482 28332 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.926608 28086 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:59.954952 28323 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:59.952414 28284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.034s	sys 0.015s
I20260709 13:12:59.973150 28302 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.953138 28293 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:59.967830 21318 rpcz_store.cc:276] 0709 13:12:58.336687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.813918 (+477231us) service_pool.cc:224] Handling call
0709 13:12:58.891351 (+ 77433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.891618 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:59.370485 (+478867us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.845569 (+475084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.845623 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:59.845670 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.845733 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.845838 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":532520,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":84,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7288,"thread_start_us":953158,"threads_started":2}
I20260709 13:12:59.973562 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:00.126668 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:12:59.977284 28340 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:12:59.989120 27918 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:12:59.891122 28276 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:12:59.992995 28187 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:12:59.992921 27937 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:12:59.926254 28184 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:00.089109 28349 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:59.925808 28154 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:12:59.995875 27987 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:12:59.947666 28145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.017s	sys 0.033s
I20260709 13:12:59.893040 28247 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.069s
I20260709 13:12:59.926937 27928 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.002327 28282 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:00.004076 28209 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.723s	user 0.012s	sys 0.001s
I20260709 13:13:00.008503 27932 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.009676 28143 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.012310 28245 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:00.012678 28132 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.666s	user 0.003s	sys 0.008s
I20260709 13:12:59.925930 28346 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:00.015664 28238 raft_consensus.cc:2764] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:13:00.191663 28316 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.192688 28143 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.192858 28316 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.017889 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:00.195097 28143 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:00.195753 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.021438 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:00.179181 28182 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.021867 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3492) took 1393 ms. Trace:
I20260709 13:13:00.197175 21316 rpcz_store.cc:276] 0709 13:12:58.628156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.024125 (+395969us) service_pool.cc:224] Handling call
0709 13:12:59.024462 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:59.024676 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:59.024700 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:59.025135 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.370103 (+344968us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:59.370155 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.370247 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:00.021578 (+651331us) raft_consensus.cc:1685] finished
0709 13:13:00.021610 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.021799 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":344600,"threads_started":1,"wal-append.queue_time_us":592461}
W20260709 13:13:00.198660 28319 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.734s	user 0.006s	sys 0.003s
I20260709 13:13:00.024740 28289 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:00.024870 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 3054) took 1423 ms. Trace:
I20260709 13:13:00.025894 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:12:59.962236 28342 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:13:00.200906 27987 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:00.201172 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 175372us
W20260709 13:13:00.033110 28345 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.640s	user 0.005s	sys 0.000s
I20260709 13:12:59.971947 28308 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:00.037732 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1664) took 1387 ms. Trace:
I20260709 13:13:00.052767 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1665) took 1402 ms. Trace:
I20260709 13:13:00.205066 22031 rpcz_store.cc:276] 0709 13:12:58.650364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.658503 (+  8139us) service_pool.cc:224] Handling call
0709 13:12:58.658814 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.799120 (+1140306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.052425 (+253305us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400647654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:00.052686 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479672192}
W20260709 13:13:00.055786 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 277044us
I20260709 13:13:00.204967 22034 rpcz_store.cc:276] 0709 13:12:58.650132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.654906 (+  4774us) service_pool.cc:224] Handling call
0709 13:12:59.484120 (+829214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.581080 (+ 96960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.037486 (+456406us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54003188d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:00.037662 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906298240}
I20260709 13:13:00.069928 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:13:00.084859 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 121340us
I20260709 13:13:00.088465 21314 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 25. Current term is 26. Ops: []
I20260709 13:13:00.206986 22038 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:00.094907 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2952) took 1035 ms. Trace:
W20260709 13:13:00.099736 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 295791us
I20260709 13:13:00.208941 21285 leader_election.cc:400] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:00.209215 21285 leader_election.cc:403] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:00.092108 22042 raft_consensus.cc:2468] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 11.
W20260709 13:13:00.119669 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.076990 28272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.009s	sys 0.015s
I20260709 13:13:00.126187 27168 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:00.161914 28364 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:13:00.214011 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:00.214316 27168 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:00.138298 21312 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:59.975800 28234 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:12:59.891723 28250 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.170197 22040 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:13:00.229023 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:00.156643 28277 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:13:00.174546 28219 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.051s	user 0.008s	sys 0.005s
I20260709 13:13:00.168527 28184 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:00.190244 28132 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:00.187987 28209 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:00.016770 28164 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.999s	user 0.012s	sys 0.001s
I20260709 13:13:00.192348 21315 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:00.192233 27932 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.202570 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.200647 21394 rpcz_store.cc:276] 0709 13:12:58.601328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.636007 (+ 34679us) service_pool.cc:224] Handling call
0709 13:13:00.024568 (+1388561us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001ecb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:00.024764 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748564352}
I20260709 13:13:00.088259 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:00.208243 21464 rpcz_store.cc:276] 0709 13:12:59.059390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.059510 (+   120us) service_pool.cc:224] Handling call
0709 13:13:00.094664 (+1035154us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400216454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:00.094850 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996822272}
W20260709 13:13:00.220997 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 446219us
W20260709 13:13:00.206965 28353 log.cc:927] Time spent T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:13:00.229292 22040 pending_rounds.cc:85] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 12
W20260709 13:13:00.170769 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.231185 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:00.231204 21321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3494) took 1230 ms. Trace:
I20260709 13:13:00.231954 21359 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.205106 28282 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:00.204751 28308 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:00.192992 28242 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.195137 28316 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:00.256809 28343 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.827s	user 0.000s	sys 0.005s
I20260709 13:13:00.257241 28369 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:00.257468 28164 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:00.257879 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49059.6us
W20260709 13:13:00.258278 28367 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:13:00.259318 22040 pending_rounds.cc:107] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:13:00.239326 27168 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:00.277596 22040 raft_consensus.cc:2889] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:00.277771 27168 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:00.254769 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:00.230379 27918 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
W20260709 13:13:00.280534 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48657.3us
I20260709 13:13:00.260525 21318 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:00.260965 22038 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:00.260428 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1390) took 1962 ms. Trace:
I20260709 13:13:00.269269 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.260936 21321 rpcz_store.cc:276] 0709 13:12:59.001315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.038315 (+ 37000us) service_pool.cc:224] Handling call
0709 13:12:59.038586 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:59.042434 (+  3848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:59.042462 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:59.061559 (+ 19097us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.359488 (+297929us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:59.359532 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.359601 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:00.230946 (+871345us) raft_consensus.cc:1685] finished
0709 13:13:00.230974 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.231134 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3679,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":14956,"thread_start_us":297194,"threads_started":1,"wal-append.queue_time_us":710597}
I20260709 13:13:00.261101 28308 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:00.281540 21390 rpcz_store.cc:276] 0709 13:12:58.298228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.502408 (+204180us) service_pool.cc:224] Handling call
0709 13:12:58.524456 (+ 22048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.607901 (+ 83445us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:12:59.068377 (+460476us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b18003fc640. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2c2c103c7 00007fc2bf2229a7 00007fc2bf2320bf 00007fc2bf232038
0709 13:12:59.068656 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.449137 (+380481us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:59.477295 (+ 28158us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.477462 (+   167us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:12:59.477498 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.477566 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:00.254874 (+777308us) raft_consensus.cc:1685] finished
0709 13:13:00.260210 (+  5336us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.260371 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86579,"prepare.queue_time_us":462612,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":111473,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":119141,"spinlock_wait_cycles":11937152,"thread_start_us":448497,"threads_started":2,"wal-append.queue_time_us":606360}
I20260709 13:13:00.264487 22034 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:00.234568 28277 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.268201 21392 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 9: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:00.235625 28349 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:13:00.199098 28319 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.273553 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:00.269375 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3314) took 1962 ms. Trace:
I20260709 13:13:00.190666 28346 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.139158 28302 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.276427 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3318) took 1801 ms. Trace:
I20260709 13:13:00.267830 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:00.273797 21312 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:00.299008 21469 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:00.229785 28284 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:13:00.234254 28314 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:13:00.300343 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:00.300984 21312 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:13:00.281075 28132 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:13:00.298784 21319 rpcz_store.cc:276] 0709 13:12:58.475089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.933449 (+458360us) service_pool.cc:224] Handling call
0709 13:12:58.933839 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.934068 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:12:59.337681 (+403613us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.952785 (+615104us) log.cc:844] Serialized 14 byte log entry
0709 13:13:00.266772 (+313987us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:00.266825 (+    53us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:00.266868 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.276147 (+  9279us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.276366 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6704,"prepare.queue_time_us":490321,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":218719,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":11083,"thread_start_us":1295931,"threads_started":4,"wal-append.queue_time_us":614652}
I20260709 13:13:00.302671 28164 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:00.303848 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:00.304718 21319 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:00.293612 28277 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:00.312942 27937 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.314901 28302 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.315871 22031 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:00.317464 28319 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.317692 28369 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:00.318472 28369 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.319110 27168 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.320082 27168 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:00.238672 28219 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:00.321673 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.286352 28373 raft_consensus.cc:2764] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:13:00.288270 28316 raft_consensus.cc:2804] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:00.282788 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.218971 28348 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:13:00.219707 28276 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.294317 21317 rpcz_store.cc:276] 0709 13:12:58.307177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.804777 (+497600us) service_pool.cc:224] Handling call
0709 13:12:58.805049 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.805240 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:59.192894 (+387654us) log.cc:844] Serialized 14 byte log entry
0709 13:13:00.269041 (+1076147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:00.269092 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:00.269138 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.269201 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.269322 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":580920,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":144936,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":37627,"thread_start_us":1462963,"threads_started":3,"wal-append.queue_time_us":787402}
I20260709 13:13:00.326978 21467 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
W20260709 13:13:00.387388 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 291314us
I20260709 13:13:00.335745 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:00.284495 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:00.078648 28324 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:00.391863 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 109183us
I20260709 13:13:00.390005 21321 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:00.389135 21313 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:13:00.388900 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 246274us
I20260709 13:13:00.393038 22032 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:00.392647 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.414886 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:00.418711 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 3034) took 2399 ms. Trace:
I20260709 13:13:00.419330 21392 rpcz_store.cc:276] 0709 13:12:58.019156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.312716 (+293560us) service_pool.cc:224] Handling call
0709 13:13:00.418466 (+2105750us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400342bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:00.418635 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4168305920}
I20260709 13:13:00.318889 28369 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:00.429080 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:00.429726 21392 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:00.430104 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 219416us
I20260709 13:13:00.430828 21360 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:00.433460 28349 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:13:00.434623 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 232119us
I20260709 13:13:00.440613 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:00.434904 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 100360us
W20260709 13:13:00.392050 28371 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:13:00.442200 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:00.444638 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52077.9us
I20260709 13:13:00.446820 28182 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:00.447263 28182 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:00.447216 28347 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:00.447835 28182 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:00.448135 28282 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:00.448865 28282 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:00.449311 28282 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:00.450199 28282 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.452396 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.438437 28349 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:00.453323 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.453752 28349 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.454234 27918 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:00.454854 28349 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:00.454994 28332 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:00.455408 28332 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:00.455806 28332 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:00.460681 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:00.454609 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.461804 21313 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:00.415913 28316 raft_consensus.cc:697] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:00.444300 21392 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:13:00.489733 28182 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.493300 28242 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.494243 28209 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:00.498343 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43774.8us
I20260709 13:13:00.511739 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:00.449318 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:00.499919 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 201451us
I20260709 13:13:00.512382 28182 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.501067 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:00.514290 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:13:00.515105 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 65859.4us
I20260709 13:13:00.443022 27937 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:00.425894 28375 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:00.518330 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:00.518815 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.518972 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:00.519953 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:00.533694 21319 raft_consensus.cc:2393] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 9: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:00.533593 21467 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:00.521661 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:00.535550 21997 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:00.511240 28316 consensus_queue.cc:237] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.522678 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:00.523203 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:00.523604 21468 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:13:00.528237 28358 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:00.530349 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:00.537755 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:00.537855 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:00.462426 27918 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:00.564159 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:00.323273 28315 consensus_queue.cc:1175] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfcd9560f8f44414b25f8069384c5a73" responder_term: 20 status { last_received { term: 19 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:00.542414 27928 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:00.520660 27937 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:00.545797 27932 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:00.546541 28250 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:00.546976 28346 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:00.547474 28375 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:00.548261 28324 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.495846 28314 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:00.486618 27976 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:00.633256 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:00.633738 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:00.633935 21467 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:13:00.556171 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:00.565088 21316 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:00.565629 21461 raft_consensus.cc:2393] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:00.577208 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:00.513521 28219 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:00.550552 28247 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.520387 28376 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:00.557575 28347 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:00.551177 28373 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:00.550904 28147 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:00.550349 28154 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:00.580981 27918 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.587523 21314 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:00.787971 21316 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:00.597149 22038 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:13:00.601142 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:00.564592 28364 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:00.557986 27934 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:00.636703 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 80619.2us
W20260709 13:13:00.649890 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.654068 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.550128 28186 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:13:00.551400 28242 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.078s
I20260709 13:13:00.697572 28247 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.590461 28277 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.671437 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:00.599983 27932 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.599694 27937 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:00.632562 28366 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:00.747175 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:00.877489 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:00.878157 21470 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:00.878645 21396 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:00.878732 21387 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:13:00.878927 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:00.879575 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:00.735967 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:00.638404 27976 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:00.880286 21467 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:00.880781 27976 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.881832 27976 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:00.695546 28250 raft_consensus.cc:2764] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:13:00.879914 21470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:13:00.884889 21470 raft_consensus.cc:606] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:13:00.696290 28086 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.004s
I20260709 13:13:00.667856 28376 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:00.886580 28376 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:00.888374 22036 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:13:00.888255 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.888978 22036 pending_rounds.cc:85] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 12
I20260709 13:13:00.889295 22036 pending_rounds.cc:107] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:13:00.889525 22036 raft_consensus.cc:2889] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:00.695564 28373 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:00.889856 28348 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:00.890479 28373 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:00.781026 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 226893us
I20260709 13:13:00.892244 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:00.735823 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.595932 21319 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:00.898814 21467 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:00.744422 28147 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:00.901301 28147 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:00.902251 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.793018 27168 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:00.905766 27168 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:00.889551 28186 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:00.906562 27168 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.907292 28186 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:00.696169 28347 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.908628 28346 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:00.908223 28186 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:00.909683 28347 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:00.817061 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.533897 28302 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:13:00.825709 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:00.826242 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:00.913230 28376 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:00.914155 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 87984.4us
I20260709 13:13:00.915362 28376 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.830269 21314 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:13:00.917652 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:00.832129 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:00.795913 28164 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:00.867259 21392 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:00.920290 28164 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:00.920933 28324 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:00.921263 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:00.922109 28143 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.877642 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:00.922631 28143 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.922932 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:00.866706 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:00.924328 21395 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:00.925246 28143 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:00.695959 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 2953) took 1636 ms. Trace:
I20260709 13:13:00.926729 21463 rpcz_store.cc:276] 0709 13:12:59.059752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.060276 (+   524us) service_pool.cc:224] Handling call
0709 13:13:00.672136 (+1611860us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540025bf54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:00.695897 (+ 23761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642340736}
I20260709 13:13:00.866300 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:00.928643 21463 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:13:00.695796 28154 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.929379 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:00.929838 28154 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:00.930675 21389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:13:00.931349 21389 raft_consensus.cc:606] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:13:00.792158 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 191094us
I20260709 13:13:00.902666 28245 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:00.937281 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:00.920367 21461 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:00.921377 28164 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.879173 21387 pending_rounds.cc:85] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 3
I20260709 13:13:00.921444 28324 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:00.938618 28164 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:00.939474 28324 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:00.938530 21387 pending_rounds.cc:107] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:13:00.943136 21387 raft_consensus.cc:2889] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:00.944583 21387 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:13:00.939486 21392 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:13:00.945797 21387 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:13:00.946552 21392 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:00.947911 21395 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:00.863444 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:00.951239 28245 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:00.961519 28143 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:00.962817 28284 raft_consensus.cc:993] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: : Instructing follower 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:13:00.963352 28284 raft_consensus.cc:1081] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Signalling peer 058db415e9884ea0ba23f1e1ff59127a to start an election
I20260709 13:13:00.968830 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:00.978605 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:00.835337 28205 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.003s
I20260709 13:13:00.993675 22038 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:00.992542 21360 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:00.836447 27932 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:00.856184 28308 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
W20260709 13:13:00.984838 28369 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 13:13:00.863015 27987 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.859869 28358 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.860441 28271 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:00.827945 27934 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:01.015125 21467 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:01.017586 21434 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:01.004820 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:01.178362 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 173621us
I20260709 13:13:01.179325 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:01.018657 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 193031us
I20260709 13:13:00.985013 28306 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:01.250098 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 66572.6us
I20260709 13:13:01.173265 28347 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:00.838230 28375 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:01.002351 28308 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:01.263656 28308 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:01.264181 21464 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 24. Current term is 25. Ops: []
W20260709 13:13:01.305789 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 91190.2us
I20260709 13:13:01.177636 27928 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:01.318993 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.168956 28250 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:01.254506 28284 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 13:13:01.397454 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:01.172269 28358 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.321354 21360 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:01.193156 28346 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:01.253772 21319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5"
dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:45126
I20260709 13:13:01.405185 21319 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.405786 21319 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:01.247444 28306 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.191587 28276 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:01.188207 28205 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:01.025640 28400 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:13:01.360994 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 102528us
I20260709 13:13:01.423753 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:01.425282 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:01.069720 28369 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:01.426260 21393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.017s
W20260709 13:13:01.430699 21393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.000s	sys 0.017s
W20260709 13:13:01.363768 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.188495 28271 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.402654 21314 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
W20260709 13:13:01.371764 28282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.031s	sys 0.030s
W20260709 13:13:01.378154 28394 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.630s	user 0.001s	sys 0.000s
I20260709 13:13:01.168718 28366 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:01.410624 28246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.044s	sys 0.073s
W20260709 13:13:01.419109 22032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.041s	sys 0.049s
W20260709 13:13:01.474737 22032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.041s	sys 0.049s
W20260709 13:13:01.436669 28364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.024s	sys 0.056s
W20260709 13:13:01.455350 28282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.031s	sys 0.031s
I20260709 13:13:01.368789 21396 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:01.442914 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:01.403394 28347 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.398617 28348 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:13:01.453805 21389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.004s	sys 0.013s
I20260709 13:13:01.405258 28409 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.411549 28360 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
W20260709 13:13:01.426141 28147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.012s
I20260709 13:13:01.375443 27928 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:01.462510 21435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.016s
W20260709 13:13:01.438875 28186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.008s	sys 0.012s
I20260709 13:13:01.464051 21469 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
W20260709 13:13:01.521468 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.006s	sys 0.017s
I20260709 13:13:01.482252 28284 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.410997 28276 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:01.334122 27987 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:01.455646 28392 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.650s	user 0.001s	sys 0.000s
I20260709 13:13:01.436968 28242 raft_consensus.cc:2764] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:13:01.509723 28401 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
W20260709 13:13:01.489924 21389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.005s	sys 0.013s
W20260709 13:13:01.458482 27168 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.001s	sys 0.013s
W20260709 13:13:01.475409 28396 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.645s	user 0.001s	sys 0.000s
I20260709 13:13:01.463063 28376 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:13:01.478523 28364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.024s	sys 0.056s
I20260709 13:13:01.593087 28364 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:01.593820 28184 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.338s	user 0.007s	sys 0.004s
I20260709 13:13:01.594261 28364 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:01.596268 28395 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.536s	user 0.001s	sys 0.000s
I20260709 13:13:01.598384 28219 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.598960 28219 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.600314 28276 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:01.603130 22041 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:13:01.603515 21470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.003s	sys 0.007s
W20260709 13:13:01.477978 28246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.045s	sys 0.073s
W20260709 13:13:01.503917 28399 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
W20260709 13:13:01.504848 28408 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:13:01.505331 28410 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:13:01.506558 28402 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:13:01.524590 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.496565 28215 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.531s	user 0.009s	sys 0.005s
W20260709 13:13:01.511211 22002 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.005s	sys 0.017s
W20260709 13:13:01.625990 22002 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.005s	sys 0.017s
I20260709 13:13:01.500805 28409 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.483043 28308 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:01.525712 21319 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:01.464287 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.010s
I20260709 13:13:01.490268 28182 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:01.502235 28147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.005s	sys 0.013s
W20260709 13:13:01.522617 21435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.001s	sys 0.016s
W20260709 13:13:01.525733 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.017s
I20260709 13:13:01.497212 28348 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.526955 28247 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:01.488058 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:01.450911 28400 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:01.525401 28186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.012s
I20260709 13:13:01.523329 28277 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:01.565371 27168 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.002s	sys 0.014s
I20260709 13:13:01.649708 27168 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:01.556166 28284 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.474856 28366 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.492975 28347 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.777246 28271 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:01.583000 21461 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
W20260709 13:13:01.559415 28238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.006s	sys 0.045s
I20260709 13:13:01.585882 28232 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:01.592417 28376 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:01.944811 28376 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:01.945665 28332 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.489s	user 0.007s	sys 0.004s
I20260709 13:13:01.947080 28247 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:01.603832 21470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.003s	sys 0.007s
W20260709 13:13:01.603268 28373 consensus_meta.cc:287] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.000s
I20260709 13:13:01.634106 27928 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:01.626307 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 729151us
W20260709 13:13:01.949465 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.525098 21391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.015s	sys 0.092s
W20260709 13:13:01.951061 21391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.018s	sys 0.093s
W20260709 13:13:01.631919 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.008s	sys 0.010s
I20260709 13:13:01.584599 27934 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:01.625392 28349 consensus_meta.cc:287] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.170s	user 0.011s	sys 0.005s
I20260709 13:13:01.500983 28406 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:01.663275 28242 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:01.663538 21388 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:01.873010 28308 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.665668 28277 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:01.594305 28184 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:01.669098 28397 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.556s	user 0.000s	sys 0.002s
W20260709 13:13:01.672184 28407 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
W20260709 13:13:01.667729 27932 consensus_meta.cc:287] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.001s
W20260709 13:13:01.879694 21395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.000s	sys 0.031s
W20260709 13:13:01.886068 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.977244 21395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.001s	sys 0.031s
I20260709 13:13:01.977401 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1684) took 1365 ms. Trace:
I20260709 13:13:01.925827 28232 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:01.938314 28284 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:01.939509 28369 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:01.632377 28215 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.634490 28410 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:01.872499 28154 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.002s
W20260709 13:13:01.951710 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 1.0188e+06us
W20260709 13:13:01.873309 28238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.006s	sys 0.046s
I20260709 13:13:01.664806 28400 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:01.946237 28332 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:01.781564 28366 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:01.947678 28247 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.948150 28373 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:01.931705 21315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3323) took 2050 ms (client timeout 2326 ms). Trace:
W20260709 13:13:01.984167 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.056490 21315 rpcz_store.cc:269] 0709 13:12:59.881427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.068572 (+187145us) service_pool.cc:224] Handling call
0709 13:13:01.931459 (+1862887us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540032b4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:01.931640 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281854848}
I20260709 13:13:01.955734 28242 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.982239 22034 rpcz_store.cc:276] 0709 13:13:00.595080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.595754 (+   674us) service_pool.cc:224] Handling call
0709 13:13:00.596083 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.596386 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.596411 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.596945 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:13:00.777873 (+180928us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:00.777972 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.778106 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:01.776942 (+998836us) raft_consensus.cc:1685] finished
0709 13:13:01.776964 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.960921 (+183957us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":289548,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":180527,"threads_started":1,"wal-append.queue_time_us":579990}
I20260709 13:13:01.962270 28308 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.993075 21388 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:13:01.990540 27932 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:01.995996 28219 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:01.996202 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:01.959887 28277 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:02.038208 28347 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:02.013057 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 525177us
I20260709 13:13:02.072888 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:02.013134 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.007s	sys 0.018s
I20260709 13:13:02.016705 22039 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
W20260709 13:13:01.998720 21268 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.007s	sys 0.017s
W20260709 13:13:02.053077 28407 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:02.054718 28238 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:13:02.012982 28324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.011s	sys 0.016s
I20260709 13:13:02.066591 21317 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:02.016202 28413 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.017978 28410 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:02.047036 28323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.011s	sys 0.036s
I20260709 13:13:02.069770 22040 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:13:02.154928 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3064) took 1282 ms. Trace:
I20260709 13:13:02.019835 28215 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:02.073868 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.007s	sys 0.018s
I20260709 13:13:02.081441 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:02.162842 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 81504.7us
W20260709 13:13:02.127208 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.116659 22031 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:13:02.163976 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:02.166460 28401 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:02.167398 28401 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:02.159078 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.000s	sys 0.034s
W20260709 13:13:02.168886 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.000s	sys 0.035s
W20260709 13:13:02.169608 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.15205e+06us
I20260709 13:13:02.174259 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.064234 28242 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:02.066478 28293 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:13:02.084709 21268 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.008s	sys 0.018s
I20260709 13:13:02.016518 28154 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:02.188939 27937 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.326s	user 0.014s	sys 0.000s
I20260709 13:13:02.066624 27987 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:02.169476 28429 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.184748 28293 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:02.152207 28424 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:02.083315 28366 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:02.159276 21318 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.561s	user 0.004s	sys 0.019s
I20260709 13:13:02.158161 21391 rpcz_store.cc:276] 0709 13:13:00.873060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.873814 (+   754us) service_pool.cc:224] Handling call
0709 13:13:00.874283 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:00.874800 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.874840 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:00.875641 (+   801us) log.cc:844] Serialized 52 byte log entry
0709 13:13:01.951421 (+1075780us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:01.951454 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.951513 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.154651 (+203138us) raft_consensus.cc:1685] finished
0709 13:13:02.154678 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.154855 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":993,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":230,"thread_start_us":1075326,"threads_started":1,"wal-append.queue_time_us":1275886}
W20260709 13:13:02.206626 21318 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.608s	user 0.004s	sys 0.020s
I20260709 13:13:02.207473 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:02.062911 27976 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.006s	sys 0.024s
I20260709 13:13:02.180387 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.181123 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:02.148983 28324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.011s	sys 0.017s
I20260709 13:13:02.148198 28238 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:02.194494 28348 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:02.149544 28409 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:02.157804 28323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.011s	sys 0.036s
I20260709 13:13:02.086138 28250 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:13:02.189064 28382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.216s	user 0.015s	sys 0.039s
W20260709 13:13:02.244827 28382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.418s	user 0.016s	sys 0.040s
I20260709 13:13:02.184670 28219 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:02.246368 28219 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.248706 28219 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:02.125648 21394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1404) took 1698 ms. Trace:
I20260709 13:13:02.249321 21394 rpcz_store.cc:276] 0709 13:13:00.427699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.427847 (+   148us) service_pool.cc:224] Handling call
0709 13:13:00.456602 (+ 28755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.456818 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.456846 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.457366 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:13:00.749413 (+292047us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:00.749466 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.749561 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.125329 (+1375768us) raft_consensus.cc:1685] finished
0709 13:13:02.125383 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.125566 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":291654,"threads_started":1,"wal-append.queue_time_us":347533}
I20260709 13:13:02.251003 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:02.251749 21394 raft_consensus.cc:2368] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20.
I20260709 13:13:02.067260 28358 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:02.209167 21465 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.422s	user 0.013s	sys 0.014s
W20260709 13:13:02.252532 21465 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.466s	user 0.013s	sys 0.015s
I20260709 13:13:02.208608 21387 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:13:02.253724 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:02.254813 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:02.068957 28232 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:02.259133 28416 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:13:02.261341 28154 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:02.261837 28433 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:13:02.262295 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1682) took 1667 ms. Trace:
I20260709 13:13:02.262705 22032 rpcz_store.cc:276] 0709 13:13:00.594465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.597421 (+  2956us) service_pool.cc:224] Handling call
0709 13:13:00.597728 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.860279 (+262551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.860312 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.860819 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:13:01.475190 (+614371us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:01.475229 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.475296 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.262080 (+786784us) raft_consensus.cc:1685] finished
0709 13:13:02.262101 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.262235 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":288070,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":50,"thread_start_us":872984,"threads_started":2,"wal-append.queue_time_us":1098761}
I20260709 13:13:02.163007 28413 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.268462 27932 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:02.269660 28293 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.270383 28413 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:02.270889 28293 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:02.275211 28247 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:02.275990 28184 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:02.276376 28426 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
W20260709 13:13:02.219712 27976 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.308s	user 0.006s	sys 0.028s
I20260709 13:13:02.231590 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:02.278702 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:02.222098 21393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.006s	sys 0.017s
W20260709 13:13:02.284734 21393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.007s	sys 0.017s
I20260709 13:13:02.285992 28238 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.286679 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 3066) took 1409 ms. Trace:
I20260709 13:13:02.287211 28238 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:02.232249 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:02.287289 21388 rpcz_store.cc:276] 0709 13:13:00.877313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.877436 (+   123us) service_pool.cc:224] Handling call
0709 13:13:02.286413 (+1408977us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54000abed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:02.286597 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703640448}
I20260709 13:13:02.192101 27937 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:02.194918 27987 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:02.222991 21362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.000s	sys 0.024s
W20260709 13:13:02.293157 21362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.000s	sys 0.024s
I20260709 13:13:02.289956 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.291468 21391 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:02.295051 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:02.295953 21388 raft_consensus.cc:2393] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:02.300540 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.301169 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.302373 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.303437 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2967) took 1779 ms. Trace:
I20260709 13:13:02.304230 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.307566 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.303813 21465 rpcz_store.cc:276] 0709 13:13:00.524527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.524680 (+   153us) service_pool.cc:224] Handling call
0709 13:13:00.525040 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.525507 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.525548 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.526332 (+   784us) log.cc:844] Serialized 26 byte log entry
0709 13:13:00.740270 (+213938us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:02.252905 (+1512635us) log.cc:844] Serialized 14 byte log entry
0709 13:13:02.303075 (+ 50170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.303154 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.303211 (+    57us) raft_consensus.cc:1685] finished
0709 13:13:02.303229 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.303384 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54171,"prepare.queue_time_us":45412,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":653,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"thread_start_us":1679333,"threads_started":2,"wal-append.queue_time_us":470369}
W20260709 13:13:02.261377 28419 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:13:02.311173 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.312570 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:02.324810 21387 raft_consensus.cc:2368] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16.
I20260709 13:13:02.324980 21388 raft_consensus.cc:2368] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9.
I20260709 13:13:02.326119 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.326589 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:02.326967 21394 raft_consensus.cc:2376] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23. Re-sending same reply.
W20260709 13:13:02.327735 21389 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.015s	sys 0.012s
W20260709 13:13:02.328130 21389 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.015s	sys 0.012s
I20260709 13:13:02.329054 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3072) took 1450 ms. Trace:
I20260709 13:13:02.329432 21389 rpcz_store.cc:276] 0709 13:13:00.878810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.933579 (+ 54769us) service_pool.cc:224] Handling call
0709 13:13:00.933973 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.934385 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.934431 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.935030 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:13:01.565930 (+630900us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:02.328490 (+762560us) log.cc:844] Serialized 14 byte log entry
0709 13:13:02.328788 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.328856 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.328892 (+    36us) raft_consensus.cc:1685] finished
0709 13:13:02.328902 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.329009 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10643,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":1338319,"threads_started":2,"wal-append.queue_time_us":1061261}
I20260709 13:13:02.324399 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:02.340391 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.190040 28277 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.342423 21389 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:02.243010 28409 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.343079 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.343645 28427 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:13:02.345745 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.347885 21316 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:02.198302 28429 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:02.348295 28435 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.362694 21315 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:13:02.366184 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.366868 21315 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:02.349696 28242 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:02.377084 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.012s	sys 0.088s
W20260709 13:13:02.377645 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.012s	sys 0.088s
I20260709 13:13:02.356349 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:02.378422 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 1.05713e+06us
W20260709 13:13:02.358487 21435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.045s	sys 0.043s
W20260709 13:13:02.379145 21435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.045s	sys 0.043s
I20260709 13:13:02.379882 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:02.381351 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:02.378849 21313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.584s	user 0.013s	sys 0.013s
W20260709 13:13:02.383206 21313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.589s	user 0.013s	sys 0.013s
I20260709 13:13:02.378674 21391 raft_consensus.cc:2368] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19.
I20260709 13:13:02.357306 21394 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:13:02.385089 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.386968 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.387354 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:02.387847 21315 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:13:02.389128 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:02.411032 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.358811 28349 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:13:02.359983 28332 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:02.305763 27987 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:02.432806 28308 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:02.341862 28400 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 13:13:02.486889 21392 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:13:02.446168 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:02.487406 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.487825 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.433446 21468 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:02.492348 21464 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:13:02.386686 28360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.009s	sys 0.002s
I20260709 13:13:02.489176 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:02.523691 22002 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.502s (SENT)
I20260709 13:13:02.449770 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:02.503772 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:02.491961 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:02.522703 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 76698.4us
I20260709 13:13:02.532922 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:02.534087 21360 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:02.534808 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.535631 21464 raft_consensus.cc:2393] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:13:02.536139 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44263.1us
I20260709 13:13:02.536936 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:02.524745 28360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.015s	sys 0.010s
W20260709 13:13:02.519733 22038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.037s	sys 0.068s
I20260709 13:13:02.450163 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.492693 28373 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:02.496121 28440 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:02.525936 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.562672 21321 raft_consensus.cc:2468] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:02.559662 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:02.528398 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.492893 28332 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:02.567270 21464 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:02.492956 21470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.013s
W20260709 13:13:02.576781 21470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.008s	sys 0.013s
I20260709 13:13:02.432689 28347 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:02.570936 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:02.544682 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.582479 21465 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
W20260709 13:13:02.543378 22038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.037s	sys 0.068s
I20260709 13:13:02.542814 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:02.450987 28284 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:02.563655 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.364466 28409 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:02.564888 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.539549 22002 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.500s (SENT)
I20260709 13:13:02.561440 28366 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:02.542590 28349 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:02.588979 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.612015 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:02.565570 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 392497us
I20260709 13:13:02.432586 28435 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.557734 28250 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:02.547497 28308 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:02.557109 28247 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:02.556572 28145 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:13:02.556582 28441 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.600597 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61071.2us
I20260709 13:13:02.601269 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:02.587747 28154 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:02.565948 28410 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:13:02.614323 21464 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:02.591686 28284 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:02.531546 27918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.031s	sys 0.033s
I20260709 13:13:02.589092 28184 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:02.633514 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:02.645679 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:02.635550 28145 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:02.646340 28405 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.016s	sys 0.050s
I20260709 13:13:02.647487 28429 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:02.650116 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.579559 28440 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.651954 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:02.608182 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2974) took 2076 ms. Trace:
I20260709 13:13:02.614267 28347 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:02.655236 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:02.652832 28419 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:13:02.589418 28332 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:02.651991 28431 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:13:02.625661 28375 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.675096 27918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.033s	sys 0.034s
I20260709 13:13:02.689478 28360 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:02.639571 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:02.726266 22042 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:02.676817 28284 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:02.704738 22034 raft_consensus.cc:2393] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:13:02.729692 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.636864 28366 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.707408 28294 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:02.692982 28323 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:13:02.732926 28294 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:02.733933 28294 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.691354 28184 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:02.735035 28294 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:02.737066 28184 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:02.737666 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 1023) took 3199 ms. Trace:
I20260709 13:13:02.738051 22039 rpcz_store.cc:276] 0709 13:12:59.538647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.538830 (+   183us) service_pool.cc:224] Handling call
0709 13:12:59.539208 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.078124 (+2538916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.737399 (+659275us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b540052b054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:02.737579 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5697366400}
I20260709 13:13:02.738703 28364 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.739256 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:02.739274 28364 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.655238 28154 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.740226 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1666) took 4089 ms. Trace:
I20260709 13:13:02.740656 22036 rpcz_store.cc:276] 0709 13:12:58.651037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.659423 (+  8386us) service_pool.cc:224] Handling call
0709 13:12:58.659684 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.890159 (+2230475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.739965 (+1849806us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54006c5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:02.740168 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5124845440}
I20260709 13:13:02.741771 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:02.741957 28154 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:02.717943 28242 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:02.707648 28145 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:02.743213 28145 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:02.703125 28347 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:02.745018 28347 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:02.727761 22002 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.030s (SENT)
I20260709 13:13:02.723042 28306 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:02.748158 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:02.743108 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:02.708117 28405 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.016s	sys 0.051s
I20260709 13:13:02.750402 22034 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:13:02.749488 28428 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:13:02.749143 28306 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:02.662552 28441 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.730576 28375 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:02.796017 28456 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:13:02.803835 28441 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:02.794453 28438 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260709 13:13:02.811275 28435 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:02.813901 28418 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.668s	user 0.004s	sys 0.000s
W20260709 13:13:02.817565 28445 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:13:02.817977 28440 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:02.859757 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3079) took 1881 ms. Trace:
I20260709 13:13:02.861770 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3062) took 1995 ms. Trace:
I20260709 13:13:02.862331 21390 rpcz_store.cc:276] 0709 13:13:00.866077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.866205 (+   128us) service_pool.cc:224] Handling call
0709 13:13:00.866499 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.910193 (+ 43694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.910224 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:00.910263 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:00.910301 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.861136 (+1950835us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b540039e9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:02.861229 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.861582 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100073728}
W20260709 13:13:02.863654 21396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 3074) took 1984 ms (client timeout 1541 ms). Trace:
I20260709 13:13:02.864663 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3333) took 2347 ms. Trace:
I20260709 13:13:02.865147 21313 rpcz_store.cc:276] 0709 13:13:00.516990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.518747 (+  1757us) service_pool.cc:224] Handling call
0709 13:13:00.519091 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:00.657921 (+138830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.657967 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:00.697834 (+ 39867us) log.cc:844] Serialized 52 byte log entry
0709 13:13:02.383676 (+1685842us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:02.498480 (+114804us) log.cc:844] Serialized 14 byte log entry
0709 13:13:02.498777 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.498877 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.863965 (+365088us) raft_consensus.cc:1685] finished
0709 13:13:02.864010 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.864406 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4236,"prepare.queue_time_us":114498,"raft.queue_time_us":6370,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":22103,"spinlock_wait_cycles":45954176,"thread_start_us":1722945,"threads_started":2,"wal-append.queue_time_us":1843363}
W20260709 13:13:02.869688 21359 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.013s	sys 0.013s
W20260709 13:13:02.870335 21359 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.014s	sys 0.013s
W20260709 13:13:02.871047 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 625751us
W20260709 13:13:02.681995 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 122443us
I20260709 13:13:02.687206 21463 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:13:02.681856 21465 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:02.877317 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3069) took 1999 ms. Trace:
W20260709 13:13:02.676594 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.877837 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.860970 21395 rpcz_store.cc:276] 0709 13:13:00.977636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.977804 (+   168us) service_pool.cc:224] Handling call
0709 13:13:00.978223 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.978654 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.978693 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.979248 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:13:01.980958 (+1001710us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:01.981020 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.981123 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.858589 (+877466us) raft_consensus.cc:1685] finished
0709 13:13:02.858681 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.859293 (+   612us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1543,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":999600,"threads_started":1,"wal-append.queue_time_us":1381140}
W20260709 13:13:02.679945 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 59294.6us
I20260709 13:13:02.885563 21319 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:02.886576 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45126 (request call id 3348) took 1848 ms. Trace:
W20260709 13:13:02.888422 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.888551 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.889526 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.890389 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.891090 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.887042 21319 rpcz_store.cc:276] 0709 13:13:01.176998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.177287 (+   289us) service_pool.cc:224] Handling call
0709 13:13:02.883955 (+1706668us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4c00370cc0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bd4e4a20 00007fc2bd4f5a29 00007fc2bd4f613f 00007fc2bd4ba2ab 00007fc2bd4e7f3c 00007fc2bd4e83fe 00007fc2bd77588b 00007fc2bf174495 00007fc2bf1c530f 00007fc2bf20fa55 00007fc2c41dfcd0
0709 13:13:02.886417 (+  2462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72170240}
I20260709 13:13:02.892916 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.893771 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.893932 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.894794 21315 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
W20260709 13:13:02.750326 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.894912 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.702443 21470 rpcz_store.cc:276] 0709 13:13:00.531460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.886967 (+355507us) service_pool.cc:224] Handling call
0709 13:13:00.887279 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.888155 (+   876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.888182 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.888626 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:13:01.948141 (+1059515us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:02.577683 (+629542us) log.cc:844] Serialized 14 byte log entry
0709 13:13:02.607712 (+ 30029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.607831 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.607884 (+    53us) raft_consensus.cc:1685] finished
0709 13:13:02.607902 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.608101 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72518,"prepare.queue_time_us":630797,"prepare.run_wall_time_us":38,"raft.queue_time_us":46714,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":15900,"spinlock_wait_cycles":12686592,"thread_start_us":1687734,"threads_started":2,"wal-append.queue_time_us":1265464}
I20260709 13:13:02.937179 21470 pending_rounds.cc:85] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 12
I20260709 13:13:02.937708 21470 pending_rounds.cc:107] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:13:02.937784 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1148) took 2521 ms. Trace:
I20260709 13:13:02.938154 21470 raft_consensus.cc:2889] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:02.938383 21469 rpcz_store.cc:276] 0709 13:13:00.415815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.415932 (+   117us) service_pool.cc:224] Handling call
0709 13:13:00.431684 (+ 15752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:01.525519 (+1093835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.936928 (+1411409us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001a77d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:02.937527 (+   599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373630720}
I20260709 13:13:02.940758 27987 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:02.941745 28378 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:02.942759 28378 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.752880 28360 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.944474 21321 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:02.944664 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.946156 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.946677 22032 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:13:02.947175 28360 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:02.895629 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:02.950945 22034 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:02.951519 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.952447 21319 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:02.953153 28448 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.953634 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.751076 22039 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:02.899554 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:02.953977 28448 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:02.954633 21319 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:02.875013 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:02.930588 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:02.947667 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.753818 28366 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:02.934052 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:02.944228 22041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1686) took 2348 ms (client timeout 1657 ms). Trace:
I20260709 13:13:02.877888 21393 rpcz_store.cc:276] 0709 13:13:00.878081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.879384 (+  1303us) service_pool.cc:224] Handling call
0709 13:13:00.879665 (+   281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:00.880017 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.880079 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:00.880715 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 13:13:01.431211 (+550496us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:02.285147 (+853936us) log.cc:844] Serialized 14 byte log entry
0709 13:13:02.285408 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.285488 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.812232 (+526744us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:13:02.876439 (+ 64207us) raft_consensus.cc:1685] finished
0709 13:13:02.876657 (+   218us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.877075 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1126535,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3594,"raft.queue_time_us":2731,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":192,"spinlock_wait_cycles":7780736,"thread_start_us":1381534,"threads_started":2,"wal-append.queue_time_us":1182659}
W20260709 13:13:02.930991 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44160.3us
W20260709 13:13:02.864331 21396 rpcz_store.cc:269] 0709 13:13:00.879274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.879374 (+   100us) service_pool.cc:224] Handling call
0709 13:13:02.863120 (+1983746us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54001c7354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:02.863391 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848533376}
W20260709 13:13:02.956244 22041 rpcz_store.cc:269] 0709 13:13:00.595611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.595719 (+   108us) service_pool.cc:224] Handling call
0709 13:13:02.943655 (+2347936us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54005055d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:02.943950 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227503360}
I20260709 13:13:02.968722 21314 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:02.974016 28441 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:13:02.978008 21466 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:02.980271 21464 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:13:02.981038 28308 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:02.981945 28308 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:02.984165 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 60955.5us
I20260709 13:13:02.987497 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1689) took 1036 ms. Trace:
I20260709 13:13:02.988334 21313 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
W20260709 13:13:02.991698 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.992324 28427 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:03.002796 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:02.997459 28308 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:03.001042 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:03.016405 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:03.017104 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:03.017747 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:03.018795 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:03.019805 21315 raft_consensus.cc:2410] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:03.020995 28410 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.023046 28308 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:03.025566 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:02.973656 28435 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.015537 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:03.004228 22031 rpcz_store.cc:276] 0709 13:13:01.950814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.951560 (+   746us) service_pool.cc:224] Handling call
0709 13:13:01.951866 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.163816 (+211950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.962506 (+798690us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540048b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:02.987207 (+ 24701us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306969856}
W20260709 13:13:03.030845 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 100747us
W20260709 13:13:03.057986 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.058626 28454 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:13:03.058808 28293 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.762s	user 0.012s	sys 0.004s
I20260709 13:13:03.069097 28454 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:03.070886 21421 heartbeater.cc:646] Failed to heartbeat to 127.19.185.254:40067 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.185.254:40067 timed out after 15.000s (SENT)
W20260709 13:13:03.076469 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 91188.5us
I20260709 13:13:03.079149 28435 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:03.059043 28434 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 13:13:03.021806 28410 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:03.071071 28454 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:03.579000 21469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.016s
W20260709 13:13:03.200071 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.088419 21393 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21. Ops: []
W20260709 13:13:03.658772 21469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.005s	sys 0.018s
W20260709 13:13:03.156397 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.657894 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:03.371451 22042 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.002s
I20260709 13:13:03.345989 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:03.354274 21465 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:13:03.669489 22042 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:03.669919 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1159) took 1123 ms. Trace:
I20260709 13:13:03.670004 28276 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:03.670212 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1613) took 1059 ms. Trace:
W20260709 13:13:03.618505 21470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.007s	sys 0.006s
W20260709 13:13:03.673980 21470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.007s
W20260709 13:13:03.085620 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83077.4us
I20260709 13:13:03.265806 21314 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:03.225895 21462 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:13:03.670704 22042 rpcz_store.cc:276] 0709 13:13:02.611096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.611702 (+   606us) service_pool.cc:224] Handling call
0709 13:13:03.670125 (+1058423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.266621 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:03.088909 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:03.585088 21463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.008s	sys 0.012s
W20260709 13:13:03.671665 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 593292us
W20260709 13:13:03.677191 21463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.010s	sys 0.013s
I20260709 13:13:03.670873 21465 rpcz_store.cc:276] 0709 13:13:02.546735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.621358 (+ 74623us) service_pool.cc:224] Handling call
0709 13:13:03.669801 (+1048443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.132939 21321 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:03.090364 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:03.266930 21313 raft_consensus.cc:3055] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:13:03.585707 28086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.016s
I20260709 13:13:03.684023 21313 raft_consensus.cc:740] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:13:03.542585 28308 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.007s
W20260709 13:13:03.196610 28316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.587s	user 0.027s	sys 0.021s
W20260709 13:13:03.655957 28294 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.811s	user 0.006s	sys 0.016s
I20260709 13:13:03.689338 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3357) took 1334 ms. Trace:
W20260709 13:13:03.086495 28383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.221s	user 0.007s	sys 0.007s
I20260709 13:13:03.089648 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:03.092603 28332 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:03.693841 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.546072 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1691) took 1340 ms. Trace:
I20260709 13:13:03.690321 28242 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:03.686591 28086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.002s	sys 0.017s
I20260709 13:13:03.197342 28413 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.690356 28465 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.397s	user 0.005s	sys 0.005s
I20260709 13:13:03.623924 28440 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:03.695024 21314 rpcz_store.cc:276] 0709 13:13:02.350743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.028000 (+677257us) service_pool.cc:224] Handling call
0709 13:13:03.187323 (+159323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.684805 (+497482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.685044 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.082871 28366 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:03.351992 28284 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.000s
I20260709 13:13:03.085821 28400 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:03.084889 28442 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:03.083396 28349 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:13:03.709658 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.697158 28316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.246s	user 0.034s	sys 0.030s
I20260709 13:13:03.081655 28409 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:03.711885 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.691354 28435 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:03.705758 28383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.878s	user 0.011s	sys 0.017s
I20260709 13:13:03.716369 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.700940 22038 rpcz_store.cc:276] 0709 13:13:01.959796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.960162 (+   366us) service_pool.cc:224] Handling call
0709 13:13:01.960497 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.583752 (+623255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.583800 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.588349 (+  4549us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.159882 (+571533us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:03.161681 (+  1799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.161896 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.169708 (+  7812us) raft_consensus.cc:1685] finished
0709 13:13:03.169757 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.299663 (+129906us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":226336,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3176,"thread_start_us":1037596,"threads_started":2,"wal-append.queue_time_us":482756}
I20260709 13:13:03.716641 28242 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:03.717878 21319 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:13:03.718184 21314 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:13:03.718505 28413 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:03.719794 21313 consensus_queue.cc:260] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:03.720682 22035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1617) took 1067 ms. Trace:
I20260709 13:13:03.721515 21315 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:03.084081 28306 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.682s
I20260709 13:13:03.726367 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:03.731294 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2982) took 1170 ms. Trace:
I20260709 13:13:03.732455 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:03.732571 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:03.733831 28378 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:03.734072 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3516) took 3138 ms. Trace:
I20260709 13:13:03.740777 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:03.741734 21390 raft_consensus.cc:2410] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:03.752974 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 1080) took 1264 ms. Trace:
I20260709 13:13:03.743697 28349 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.746366 21319 pending_rounds.cc:85] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 8
I20260709 13:13:03.754959 21319 pending_rounds.cc:107] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:13:03.755261 21319 raft_consensus.cc:2889] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:03.750299 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3518) took 1166 ms. Trace:
W20260709 13:13:03.747176 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 697323us
I20260709 13:13:03.753512 21315 rpcz_store.cc:276] 0709 13:13:02.488919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.048895 (+559976us) service_pool.cc:224] Handling call
0709 13:13:03.697709 (+648814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.752436 (+ 54727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.752905 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.755780 21314 rpcz_store.cc:276] 0709 13:13:02.580674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.717284 (+1136610us) service_pool.cc:224] Handling call
0709 13:13:03.717786 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.746441 (+ 28655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.746686 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.752669 21317 rpcz_store.cc:276] 0709 13:13:00.595687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.596129 (+   442us) service_pool.cc:224] Handling call
0709 13:13:00.596472 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.149225 (+1552753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.733602 (+1584377us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000fd554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:03.733897 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3379579136}
I20260709 13:13:03.751195 21463 rpcz_store.cc:276] 0709 13:13:02.561091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.006604 (+445513us) service_pool.cc:224] Handling call
0709 13:13:03.022110 (+ 15506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.022792 (+   682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.022826 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.023375 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.677640 (+654265us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:03.677681 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.677742 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.731012 (+ 53270us) raft_consensus.cc:1685] finished
0709 13:13:03.731038 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.731192 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11,"raft.queue_time_us":12132,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":45385,"thread_start_us":653835,"threads_started":1,"wal-append.queue_time_us":704617}
I20260709 13:13:03.739980 28284 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:03.769291 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:03.769549 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 55401.3us
I20260709 13:13:03.751747 28448 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:03.774855 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.776095 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.760747 28349 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:03.777632 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3517) took 1205 ms. Trace:
I20260709 13:13:03.780444 21319 rpcz_store.cc:276] 0709 13:13:02.578036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.073518 (+495482us) service_pool.cc:224] Handling call
0709 13:13:03.696772 (+623254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.777385 (+ 80613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.777574 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.765321 28246 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:03.748731 22035 rpcz_store.cc:276] 0709 13:13:02.653605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.674886 (+ 21281us) service_pool.cc:224] Handling call
0709 13:13:02.696575 (+ 21689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.696860 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:02.719629 (+ 22769us) log.cc:844] Serialized 14 byte log entry
0709 13:13:02.950015 (+230386us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b1800397a20. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:13:03.712465 (+762450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:03.720183 (+  7718us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:03.720265 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.720374 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.720511 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125651,"prepare.queue_time_us":21161,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":138820,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"spinlock_wait_cycles":13354880,"thread_start_us":477866,"threads_started":1}
I20260709 13:13:03.786686 21314 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:13:03.787317 21466 raft_consensus.cc:2393] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:03.788866 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.789978 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3522) took 1190 ms. Trace:
I20260709 13:13:03.791772 21314 rpcz_store.cc:276] 0709 13:13:02.599928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.767303 (+1167375us) service_pool.cc:224] Handling call
0709 13:13:03.786402 (+ 19099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.787054 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.789934 (+  2880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.794173 21465 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:13:03.782516 28366 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:03.788723 28332 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:03.785694 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:03.799331 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3519) took 1215 ms. Trace:
I20260709 13:13:03.799641 21315 rpcz_store.cc:276] 0709 13:13:02.580982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.766233 (+1185251us) service_pool.cc:224] Handling call
0709 13:13:03.787961 (+ 21728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.791020 (+  3059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.791050 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:03.791096 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:03.796311 (+  5215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.796373 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.796473 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.784412 28400 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:03.802240 28462 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.802897 28462 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:03.764274 28440 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:03.805063 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:03.814803 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.787699 28409 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:03.817119 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:03.817492 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.816550 21467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.014s	sys 0.031s
W20260709 13:13:03.821157 21467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.014s	sys 0.031s
I20260709 13:13:03.816902 21314 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
W20260709 13:13:03.820287 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.822413 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3526) took 1208 ms. Trace:
I20260709 13:13:03.822806 21314 rpcz_store.cc:276] 0709 13:13:02.613741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.792618 (+1178877us) service_pool.cc:224] Handling call
0709 13:13:03.793009 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.822020 (+ 29011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.822346 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.803889 28400 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:03.824409 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:03.782204 28442 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:03.833554 21465 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:03.832769 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:03.792645 28246 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:03.832484 21391 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
W20260709 13:13:03.841583 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 115411us
I20260709 13:13:03.843669 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:03.826699 28242 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:03.847671 21319 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:13:03.798697 28086 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
W20260709 13:13:03.848738 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51224.2us
I20260709 13:13:03.830217 28308 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 13:13:03.838871 28238 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.479s	user 0.022s	sys 0.005s
I20260709 13:13:03.846701 21463 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:03.851709 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3525) took 1238 ms. Trace:
I20260709 13:13:03.853884 21319 rpcz_store.cc:276] 0709 13:13:02.613466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.796097 (+1182631us) service_pool.cc:224] Handling call
0709 13:13:03.831095 (+ 34998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.849320 (+ 18225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.851640 (+  2320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:03.857879 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:03.861023 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.828279 28332 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:03.855886 28242 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:13:03.869225 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.870039 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.877429 21316 raft_consensus.cc:2410] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:13:03.877686 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:03.880414 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46397us
I20260709 13:13:03.865715 28413 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:03.881742 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3527) took 1267 ms. Trace:
I20260709 13:13:03.886076 21315 rpcz_store.cc:276] 0709 13:13:02.613975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.818039 (+1204064us) service_pool.cc:224] Handling call
0709 13:13:03.858304 (+ 40265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.881513 (+ 23209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.881534 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:03.881561 (+    27us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:03.881579 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.881620 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.881702 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22272}
W20260709 13:13:03.875958 28145 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.057s	user 0.011s	sys 0.007s
I20260709 13:13:03.877468 28462 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:03.888157 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:03.883793 28308 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:03.885521 28306 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:03.898787 28391 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 2.536s	user 0.006s	sys 0.017s
I20260709 13:13:03.901512 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.887792 28284 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:03.910729 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:03.911197 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:03.913365 28332 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:03.918696 21465 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:03.901746 28308 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.900121 28410 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:03.902388 28306 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:03.924197 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.926733 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.927712 21466 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:03.927868 28246 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:03.929241 21466 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:13:03.930161 21433 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:03.930003 28434 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:03.932327 28234 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:03.932886 28234 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:03.936242 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45126 (request call id 3363) took 1578 ms. Trace:
I20260709 13:13:03.921631 28308 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:03.925001 28306 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:03.925563 28409 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:03.939688 21316 rpcz_store.cc:276] 0709 13:13:02.357997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.431670 (+ 73673us) service_pool.cc:224] Handling call
0709 13:13:03.935958 (+1504288us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400089154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:03.936165 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3026285824}
I20260709 13:13:03.925715 28413 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:03.935638 28234 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:03.951710 21466 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:13:03.948983 22036 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:03.952911 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:03.933378 28232 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:03.955750 22035 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:03.955380 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 2981) took 2966 ms. Trace:
I20260709 13:13:03.949023 28409 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.972306 22041 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:13:03.957281 21461 rpcz_store.cc:276] 0709 13:13:00.985682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.998873 (+ 13191us) service_pool.cc:224] Handling call
0709 13:13:00.999254 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:01.783811 (+784557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.950296 (+2166485us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b5400070154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:03.951570 (+  1274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338748800}
I20260709 13:13:03.957043 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:03.992782 27937 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:03.994014 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:03.995014 21461 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 22 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:13:03.996240 21461 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:04.000125 28435 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.000820 28435 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.001905 28317 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:04.002359 28317 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:04.003425 28232 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.004088 28232 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.003377 28317 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.005725 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3507) took 3865 ms. Trace:
I20260709 13:13:04.006543 28317 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:03.959232 28332 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.971941 28409 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:04.006937 28232 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:04.004657 27937 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.006177 21320 rpcz_store.cc:276] 0709 13:13:00.140237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.195768 (+ 55531us) service_pool.cc:224] Handling call
0709 13:13:01.931612 (+1735844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.931929 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.931955 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.931995 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:01.932050 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.932112 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.005348 (+2073236us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540032b4d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:04.005550 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20526,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2804,"spinlock_wait_cycles":3991207680}
W20260709 13:13:04.032812 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 169991us
W20260709 13:13:04.033967 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 81759.5us
I20260709 13:13:04.009545 28440 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.024971 28442 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:04.046802 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46889.1us
I20260709 13:13:04.026602 28332 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.057567 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:04.058467 21463 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:13:04.035548 28284 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:04.061620 28479 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:13:04.063223 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3511) took 3787 ms. Trace:
W20260709 13:13:04.063830 28468 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:13:04.083904 21463 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:04.074505 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:04.051159 28143 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:13:04.085413 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 260717us
I20260709 13:13:04.085587 28314 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:04.086454 21285 leader_election.cc:400] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20.
I20260709 13:13:04.086678 28314 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:04.087155 28314 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:04.068225 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 117999us
I20260709 13:13:04.087795 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.089212 21461 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:13:04.090397 28474 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:13:04.092309 28400 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.092896 28400 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.094961 28400 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.043728 27937 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.097553 27937 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:04.099081 28347 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.353s	user 0.014s	sys 0.006s
I20260709 13:13:04.099582 28347 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.101840 28347 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:04.102429 28332 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:04.104809 28467 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.302s	user 0.001s	sys 0.003s
I20260709 13:13:04.081194 28246 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:13:04.107244 28472 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
W20260709 13:13:04.077219 28470 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:13:04.107563 28246 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:04.108089 28246 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:04.082206 21312 rpcz_store.cc:276] 0709 13:13:00.257238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.305846 (+ 48608us) service_pool.cc:224] Handling call
0709 13:13:00.306295 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.306775 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.306810 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.307354 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:13:00.513305 (+205951us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:00.513404 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.513500 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.860757 (+3347257us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:13:04.026660 (+165903us) raft_consensus.cc:1685] finished
0709 13:13:04.026688 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.044855 (+ 18167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":756,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":34658176,"thread_start_us":205389,"threads_started":1,"wal-append.queue_time_us":555018}
W20260709 13:13:04.111049 21321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3520) took 1529 ms (client timeout 1710 ms). Trace:
W20260709 13:13:04.111459 21321 rpcz_store.cc:269] 0709 13:13:02.581300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.601011 (+ 19711us) service_pool.cc:224] Handling call
0709 13:13:04.110854 (+1509843us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540022cc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:04.110994 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686241536}
I20260709 13:13:04.112795 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:04.107007 28435 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:04.114850 21388 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
W20260709 13:13:04.124706 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.121030 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1153) took 1569 ms. Trace:
I20260709 13:13:04.128239 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2407) took 1571 ms. Trace:
W20260709 13:13:04.132591 28471 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260709 13:13:04.133059 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.132436 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:04.135015 28383 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:04.135396 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1155) took 1589 ms. Trace:
I20260709 13:13:04.135684 28383 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:04.135825 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 84110.6us
I20260709 13:13:04.144735 28383 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.145705 21463 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:13:04.128623 21469 rpcz_store.cc:276] 0709 13:13:02.557193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.939902 (+382709us) service_pool.cc:224] Handling call
0709 13:13:02.968155 (+ 28253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.020569 (+ 52414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.020604 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.021182 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.660251 (+639069us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:03.660290 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.660361 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.860468 (+200107us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b48001e0258. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:13:04.106695 (+246227us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:13:04.127942 (+ 21247us) raft_consensus.cc:1685] finished
0709 13:13:04.127962 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.128181 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136,"raft.run_cpu_time_us":3288,"raft.run_wall_time_us":840038,"spinlock_wait_cycles":43772032,"thread_start_us":638640,"threads_started":1,"wal-append.queue_time_us":746498}
I20260709 13:13:04.135795 21470 rpcz_store.cc:276] 0709 13:13:02.545827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.935639 (+389812us) service_pool.cc:224] Handling call
0709 13:13:02.936366 (+   727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.939320 (+  2954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.939364 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.965710 (+ 26346us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.674463 (+708753us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:03.674508 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.674576 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.131806 (+457230us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:13:04.135094 (+  3288us) raft_consensus.cc:1685] finished
0709 13:13:04.135115 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.135337 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41131264,"thread_start_us":660578,"threads_started":1,"wal-append.queue_time_us":798817}
I20260709 13:13:04.134599 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.120657 28413 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:04.125586 21467 rpcz_store.cc:276] 0709 13:13:02.545374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.929544 (+384170us) service_pool.cc:224] Handling call
0709 13:13:02.930294 (+   750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.000260 (+ 69966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.000301 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.000916 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.821586 (+820670us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:03.821624 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.821695 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.114282 (+292587us) raft_consensus.cc:1685] finished
0709 13:13:04.114306 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.114479 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40671,"raft.queue_time_us":69337,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":196,"thread_start_us":820219,"threads_started":1,"wal-append.queue_time_us":805629}
I20260709 13:13:04.123287 28234 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:04.170492 28234 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.171586 28308 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.173274 28234 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:04.174093 28308 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:04.169268 28084 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.169421 21284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.859s (SENT) [suppressed 20 similar messages]
I20260709 13:13:04.174188 21468 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:04.124161 28454 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:04.174824 28415 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:04.165643 28348 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:04.181687 28306 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.156522 28332 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:13:04.192456 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 79805.6us
W20260709 13:13:04.193305 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 58820.1us
I20260709 13:13:04.185114 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:04.159811 28413 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:04.198210 21434 connection.cc:256] RPC call timeout handler was delayed by -1.8260765590000574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:13:04.220475 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 132807us
I20260709 13:13:04.225267 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.225906 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:04.231019 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 61655us
I20260709 13:13:04.232167 28413 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:04.232933 21319 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 23: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:04.234035 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:04.235128 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.236826 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.237247 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.237654 21312 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:04.238692 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.239382 21312 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:13:04.240454 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.241277 22038 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:04.241600 21316 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:13:04.235905 21319 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:04.250799 28246 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.226635 28084 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.254105 28084 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.254899 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:04.255318 21393 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:13:04.255529 21394 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:04.256497 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:04.256976 21390 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:04.257217 21393 raft_consensus.cc:2393] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:04.258040 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:04.258745 21391 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:13:04.265247 21394 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:13:04.266888 28349 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.268373 28086 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:04.268937 28086 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:04.269364 28086 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:04.218336 28434 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.276337 28332 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:04.278052 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:04.278738 21394 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:04.286757 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:04.287613 21391 raft_consensus.cc:2368] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
I20260709 13:13:04.286789 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.289633 28415 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:04.272293 28434 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.303331 21394 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:13:04.304426 28302 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
W20260709 13:13:04.309290 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.312314 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.312722 28332 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:04.312853 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.313905 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.314636 21320 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 9.
I20260709 13:13:04.314817 28332 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:04.315894 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:04.316527 21314 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:04.320565 21315 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:13:04.322959 21360 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:04.324169 28348 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:04.326140 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:04.327123 28410 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:04.327693 28145 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:04.328088 28410 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:04.226866 28454 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.329057 28410 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:04.329479 28410 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:04.330830 28454 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:04.330536 28410 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:04.328285 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 143277us
I20260709 13:13:04.335176 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.336575 28306 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.337092 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.337544 28234 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.337879 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.338119 28234 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.339875 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3330) took 4381 ms. Trace:
I20260709 13:13:04.336643 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.341176 22041 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:13:04.340286 21318 rpcz_store.cc:276] 0709 13:12:59.957964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.166564 (+208600us) service_pool.cc:224] Handling call
0709 13:13:00.169565 (+  3001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.207204 (+2037639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.207250 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:02.207310 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:02.207375 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.339445 (+2132070us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b540032bed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:04.339512 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.339714 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32620,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6996,"spinlock_wait_cycles":208888704,"thread_start_us":1608711,"threads_started":1}
I20260709 13:13:04.338552 28489 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.342362 28489 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.338136 28317 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.345359 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:04.346244 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:04.347422 28316 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:04.347812 28316 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.348189 28316 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:04.348654 21391 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:04.350831 28366 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.351272 28366 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:04.353681 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.354401 28232 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.354486 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.355156 28232 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.356232 22038 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:04.356921 28276 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:13:04.348213 28462 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:04.360707 28462 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.361124 28462 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:04.361600 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1161) took 1802 ms. Trace:
I20260709 13:13:04.313993 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.350633 28487 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:04.345203 28317 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.357250 28375 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:04.354578 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 1416) took 1267 ms. Trace:
I20260709 13:13:04.362017 21462 rpcz_store.cc:276] 0709 13:13:02.559474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.955409 (+395935us) service_pool.cc:224] Handling call
0709 13:13:02.977755 (+ 22346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.685460 (+707705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.361307 (+675847us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540025a154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:04.361539 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274669440}
I20260709 13:13:04.368543 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.370328 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:04.370512 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56658.5us
I20260709 13:13:04.371435 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.371865 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.372800 28440 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:04.373556 21285 leader_election.cc:400] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9.
I20260709 13:13:04.373871 21285 leader_election.cc:403] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:13:04.374162 28232 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:04.374455 28440 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 8. Current term is 9.
I20260709 13:13:04.367992 21387 rpcz_store.cc:276] 0709 13:13:03.087200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.197467 (+110267us) service_pool.cc:224] Handling call
0709 13:13:04.353427 (+1155960us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800124e98. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41de0a0 00007fc2c41dd984 00007fc2bd7586d4 00007fc2bd758662
0709 13:13:04.354522 (+  1095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558208}
I20260709 13:13:04.376950 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.377615 21315 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:04.378458 28440 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:04.379499 28440 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:04.379881 28440 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:04.381148 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.382486 28364 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.382995 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.383934 22031 raft_consensus.cc:2410] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:13:04.370601 28332 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:13:04.388247 28317 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:04.388815 21318 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:04.392059 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.392999 21316 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:04.393091 28234 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:04.395489 21319 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:13:04.396189 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.396793 21315 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:04.398738 28349 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.380836 28440 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.375748 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.403923 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.404984 21392 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:04.403990 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:04.406111 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 162901us
I20260709 13:13:04.364740 28410 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:04.416229 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:04.420065 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52841.6us
I20260709 13:13:04.366742 28489 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:04.425385 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:04.430078 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.435072 21360 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:04.435222 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.429014 21316 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:04.432468 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.430797 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1410) took 1345 ms. Trace:
I20260709 13:13:04.438239 28277 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:04.440373 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.441092 22041 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:04.442044 28246 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:04.442126 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 66472.7us
I20260709 13:13:04.442725 28434 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:04.443104 21285 leader_election.cc:400] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16.
I20260709 13:13:04.444226 28405 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:04.444655 28405 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:04.445655 28405 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.446846 28405 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:04.449000 28366 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.450062 28316 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.451349 28366 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.451762 21466 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:13:04.452477 28378 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.453050 28378 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.440510 28440 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:04.440959 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:04.466236 22042 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:13:04.456611 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.457392 22031 raft_consensus.cc:1240] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:04.459120 21318 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:04.464599 21314 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:13:04.415546 28238 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:04.466995 22039 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
W20260709 13:13:04.473852 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46089.1us
I20260709 13:13:04.475492 21362 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:04.478320 21285 leader_election.cc:400] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19.
W20260709 13:13:04.478735 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 188785us
W20260709 13:13:04.480930 21359 connection.cc:256] RPC call timeout handler was delayed by -1.0435397909999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 13:13:04.471217 28234 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:04.473121 28366 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 13:13:04.495836 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 135389us
I20260709 13:13:04.498631 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:04.499898 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.480669 28316 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:04.487380 28284 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.508383 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:04.512867 21391 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:04.513677 28308 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.514218 28308 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.517304 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:04.517956 21470 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:13:04.521044 22036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 1029) took 1821 ms (client timeout 1859 ms). Trace:
I20260709 13:13:04.521327 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:04.521549 22036 rpcz_store.cc:269] 0709 13:13:02.700612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.741519 (+ 40907us) service_pool.cc:224] Handling call
0709 13:13:04.520806 (+1779287us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b540053cfd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:04.520978 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227350400}
I20260709 13:13:04.522477 28376 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:13:04.524178 28324 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:04.524770 28324 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:04.525663 28324 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.512869 21313 raft_consensus.cc:3060] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:04.436650 21395 rpcz_store.cc:276] 0709 13:13:03.084881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.146836 (+1061955us) service_pool.cc:224] Handling call
0709 13:13:04.147143 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.147499 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:13:04.147883 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.411746 (+263863us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.419697 (+  7951us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.419769 (+    72us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:13:04.430440 (+ 10671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.430540 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.430714 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7667,"prepare.queue_time_us":3787,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":96,"raft.queue_time_us":17448,"raft.run_wall_time_us":15472,"spinlock_wait_cycles":24973568,"thread_start_us":221723,"threads_started":1,"wal-append.queue_time_us":292719}
I20260709 13:13:04.511721 28182 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:04.533226 28182 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:04.534217 28182 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.535496 28182 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:04.536363 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:04.537011 21469 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
W20260709 13:13:04.538913 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.535385 28413 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.495841 28410 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:04.580240 28410 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.580721 28410 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:04.580842 28086 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.549717 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.589300 21394 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:04.585006 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.596256 21393 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:04.590370 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.551038 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:04.496587 28434 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:04.553839 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:04.556618 28462 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.559659 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:04.560578 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.552325 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:04.501909 28145 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:13:04.565589 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.566066 28215 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:04.567031 21391 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:13:04.622061 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.568244 28143 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:04.500993 28375 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:13:04.612003 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:04.615137 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 137008us
W20260709 13:13:04.615929 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 67315.9us
W20260709 13:13:04.616616 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64394.1us
I20260709 13:13:04.617982 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:04.622745 22035 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:04.638665 28308 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.639381 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.639112 28314 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.639991 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.672461 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.505914 28409 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.653606 28232 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:04.654103 21389 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:04.656905 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1164) took 1368 ms. Trace:
I20260709 13:13:04.656647 28215 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.659340 21387 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:04.660584 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:04.663023 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:04.624859 28415 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:04.694072 28413 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:04.692624 21461 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:04.697849 22034 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:04.697453 28415 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.698222 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.698727 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:04.698846 21387 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:04.698997 22034 raft_consensus.cc:1240] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:04.693296 28314 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:04.630225 28316 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:04.693640 28409 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.699838 28415 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:04.697484 21390 raft_consensus.cc:2368] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20.
I20260709 13:13:04.697510 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.504948 28234 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.624104 28143 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:04.692621 21469 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:13:04.705191 22039 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:04.705094 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.666961 28238 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:04.706348 28238 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:04.706809 28238 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:04.707257 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:04.707819 28238 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.668454 21396 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:13:04.667335 21395 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:04.708974 28369 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:04.709400 28436 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:04.708096 28317 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:13:04.669740 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:04.672659 21392 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 20. Ops: []
I20260709 13:13:04.675082 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3364) took 2094 ms. Trace:
I20260709 13:13:04.640841 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.677109 22031 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:04.679790 22032 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:04.705551 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.708250 28434 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:04.708753 28276 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:04.709909 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.667665 28366 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:04.668246 28376 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:13:04.701987 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.615557 28284 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.702405 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.837110 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:04.809341 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:04.894847 21320 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:04.710546 21461 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:04.820612 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:04.895875 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:04.837831 21394 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:13:04.710736 21466 rpcz_store.cc:276] 0709 13:13:03.288872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.957805 (+668933us) service_pool.cc:224] Handling call
0709 13:13:03.988776 (+ 30971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.452227 (+463451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.656591 (+204364us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b540025ba54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:04.656817 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064031488}
W20260709 13:13:04.898043 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.673130 28246 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:04.686106 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:04.837194 21319 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:04.714253 21463 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:04.699791 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.894433 21313 rpcz_store.cc:276] 0709 13:13:02.540248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.036259 (+496011us) service_pool.cc:224] Handling call
0709 13:13:03.266671 (+230412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.283981 (+1017310us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b18000fd200. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf253646 00007fc2bf18d58e 00007fc2bf20ef9e 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4
0709 13:13:04.512550 (+228569us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b58004bb9d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4
0709 13:13:04.613755 (+101205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:04.613784 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.622716 (+  8932us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:04.634014 (+ 11298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.634088 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.634212 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1242,"raft.queue_time_us":62088,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6755,"spinlock_wait_cycles":1743122688}
I20260709 13:13:04.694358 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:04.901440 22036 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
W20260709 13:13:04.870972 21468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2401) took 2455 ms (client timeout 1551 ms). Trace:
I20260709 13:13:04.899278 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:04.895292 21390 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:04.902494 22041 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:13:04.898995 22035 raft_consensus.cc:2376] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21. Re-sending same reply.
W20260709 13:13:04.903846 21468 rpcz_store.cc:269] 0709 13:13:02.382566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.503437 (+120871us) service_pool.cc:224] Handling call
0709 13:13:04.810533 (+2307096us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540025ab54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:04.837982 (+ 27449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3687542144}
I20260709 13:13:04.924480 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:04.925026 21321 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:04.925366 21469 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
W20260709 13:13:04.898702 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.929134 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:04.695427 28491 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:13:04.930522 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 260915us
I20260709 13:13:04.930604 22034 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:13:04.932154 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:04.935041 21314 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:04.935154 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.929551 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:04.939083 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.870402 28316 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:04.940234 28316 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.837395 27937 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:04.944334 27937 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:04.946372 27937 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:04.805754 28435 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.141s
I20260709 13:13:04.938963 21389 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:04.708109 28454 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:13:04.950636 21320 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:04.950289 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.696974 28462 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:04.905011 28474 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:13:04.954654 21390 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 24: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:04.964550 21285 leader_election.cc:400] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
I20260709 13:13:04.970503 21285 leader_election.cc:403] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:13:04.896260 28276 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:04.870692 28489 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
W20260709 13:13:04.968111 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 72339.1us
W20260709 13:13:04.951908 28473 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:04.902348 28215 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:04.966830 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:04.985852 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:04.952376 28182 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:04.948099 28375 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:13:04.996425 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 286610us
I20260709 13:13:04.968851 28442 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:05.001854 21461 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:04.898743 28246 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:04.975160 28317 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:05.000627 21314 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
W20260709 13:13:04.994131 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43483.1us
W20260709 13:13:05.010262 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 80762.3us
I20260709 13:13:05.010670 21387 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:13:05.011016 21387 pending_rounds.cc:85] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 12
I20260709 13:13:05.011225 21387 pending_rounds.cc:107] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:13:05.011430 21387 raft_consensus.cc:2889] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:04.999630 28332 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:13:05.015974 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.015909 28332 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:05.016578 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.017138 28406 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:13:05.018217 28332 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:05.018776 28332 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 14. Current term is 15.
I20260709 13:13:04.994113 28435 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:04.989625 28277 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:05.024065 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:05.025640 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 211360us
W20260709 13:13:05.029631 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 43904.1us
I20260709 13:13:05.032519 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:05.036494 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:05.039862 28314 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:05.040405 28314 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:05.041316 28314 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:05.043356 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.046540 28316 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:05.049917 28246 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:05.057200 28316 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:05.058903 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:04.994589 28232 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:13:05.004099 28375 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:05.010178 28317 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:05.067003 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.074386 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.085130 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 133528us
I20260709 13:13:05.028074 28277 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:05.061553 27937 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:05.033721 28442 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:05.102460 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:05.088847 21470 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.000s
W20260709 13:13:05.087483 28508 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:13:05.108881 21321 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:05.106339 21470 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:05.085032 28317 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:05.113124 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.113375 28234 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:05.114091 28504 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:13:05.115981 28507 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:13:05.122292 28317 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:05.123446 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:05.127307 28405 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.007s
I20260709 13:13:05.127031 21320 raft_consensus.cc:2410] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:13:05.150542 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 221167us
I20260709 13:13:05.152117 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:05.152848 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:05.084733 28348 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.059s
W20260709 13:13:05.193647 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44017us
I20260709 13:13:05.109522 28435 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
W20260709 13:13:05.196655 28508 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:13:05.215687 28462 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:13:05.168434 28436 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:05.228701 28436 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.229132 28436 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:05.140514 28375 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.229871 28375 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:05.223021 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:05.234755 28410 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.653s	user 0.003s	sys 0.003s
I20260709 13:13:05.235219 28410 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.149133 28454 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:13:05.237157 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1408) took 2197 ms. Trace:
I20260709 13:13:05.237869 28378 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:05.179098 28348 consensus_queue.cc:1243] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:13:05.220752 28510 consensus_queue.cc:1059] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:13:05.223603 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:05.242971 21467 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:05.221014 28277 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.237604 21396 rpcz_store.cc:276] 0709 13:13:03.084135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.667839 (+1583704us) service_pool.cc:224] Handling call
0709 13:13:04.668175 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.708964 (+ 40789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.236848 (+527884us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003091a0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf18fdc0 00007fc2bf21ba02 00007fc2bf217dd6 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:13:05.237087 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426693888}
W20260709 13:13:05.254920 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 96207.9us
I20260709 13:13:05.250449 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:05.172371 28515 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:05.241202 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:05.263734 21360 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:05.264851 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:05.265028 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:05.265413 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.219486 28487 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:05.270129 21461 raft_consensus.cc:2410] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:13:05.267686 21393 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:13:05.269094 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:05.271997 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:05.272861 22038 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:05.272322 21321 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:05.274865 21321 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:05.271607 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:05.280695 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 131968us
I20260709 13:13:05.296941 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:05.262154 28277 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:05.301393 22034 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:13:05.313158 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73154.3us
I20260709 13:13:05.316123 21320 pending_rounds.cc:85] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 9
I20260709 13:13:05.313560 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:05.268213 28347 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:05.316455 21320 pending_rounds.cc:107] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:13:05.319334 21320 raft_consensus.cc:2889] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:05.316691 22040 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:05.227837 28143 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:05.320307 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57494.5us
I20260709 13:13:05.319463 21321 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.273738 28515 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:05.274554 28400 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:05.271602 28435 raft_consensus.cc:3055] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:05.278069 28510 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:05.346992 21321 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:05.301414 28406 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.344537 22042 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:13:05.307266 27937 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:05.342029 28182 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:05.345752 28332 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:05.344003 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:05.301069 28487 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:05.349170 22042 pending_rounds.cc:85] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 14
I20260709 13:13:05.353736 22042 pending_rounds.cc:107] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:13:05.354216 22042 raft_consensus.cc:2889] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:05.352312 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:05.345814 28205 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:13:05.344986 28400 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.375942 22034 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 20: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:05.343269 28347 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:05.375741 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:05.374119 28512 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:13:05.345316 28435 raft_consensus.cc:740] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:05.351971 28376 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:05.374217 28086 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:05.300838 22032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
mode: GRACEFUL
new_leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
 from {username='slave'} at 127.0.0.1:44624
I20260709 13:13:05.352659 28406 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.384349 22032 raft_consensus.cc:606] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Received request to transfer leadership to TS 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:05.386701 22032 raft_consensus.cc:614] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:05.379329 28400 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:05.393239 21321 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:13:05.425122 21321 pending_rounds.cc:85] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 10
I20260709 13:13:05.425725 21321 pending_rounds.cc:107] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:13:05.426151 21321 raft_consensus.cc:2889] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:05.397940 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.385411 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:05.427773 22034 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:05.384790 28205 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:05.456272 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 159464us
W20260709 13:13:05.450544 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 73116.3us
I20260709 13:13:05.462541 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:05.463900 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 141631us
I20260709 13:13:05.458685 28376 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:05.465296 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:05.460655 28182 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.472476 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:05.473757 22042 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:05.472338 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:05.421236 28308 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:05.474920 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 130991us
I20260709 13:13:05.477664 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:05.481709 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 106081us
W20260709 13:13:05.485287 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 135286us
I20260709 13:13:05.488596 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:05.473165 28410 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:05.493573 28406 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:05.493369 28435 consensus_queue.cc:260] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:05.494148 28406 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.494655 28406 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:05.495604 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:05.487386 28349 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:05.507381 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:05.508854 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:05.508881 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:05.492267 28527 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.439352 28515 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.495841 28539 raft_consensus.cc:2764] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:13:05.519304 21436 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:05.473284 27937 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:05.536674 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.479981 28519 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:13:05.538537 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.505210 28534 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:13:05.539515 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 52753us
I20260709 13:13:05.472359 28376 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.517019 28143 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:05.517076 28332 raft_consensus.cc:2764] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:13:05.510744 28316 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:05.526007 28435 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:05.484426 28487 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.538435 28410 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:05.495402 28347 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:05.553577 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44814.4us
W20260709 13:13:05.548936 28369 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.839s	user 0.013s	sys 0.000s
I20260709 13:13:05.544080 28524 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:05.555951 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:05.543287 28534 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:05.564353 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:05.565490 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:05.566299 21434 leader_election.cc:400] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20.
I20260709 13:13:05.566533 21434 leader_election.cc:403] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:13:05.567546 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:05.572531 21389 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:05.572642 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:05.573341 21396 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:05.579257 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:05.579404 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:05.580226 21468 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:05.580471 21463 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:05.581557 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:05.581700 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3081) took 1074 ms. Trace:
I20260709 13:13:05.582065 21392 rpcz_store.cc:276] 0709 13:13:04.507326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.507452 (+   126us) service_pool.cc:224] Handling call
0709 13:13:04.514295 (+  6843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.893704 (+379409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.581488 (+687784us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54002cd654. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:05.581647 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363788672}
I20260709 13:13:05.583937 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:05.584435 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:05.584798 21465 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:05.587354 28086 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.589171 21468 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:05.589154 28086 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:05.590327 21396 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
W20260709 13:13:05.599861 22002 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.467s (SENT)
I20260709 13:13:05.600419 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:05.602676 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53176.8us
I20260709 13:13:05.591774 28086 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:05.536577 28205 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.608225 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:05.594329 28505 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.563s	user 0.004s	sys 0.000s
I20260709 13:13:05.555960 28366 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:05.600747 28369 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:05.614754 22038 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:13:05.525758 28527 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.627135 28513 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:05.627981 28535 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:05.560937 28519 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:13:05.561954 28454 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:05.628006 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 68700.5us
I20260709 13:13:05.612716 21468 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:05.654436 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.630033 21467 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:05.561450 28332 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:05.650520 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:05.653239 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:05.653347 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:05.611722 28405 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:05.628750 28366 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.560609 28143 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:13:05.558399 28539 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:13:05.599418 28316 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:13:05.670997 28535 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:05.654460 21389 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:13:05.661619 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:05.506132 28378 consensus_queue.cc:1175] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "058db415e9884ea0ba23f1e1ff59127a" responder_term: 20 status { last_received { term: 18 index: 15 } last_committed_idx: 15 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:13:05.877681 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.671592 28406 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:06.159034 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.159251 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.159878 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.782055 28454 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:06.090543 28400 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
W20260709 13:13:06.161528 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.161967 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.162909 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.667765 28332 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:06.163573 28332 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:06.163810 28366 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:06.164166 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:05.881924 21319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 3540) took 1485 ms (client timeout 1794 ms). Trace:
W20260709 13:13:05.780685 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 240376us
I20260709 13:13:05.720122 28369 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 19. Current term is 20.
W20260709 13:13:05.873602 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 234541us
W20260709 13:13:05.994642 22034 consensus_meta.cc:287] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.002s
I20260709 13:13:05.727767 21470 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
W20260709 13:13:06.170779 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.881461 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3090) took 1323 ms. Trace:
W20260709 13:13:05.842691 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.168815 21389 pending_rounds.cc:85] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 12
I20260709 13:13:06.171367 21393 rpcz_store.cc:276] 0709 13:13:04.558318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.623410 (+ 65092us) service_pool.cc:224] Handling call
0709 13:13:04.631013 (+  7603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.274249 (+643236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.881167 (+606918us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400342bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:05.881394 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463532416}
I20260709 13:13:06.172233 21389 pending_rounds.cc:107] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:13:06.172710 21389 raft_consensus.cc:2889] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:06.169716 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:06.173492 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:06.177949 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:06.178810 21321 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:06.179276 22042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.004s	sys 0.007s
W20260709 13:13:06.179615 22042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.004s	sys 0.007s
W20260709 13:13:06.020655 28521 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:13:06.157567 21468 consensus_meta.cc:287] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.503s	user 0.032s	sys 0.011s
I20260709 13:13:06.180683 21468 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:13:06.169548 22034 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
W20260709 13:13:06.166869 21319 rpcz_store.cc:269] 0709 13:13:04.396610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.401874 (+  5264us) service_pool.cc:224] Handling call
0709 13:13:05.881739 (+1479865us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54000fcb54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:05.881862 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960882048}
I20260709 13:13:06.182723 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:06.185286 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:06.185875 21359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.002s
W20260709 13:13:06.186108 21359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.003s	sys 0.002s
I20260709 13:13:06.195559 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:05.873086 28541 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:06.160451 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.204345 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:06.205260 21319 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:05.873282 28525 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:05.671703 28544 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:06.007562 28542 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:05.832957 28086 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:05.830826 28528 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:06.211289 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:06.171657 28400 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.174490 28527 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:06.229698 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:06.216161 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.216745 21392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c"
dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:49116
I20260709 13:13:06.199858 28454 raft_consensus.cc:2764] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:13:06.224371 21318 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:06.232364 21392 raft_consensus.cc:606] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:06.235976 21392 raft_consensus.cc:614] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:06.222110 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:06.237016 21312 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
W20260709 13:13:06.241731 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46247.1us
I20260709 13:13:06.209165 28317 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:06.204877 28532 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:06.204206 28530 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:06.277650 21321 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 10.
I20260709 13:13:05.879837 28276 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.214906 28544 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:06.219151 28539 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:06.280777 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:06.297672 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.024s	sys 0.020s
I20260709 13:13:06.241086 28522 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:06.221122 28542 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.226744 28086 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.213982 28440 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:13:06.233944 28375 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 1.004s	user 0.010s	sys 0.003s
W20260709 13:13:06.386667 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.028s	sys 0.025s
W20260709 13:13:06.392951 28314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.046s	sys 0.127s
W20260709 13:13:06.296341 28277 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.975s	user 0.006s	sys 0.007s
W20260709 13:13:06.385569 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 104895us
I20260709 13:13:06.248713 28543 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:06.244247 28436 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.015s	user 0.013s	sys 0.000s
I20260709 13:13:06.246975 28316 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:06.416244 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 250339us
I20260709 13:13:06.387356 28527 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.290547 28530 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:06.409272 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 841698us
W20260709 13:13:06.392464 28515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.019s	sys 0.065s
I20260709 13:13:06.473203 21316 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:13:06.407341 28538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.031s	sys 0.070s
W20260709 13:13:06.450821 28314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.046s	sys 0.132s
I20260709 13:13:06.406189 28525 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:06.478125 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:06.478415 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:06.378196 28532 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.407527 28560 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.407970 28454 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:06.533583 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:06.426606 28542 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:06.478966 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:06.539379 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.450021 28440 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:06.410892 28086 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:06.557881 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:06.475881 28435 consensus_meta.cc:287] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.918s	user 0.009s	sys 0.003s
I20260709 13:13:06.439157 28522 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.557479 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:06.681195 22039 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:06.682399 28560 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.555951 28277 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.684448 28277 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.687041 28277 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:06.556861 28538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.039s	sys 0.074s
I20260709 13:13:06.407863 28276 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:06.595924 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.694164 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.693871 28534 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:06.694926 28554 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:13:06.694927 28528 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:06.695379 28534 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:06.695715 28528 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.696228 21312 raft_consensus.cc:1240] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:13:06.697417 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:06.461694 28539 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:06.698016 28528 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:06.698611 28528 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:06.698374 28539 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:06.699405 28546 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:13:06.699156 28528 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.698005 21312 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:13:06.700853 28539 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:06.701342 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:06.701982 21312 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:06.648090 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:06.647244 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:06.709106 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.709219 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 229196us
I20260709 13:13:06.710508 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:06.711602 21314 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
W20260709 13:13:06.713814 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.717252 22032 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:06.719172 21313 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:06.708776 22031 raft_consensus.cc:2376] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15. Re-sending same reply.
W20260709 13:13:06.721078 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 473700us
W20260709 13:13:06.626736 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.729239 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.738183 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:06.744679 21462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.003s	sys 0.007s
W20260709 13:13:06.554538 28515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.030s	sys 0.103s
W20260709 13:13:06.750406 21462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.003s	sys 0.008s
I20260709 13:13:06.758216 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1174) took 1178 ms. Trace:
W20260709 13:13:06.758566 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.756438 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.002s	sys 0.010s
W20260709 13:13:06.760826 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.003s	sys 0.010s
W20260709 13:13:06.762850 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.14667e+06us
I20260709 13:13:06.482764 28530 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:06.642607 28531 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.772687 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:06.532374 28527 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.782994 21315 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:06.758844 21462 rpcz_store.cc:276] 0709 13:13:05.579607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.584830 (+  5223us) service_pool.cc:224] Handling call
0709 13:13:05.585153 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.585392 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:05.925557 (+340165us) log.cc:844] Serialized 14 byte log entry
0709 13:13:06.757797 (+832240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:06.757850 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:06.757902 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.758014 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.758156 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":292102,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"thread_start_us":1171453,"threads_started":2}
I20260709 13:13:06.627243 28545 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:06.745471 28537 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.482074 28316 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.742056 28454 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:06.773623 28563 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:06.831916 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57706.3us
I20260709 13:13:06.789036 28276 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.774536 28510 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:06.789624 28400 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:06.790956 28522 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:06.796242 28440 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.800179 28562 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:13:06.800825 28537 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:06.803776 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.804320 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:06.804652 28524 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:06.808993 28557 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 13:13:06.810005 28558 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:13:06.812894 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3097) took 2165 ms. Trace:
I20260709 13:13:06.887966 21387 rpcz_store.cc:276] 0709 13:13:04.647909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.934058 (+286149us) service_pool.cc:224] Handling call
0709 13:13:04.938440 (+  4382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.062335 (+123895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.812620 (+1750285us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b54001ef5d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:06.812828 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156635392}
I20260709 13:13:06.777871 28528 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:06.817162 28560 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:06.817629 28553 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.667026 28525 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:06.818848 28332 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.000s
I20260709 13:13:06.734974 28435 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 13:13:06.819182 28532 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:06.823902 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.920087 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.920797 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.833323 21466 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:06.839182 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:06.834429 28314 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:06.837381 28347 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.532599 28543 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.771317 28535 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:06.478175 28436 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:06.846946 21319 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.001s
I20260709 13:13:06.854249 28238 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:06.856470 28518 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 1.480s	user 0.001s	sys 0.003s
I20260709 13:13:06.786783 28317 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:06.859946 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:06.863622 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:06.833063 28454 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:06.866464 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:06.867249 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:06.877930 21359 connection.cc:256] RPC call timeout handler was delayed by -1.0144664310000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 13:13:06.878883 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:06.936980 21393 raft_consensus.cc:2410] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:13:06.857785 28316 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:06.889904 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:06.891345 21395 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:06.915542 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:06.859490 28276 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.555532 28544 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.839918 28487 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.841552 21392 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:06.931815 28440 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:06.924268 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 85217.2us
I20260709 13:13:06.944815 21362 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:06.787655 28531 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.927098 21319 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:06.928200 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:06.946195 28537 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:06.946867 28537 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:06.947256 28537 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:06.947324 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:06.947687 28537 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:06.937469 28565 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:13:06.952538 28544 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:06.956251 28376 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:06.956144 28487 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.956965 28376 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:06.957930 28376 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.958704 28487 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:06.930141 28570 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.829478 28545 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.960057 28570 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.961277 28276 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:06.961674 28527 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:06.934976 21467 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:06.923066 28489 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.962723 21317 raft_consensus.cc:2410] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:13:06.939924 21461 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: [19.15-21.16]
I20260709 13:13:06.939690 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:06.963544 21465 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:13:06.941084 21391 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:13:06.931526 28532 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:06.893476 28524 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.937062 21389 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:13:06.934857 21462 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 14.
I20260709 13:13:06.942412 21390 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:06.921465 28332 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.993029 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:06.982796 21362 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:06.941856 28400 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.005960 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:07.006714 22035 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:06.926990 28347 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:06.962069 28545 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:06.936663 28086 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.923441 28553 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:06.937908 28317 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.011412 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:07.044603 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 97401.8us
I20260709 13:13:07.044900 21465 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:13:07.046365 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.046680 21467 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:06.978739 28532 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:07.048924 28584 log.cc:927] Time spent T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:07.051311 28542 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.059106 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:07.057889 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 86119us
I20260709 13:13:07.084074 22034 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:07.036123 28375 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.001673 28487 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:13:07.068320 28580 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:13:07.055941 28541 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.000s
I20260709 13:13:07.005704 28145 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:07.059003 28436 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.043051 28570 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:07.073174 28579 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:13:07.108343 28541 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:07.109565 21462 raft_consensus.cc:2410] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:13:07.110497 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.112126 28542 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:07.113054 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.113698 21318 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:13:07.116660 28522 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:07.081072 28532 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:07.111867 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.117919 28544 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.118377 28544 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.118780 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.119537 21321 raft_consensus.cc:2393] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 16: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:07.120285 28487 raft_consensus.cc:697] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:07.121572 28531 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.121282 28487 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.122766 28086 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.075546 22035 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:07.080698 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.127034 21318 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:07.128271 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:07.069088 28572 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:13:07.092537 28316 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:07.002934 28527 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:13:07.093585 28317 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.094959 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:07.048961 28347 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:06.992563 28489 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.096910 28332 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.097594 28525 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.098477 28543 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.101104 28375 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.105667 28145 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:07.106482 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.128274 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.009793 28400 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:07.103700 28366 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.939s	user 0.008s	sys 0.004s
I20260709 13:13:07.085711 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:07.135517 27937 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:07.137213 28544 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.123839 28522 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.148607 28531 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:07.233664 28366 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.234640 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:07.182968 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:07.237608 21359 leader_election.cc:336] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.528s (SENT)
I20260709 13:13:07.238021 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:07.132803 28316 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:07.233060 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 147423us
I20260709 13:13:07.151950 21317 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
W20260709 13:13:07.233042 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 138172us
I20260709 13:13:07.237449 21316 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:07.243371 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:07.244719 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:07.247463 21316 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:13:07.176888 28525 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:07.177675 28553 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.208457 28524 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.240290 28205 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.236182 28347 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:07.268800 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.243996 28316 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:07.244866 27937 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:07.252621 28143 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:07.284356 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.142922 28454 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.255122 28560 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:13:07.289026 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.285032 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:07.231063 28145 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.297330 28366 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.272498 28205 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.300891 27937 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.301479 28205 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.302832 28522 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:07.303002 28530 consensus_meta.cc:287] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.003s
I20260709 13:13:07.303412 28530 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.305497 28530 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:07.307691 28532 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.310062 28532 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.244638 28537 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.271643 28544 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:07.261293 28525 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.271332 28347 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:07.318853 28454 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.319999 28366 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:07.288412 28560 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:07.321179 28560 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:07.322283 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.323413 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.324808 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.333068 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:07.329609 28571 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.554s	user 0.000s	sys 0.003s
I20260709 13:13:07.335210 21317 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
W20260709 13:13:07.335451 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:07.336395 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.329741 28537 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.331705 28510 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:07.337523 21317 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:13:07.338274 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 63986.3us
I20260709 13:13:07.338498 28562 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.339051 28562 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.339664 28578 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:07.339838 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:07.340866 28435 raft_consensus.cc:3055] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:07.341212 28435 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:07.342025 28544 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:07.342085 28435 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.333653 28347 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:07.344194 28378 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:07.344702 28378 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.346665 28378 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:07.326857 28525 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.344857 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:07.348845 28577 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.409s	user 0.003s	sys 0.000s
I20260709 13:13:07.349803 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:07.351171 28525 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:07.350905 28347 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.351564 28525 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.342612 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:07.352779 28524 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:07.352639 28308 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:07.353197 28524 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.353684 28524 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:07.356388 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3017) took 1897 ms. Trace:
I20260709 13:13:07.356777 21461 rpcz_store.cc:276] 0709 13:13:05.458816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.459008 (+   192us) service_pool.cc:224] Handling call
0709 13:13:05.459482 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:06.963387 (+1503905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.356101 (+392714us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400216454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:07.356333 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3403992320}
I20260709 13:13:07.357398 21469 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:07.359767 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.360144 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.360602 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.361354 21469 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 26.
W20260709 13:13:07.361960 28536 log.cc:927] Time spent T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.734s	user 0.007s	sys 0.004s
I20260709 13:13:07.363710 28537 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:07.364323 28537 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:07.366174 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:07.361379 21394 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.364398 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3020) took 1175 ms. Trace:
I20260709 13:13:07.363511 28347 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.367163 21464 rpcz_store.cc:276] 0709 13:13:06.188548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.363581 (+1175033us) service_pool.cc:224] Handling call
0709 13:13:07.363905 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.364090 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.364118 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.364163 (+    45us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:07.364201 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.364252 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.364348 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.374225 28284 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.374708 28531 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.375339 28531 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.376056 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3396) took 2060 ms. Trace:
W20260709 13:13:07.376426 28566 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.597s	user 0.002s	sys 0.000s
I20260709 13:13:07.376471 21320 rpcz_store.cc:276] 0709 13:13:05.315458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.315588 (+   130us) service_pool.cc:224] Handling call
0709 13:13:05.315910 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.341541 (+ 25631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.341580 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:05.343620 (+  2040us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.474099 (+130479us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:05.474248 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.474598 (+   350us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.361270 (+1886672us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:13:07.365828 (+  4558us) raft_consensus.cc:1685] finished
0709 13:13:07.365848 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.375981 (+ 10133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26700160,"thread_start_us":92154,"threads_started":1,"wal-append.queue_time_us":178100}
I20260709 13:13:07.378494 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.378814 28531 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.370833 21461 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:07.379953 28316 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.370823 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.380841 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.381837 21463 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:07.384456 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.351924 28525 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:07.397645 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.390383 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:07.366765 28378 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.399619 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:07.341228 28562 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:07.365590 28537 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.464960 21317 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:07.400789 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.538991 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:07.539554 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.539992 21320 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:07.476656 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 139338us
W20260709 13:13:07.451561 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.523053 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:07.536266 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 136745us
I20260709 13:13:07.543859 21360 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:07.465337 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.398993 28232 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:07.545337 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 143894us
I20260709 13:13:07.540228 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.546787 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.548414 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.549371 21388 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:07.546904 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:07.556283 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.558265 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.491277 28427 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:07.559245 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.561228 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.554914 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:07.562983 21463 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:07.419605 28544 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:07.408452 28541 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:07.409626 28531 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.565804 21391 raft_consensus.cc:2410] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 23 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:13:07.450057 28376 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.567337 21388 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:13:07.568894 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.569541 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.573241 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.570374 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.573431 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.453416 28316 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.574926 21390 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:07.574838 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.575323 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:07.575511 21392 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:07.404125 28317 consensus_queue.cc:1059] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 13:13:07.573534 21462 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:13:07.558168 28462 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:07.424515 28569 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.160s
I20260709 13:13:07.585429 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.467644 28524 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.583115 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.455262 28560 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.584182 21389 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 15. Current term is 16. Ops: [15.14-15.14]
W20260709 13:13:07.586542 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 221049us
I20260709 13:13:07.549064 28592 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:07.587381 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.588085 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.570387 28487 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:13:07.571380 28541 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.544997 28378 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.593984 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:07.606550 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.561647 28427 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:07.565244 28513 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:07.558172 28527 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:13:07.577275 28232 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:07.571791 28544 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.584738 28376 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.609786 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.595463 28596 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:13:07.605242 28541 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:07.610067 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:07.599200 28592 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.604368 28487 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:07.627041 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.628756 21390 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:07.598067 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:07.560856 28349 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:13:07.599572 21321 raft_consensus.cc:2468] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:07.653584 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:07.601079 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.654681 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.599200 21320 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:07.608521 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.578213 28562 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:13:07.634621 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:07.671892 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 73904.5us
W20260709 13:13:07.666109 21359 leader_election.cc:336] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.866s (SENT)
I20260709 13:13:07.599486 21313 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:07.641417 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.643085 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:07.641976 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:07.643983 21465 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:13:07.775873 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.583675 28522 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:13:07.858551 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:07.609007 28513 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.861433 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:07.776413 21312 raft_consensus.cc:2410] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:13:07.580363 28531 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:07.774163 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 109311us
I20260709 13:13:07.642469 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.642683 21469 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:13:07.637987 28544 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.863150 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:07.778338 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.858098 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.861677 21390 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:07.861994 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:07.797233 21461 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:07.865763 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.661955 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:07.653644 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.869779 21312 raft_consensus.cc:2410] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:07.870148 21468 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:07.870793 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.871555 21312 raft_consensus.cc:2410] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:13:07.628470 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.656361 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.641727 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.865856 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.873039 21321 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:07.873325 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:07.873467 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.874112 21391 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:13:07.868691 21387 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:13:07.876652 21387 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: []
W20260709 13:13:07.877169 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 215298us
I20260709 13:13:07.877890 21463 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:07.775743 21394 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:07.863168 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.881843 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:07.648103 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1170) took 2069 ms (client timeout 1994 ms). Trace:
W20260709 13:13:07.884910 21466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1173) took 2305 ms (client timeout 2138 ms). Trace:
W20260709 13:13:07.887460 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.648554 28234 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:07.895107 21312 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:13:07.776363 28349 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:07.911315 28349 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:07.918349 28531 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.658782 28400 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:07.906936 21466 rpcz_store.cc:269] 0709 13:13:05.579332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.584152 (+  4820us) service_pool.cc:224] Handling call
0709 13:13:07.884649 (+2300497us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000b8454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:07.884807 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2603611136}
I20260709 13:13:07.656924 28487 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:13:07.907495 21470 rpcz_store.cc:269] 0709 13:13:05.578470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.583571 (+  5101us) service_pool.cc:224] Handling call
0709 13:13:07.647891 (+2064320us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540025a154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:07.647985 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328830848}
I20260709 13:13:07.648501 28592 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:07.640388 28527 consensus_queue.cc:1243] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:13:07.652141 28317 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:07.908365 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 242282us
W20260709 13:13:07.936836 21359 leader_election.cc:336] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 2.005s (SENT)
I20260709 13:13:07.921922 21320 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:07.634092 28524 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.635187 28378 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:07.637348 28376 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:07.779083 28596 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:07.907279 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:07.923178 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:07.924412 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.958369 21314 raft_consensus.cc:2410] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:13:07.925693 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.958488 21320 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:07.958926 21316 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:13:07.875432 28522 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:07.926867 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:07.635392 28560 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.628672 28375 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.879837 28569 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:07.967172 28569 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:07.967643 28569 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:07.868969 28513 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:07.778335 28276 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:07.880059 28568 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:07.912705 28349 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.931819 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:07.940361 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:07.974238 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51123.6us
I20260709 13:13:07.623958 28525 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:07.975900 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44205.8us
I20260709 13:13:07.978219 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:07.946674 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:07.930064 28591 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:07.988523 21388 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 16: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:07.954938 21394 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:07.959913 21312 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:07.632853 28427 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.961674 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:07.963331 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:07.970525 21467 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:07.971387 21359 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 2.176s (SENT)
I20260709 13:13:07.975430 28276 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.961546 28522 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:07.985146 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:07.984886 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:07.929867 28234 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:07.994526 28234 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.995936 28276 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:07.996426 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.996749 28591 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.997601 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1717) took 1427 ms. Trace:
I20260709 13:13:07.997987 22040 rpcz_store.cc:276] 0709 13:13:06.570274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.570406 (+   132us) service_pool.cc:224] Handling call
0709 13:13:06.656402 (+ 85996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.656699 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:13:06.680292 (+ 23593us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.997237 (+1316945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.997297 (+    60us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:07.997344 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.997411 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.997528 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1234043,"prepare.queue_time_us":24158,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":82441,"threads_started":1,"wal-append.queue_time_us":178972,"wal-append.run_cpu_time_us":1172,"wal-append.run_wall_time_us":1013501}
I20260709 13:13:07.999094 28591 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:07.978891 28510 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:07.999924 28510 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:07.981154 28560 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:13:08.000170 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.2275e+06us
W20260709 13:13:08.015620 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44264.7us
I20260709 13:13:07.955513 28317 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.018395 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:08.014426 28510 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:08.023721 28595 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:08.024319 28595 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.024926 28595 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:08.028501 28522 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:07.983814 28232 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:08.007256 21312 raft_consensus.cc:2468] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:08.020298 28596 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:08.017516 28276 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.030591 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.031049 28276 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.033106 28276 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:08.017094 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:08.019407 28560 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:08.033924 28560 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:08.034125 28317 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.035228 21312 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:08.000895 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.036456 28575 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:07.977974 28375 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:13:08.036943 28405 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.028314 28378 consensus_queue.cc:1059] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:13:08.036394 28086 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:08.037506 28405 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.038141 28086 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:08.038658 28086 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.039618 28405 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:08.040510 21314 raft_consensus.cc:2410] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:08.041728 21314 raft_consensus.cc:1240] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:13:08.042305 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.043880 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.043946 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.044988 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.042687 28086 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:08.046820 28086 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:13:08.047443 28574 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.271s	user 0.004s	sys 0.000s
I20260709 13:13:08.047334 28086 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.048424 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.048969 28276 raft_consensus.cc:3055] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:08.049346 28276 raft_consensus.cc:740] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:08.049425 28086 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:08.050055 28086 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:08.050238 28276 consensus_queue.cc:260] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:07.990773 21316 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:13:08.036722 21312 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:07.992269 21468 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:08.051744 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.053324 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.054121 21461 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 24: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:08.060844 21467 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:13:08.073923 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.075672 21312 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:13:08.063197 28317 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:08.077590 28317 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.080348 28317 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.081893 28375 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:08.082387 28375 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:08.083166 28375 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.084940 28544 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:08.085120 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:08.085688 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:08.085626 28595 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.086584 28544 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:08.086952 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.087700 28544 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:08.055757 28596 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.000205 28434 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:13:08.092824 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:08.090174 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.090471 21317 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:08.098809 21389 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:08.100203 21317 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:13:08.091506 28462 consensus_meta.cc:287] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.001s
I20260709 13:13:08.101049 28596 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.102149 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.102737 21466 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:08.103384 28596 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.103590 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.089784 28375 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:08.017200 28561 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.101581 28462 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:08.087821 28435 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:08.070204 28376 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:08.073007 28575 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.107688 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.109263 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.109676 28569 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.138236 21461 raft_consensus.cc:2368] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20.
I20260709 13:13:08.139204 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.110848 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3547) took 1415 ms. Trace:
I20260709 13:13:08.111948 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.139828 21315 rpcz_store.cc:276] 0709 13:13:06.695607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.698114 (+  2507us) service_pool.cc:224] Handling call
0709 13:13:06.698404 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.787002 (+ 88598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.110651 (+1323649us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b54000fd554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:08.110797 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193977216}
I20260709 13:13:08.113116 21466 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:13:08.114545 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.115947 21391 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:13:08.116568 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:08.115979 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 131193us
I20260709 13:13:08.145169 21362 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:08.061331 28405 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:08.116086 28332 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:08.104051 28510 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.087917 28595 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:08.115576 28531 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.122047 28561 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.109808 28513 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.117292 28276 raft_consensus.cc:3060] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:08.110821 28544 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:08.169960 28544 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:08.141360 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.153388 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:08.172968 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.088922 28560 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.156404 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.175014 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:08.175808 21466 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:08.176165 28560 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.176602 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.177120 28537 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:08.177484 21466 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:08.177739 28537 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.178257 28537 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:08.178457 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:08.179275 21466 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:08.122943 28442 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:08.185829 28537 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.187152 28592 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.188357 28332 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:08.188858 28568 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:08.190114 28537 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.169145 28561 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:08.151777 28376 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:08.193216 28561 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:13:08.193629 28376 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.191740 28575 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:08.192518 28086 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:08.160494 21468 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:08.201823 21466 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:13:08.161916 28366 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:08.165930 28145 raft_consensus.cc:2804] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:08.213516 21466 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:13:08.202626 28405 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.233569 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:08.234869 21314 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:08.217438 28592 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.220577 28544 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.225173 28527 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.229379 28145 raft_consensus.cc:697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:08.241153 21465 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:08.120891 28541 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.214731 28487 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.195923 28531 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.236694 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.248128 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.237504 21466 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:13:08.244853 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 194047us
I20260709 13:13:08.245821 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:08.249735 22040 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:08.250968 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:08.253575 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.202369 28086 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:08.256253 21466 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:13:08.258051 28234 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:08.258582 28145 consensus_queue.cc:237] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.259117 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:08.260377 22040 raft_consensus.cc:2410] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:13:08.261931 28569 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:08.262499 28513 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.264194 28510 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.265463 28544 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:08.266525 28612 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:08.266968 28612 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:08.267890 28612 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.268965 28612 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:08.272954 21395 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:13:08.282593 21389 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:08.282742 21466 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:13:08.283401 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:08.288573 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 115709us
W20260709 13:13:08.289196 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.289728 21285 leader_election.cc:400] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20.
I20260709 13:13:08.290156 21285 leader_election.cc:403] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:08.296066 21393 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 26. Current term is 27. Ops: [26.16-26.16]
W20260709 13:13:08.297056 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 159307us
I20260709 13:13:08.299297 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.301859 21389 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:08.300467 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.300959 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:08.313128 22038 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:08.313247 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:08.314424 22040 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:08.311843 21314 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
I20260709 13:13:08.316586 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:08.280925 28436 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:08.240942 28405 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:08.330675 22002 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.594s (SENT)
W20260709 13:13:08.326390 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.329851 21314 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:13:08.331929 21314 pending_rounds.cc:85] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 12
I20260709 13:13:08.332186 21314 pending_rounds.cc:107] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:13:08.332541 21314 raft_consensus.cc:2889] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:08.284135 28610 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:08.331178 22002 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.248582 28527 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.304850 28543 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20.
I20260709 13:13:08.324378 28442 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:08.341349 22032 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:08.344249 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:08.345817 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:08.329489 28537 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:08.331585 28366 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.356815 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.360795 21434 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.361284 21433 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.335595 28436 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:08.378113 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.379539 21389 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:08.380820 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.349820 28510 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:08.382937 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:08.354795 28568 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:08.389866 21997 connection.cc:256] RPC call timeout handler was delayed by -2.2814258930000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 13:13:08.382937 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.374974 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:08.388746 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.350088 27937 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:08.391289 21318 raft_consensus.cc:2410] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:13:08.358134 28537 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.381762 21315 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
W20260709 13:13:08.391167 21997 connection.cc:256] RPC call timeout handler was delayed by -1.9106258930000877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 13:13:08.414041 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.368902 28276 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:08.382411 28530 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.423233 28530 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.425447 28530 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.426033 28530 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:13:08.419198 21997 connection.cc:256] RPC call timeout handler was delayed by -1.8557258929999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
I20260709 13:13:08.389740 22032 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:08.419552 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:08.428150 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:08.396570 21317 raft_consensus.cc:2368] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19.
I20260709 13:13:08.420388 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:08.427314 21997 connection.cc:256] RPC call timeout handler was delayed by -1.7810258929999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:13:08.429414 21997 connection.cc:256] RPC call timeout handler was delayed by -1.7729258929999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 13:13:08.406919 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.373418 28513 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:08.370401 28442 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:08.431370 21317 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:13:08.454223 21317 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:13:08.421455 28542 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:08.450847 28544 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:08.456378 28544 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.456976 28544 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:08.458899 28542 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:08.459924 28542 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:08.460666 28615 log.cc:927] Time spent T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:13:08.422358 28276 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:08.372195 28569 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:13:08.469532 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:08.470233 21389 raft_consensus.cc:2368] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:13:08.471274 21285 leader_election.cc:400] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:13:08.471557 21285 leader_election.cc:403] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:13:08.429903 21997 connection.cc:256] RPC call timeout handler was delayed by -1.7720258929999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
I20260709 13:13:08.463789 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3427) took 1096 ms. Trace:
I20260709 13:13:08.370779 28347 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:13:08.383421 28596 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:08.373783 28366 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.473196 21316 rpcz_store.cc:276] 0709 13:13:07.367643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.063550 (+695907us) service_pool.cc:224] Handling call
0709 13:13:08.084453 (+ 20903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.086129 (+  1676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.086162 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.106016 (+ 19854us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.202881 (+ 96865us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:08.202922 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.203003 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.463578 (+260575us) raft_consensus.cc:1685] finished
0709 13:13:08.463602 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.463730 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":954,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":96466,"threads_started":1,"wal-append.queue_time_us":189700}
I20260709 13:13:08.476881 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:08.479455 21389 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:08.349812 28086 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.421885 28537 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:08.396992 28232 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.090s
I20260709 13:13:08.388628 28510 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.472925 28276 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:08.383941 28613 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 13:13:08.475306 28543 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:08.476042 28234 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:08.522691 21389 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:08.535320 21389 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:08.500865 28620 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.529788 28376 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:08.532091 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 234014us
W20260709 13:13:08.541290 22002 connection.cc:256] RPC call timeout handler was delayed by -1.316327552999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:13:08.541788 22002 connection.cc:256] RPC call timeout handler was delayed by -1.3073275529999364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 13:13:08.543923 22002 connection.cc:256] RPC call timeout handler was delayed by -1.2614275529999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
I20260709 13:13:08.527372 21394 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:13:08.510648 28610 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:08.535274 28541 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:08.549130 28531 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.549362 28366 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:08.585168 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 194195us
I20260709 13:13:08.513824 28626 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:08.524200 28487 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:08.525110 28332 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:08.584909 21395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2427) took 1024 ms. Trace:
I20260709 13:13:08.594444 21395 rpcz_store.cc:276] 0709 13:13:07.560619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.560742 (+   123us) service_pool.cc:224] Handling call
0709 13:13:08.584645 (+1023903us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54000ab9d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:08.584830 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284273024}
I20260709 13:13:08.585704 21392 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: [12.8-15.9]
I20260709 13:13:08.596429 28630 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:08.597476 28630 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:08.597815 28630 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:08.598664 28630 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.603034 21433 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:08.603874 28317 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:08.604387 28317 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.604744 28317 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:08.605547 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.607179 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.607708 21470 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:08.480465 28436 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.533685 28234 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:08.613848 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 138323us
I20260709 13:13:08.551242 28086 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:08.533842 28575 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:13:08.582672 28596 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.626920 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.623890 21394 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:08.629594 28568 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:13:08.616796 28624 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:13:08.633567 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:08.643342 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:08.643963 21466 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:08.613044 28366 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:08.535876 28625 consensus_queue.cc:1175] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33be1cb5cfc143fc90e164888c96cc6f" responder_term: 16 status { last_received { term: 16 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 16 index: 13 } }
I20260709 13:13:08.650734 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.581597 28376 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.550755 28620 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.580320 28442 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.641836 28405 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:08.671036 21466 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:08.672223 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:08.641141 28542 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.661403 28527 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.656888 28630 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:08.674355 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.646924 28596 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.678366 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:08.680275 21466 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:08.653045 28366 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:08.681753 28628 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:08.683424 28366 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.683249 28544 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:08.677446 28542 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.685462 28544 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:08.687163 28542 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.690027 28347 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:08.691179 28591 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:08.692405 28522 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:08.694563 21466 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:08.678649 28234 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.695393 28234 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:08.696630 28489 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.698130 28349 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:08.701165 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.701802 21466 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:08.702558 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:08.702617 28636 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:13:08.703644 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:08.704172 21466 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:08.704663 21317 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:13:08.705477 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3123) took 1074 ms. Trace:
W20260709 13:13:08.689726 28375 consensus_meta.cc:287] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.003s
I20260709 13:13:08.675177 28610 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:08.705966 21387 rpcz_store.cc:276] 0709 13:13:07.631109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.877704 (+246595us) service_pool.cc:224] Handling call
0709 13:13:07.878019 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:07.878473 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.878505 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.928986 (+ 50481us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.110743 (+181757us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:13:08.123835 (+ 13092us) log.cc:844] Serialized 14 byte log entry
0709 13:13:08.134891 (+ 11056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.134970 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.682411 (+547441us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b180026c020. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1
0709 13:13:08.683936 (+  1525us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b180026c020. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:13:08.705239 (+ 21303us) raft_consensus.cc:1685] finished
0709 13:13:08.705265 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.705400 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15612,"prepare.queue_time_us":12860,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":12383,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":41697,"spinlock_wait_cycles":13430912,"thread_start_us":154447,"threads_started":1,"wal-append.queue_time_us":204529}
I20260709 13:13:08.720853 28510 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:08.671690 28626 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:09.194259 21312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.021s	sys 0.045s
I20260709 13:13:08.732923 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:09.523272 21312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.023s	sys 0.054s
I20260709 13:13:08.869048 28544 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:08.794476 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.525063 28544 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:09.526225 21284 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.196:44175 timed out after 1.507s (SENT) [suppressed 21 similar messages]
W20260709 13:13:08.950610 28435 consensus_meta.cc:287] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.002s
I20260709 13:13:08.773275 28317 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:09.527746 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 899009us
I20260709 13:13:08.947809 28375 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:09.549978 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:09.495465 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.005s	sys 0.014s
W20260709 13:13:09.554116 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.005s	sys 0.017s
W20260709 13:13:08.857491 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:08.898433 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.551710 21316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.006s	sys 0.006s
I20260709 13:13:09.553781 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3572) took 1902 ms. Trace:
W20260709 13:13:09.555826 21316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.007s	sys 0.006s
I20260709 13:13:08.807116 21466 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:09.556061 21312 rpcz_store.cc:276] 0709 13:13:07.651371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.288216 (+636845us) service_pool.cc:224] Handling call
0709 13:13:08.288614 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.317788 (+ 29174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.317820 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.687367 (+369547us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b2c00014818. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:13:08.687731 (+   364us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.523793 (+836062us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:09.523843 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.523933 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.532610 (+  8677us) raft_consensus.cc:1685] finished
0709 13:13:09.532643 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.553686 (+ 21043us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12888,"raft.queue_time_us":29014,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8764,"spinlock_wait_cycles":3562240,"thread_start_us":835653,"threads_started":1,"wal-append.queue_time_us":837657}
W20260709 13:13:09.557631 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 920890us
W20260709 13:13:09.228226 21315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.009s
W20260709 13:13:09.559024 21315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.000s	sys 0.022s
W20260709 13:13:09.392714 28086 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.767s	user 0.011s	sys 0.000s
I20260709 13:13:09.559067 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:09.513203 28543 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.975s	user 0.011s	sys 0.000s
W20260709 13:13:09.545053 28487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.000s	sys 0.009s
W20260709 13:13:08.956377 28642 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:13:09.514979 28522 consensus_meta.cc:287] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.822s	user 0.007s	sys 0.004s
I20260709 13:13:09.562044 22002 leader_election.cc:400] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19.
I20260709 13:13:09.566030 21470 raft_consensus.cc:2368] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
W20260709 13:13:09.565897 21320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 1101) took 2140 ms (client timeout 2138 ms). Trace:
I20260709 13:13:09.568423 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:09.563313 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:09.581727 21320 rpcz_store.cc:269] 0709 13:13:07.425483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.862879 (+437396us) service_pool.cc:224] Handling call
0709 13:13:09.565731 (+1702852us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b540021acd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:09.565824 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34570880}
I20260709 13:13:09.582430 21466 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:09.572872 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:09.574487 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:09.584389 21462 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:09.008136 28596 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:09.554636 28626 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:08.963361 28620 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:08.773891 28537 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:09.579593 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:08.969125 28276 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.574353 28544 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:09.550210 28375 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:09.570330 28487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.010s
I20260709 13:13:09.590710 21396 raft_consensus.cc:2410] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:13:09.573542 28543 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17.
I20260709 13:13:09.592947 21466 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
W20260709 13:13:09.596300 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.562381 28650 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:09.599526 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 3059) took 1007 ms. Trace:
I20260709 13:13:09.586421 28317 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:09.580569 28086 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:13:09.591327 28651 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:13:09.553048 28349 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:13:09.606139 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:09.608309 21464 rpcz_store.cc:276] 0709 13:13:08.592313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.575460 (+983147us) service_pool.cc:224] Handling call
0709 13:13:09.599463 (+ 24003us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.609381 28568 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.620023 28568 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.622344 28537 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:09.622937 28568 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:09.624295 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2447) took 1261 ms. Trace:
I20260709 13:13:09.624804 21389 rpcz_store.cc:276] 0709 13:13:08.363112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.536318 (+173206us) service_pool.cc:224] Handling call
0709 13:13:08.536675 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.536941 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.536980 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.537536 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.799267 (+261731us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:08.799323 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.799425 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.623974 (+824549us) raft_consensus.cc:1685] finished
0709 13:13:09.624002 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.624216 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":212804,"threads_started":1,"wal-append.queue_time_us":1052794}
I20260709 13:13:09.627226 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:09.628145 21464 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:13:09.628509 28276 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:09.603281 28544 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.593372 28626 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:09.629434 28544 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:09.631526 28544 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:09.629423 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:09.611941 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:09.600816 28620 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:09.614748 21314 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:09.616122 28347 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:09.608227 28650 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.635141 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 3066) took 1032 ms. Trace:
I20260709 13:13:09.636686 22035 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: [19.15-21.16]
W20260709 13:13:09.634353 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 108171us
I20260709 13:13:09.662299 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:09.664578 22039 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:09.664534 21466 rpcz_store.cc:276] 0709 13:13:08.602666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.610312 (+1007646us) service_pool.cc:224] Handling call
0709 13:13:09.635087 (+ 24775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.665845 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:09.667889 21464 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 24.
I20260709 13:13:09.670382 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:09.678049 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1182) took 1353 ms. Trace:
I20260709 13:13:09.679178 21466 rpcz_store.cc:276] 0709 13:13:08.324798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.670147 (+1345349us) service_pool.cc:224] Handling call
0709 13:13:09.677986 (+  7839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.680750 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:09.693837 21466 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:09.698661 21312 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:09.712653 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.716012 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.717221 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.716046 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:09.718222 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:09.666569 28650 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:09.664870 28544 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:09.718734 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1181) took 1405 ms. Trace:
I20260709 13:13:09.724632 21466 rpcz_store.cc:276] 0709 13:13:08.312955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.680495 (+1367540us) service_pool.cc:224] Handling call
0709 13:13:09.718667 (+ 38172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.724735 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 3057) took 1133 ms. Trace:
I20260709 13:13:09.729305 21464 rpcz_store.cc:276] 0709 13:13:08.591728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.668683 (+1076955us) service_pool.cc:224] Handling call
0709 13:13:09.724662 (+ 55979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.663384 28620 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.731333 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:09.653826 28347 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:09.732014 21466 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:09.733098 21466 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:09.733826 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2442) took 1397 ms. Trace:
I20260709 13:13:09.734229 21466 rpcz_store.cc:276] 0709 13:13:08.336126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.732636 (+1396510us) service_pool.cc:224] Handling call
0709 13:13:09.732922 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.733588 (+   666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.733769 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.735949 21466 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:09.741427 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.693660 28537 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:09.743117 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2444) took 1403 ms. Trace:
I20260709 13:13:09.745503 21466 rpcz_store.cc:276] 0709 13:13:08.339979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.735318 (+1395339us) service_pool.cc:224] Handling call
0709 13:13:09.735735 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.736396 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.743061 (+  6665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.746260 21464 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:09.750262 28347 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:09.751205 22039 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:09.753039 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2441) took 1422 ms. Trace:
I20260709 13:13:09.753945 21466 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
I20260709 13:13:09.753466 21464 rpcz_store.cc:276] 0709 13:13:08.331061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.729945 (+1398884us) service_pool.cc:224] Handling call
0709 13:13:09.746084 (+ 16139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.752826 (+  6742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.752986 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.754565 21466 pending_rounds.cc:85] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 3
I20260709 13:13:09.755167 21466 pending_rounds.cc:107] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:13:09.755432 21466 raft_consensus.cc:2889] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:09.755796 21464 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: [19.15-21.16]
I20260709 13:13:09.756373 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:09.756984 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3058) took 1165 ms. Trace:
I20260709 13:13:09.757347 21469 rpcz_store.cc:276] 0709 13:13:08.592011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.747827 (+1155816us) service_pool.cc:224] Handling call
0709 13:13:09.756531 (+  8704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.756694 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.756709 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.756752 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:09.756776 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.756847 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.756942 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.724396 28544 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:09.758950 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3062) took 1164 ms. Trace:
I20260709 13:13:09.759418 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:09.759352 21464 rpcz_store.cc:276] 0709 13:13:08.594873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.754861 (+1159988us) service_pool.cc:224] Handling call
0709 13:13:09.755269 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:09.758649 (+  3380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.758892 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.761370 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:09.762197 21312 raft_consensus.cc:2410] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:13:09.751680 28630 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.045s	user 0.007s	sys 0.006s
I20260709 13:13:09.765093 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3056) took 1174 ms. Trace:
I20260709 13:13:09.765427 21466 rpcz_store.cc:276] 0709 13:13:08.591188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.747591 (+1156403us) service_pool.cc:224] Handling call
0709 13:13:09.747800 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.764870 (+ 17070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.765048 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.767769 21469 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:09.769431 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.772439 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.777165 28620 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:09.751048 28537 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:09.780732 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3064) took 1184 ms. Trace:
I20260709 13:13:09.781210 21469 rpcz_store.cc:276] 0709 13:13:08.596171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.758130 (+1161959us) service_pool.cc:224] Handling call
0709 13:13:09.767615 (+  9485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.780491 (+ 12876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.780677 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:09.758719 28653 log.cc:927] Time spent T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:13:09.785279 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:09.785533 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:09.787930 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:09.787328 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3065) took 1185 ms. Trace:
I20260709 13:13:09.789211 22035 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:13:09.789095 21464 rpcz_store.cc:276] 0709 13:13:08.602389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.760268 (+1157879us) service_pool.cc:224] Handling call
0709 13:13:09.786856 (+ 26588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.787027 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.787052 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.787104 (+    52us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:09.787135 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.787184 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.787276 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.787835 28596 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:09.791285 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.795378 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:09.796015 21463 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:13:09.797222 28544 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:09.807935 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.763274 28613 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.814842 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3450) took 1106 ms. Trace:
I20260709 13:13:09.808997 22039 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:09.763406 28375 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:09.817765 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:13:09.818939 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2440) took 1496 ms (client timeout 1640 ms). Trace:
W20260709 13:13:09.824465 21470 rpcz_store.cc:269] 0709 13:13:08.322562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.633058 (+310496us) service_pool.cc:224] Handling call
0709 13:13:09.818727 (+1185669us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54000b8454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:09.818855 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102612864}
W20260709 13:13:09.819969 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.816228 21316 rpcz_store.cc:276] 0709 13:13:08.708779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.708921 (+   142us) service_pool.cc:224] Handling call
0709 13:13:08.709213 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.709515 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.709542 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.732649 (+ 23107us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.556558 (+823909us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:09.556616 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.556735 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.814505 (+257770us) raft_consensus.cc:1685] finished
0709 13:13:09.814541 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.814757 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":427,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":34965,"thread_start_us":595225,"threads_started":1,"wal-append.queue_time_us":734917}
I20260709 13:13:09.831422 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:09.832736 21316 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:13:09.834540 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:09.835639 21316 raft_consensus.cc:2393] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:13:09.837971 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.841945 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.842522 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.842555 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:09.843621 21316 raft_consensus.cc:2410] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:13:09.844727 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:09.846731 21466 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:13:09.782219 28630 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.850445 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:09.852754 28086 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:09.854017 28086 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.859090 28375 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:09.859649 28375 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:09.785953 28537 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:09.868613 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:09.869956 21462 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:09.870784 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 3060) took 1278 ms. Trace:
I20260709 13:13:09.871266 21462 rpcz_store.cc:276] 0709 13:13:08.593222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.574249 (+981027us) service_pool.cc:224] Handling call
0709 13:13:09.870705 (+296456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.872901 28656 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:09.873168 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:09.884063 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:09.896903 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.897605 22035 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 15.
I20260709 13:13:09.874078 28375 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:09.874661 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:09.874661 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:09.877127 21388 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:09.848279 21321 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:09.879048 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36486 (request call id 1434) took 1578 ms. Trace:
I20260709 13:13:09.904793 21396 rpcz_store.cc:276] 0709 13:13:08.300459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.300658 (+   199us) service_pool.cc:224] Handling call
0709 13:13:09.878791 (+1578133us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540009f954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:09.878971 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2960652544}
I20260709 13:13:09.889426 21313 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:13:09.881258 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:09.911450 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:09.912217 28276 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:09.897367 28317 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:13:09.912642 28276 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:09.873912 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:09.882882 28630 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.863761 21360 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:09.847337 28562 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.848085 28544 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:09.907874 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3407) took 2885 ms. Trace:
I20260709 13:13:09.942139 21319 rpcz_store.cc:276] 0709 13:13:07.022236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.245304 (+223068us) service_pool.cc:224] Handling call
0709 13:13:07.245564 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.245965 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:13:07.268366 (+ 22401us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.598971 (+2330605us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18003016c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:13:09.907397 (+308426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.907447 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:09.907493 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.907715 (+   222us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.907821 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22179,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1365,"raft.queue_time_us":9298,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":23095,"spinlock_wait_cycles":4087040,"thread_start_us":299343,"threads_started":1,"wal-append.queue_time_us":2637337}
I20260709 13:13:09.907907 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:09.913941 21387 raft_consensus.cc:2368] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20.
I20260709 13:13:09.944500 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.945351 22035 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:09.902457 28400 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.918419 28276 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:09.921469 28644 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.135s	user 0.008s	sys 0.010s
I20260709 13:13:09.923199 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:09.923976 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:09.959249 22036 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:09.926074 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3432) took 2007 ms. Trace:
I20260709 13:13:09.932282 28316 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:13:09.932945 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 373988us
W20260709 13:13:09.934333 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70650.2us
I20260709 13:13:09.962731 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:09.902334 28510 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.965286 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:09.841362 28613 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.960171 21315 rpcz_store.cc:276] 0709 13:13:07.918428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.421814 (+503386us) service_pool.cc:224] Handling call
0709 13:13:08.425595 (+  3781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.582275 (+156680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.582307 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.615934 (+ 33627us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.559452 (+943518us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:09.559490 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.925629 (+366139us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b5400088c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:09.925684 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.925740 (+    56us) raft_consensus.cc:1685] finished
0709 13:13:09.925757 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.926006 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73659,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":4441,"spinlock_wait_cycles":202880896,"thread_start_us":941416,"threads_started":2,"wal-append.queue_time_us":877688}
I20260709 13:13:09.958226 28347 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:09.943903 28487 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:09.973658 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:09.975199 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:09.975684 22036 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
W20260709 13:13:09.979255 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.976456 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:09.968837 28347 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:09.980473 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.980746 22042 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:09.964068 28316 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:09.983906 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:09.987247 28665 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:09.987663 28665 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.987975 28665 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:09.980698 28666 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:09.989096 28666 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.989461 28666 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:09.990684 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:09.957096 28562 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.956889 28656 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:13:09.978247 28625 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:10.013622 28613 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.014907 28625 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:10.017544 28665 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.021395 28665 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.025028 28625 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.982440 28610 raft_consensus.cc:2764] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:13:09.964046 28317 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:13:10.041481 28317 consensus_queue.cc:1243] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:13:10.044538 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.045506 22036 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:13:10.046249 28626 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.046806 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:09.997114 28524 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:10.004175 28663 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:10.006659 28650 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.008525 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.009214 28630 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:09.958824 28544 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:09.963747 28400 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:09.986841 28347 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:09.982121 28487 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:09.991636 28596 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:13:10.047842 22031 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:09.971949 28510 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.049961 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.053370 22035 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
W20260709 13:13:10.058454 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 95823.1us
W20260709 13:13:10.060751 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 70126.5us
I20260709 13:13:10.065980 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:10.043259 28316 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.068455 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.069329 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.070466 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:10.072378 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:10.073556 21396 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
W20260709 13:13:10.076774 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 119141us
I20260709 13:13:10.078280 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:10.066017 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:10.079208 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.080355 22036 raft_consensus.cc:2368] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
W20260709 13:13:10.080174 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 124679us
I20260709 13:13:10.081323 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.094259 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:10.096699 28673 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:10.112250 21319 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:13:10.085017 28317 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:10.114802 21997 leader_election.cc:400] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20.
I20260709 13:13:10.077739 28656 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:10.125321 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.126438 21997 leader_election.cc:403] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:10.096521 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.128350 21315 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:10.128674 22036 raft_consensus.cc:2368] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:10.093824 28679 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:10.117151 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.120471 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:10.135790 28400 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.136750 28562 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:10.136866 28525 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 16 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.094396 28316 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:10.145588 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:10.114606 28626 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:10.146436 21387 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:10.137392 28537 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.151810 22039 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:10.100098 28610 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:13:10.126811 28656 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:10.156507 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:10.350399 21315 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
W20260709 13:13:10.343264 21465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2435) took 2313 ms (client timeout 1507 ms). Trace:
W20260709 13:13:10.260473 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 146291us
W20260709 13:13:10.351203 21465 rpcz_store.cc:269] 0709 13:13:08.030093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.084859 (+ 54766us) service_pool.cc:224] Handling call
0709 13:13:10.343030 (+2258171us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540029aed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:10.343176 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343060224}
W20260709 13:13:10.352528 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 232151us
W20260709 13:13:10.206485 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 96949.1us
I20260709 13:13:10.349282 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:10.249764 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.360244 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.361050 22040 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 22: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:10.157120 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:10.159870 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.362813 21396 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:10.129508 28665 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:10.157366 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:10.311017 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3120) took 2680 ms. Trace:
I20260709 13:13:10.364660 21391 rpcz_store.cc:276] 0709 13:13:07.630301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.876700 (+246399us) service_pool.cc:224] Handling call
0709 13:13:08.110302 (+233602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.152135 (+ 41833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.310702 (+2158567us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54000abed0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:10.310902 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438281472}
I20260709 13:13:10.129781 28657 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:13:10.356323 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:10.369630 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:10.311291 28609 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 2.053s	user 0.010s	sys 0.005s
W20260709 13:13:10.304549 28608 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 2.039s	user 0.008s	sys 0.029s
W20260709 13:13:10.329497 28648 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.738s	user 0.003s	sys 0.000s
W20260709 13:13:10.191512 28670 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:10.386721 21315 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:10.387130 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:10.193861 28347 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.386655 21313 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:13:10.249738 28376 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.375357 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:10.376997 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:10.385572 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:10.397168 28633 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.397431 28347 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.397802 28633 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.400188 28378 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:10.400710 28317 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.401106 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:10.401371 28317 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.402369 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.403021 21463 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:10.404145 28681 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.381531 28661 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:13:10.404685 28681 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.406997 28681 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:10.407656 28375 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:10.381276 28427 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:10.373577 28434 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.410359 28434 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.247159 28666 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.412427 28434 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:10.366299 28348 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:13:10.414064 28666 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.416492 28317 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:10.419201 28276 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.366179 28570 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:13:10.420873 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.131201 28663 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.243s
I20260709 13:13:10.422161 28663 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:10.422236 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.422566 28663 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:10.423451 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.397207 21320 raft_consensus.cc:3060] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:10.356568 28650 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.194559 28674 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:10.419864 28633 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:10.427968 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2430) took 2860 ms. Trace:
I20260709 13:13:10.437425 21393 rpcz_store.cc:276] 0709 13:13:07.567868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.567983 (+   115us) service_pool.cc:224] Handling call
0709 13:13:07.571124 (+  3141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.296685 (+725561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.427718 (+2131033us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54000f1ed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:10.427913 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666358656}
I20260709 13:13:10.438084 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:10.428612 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:10.429543 21359 connection.cc:256] RPC call timeout handler was delayed by -1.6820382040000368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:13:10.439211 21463 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
W20260709 13:13:10.439430 21359 connection.cc:256] RPC call timeout handler was delayed by -1.6037382040000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:13:10.171629 28537 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.446404 21313 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:10.446664 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:10.424131 22040 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
W20260709 13:13:10.435256 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59997.6us
W20260709 13:13:10.440668 21359 connection.cc:256] RPC call timeout handler was delayed by -1.5517653599999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 13:13:10.441823 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:10.449770 21359 connection.cc:256] RPC call timeout handler was delayed by -1.523638204000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 13:13:10.449957 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:10.450342 21359 connection.cc:256] RPC call timeout handler was delayed by -1.4167653599999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:13:10.450598 22040 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:10.451452 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.452318 22040 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:13:10.453101 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:10.453841 22040 raft_consensus.cc:2368] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19.
I20260709 13:13:10.445134 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.454571 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.197059 28510 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:10.458441 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:10.459619 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.460210 21393 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:13:10.455997 21461 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:10.455792 21320 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:10.456229 21315 raft_consensus.cc:2410] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:13:10.453364 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.455813 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.462260 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:10.462811 21388 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:10.463764 28690 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:10.464833 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:10.465394 21462 raft_consensus.cc:2376] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19. Re-sending same reply.
W20260709 13:13:10.465821 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70867.7us
I20260709 13:13:10.466194 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.466754 21462 raft_consensus.cc:2376] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21. Re-sending same reply.
I20260709 13:13:10.467509 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.468366 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.469079 21469 raft_consensus.cc:2368] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:10.468400 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:10.469940 28347 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:10.470544 28347 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:10.469882 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:10.471401 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.473059 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:10.152742 28487 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.476094 21392 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:10.476935 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.467985 21462 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:10.475713 21394 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 24: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:10.466749 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:10.423390 28663 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.507256 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.476207 21436 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:10.477052 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:10.508781 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:10.506618 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.447731 28570 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:13:10.478094 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:10.537838 21392 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:10.537161 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61019.5us
I20260709 13:13:10.507627 21319 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:10.484807 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:10.542366 21389 raft_consensus.cc:2376] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16. Re-sending same reply.
I20260709 13:13:10.543186 28592 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:10.543323 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 58663.7us
I20260709 13:13:10.543510 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.544139 21389 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:10.544932 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.545830 21389 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:13:10.546536 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.547484 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.547565 28592 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:10.548550 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.539678 21321 raft_consensus.cc:2410] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:13:10.549291 21389 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:13:10.549721 21392 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:10.540908 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.509225 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.475270 21360 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:10.477371 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:10.457772 28674 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:10.552454 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 175522us
I20260709 13:13:10.455071 28314 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.476747 28522 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:13:10.557401 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.561992 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:10.551438 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:10.564654 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 89468.6us
I20260709 13:13:10.564826 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:10.566258 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.506855 28681 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:13:10.477545 28633 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:13:10.555953 28663 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:10.573998 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 199225us
I20260709 13:13:10.556413 28570 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:10.509207 28661 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:13:10.581465 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:10.596119 21394 raft_consensus.cc:2376] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17. Re-sending same reply.
W20260709 13:13:10.582479 28687 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:13:10.583396 28674 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.433656 28656 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.566686 28592 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:10.586061 28676 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:13:10.563398 28510 raft_consensus.cc:2804] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:10.561056 28544 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:10.614220 28691 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:13:10.619874 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3449) took 1913 ms. Trace:
I20260709 13:13:10.588011 21387 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:10.603245 21284 leader_election.cc:400] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:10.585279 28694 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:10.608987 28537 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:10.611287 28686 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:13:10.471414 28347 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.648448 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.649417 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:10.571400 28314 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.622469 28544 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:10.606791 28681 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:10.626637 21317 rpcz_store.cc:276] 0709 13:13:08.706089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.732408 (+ 26319us) service_pool.cc:224] Handling call
0709 13:13:08.732995 (+   587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.733357 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:08.785423 (+ 52066us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.918089 (+1132666us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18002e1a40. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:13:10.341842 (+423753us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18002e1a40. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:13:10.603041 (+261199us) log.cc:844] Serialized 14 byte log entry
0709 13:13:10.603290 (+   249us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.603784 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:13:10.603953 (+   169us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:10.603997 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.604111 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.619655 (+ 15544us) raft_consensus.cc:1685] finished
0709 13:13:10.619673 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.619813 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474685,"prepare.queue_time_us":53730,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":5103,"raft.queue_time_us":161512,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":2295,"spinlock_wait_cycles":11220608,"thread_start_us":218351,"threads_started":2,"wal-append.queue_time_us":1667369}
I20260709 13:13:10.621816 28510 raft_consensus.cc:697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:10.660159 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.653016 21284 leader_election.cc:403] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:10.661463 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:10.665890 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:10.667790 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 201119us
I20260709 13:13:10.669201 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:10.668009 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:10.671511 22031 raft_consensus.cc:2368] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19.
I20260709 13:13:10.676357 28525 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:10.679802 28570 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.692919 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.694583 21393 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:13:10.698014 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2426) took 3027 ms. Trace:
I20260709 13:13:10.698730 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.699620 22039 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:10.700742 28510 consensus_queue.cc:237] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:10.703214 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.705974 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:10.707717 28664 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:10.709275 28664 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.709682 28664 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:10.709751 21391 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:10.710110 21396 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:10.710963 21391 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:10.708572 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:10.713500 22042 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:10.714882 28276 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:10.717365 28679 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:10.717793 28679 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:10.717929 28314 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:10.718634 28679 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.719707 28679 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:10.720371 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3451) took 2010 ms. Trace:
I20260709 13:13:10.658643 28694 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:10.721369 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.722143 22034 raft_consensus.cc:2393] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 22: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:10.721884 28694 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.722852 28664 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:10.660351 28681 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:10.724828 28681 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.726012 28681 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:10.727095 21314 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:13:10.728181 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:10.728753 21320 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:10.729673 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:10.720892 21318 rpcz_store.cc:276] 0709 13:13:08.710081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.710190 (+   109us) service_pool.cc:224] Handling call
0709 13:13:08.768834 (+ 58644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.780273 (+ 11439us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:10.272895 (+1492622us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18004a2720. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2bc12da40 00007fc2bc1284e4 00007fc2bc128455 00007fc2c2c103c7 00007fc2bf2229a7 00007fc2bf2320bf 00007fc2bf232038
0709 13:13:10.273237 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:13:10.367338 (+ 94101us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.380518 (+ 13180us) log.cc:844] Serialized 26 byte log entry
0709 13:13:10.380680 (+   162us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:10.380716 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.380784 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.719959 (+339175us) raft_consensus.cc:1685] finished
0709 13:13:10.720104 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.720289 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9101,"prepare.queue_time_us":1493371,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":17234,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":7992,"spinlock_wait_cycles":40570240,"thread_start_us":92266,"threads_started":1,"wal-append.queue_time_us":92030}
I20260709 13:13:10.698581 21468 rpcz_store.cc:276] 0709 13:13:07.671101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.224112 (+553011us) service_pool.cc:224] Handling call
0709 13:13:08.225098 (+   986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.665153 (+2440055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.665182 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:10.665220 (+    38us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:10.665259 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.697652 (+ 32393us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54002490d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:10.697752 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.697934 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5463,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1799,"spinlock_wait_cycles":5610855296}
I20260709 13:13:10.708667 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:10.700814 22039 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:13:10.734823 21391 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:10.741088 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.744065 22034 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:10.763185 21388 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:10.794001 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.797319 22031 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:10.808301 28568 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.808835 28568 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.811236 28568 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:10.812222 28522 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:10.814837 28568 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:10.786139 28649 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:13:10.818533 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.816216 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:10.827754 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 249409us
I20260709 13:13:10.830361 21320 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
I20260709 13:13:10.799325 28560 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:10.831605 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:10.872527 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48348us
W20260709 13:13:10.872818 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 294346us
W20260709 13:13:10.873268 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 57150.4us
I20260709 13:13:10.874801 21387 raft_consensus.cc:2376] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17. Re-sending same reply.
I20260709 13:13:10.874361 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:10.876696 21318 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:10.877168 21396 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:10.825094 28681 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.795104 28625 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:13:10.835827 28657 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20.
W20260709 13:13:10.886206 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 217074us
I20260709 13:13:10.898355 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:10.836681 28649 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:10.896832 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:10.827185 28348 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.067s
W20260709 13:13:10.909996 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 154463us
I20260709 13:13:10.930164 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:13:10.938659 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 335417us
W20260709 13:13:10.940613 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43877.7us
I20260709 13:13:10.941546 21434 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:10.942889 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:10.832481 28524 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:13:10.949416 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:10.960903 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73796.7us
I20260709 13:13:10.961866 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:10.891358 28284 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:10.885214 28349 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:10.891278 28698 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:10.986631 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.983886 21360 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:10.990698 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:10.995208 22036 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:10.986227 28378 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:10.986647 28569 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:10.987226 28349 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.990990 22035 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:10.892540 28681 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:10.998366 28400 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:11.001778 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:11.006367 28700 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:13:10.885068 28560 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.008160 28570 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:10.975546 28664 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:11.009020 28697 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:10.976204 28695 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:10.990921 28427 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 13:13:10.951143 28376 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:10.952346 28633 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:11.112686 28633 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:11.113054 28633 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:11.113969 28633 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.115229 28633 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:10.892086 28487 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:13:10.953475 28544 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:10.966367 28435 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:10.992166 28698 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.080000 22041 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:11.117769 28698 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:11.089774 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 129217us
I20260709 13:13:11.119009 22041 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:13:11.119254 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:11.120314 22041 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:11.121001 28378 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:11.069115 28569 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.122519 28569 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:11.122677 28378 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:11.123582 28378 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:13:11.046320 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 103308us
I20260709 13:13:11.074823 28349 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:11.010020 28675 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:10.991179 28284 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.103677 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:11.103660 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 140532us
I20260709 13:13:11.117806 28435 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:11.108305 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.093930 28578 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.096686 28570 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.130544 22035 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:13:11.139757 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 209666us
I20260709 13:13:11.124945 21284 leader_election.cc:400] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19.
I20260709 13:13:11.146395 21284 leader_election.cc:403] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:13:11.147800 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:11.097967 28697 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.149610 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:11.102991 28695 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.155712 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:11.161404 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:11.110697 28376 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.162436 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:11.163328 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:11.164695 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 1056) took 1158 ms. Trace:
I20260709 13:13:11.163769 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:11.165235 22038 rpcz_store.cc:276] 0709 13:13:10.006075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.149349 (+1143274us) service_pool.cc:224] Handling call
0709 13:13:11.164602 (+ 15253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.165686 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 1070) took 1049 ms. Trace:
W20260709 13:13:11.167098 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.129722 28284 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:11.137270 28664 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.150120 28570 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:11.166324 22032 rpcz_store.cc:276] 0709 13:13:10.115874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.163537 (+1047663us) service_pool.cc:224] Handling call
0709 13:13:11.165607 (+  2070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.155055 28537 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:11.189173 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52029.8us
I20260709 13:13:11.151664 28544 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:11.089042 28649 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.124015 28378 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:11.188969 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:11.190729 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.162459 28695 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:11.199275 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.188699 21434 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:11.191994 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:11.163226 28690 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:13:11.155582 28697 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:11.218159 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.170264 28376 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:11.204895 28284 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:11.132704 28349 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.132946 28435 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.238719 21391 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:13:11.278427 21391 pending_rounds.cc:85] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 15
W20260709 13:13:11.240165 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51556.4us
W20260709 13:13:11.250115 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 55274.1us
I20260709 13:13:11.279603 21391 pending_rounds.cc:107] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:13:11.244354 28715 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:11.267783 28695 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.278404 21319 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:11.279521 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:11.280100 21391 raft_consensus.cc:2889] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.239794 22035 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:11.150755 28578 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:11.242326 28699 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:13:11.244576 28703 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:11.287165 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:11.290426 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:11.284504 21318 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:13:11.249815 28696 consensus_queue.cc:1059] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
W20260709 13:13:11.314646 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.273204 28636 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.324357 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:11.266839 28375 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:13:11.187984 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 164215us
I20260709 13:13:11.282948 28715 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.194960 28664 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:11.332226 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52777.2us
I20260709 13:13:11.333824 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:11.430274 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 62841.7us
W20260709 13:13:11.430434 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 60298.4us
I20260709 13:13:11.323205 28434 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:11.364019 28636 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.445482 21211 catalog_manager.cc:5697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 12 to 21. New cstate: current_term: 21 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.447724 21389 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:11.428462 28702 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:11.450088 28510 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.450217 28578 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:11.489567 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:11.328094 28703 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:11.324476 28378 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.438318 28698 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.284266 28569 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.329475 28375 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.363588 28276 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:11.363620 28715 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:11.429976 28284 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:11.455185 28434 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:11.511960 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 349589us
I20260709 13:13:11.436439 28562 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:13:11.566457 28562 consensus_queue.cc:1243] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:13:11.566399 21285 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:11.532833 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.492260 28711 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:13:11.454175 28681 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:11.438438 28625 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:11.581786 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.508229 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:11.568305 21285 leader_election.cc:400] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:11.498747 28695 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:11.636819 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68654.6us
I20260709 13:13:11.514647 28375 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:11.644163 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:11.666693 28569 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:11.656410 28695 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:11.682401 28625 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.507879 28716 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:13:11.669271 28710 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
I20260709 13:13:11.668354 28375 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:11.662441 28633 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.001s
I20260709 13:13:11.657516 28697 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:11.664589 28679 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.911s	user 0.014s	sys 0.000s
W20260709 13:13:11.632151 28709 log.cc:927] Time spent T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
I20260709 13:13:11.515843 28702 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.707581 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.715615 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 381852us
I20260709 13:13:11.564280 28560 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:11.579015 28434 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:11.623548 28284 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:11.508134 28427 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.188s
W20260709 13:13:11.699153 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55116.7us
I20260709 13:13:11.496558 28510 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.731750 22031 raft_consensus.cc:2410] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:13:11.709071 28664 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:11.753744 21320 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:11.755820 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:11.702766 28562 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.846733 28562 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.847489 28375 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:11.847932 28636 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:11.738730 28703 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:11.849720 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 93989.5us
I20260709 13:13:11.703015 28276 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:11.713622 28349 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:11.694435 28695 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.828420 28659 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.829048 28723 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:13:11.739408 28702 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.835597 28697 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:11.837550 28625 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:11.840054 28737 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:11.835896 28676 raft_consensus.cc:3055] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:13:11.865626 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 366017us
I20260709 13:13:11.841936 28656 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:11.843341 28696 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.844574 28698 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:11.850490 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:11.849125 28562 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:11.852139 28686 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:13:11.822811 28679 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.863649 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 194255us
I20260709 13:13:11.855819 28316 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.859202 28544 consensus_meta.cc:287] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.011s
W20260709 13:13:11.872416 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.000s	sys 0.022s
W20260709 13:13:11.858048 28721 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:13:11.856623 28695 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:11.877507 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:11.858419 28728 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:11.909166 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3596) took 1079 ms. Trace:
I20260709 13:13:11.909606 21312 rpcz_store.cc:276] 0709 13:13:10.829956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.830067 (+   111us) service_pool.cc:224] Handling call
0709 13:13:10.871335 (+ 41268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.902211 (+ 30876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.902236 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.937136 (+ 34900us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.137005 (+199869us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:11.137047 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.137129 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.908939 (+771810us) raft_consensus.cc:1685] finished
0709 13:13:11.908961 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.909091 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28326,"raft.queue_time_us":55745,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":15431,"spinlock_wait_cycles":4480,"thread_start_us":137418,"threads_started":1,"wal-append.queue_time_us":462240}
I20260709 13:13:11.898448 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.912223 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:11.912343 21461 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:13:11.912838 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:11.914129 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:11.914824 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:11.916275 28537 consensus_meta.cc:287] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.722s	user 0.007s	sys 0.003s
I20260709 13:13:11.916446 21389 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:13:11.867573 28715 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.916780 28537 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 18. Current term is 19.
I20260709 13:13:11.917555 28537 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:11.918354 28715 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:11.900606 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.882138 28740 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:11.920547 28740 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.891822 28316 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.921032 28740 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:11.922664 28316 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:11.901736 22042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1745) took 1293 ms. Trace:
I20260709 13:13:11.924180 22042 rpcz_store.cc:276] 0709 13:13:10.607982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.714157 (+106175us) service_pool.cc:224] Handling call
0709 13:13:10.714598 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.714954 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.714982 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.715981 (+   999us) log.cc:844] Serialized 508 byte log entry
0709 13:13:11.406766 (+690785us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:11.406827 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.406924 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.901542 (+494618us) raft_consensus.cc:1685] finished
0709 13:13:11.901559 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.901682 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":488005,"threads_started":1,"wal-append.queue_time_us":738729}
I20260709 13:13:11.927909 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.928498 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:11.928814 21390 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:11.929064 21467 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:11.898824 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.931625 21388 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:11.866036 28676 raft_consensus.cc:740] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:11.912472 28738 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:13:11.936408 21394 pending_rounds.cc:85] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 14
I20260709 13:13:11.936815 21394 pending_rounds.cc:107] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:13:11.937088 21394 raft_consensus.cc:2889] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.940341 28702 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:11.932770 28676 consensus_queue.cc:260] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.943373 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:11.944308 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:11.944442 28633 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:11.945528 28633 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.945924 28633 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:11.881924 28679 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.948668 28679 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:11.877223 28696 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.951153 28696 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:11.900645 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.001s	sys 0.022s
I20260709 13:13:11.945101 28675 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:11.952096 28675 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.952262 28701 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.952498 28675 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:11.952910 28701 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.953681 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:11.953860 28596 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.954355 21464 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:11.954321 28596 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.955116 28701 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:11.956175 28578 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.956568 28596 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:11.956686 28578 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.876368 28737 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:11.861167 28659 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.958428 28737 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:11.959108 28578 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:11.959573 28659 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:11.855643 28276 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.960570 28544 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:11.957139 28596 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:11.914374 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:11.912492 21392 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:11.961697 21467 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:13:11.963255 21461 raft_consensus.cc:1275] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:13:11.966559 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.967562 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.967585 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.970104 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:11.971078 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:11.984203 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:11.984877 21468 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:11.890638 28697 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:11.997519 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.001084 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.002009 21464 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:12.006824 28276 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:11.991578 28434 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.009069 28716 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:12.009506 28434 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:11.982390 28596 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.011832 28596 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:12.012391 21470 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:12.013415 21317 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:12.017464 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:11.979931 28679 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.032979 21468 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:12.000664 28649 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.064836 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:11.890959 28284 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.984917 28633 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:11.991389 28740 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:12.102397 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 132245us
W20260709 13:13:12.072854 28570 consensus_meta.cc:287] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.000s
I20260709 13:13:12.037585 28679 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.097358 28347 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:13:12.081465 28649 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.115798 21466 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:12.369004 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:12.309988 22036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 1052) took 2305 ms (client timeout 1863 ms). Trace:
I20260709 13:13:12.369874 21468 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
W20260709 13:13:12.369825 22036 rpcz_store.cc:269] 0709 13:13:10.005007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.156787 (+151780us) service_pool.cc:224] Handling call
0709 13:13:12.309704 (+2152917us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54004cac54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:12.309891 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308437760}
I20260709 13:13:12.370939 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.371443 28347 consensus_queue.cc:1243] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:13:12.372062 28714 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:12.310708 22040 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:12.372557 28714 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:12.119915 28697 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:12.373397 28697 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.373644 28714 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.375610 28510 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:12.375934 28714 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:12.320621 28747 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:13:12.105515 28695 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.227424 28625 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:12.140955 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.325851 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.362686 28749 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:13:12.410702 28715 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:12.411243 22041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1752) took 1074 ms. Trace:
I20260709 13:13:12.381105 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.383143 21464 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:12.413645 21469 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:13:12.415040 21387 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:12.383296 28697 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:12.386050 28679 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:12.116443 21285 connection.cc:256] RPC call timeout handler was delayed by -1.1475905700000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 13:13:12.171708 28376 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.894s	user 0.010s	sys 0.000s
I20260709 13:13:12.117399 28570 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.380043 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.423071 21392 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 27: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:12.371500 21468 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:12.338068 28718 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.308459 28610 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:12.365013 28740 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:12.448377 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.349264 28656 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.411650 22041 rpcz_store.cc:276] 0709 13:13:11.337093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.428506 (+ 91413us) service_pool.cc:224] Handling call
0709 13:13:11.482910 (+ 54404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.483492 (+   582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.483538 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.484208 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.860378 (+376170us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:13:11.860420 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.860490 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.411023 (+550533us) raft_consensus.cc:1685] finished
0709 13:13:12.411045 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.411181 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7878,"thread_start_us":287970,"threads_started":1,"wal-append.queue_time_us":598946}
I20260709 13:13:12.225414 28664 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:12.432698 28741 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.404062 28625 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.435760 28695 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:12.426234 28610 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:12.446151 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.450498 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36486 (request call id 1445) took 1748 ms. Trace:
I20260709 13:13:12.451110 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.451504 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.461333 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.459465 21396 rpcz_store.cc:276] 0709 13:13:10.701757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.710853 (+  9096us) service_pool.cc:224] Handling call
0709 13:13:10.711115 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.877569 (+166454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.450283 (+1572714us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003435d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:12.450441 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381512960}
I20260709 13:13:12.420614 28716 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.451900 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:12.421169 28562 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.449401 28739 raft_consensus.cc:3055] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:12.469761 21394 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:12.460954 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.451788 21468 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:13:12.464241 21395 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:12.467401 21392 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:13:12.471868 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.469707 28739 raft_consensus.cc:740] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:12.459996 28636 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:13:12.473155 21461 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
W20260709 13:13:12.472901 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 378400us
I20260709 13:13:12.498384 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.503400 21461 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.459882 28633 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:12.421053 28715 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.490784 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.450078 28376 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.509702 28462 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:12.511859 28462 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:12.497542 28610 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.512576 28610 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:12.512714 28462 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.513813 28462 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:12.466198 28741 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.517011 21317 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:12.517839 28625 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:12.460518 28656 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.520277 21470 raft_consensus.cc:2376] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24. Re-sending same reply.
I20260709 13:13:12.449704 28718 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.492664 28739 consensus_queue.cc:260] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.521613 28739 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:12.460321 28679 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:13:12.505918 21468 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:12.503175 28487 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.463193 28664 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.530064 21313 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 24. Current term is 25. Ops: []
I20260709 13:13:12.470292 28716 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.497797 28636 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:13:12.472126 28562 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:12.529564 28675 consensus_meta.cc:287] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 13:13:12.543568 21461 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:13:12.576501 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.577379 21461 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:12.578534 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.579310 21461 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:12.548796 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.524875 28741 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:12.541179 28656 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:12.584010 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 92175.1us
I20260709 13:13:12.533286 28487 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.581702 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.585986 21461 raft_consensus.cc:2376] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19. Re-sending same reply.
I20260709 13:13:12.587087 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.588476 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:12.589775 21433 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:12.592316 28766 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:12.592948 28766 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.593758 28562 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:12.595108 28766 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:12.595697 28766 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.602612 28715 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:12.603614 28376 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:12.636200 28739 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:12.636679 28562 raft_consensus.cc:2764] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:13:12.609891 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.610304 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1660) took 1654 ms. Trace:
I20260709 13:13:12.610095 28766 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.582578 28675 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.608510 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.649770 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.650484 21468 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:12.611426 28487 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:12.613809 28570 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:12.613929 28348 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:12.615216 28664 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:12.616806 28625 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:12.609159 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:12.622928 28764 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:12.656553 28348 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:12.658176 28348 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:12.658857 21468 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:12.659349 28348 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.597944 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:12.659809 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3476) took 1221 ms. Trace:
I20260709 13:13:12.660115 21312 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:12.660290 21319 rpcz_store.cc:276] 0709 13:13:11.438717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.439562 (+   845us) service_pool.cc:224] Handling call
0709 13:13:11.439914 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:11.733483 (+293569us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:13:12.039424 (+305941us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.461342 (+421918us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.461628 (+   286us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:12.462470 (+   842us) log.cc:844] Serialized 52 byte log entry
0709 13:13:12.462703 (+   233us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:13:12.462866 (+   163us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.464795 (+  1929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.464873 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.659577 (+194704us) raft_consensus.cc:1685] finished
0709 13:13:12.659598 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.659752 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14726,"prepare.queue_time_us":213393,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":272616,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":67128,"spinlock_wait_cycles":40149504,"thread_start_us":896680,"threads_started":3,"wal-append.queue_time_us":415737}
I20260709 13:13:12.625830 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.663192 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:12.663347 21461 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:12.663936 21319 raft_consensus.cc:2368] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19.
I20260709 13:13:12.627115 21433 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:13:12.638752 28762 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:13:12.631080 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:12.632859 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.633658 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.634928 21390 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:12.637986 22031 rpcz_store.cc:276] 0709 13:13:10.955530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.956112 (+   582us) service_pool.cc:224] Handling call
0709 13:13:12.610080 (+1653968us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54005c6554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:12.610241 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698813184}
W20260709 13:13:12.640854 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.643884 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:12.665269 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.678402 21319 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 13.
I20260709 13:13:12.678773 21321 raft_consensus.cc:2410] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:13:12.679381 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:12.633783 28681 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:12.629343 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.673198 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.680562 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.681085 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:12.666642 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:12.687978 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:12.691339 21468 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:12.689486 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:12.691331 21461 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:12.698700 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.680135 28656 raft_consensus.cc:2764] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:13:12.725076 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.667388 28625 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:12.681089 28690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.415s	user 0.009s	sys 0.032s
I20260709 13:13:12.714583 21312 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:13:12.729660 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:12.702692 28695 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:12.731182 28695 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.732007 28737 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:12.733390 22041 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:13:12.734097 22041 pending_rounds.cc:85] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 12
I20260709 13:13:12.734309 22041 pending_rounds.cc:107] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:13:12.734513 22041 raft_consensus.cc:2889] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:12.735749 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.725960 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:12.736111 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:12.729382 28690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.463s	user 0.009s	sys 0.032s
I20260709 13:13:12.736717 22038 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:13:12.686429 28739 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:12.737372 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.738238 21470 raft_consensus.cc:2376] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23. Re-sending same reply.
I20260709 13:13:12.739154 28694 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:12.739367 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:12.731201 28768 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:13:12.737237 28675 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:12.692694 28664 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:13:12.763942 21319 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:13:12.731129 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:12.766197 22036 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:12.766423 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.770951 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:12.700985 21461 raft_consensus.cc:2410] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:13:12.730703 28718 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:12.777872 21470 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:13:12.743186 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:12.779794 21470 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:12.779989 22038 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:12.780483 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.701243 28276 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:12.702163 28400 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:12.731792 28695 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:12.750662 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:12.762207 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 74300.3us
I20260709 13:13:12.739629 28694 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:12.774075 22031 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:13:12.665877 28715 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:13:12.805035 28715 consensus_queue.cc:1243] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 25.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:13:12.805667 28739 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:13:12.805825 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.806047 28739 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:12.806764 21318 raft_consensus.cc:2410] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:13:12.806892 28739 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.808091 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:12.808568 28739 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:13:12.811239 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:12.811878 22035 raft_consensus.cc:1813] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Handling vote request from an unknown peer 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:12.812217 22035 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:12.816516 28728 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:12.817092 28728 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:12.786289 21461 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:13:12.786543 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:12.790839 22036 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:12.719611 21468 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:12.792572 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:12.795290 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:12.797927 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:12.799634 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:12.824018 22034 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.786294 21314 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:12.825266 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.800618 28400 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:12.800343 21470 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:13:12.801349 28766 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:12.747568 28741 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:13:12.821261 21461 pending_rounds.cc:85] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 10
I20260709 13:13:12.770422 28462 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:13:11.623579 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:12.940794 21466 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:13:12.940183 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:12.908762 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 219329us
I20260709 13:13:12.959024 21312 raft_consensus.cc:2376] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19. Re-sending same reply.
I20260709 13:13:12.959264 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:12.889782 22034 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:12.960089 21467 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:12.827040 21468 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:13:12.936141 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:12.961902 22038 raft_consensus.cc:2410] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:13:12.962220 21461 pending_rounds.cc:107] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 15.11
W20260709 13:13:12.963037 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 176573us
I20260709 13:13:12.963797 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:12.964175 21470 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:13:12.913707 22035 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:13:12.964380 21468 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:13:12.965054 21461 raft_consensus.cc:2889] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:12.967662 21461 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 23. Current term is 24. Ops: []
W20260709 13:13:12.939778 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.978896 21466 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:12.980510 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.982370 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:12.986299 21284 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:12.987453 28739 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:12.987849 28739 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:12.988386 28739 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:12.990952 28773 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:12.991593 28773 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:12.993850 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:12.994700 28400 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:12.995038 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:12.942075 28737 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:12.976402 28691 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:12.997432 21314 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:12.998345 21468 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:12.998643 21466 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:13:13.000053 21434 leader_election.cc:336] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.774s (SENT)
W20260709 13:13:13.000195 22002 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.582s (SENT)
I20260709 13:13:13.000350 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:13.000661 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:13.001360 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:13.010380 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 45364.4us
I20260709 13:13:13.012817 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:13.017659 22002 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.652s (SENT)
I20260709 13:13:12.909744 28768 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:13.031970 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:12.826090 28681 raft_consensus.cc:2764] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:13:12.826735 28716 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:13.036262 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.019330 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.039402 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.029853 28766 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:12.942412 28695 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.008119 28737 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:13.047140 21312 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:13.027398 28715 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:13.040071 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.048759 22002 leader_election.cc:336] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.830s (SENT)
I20260709 13:13:13.055383 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.030087 28774 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:13.044737 28317 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:13:13.032001 28462 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:13.048174 28276 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:13.060703 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.897s (SENT)
I20260709 13:13:13.058322 21312 raft_consensus.cc:2410] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:13:13.034358 28718 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:13:13.055756 28768 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:13.052911 28716 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:12.829058 28728 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 11, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.048224 28664 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:13.064320 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.063676 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.064797 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.046373 21433 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:13.070699 22002 leader_election.cc:336] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.994s (SENT)
I20260709 13:13:13.069756 28766 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:13.075157 22002 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.055s (SENT)
I20260709 13:13:13.075332 22035 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:13:13.065654 28752 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:13.076195 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.057s (SENT)
I20260709 13:13:13.081009 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.081100 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:13.081890 22034 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:13.083478 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:13.066464 28427 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:13.084378 22038 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:13.085062 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:13.085330 28766 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:13.085944 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:13.087221 22036 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:13.087904 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:13.066385 28716 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:13.054757 28737 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.089581 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2470) took 1178 ms. Trace:
I20260709 13:13:13.081146 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:13.113646 22041 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:13:13.089588 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.243s (SENT)
I20260709 13:13:13.114123 21466 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:13.114988 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.115815 21462 rpcz_store.cc:276] 0709 13:13:11.911421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.914045 (+  2624us) service_pool.cc:224] Handling call
0709 13:13:11.914336 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.960785 (+ 46449us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:13:12.389693 (+428908us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.453177 (+ 63484us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.453228 (+    51us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:13:12.453279 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.088435 (+635156us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b1800491e60. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0f92a6 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419
0709 13:13:13.089256 (+   821us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b5400070154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:13.089319 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.089499 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":268555,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":93,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5418,"spinlock_wait_cycles":116247168,"thread_start_us":491626,"threads_started":2,"wal-append.queue_time_us":131786}
I20260709 13:13:13.118911 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.116895 21997 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:13.120070 21462 raft_consensus.cc:2376] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25. Re-sending same reply.
I20260709 13:13:13.116627 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:13.121969 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.124258 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.125385 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:13.125543 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.126740 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.076798 28435 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:13.113839 28716 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:13.095633 28728 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:13.116210 28462 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.132762 28378 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:13.127113 28691 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:13.140743 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.142452 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.092788 28427 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:13.143664 28427 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.127055 28769 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:13.145038 28427 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:13.146278 28695 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:13.122536 28675 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:13:13.148617 28737 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:13.122380 28636 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:13.063567 28773 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.141937 28768 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.122666 28664 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:13.127019 28766 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:13.136433 28739 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.149785 28691 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.083890 28752 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.152940 28562 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.154579 28664 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.166651 28739 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:13.157537 28691 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:13.087960 28694 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.160413 28766 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:13.169508 28664 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:13.180637 28694 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:13.180677 28716 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.183221 28716 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:13.220659 21312 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 23: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:13:13.220656 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 220205us
I20260709 13:13:13.223719 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3479) took 1768 ms. Trace:
W20260709 13:13:13.227061 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.229283 21388 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
W20260709 13:13:13.229590 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 106871us
I20260709 13:13:13.233122 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:13.231889 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.234597 21462 raft_consensus.cc:2376] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18. Re-sending same reply.
I20260709 13:13:13.236327 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.237275 21462 raft_consensus.cc:2376] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22. Re-sending same reply.
I20260709 13:13:13.238714 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.149796 21466 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:13.239985 21462 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:13.246057 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:13.246666 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 119886us
I20260709 13:13:13.247576 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:13.249039 21462 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:13.251806 21462 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:13:13.224418 21315 rpcz_store.cc:276] 0709 13:13:11.455110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.456991 (+  1881us) service_pool.cc:224] Handling call
0709 13:13:11.457479 (+   488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:12.811757 (+1354278us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b180046d9e0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bedc04bc 00007fc2bc10e48b 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf210bfb 00007fc2bf21b64b
0709 13:13:12.811921 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.811963 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:12.815114 (+  3151us) log.cc:844] Serialized 52 byte log entry
0709 13:13:13.065477 (+250363us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:13.065516 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.067275 (+  1759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.222732 (+155457us) raft_consensus.cc:1685] finished
0709 13:13:13.222787 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.223406 (+   619us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22715,"raft.queue_time_us":280218,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":58458,"spinlock_wait_cycles":35159808,"thread_start_us":500111,"threads_started":2,"wal-append.queue_time_us":306789}
W20260709 13:13:13.253485 22002 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.138s (SENT)
I20260709 13:13:13.247632 21466 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:13.258247 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:13.257087 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:13.262364 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:13.225257 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:13.274395 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49424us
I20260709 13:13:13.277350 21313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3488) took 1261 ms. Trace:
I20260709 13:13:13.277833 21313 rpcz_store.cc:276] 0709 13:13:12.015678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.015968 (+   290us) service_pool.cc:224] Handling call
0709 13:13:12.409294 (+393326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.530498 (+121204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.276755 (+746257us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54003f5cd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:13.277144 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277286784}
I20260709 13:13:13.280443 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.282087 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:13.283206 21314 raft_consensus.cc:2368] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 21. Current term is 22.
I20260709 13:13:13.285903 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.287009 21316 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 27.
I20260709 13:13:13.289772 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:13.291503 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.294561 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.298770 21320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3477) took 1859 ms. Trace:
I20260709 13:13:13.312099 28284 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:13.313724 28284 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:13:13.314123 28284 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:13.323411 28317 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:13.299280 21320 rpcz_store.cc:276] 0709 13:13:11.439043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.482800 (+ 43757us) service_pool.cc:224] Handling call
0709 13:13:11.483146 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.845991 (+362845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.298198 (+1452207us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400088c54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:13.298576 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621744512}
I20260709 13:13:13.329416 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.330138 28347 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:13.331410 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 1063) took 3274 ms. Trace:
I20260709 13:13:13.331681 28347 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:13.332428 28347 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:13.331910 22040 rpcz_store.cc:276] 0709 13:13:10.057079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.459684 (+402605us) service_pool.cc:224] Handling call
0709 13:13:12.310223 (+1850539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.372700 (+ 62477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.330954 (+958254us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54004cac50. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:13.331166 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4255212800}
I20260709 13:13:13.334112 28347 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.335839 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3079) took 1354 ms. Trace:
I20260709 13:13:13.336400 21469 rpcz_store.cc:276] 0709 13:13:11.981609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.981765 (+   156us) service_pool.cc:224] Handling call
0709 13:13:12.413308 (+431543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.417006 (+  3698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.335334 (+918328us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54004358d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:13.335615 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940706688}
I20260709 13:13:13.294553 21318 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:13:13.338084 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3491) took 1285 ms. Trace:
I20260709 13:13:13.338587 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1187) took 1308 ms. Trace:
I20260709 13:13:13.338464 21318 rpcz_store.cc:276] 0709 13:13:12.052822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.293132 (+1240310us) service_pool.cc:224] Handling call
0709 13:13:13.293894 (+   762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.337646 (+ 43752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.337986 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:13.339195 21470 rpcz_store.cc:276] 0709 13:13:12.030496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.957671 (+927175us) service_pool.cc:224] Handling call
0709 13:13:12.963920 (+  6249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.966138 (+  2218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.338175 (+372037us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b540025ba50. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:13.338405 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13548800}
I20260709 13:13:13.344503 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:13.348405 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:13.348968 21464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 3095) took 1353 ms (client timeout 1698 ms). Trace:
W20260709 13:13:13.349516 21464 rpcz_store.cc:269] 0709 13:13:11.995534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.414688 (+419154us) service_pool.cc:224] Handling call
0709 13:13:13.348315 (+933627us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b54002162a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c4ff5924 00007fc2c41de227 00007fc2c41ddab8 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:13.348795 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7891840}
I20260709 13:13:13.279843 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.353004 21313 raft_consensus.cc:2410] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:13:13.275692 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.315825 28284 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.343616 21315 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:13.356009 21317 raft_consensus.cc:2368] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16.
W20260709 13:13:13.365921 21395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52936 (request call id 3155) took 2177 ms (client timeout 1774 ms). Trace:
W20260709 13:13:13.366480 21395 rpcz_store.cc:269] 0709 13:13:11.188205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.188392 (+   187us) service_pool.cc:224] Handling call
0709 13:13:13.365406 (+2177014us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001c7854. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:13.365664 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815686528}
I20260709 13:13:13.367532 21317 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:13.369336 21320 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:13.372855 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.372921 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.356312 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.374787 21321 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:13.378491 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:13.379544 21466 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:13.386781 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:13.389326 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.389503 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1186) took 1366 ms. Trace:
I20260709 13:13:13.389953 21467 rpcz_store.cc:276] 0709 13:13:12.022973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.947624 (+924651us) service_pool.cc:224] Handling call
0709 13:13:12.959923 (+ 12299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.960889 (+   966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.389119 (+428230us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54001a7cd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:13.389314 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24439040}
W20260709 13:13:13.391320 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.388331 21315 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:13:13.391825 21315 pending_rounds.cc:85] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 13
I20260709 13:13:13.392217 21315 pending_rounds.cc:107] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:13:13.391997 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:13.392521 21315 raft_consensus.cc:2889] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:13.357492 21312 raft_consensus.cc:2410] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:13:13.393301 21470 raft_consensus.cc:2393] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:13.394632 21315 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:13.359854 28276 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:13.394024 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.397439 28276 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.398316 28276 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:13.392387 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.399664 21211 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 12 to 18, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.402467 21211 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 12 to 16, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 16 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.410128 21468 raft_consensus.cc:1240] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 22. Ops: [20.12-20.12]
I20260709 13:13:13.410701 21470 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:13.408828 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.360021 28284 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:13.414518 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.415318 21470 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:13.416268 28347 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:13.419121 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:13.408952 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3494) took 1024 ms. Trace:
I20260709 13:13:13.420847 21318 rpcz_store.cc:276] 0709 13:13:12.384810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.339614 (+954804us) service_pool.cc:224] Handling call
0709 13:13:13.408194 (+ 68580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.408547 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.408573 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:13.408635 (+    62us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:13.408667 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.408726 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.408863 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:13.423870 21318 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:13.391407 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:13.427592 21320 raft_consensus.cc:1275] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:13:13.429594 28276 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:13.411988 21211 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 18 to 21, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 21 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.431282 21313 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:13:13.432705 21314 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 13:13:13.433137 21360 leader_election.cc:336] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Timed out: RequestConsensusVote RPC to 127.19.185.195:45119 timed out after 1.852s (SENT)
I20260709 13:13:13.434027 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:13.440447 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:13.444289 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.445832 21321 raft_consensus.cc:1240] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:13.168267 28562 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.545537 21316 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:13.455144 21315 raft_consensus.cc:1240] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:13.546386 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 1128) took 1041 ms. Trace:
I20260709 13:13:13.546895 21316 rpcz_store.cc:276] 0709 13:13:12.504922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.287957 (+783035us) service_pool.cc:224] Handling call
0709 13:13:13.546298 (+258341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:13.492098 21466 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:13.184612 28769 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:13.452073 21214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 289) took 26956 ms (client timeout 15000 ms). Trace:
I20260709 13:13:13.479753 21314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33484 (request call id 1118) took 1051 ms. Trace:
I20260709 13:13:13.553905 21314 rpcz_store.cc:276] 0709 13:13:12.428102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.351360 (+923258us) service_pool.cc:224] Handling call
0709 13:13:13.432297 (+ 80937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.479402 (+ 47105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.479684 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:13.452493 28378 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.554805 28435 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.555313 28378 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.555903 28570 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.556697 28570 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.558499 28378 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:13.555325 28435 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.527850 21467 raft_consensus.cc:2376] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25. Re-sending same reply.
I20260709 13:13:13.540674 21360 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:13.561967 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 169952us
W20260709 13:13:13.562803 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.528970 28788 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:13.529758 21211 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 15 to 16, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 16 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:13.527940 28741 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:13:13.453270 28636 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.116s
I20260709 13:13:13.568797 21211 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 16 to 20, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 20 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.534824 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:13.535063 28775 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:13.572283 28766 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:13.535897 28739 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:13.536708 28715 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:13.531086 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:13.537392 28728 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:13.581036 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.559789 28570 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:13.581980 28766 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:13:13.592411 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 189097us
I20260709 13:13:13.581632 21211 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 22 to 23, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 23 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.591441 28716 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.593197 28788 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:13.595556 28766 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:13.635025 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 103382us
I20260709 13:13:13.636556 28568 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:13.637327 21463 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 19.
W20260709 13:13:13.637770 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 106870us
I20260709 13:13:13.638792 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:13.639143 28788 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:13.552953 21214 rpcz_store.cc:269] 0709 13:12:46.495455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.495637 (+   182us) service_pool.cc:224] Handling call
0709 13:13:13.451781 (+26956144us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:59.428110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:59.428783 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:59.428837 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:12:59.428856 (+    19us) tablet.cc:662] Decoding operations
0709 13:12:59.782810 (+353954us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:59.799497 (+ 16687us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:59.803343 (+  3846us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:12:59.808776 (+  5433us) tablet.cc:701] Row locks acquired
0709 13:12:59.808836 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:12:59.809013 (+   177us) write_op.cc:270] Start()
0709 13:12:59.809163 (+   150us) write_op.cc:276] Timestamp: P: 1783602779808946 usec, L: 0
0709 13:12:59.809185 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:59.809911 (+   726us) log.cc:844] Serialized 3702 byte log entry
0709 13:13:00.489161 (+679250us) op_driver.cc:464] REPLICATION: finished
0709 13:13:01.580912 (+1091751us) write_op.cc:301] APPLY: starting
0709 13:13:01.583619 (+  2707us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:02.781301 (+1197682us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:02.785166 (+  3865us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:04.050653 (+1265487us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:04.096390 (+ 45737us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:13:04.096442 (+    52us) write_op.cc:312] APPLY: finished
0709 13:13:04.096953 (+   511us) log.cc:844] Serialized 89 byte log entry
0709 13:13:04.228796 (+131843us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:04.236410 (+  7614us) write_op.cc:454] Released schema lock
0709 13:13:04.236473 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:04.237151 (+   678us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:04.237193 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":494987,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":1038563,"apply.run_cpu_time_us":55547,"apply.run_wall_time_us":2677275,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41855,"num_ops":9,"prepare.queue_time_us":612950,"prepare.run_cpu_time_us":27713,"prepare.run_wall_time_us":663061,"raft.queue_time_us":293614,"raft.run_cpu_time_us":6494,"raft.run_wall_time_us":47732,"replication_time_us":679815,"thread_start_us":965807,"threads_started":5,"wal-append.queue_time_us":554186,"wal-append.run_cpu_time_us":63562,"wal-append.run_wall_time_us":2227081}]]}
I20260709 13:13:13.643734 28716 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:13.644853 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 197836us
I20260709 13:13:13.646140 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.646481 28716 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:13.640197 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3492) took 1209 ms. Trace:
I20260709 13:13:13.604676 28775 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:13.609896 28695 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.553748 28769 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:13.675474 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.609047 28737 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:13.599466 28715 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.647434 21319 rpcz_store.cc:276] 0709 13:13:12.384155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.295601 (+911446us) service_pool.cc:224] Handling call
0709 13:13:13.296273 (+   672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.296744 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:13.297195 (+   451us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.592857 (+295662us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:13.592914 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:13.592980 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.593055 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.593187 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75264,"prepare.queue_time_us":181842,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":79211,"spinlock_wait_cycles":8618240,"thread_start_us":216205,"threads_started":1,"wal-append.queue_time_us":216617}
I20260709 13:13:13.676820 28716 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:13.696439 28427 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.551s	user 0.005s	sys 0.012s
I20260709 13:13:13.608625 28786 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.098s
W20260709 13:13:13.701092 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 68756.5us
I20260709 13:13:13.686431 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3501) took 1182 ms. Trace:
W20260709 13:13:13.704859 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 424611us
I20260709 13:13:13.707338 28695 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:13.708627 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 69961.4us
I20260709 13:13:13.709031 28752 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:13.714736 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 175525us
I20260709 13:13:13.714919 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3081) took 1732 ms. Trace:
W20260709 13:13:13.718698 28691 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.542s	user 0.014s	sys 0.000s
W20260709 13:13:13.724913 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 203358us
I20260709 13:13:13.721029 21465 rpcz_store.cc:276] 0709 13:13:11.982308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.774915 (+792607us) service_pool.cc:224] Handling call
0709 13:13:12.816609 (+ 41694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.817020 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.817064 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.817666 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.097714 (+280048us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:13.573685 (+475971us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.714358 (+140673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.714466 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.714526 (+    60us) raft_consensus.cc:1685] finished
0709 13:13:13.714538 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.714718 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112520,"prepare.queue_time_us":512405,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":118100,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":8501,"thread_start_us":705038,"threads_started":2,"wal-append.queue_time_us":339428}
I20260709 13:13:13.728305 21436 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.739064 28772 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:13.696525 28766 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.740077 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:13.740834 28766 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:13.743607 28796 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.744503 28796 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.731325 28568 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:13:13.746853 21285 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:13.747121 28796 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:13.748459 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.749119 28715 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:13.749847 28715 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:13.750439 28715 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:13.750636 28737 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:13.751232 28737 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:13.751344 28562 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:13.754448 28435 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:13.761641 28664 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.006s
I20260709 13:13:13.762163 28664 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.743721 28786 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:13.751518 28715 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.763543 28786 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.763926 28786 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:13.730247 28691 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.765144 21469 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:13.766191 28691 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:13.772547 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 126537us
I20260709 13:13:13.607357 21211 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 14 to 18, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.713291 21312 rpcz_store.cc:276] 0709 13:13:12.507587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.393662 (+886075us) service_pool.cc:224] Handling call
0709 13:13:13.394193 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.394638 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:13.519649 (+125011us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.685275 (+165626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:13.685379 (+   104us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:13.686162 (+   783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.686248 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.686374 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20099,"prepare.queue_time_us":118278,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":8824,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3476,"thread_start_us":211222,"threads_started":2,"wal-append.queue_time_us":106681}
I20260709 13:13:13.778470 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:13.780853 28752 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:13.781862 28752 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:13.782411 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:13.782902 28740 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:13.783288 22032 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:13.783311 28740 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:13.734553 28570 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:13.792362 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 57921.5us
I20260709 13:13:13.792994 28596 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:13.804356 21211 catalog_manager.cc:5697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.808560 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:13.806813 21211 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 11 to 15, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 15 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.803297 28316 consensus_queue.cc:1059] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:13:13.825852 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:13.791851 28788 consensus_queue.cc:1059] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:13:13.839406 28737 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:13.843750 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 70023.6us
I20260709 13:13:13.847903 28349 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:13.848318 28695 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:13.849778 28349 consensus_queue.cc:1059] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:13:13.855683 28791 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:13:13.858372 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:13.861054 28803 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.252s	user 0.003s	sys 0.000s
W20260709 13:13:13.851704 28790 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
I20260709 13:13:13.836704 28716 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:13.851866 28349 raft_consensus.cc:3055] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:13:13.871033 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 3.358s (SENT)
I20260709 13:13:13.872925 22038 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:13.784652 28740 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.823652 28570 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:13.884277 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 53286.9us
W20260709 13:13:13.886847 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.889626 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 161582us
I20260709 13:13:13.891952 28400 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:13.892611 28400 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:13.893766 21464 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:13.893718 28400 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.894423 28636 raft_consensus.cc:3055] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:13.894829 28636 raft_consensus.cc:740] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:13.895684 21388 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:13.861872 28462 consensus_queue.cc:1048] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:13:13.895891 28636 consensus_queue.cc:260] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.901628 28636 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:13.880179 28716 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:13.908526 28716 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:13.888414 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:13.912900 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.913426 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.889253 28596 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:13.881363 28349 raft_consensus.cc:740] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:13.907447 28786 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.924835 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:13.928395 28596 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:13.923790 28788 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:13.931318 28596 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:13.931425 28788 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.933774 28788 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:13.935859 28814 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:13:13.937976 28804 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:13:13.928427 28795 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:13.945694 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:13.953338 28347 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:13.953876 28410 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 8 to 15, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:13.957984 28649 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:13.919080 21211 catalog_manager.cc:5697] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 14 to 18, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.960479 21211 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 15 to 24, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 24 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:13.962421 28664 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:13.963498 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 91035.9us
I20260709 13:13:13.898038 28625 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.968622 28349 consensus_queue.cc:260] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:13.975708 28349 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:13.977108 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.977914 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:13.978278 21312 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:13.978766 21319 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 28 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
W20260709 13:13:13.973453 21463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 3075) took 2019 ms (client timeout 1813 ms). Trace:
I20260709 13:13:13.970471 28570 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:13.980964 21463 rpcz_store.cc:269] 0709 13:13:11.953699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.970846 (+ 17147us) service_pool.cc:224] Handling call
0709 13:13:13.973203 (+2002357us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540024a4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:13.973369 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3623152384}
I20260709 13:13:13.982108 21462 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:13:13.984133 28560 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:13:13.989064 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47881.1us
I20260709 13:13:14.000422 28625 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:13.949606 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:14.014266 28347 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:14.015503 28786 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:14.015854 28347 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:13:14.020167 28782 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:14.022253 28782 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:14.023429 28782 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.020679 21317 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:13:14.020891 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.026824 28740 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:13:14.027470 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 162409us
W20260709 13:13:14.028435 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 83100us
I20260709 13:13:14.030395 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.031356 28596 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:13:14.031924 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 51984.6us
I20260709 13:13:13.962357 21211 catalog_manager.cc:5697] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 13 to 21, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 21 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.972671 28676 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:14.018814 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 70791.2us
W20260709 13:13:14.040360 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.000504 28795 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:14.039969 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:14.036427 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:14.032006 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.069087 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:14.069509 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.070371 21317 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 12.
I20260709 13:13:14.071448 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:14.071594 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 50849.7us
I20260709 13:13:14.073328 28525 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:13:14.073822 28525 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:14.074213 28525 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:14.074460 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:14.074798 28768 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:14.076435 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:14.077745 28568 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:14.077936 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:14.078260 28568 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:14.078676 28568 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:14.078464 28719 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:14.079741 22042 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:13:14.080205 28719 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:14.080840 28661 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:14.080984 28733 consensus_queue.cc:1059] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:13:14.082261 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.038414 28716 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.083187 28442 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:13:14.084151 28716 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:14.069128 22036 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:14.085448 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:14.086974 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.088982 28788 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:14.089395 28788 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:14.102434 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:14.102934 28716 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:14.103367 21316 raft_consensus.cc:2376] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19. Re-sending same reply.
W20260709 13:13:14.105135 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73231.7us
I20260709 13:13:14.115809 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.035949 28462 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:13:14.089793 28788 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:14.118646 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.120659 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.119247 28560 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:13:14.123070 28442 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:14.034053 21211 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:14.123780 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 47935.3us
I20260709 13:13:14.125295 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.125293 21317 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:14.126825 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.127713 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.134886 21462 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 28 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 13:13:14.105973 28636 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:14.147118 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:14.147562 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 62214.6us
I20260709 13:13:14.129014 28378 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:14.147801 21315 raft_consensus.cc:2376] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17. Re-sending same reply.
I20260709 13:13:14.149739 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.147284 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:14.154749 28734 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:14.155211 28734 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:14.155614 28734 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:14.160534 21461 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:14.160583 28592 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:14.162951 28592 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:14.164139 28694 consensus_meta.cc:287] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.938s	user 0.014s	sys 0.002s
W20260709 13:13:14.165274 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46530.7us
I20260709 13:13:14.166247 21436 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.168830 21211 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.170717 21211 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 14 to 15, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 15 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.167781 28733 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:13:14.178678 21469 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
W20260709 13:13:14.179117 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.167796 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.165395 28592 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:14.118772 28715 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:13:14.178763 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:14.145069 28782 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.197795 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:14.201530 21315 raft_consensus.cc:2376] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22. Re-sending same reply.
I20260709 13:13:14.204069 21463 raft_consensus.cc:1240] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:14.226998 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:14.152348 28378 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:14.205777 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:14.210505 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:14.217610 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.239353 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:14.246608 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 92519.4us
I20260709 13:13:14.246634 22031 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:14.210959 28681 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:14.204294 28656 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:14.206020 28733 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:14.252537 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1196) took 1836 ms. Trace:
I20260709 13:13:14.253010 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:14.253065 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.253958 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.254782 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.199491 28719 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:14.268478 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.284852 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:14.236833 28560 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:13:14.244684 28378 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:14.200204 28715 consensus_queue.cc:1243] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:14.318104 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.212086 28782 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.285756 28786 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:14.300151 28410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47682 (request call id 11) took 9371 ms. Trace:
I20260709 13:13:14.296190 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.260193 28317 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:14.286006 28664 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.293545 21461 rpcz_store.cc:276] 0709 13:13:12.415772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.968518 (+552746us) service_pool.cc:224] Handling call
0709 13:13:12.968776 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.161077 (+1192301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.248496 (+ 87419us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540025b554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:14.252478 (+  3982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2708958464}
W20260709 13:13:14.321187 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 115466us
I20260709 13:13:14.293049 28592 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:14.392949 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:14.393504 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:14.324651 21315 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 23: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
W20260709 13:13:14.395768 28826 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:13:14.378876 28487 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:14.382543 28793 consensus_queue.cc:1059] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:14.375099 28510 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:14.374406 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 140139us
I20260709 13:13:14.381821 28636 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:14.372392 28808 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:14.322136 28410 rpcz_store.cc:276] 0709 13:13:04.928871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.980681 (+ 51810us) service_pool.cc:224] Handling call
0709 13:13:07.360136 (+2379455us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5800879ed0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf21370a 00007fc2bf21476a 00007fc2bf21391b 00007fc2bf21f03c 00007fc2bf21e6b3 00007fc2bf2169fa 00007fc2c41de4c9 00007fc2bd75ac54
0709 13:13:07.400500 (+ 40364us) log.cc:844] Serialized 508 byte log entry
0709 13:13:14.300013 (+6899513us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25748,"raft.queue_time_us":38797,"raft.run_cpu_time_us":1425,"raft.run_wall_time_us":5519,"spinlock_wait_cycles":4572624128,"thread_start_us":182913,"threads_started":1,"wal-append.queue_time_us":357486,"wal-append.run_cpu_time_us":1718,"wal-append.run_wall_time_us":1001739}
W20260709 13:13:14.315353 28819 log.cc:927] Time spent T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:13:14.378492 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 82403.2us
I20260709 13:13:14.376853 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1673) took 1296 ms. Trace:
I20260709 13:13:14.379626 28596 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:13:14.415393 21463 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:14.418152 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48969.6us
I20260709 13:13:14.325713 28317 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.422472 28487 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:14.432741 28793 consensus_queue.cc:1243] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:13:14.369387 28786 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.441915 22031 rpcz_store.cc:276] 0709 13:13:13.080676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.087623 (+  6947us) service_pool.cc:224] Handling call
0709 13:13:14.376523 (+1288900us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:14.376757 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644324736}
I20260709 13:13:14.373188 28664 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.468871 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.496119 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.496834 21463 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:14.501461 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.502243 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:14.502611 28740 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.503276 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.503172 28740 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.503486 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.503911 21390 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:14.504231 21387 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:13:14.505113 21396 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:14.505528 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:14.506089 21394 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:14.506575 21393 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:14.506605 21468 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:14.508193 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:14.434818 21211 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.511318 28796 consensus_queue.cc:1048] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:14.511057 21211 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 6 to 18. New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.512626 28525 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.516023 28782 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:14.516355 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:14.517822 21394 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:14.544325 21392 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:14.521339 21468 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:13:14.448760 28317 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:14.446345 28596 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:14.543432 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.529698 28487 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.531193 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.448782 28510 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.458482 28636 consensus_queue.cc:1243] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:14.531818 28716 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:14.562362 21388 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 25. Current term is 26. Ops: []
I20260709 13:13:14.532508 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.562857 21394 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:14.557168 21433 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:14.448236 28592 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:13:14.566372 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.549896 28782 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.550995 28349 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.556563 28596 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:13:14.559626 28676 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.004s
I20260709 13:13:14.571933 22036 pending_rounds.cc:85] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 11
I20260709 13:13:14.573997 22036 pending_rounds.cc:107] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:13:14.574334 22036 raft_consensus.cc:2889] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:14.565973 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:14.571293 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:14.585043 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.601359 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.647197 22031 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:13:14.649012 21393 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:14.670564 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.568507 28636 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:14.673413 21468 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:14.570933 28656 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:14.680298 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.696974 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:14.649611 28487 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:14.679741 28768 consensus_meta.cc:287] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
W20260709 13:13:14.705070 28788 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.002s
I20260709 13:13:14.644673 28716 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.714798 21468 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:13:14.680583 28656 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.703908 28675 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:14.719502 21462 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:14.717242 28805 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:14.716223 21468 pending_rounds.cc:85] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 8
I20260709 13:13:14.722424 21468 pending_rounds.cc:107] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:13:14.722762 21468 raft_consensus.cc:2889] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:14.724381 21468 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:14.706190 28625 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:13:14.725059 21391 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:14.722237 28525 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:14.712481 28740 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:14.655320 28349 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.670895 28782 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.715370 28681 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.716084 28768 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:14.716178 28766 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:14.718406 28656 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:14.747496 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.748384 21391 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:14.735149 28793 raft_consensus.cc:3055] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:14.727453 28788 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.777660 21319 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:14.759573 28793 raft_consensus.cc:740] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:14.793730 28793 consensus_queue.cc:260] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.794890 28793 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:14.797262 28568 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.003s
I20260709 13:13:14.797924 28568 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.746306 28681 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.802197 28681 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:14.802595 28510 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:14.803282 22041 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:14.803197 28768 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.803768 22041 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:14.804018 28768 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.806754 28378 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.808722 28568 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:14.782847 21211 catalog_manager.cc:5697] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 14 to 18, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:14.814070 28831 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:13:14.826792 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 312700us
I20260709 13:13:14.850605 21391 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:14.841384 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.851679 21394 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:13:14.787851 28716 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:14.852944 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.857699 21388 raft_consensus.cc:2410] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:13:14.848664 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:14.787950 28348 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.855414 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:14.858464 22031 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:14.879052 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.881209 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:14.882134 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.884449 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:14.885203 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:14.866779 22041 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.886329 21394 raft_consensus.cc:2410] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:13:14.892838 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.860324 28347 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.894912 21315 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:14.902693 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:14.903995 21462 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:13:14.909422 22041 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:14.889604 28832 log.cc:927] Time spent T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.210s	user 0.001s	sys 0.001s
I20260709 13:13:14.905638 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:14.910318 21312 raft_consensus.cc:1240] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:13:14.912506 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.914737 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:14.916391 21467 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:13:14.884298 28716 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.917385 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:14.922365 21392 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:14.922355 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.865007 28348 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.922837 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:14.922116 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:14.931663 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 251666us
I20260709 13:13:14.932395 21468 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:13:14.887553 28596 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:14.940241 21392 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: [15.12-16.13]
W20260709 13:13:14.942762 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 374078us
I20260709 13:13:14.924090 28510 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.943154 28734 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.001s
I20260709 13:13:14.972334 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:14.972453 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50444.9us
I20260709 13:13:14.970165 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:14.973435 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:14.943764 28349 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:14.977084 21467 raft_consensus.cc:2393] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:14.923861 28347 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.952201 28793 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:13:15.002792 28802 raft_consensus.cc:3055] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:13:15.003023 28844 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:13:15.003364 28802 raft_consensus.cc:740] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:15.003489 22002 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:14.995172 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:15.004773 28838 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:13:14.968842 28797 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.978454 28560 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:14.973826 28782 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:14.952464 28766 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 13:13:15.032357 28845 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:13:15.032804 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50087.5us
I20260709 13:13:15.034694 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:14.975018 28734 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:15.021034 28860 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:15.029554 21434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.826s (SENT) [suppressed 48 similar messages]
I20260709 13:13:14.966361 28716 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:15.041049 21316 raft_consensus.cc:1240] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:15.042048 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:15.051568 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.043486 21394 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 25.
I20260709 13:13:14.970081 28850 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:14.995093 28788 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:15.016723 28378 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:15.018639 28856 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:15.109182 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51913.7us
I20260709 13:13:15.005443 28805 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:13:15.057237 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:15.064740 28596 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:15.065603 28846 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:13:15.066401 28837 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:13:15.069149 21204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7cc0b64eb784638b78409562870a2db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:13:15.071033 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:15.072234 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.975201 21211 catalog_manager.cc:5697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 13 to 17, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 17 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.031152 28768 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:15.077670 21433 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:15.076664 28802 consensus_queue.cc:260] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:14.995280 28510 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.112831 21396 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:15.121253 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.161908 28510 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:15.122448 22041 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:13:15.134825 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.140403 28861 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:15.163329 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.164249 21314 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
W20260709 13:13:15.165309 28828 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.486s	user 0.003s	sys 0.000s
I20260709 13:13:15.166821 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:15.167806 28854 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:15.168295 28854 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.168641 28854 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:15.172863 28843 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:13:15.176342 28801 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:13:15.022527 28797 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.181695 28867 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:15.182299 28867 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.182721 28867 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:15.183108 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:15.184442 28802 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:15.184829 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:15.185318 28694 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:15.185710 28694 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:15.186070 28694 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:15.188171 28851 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:15.191596 28347 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:15.192476 28788 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:15.193040 28788 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:15.193950 28788 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.122713 28859 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:15.195566 28859 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:15.046346 28656 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.198264 21389 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: [19.10-21.11]
I20260709 13:13:15.198997 21319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33484 (request call id 1137) took 1108 ms. Trace:
I20260709 13:13:15.199479 21319 rpcz_store.cc:276] 0709 13:13:14.090453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.090707 (+   254us) service_pool.cc:224] Handling call
0709 13:13:15.198749 (+1108042us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54000be5d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:15.198871 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520180096}
W20260709 13:13:15.204317 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 133386us
I20260709 13:13:15.205272 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:15.206630 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:15.144348 21204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97056.7us
I20260709 13:13:15.151708 28410 consensus_queue.cc:1059] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:13:15.124440 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 46856.1us
W20260709 13:13:15.143625 28317 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:13:15.208698 28625 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:15.208847 28348 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:15.212242 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:15.212930 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:15.211087 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:15.221859 21387 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:15.225777 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.226282 21395 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:13:15.227671 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:15.233830 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:15.234673 22038 raft_consensus.cc:2410] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:15.231596 21470 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:15.232578 21319 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:13:15.238423 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:15.250388 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.225366 28805 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:15.230365 28737 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:15.264379 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.227016 28410 raft_consensus.cc:3055] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:13:15.278770 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 157810us
I20260709 13:13:15.238230 28656 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:15.243507 28768 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:15.239620 28636 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:15.288766 28768 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.261023 28793 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:15.261269 28348 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:15.299569 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3122) took 1041 ms. Trace:
I20260709 13:13:15.299052 21395 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:15.294481 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:15.296097 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:15.300282 21463 rpcz_store.cc:276] 0709 13:13:14.258252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.497482 (+239230us) service_pool.cc:224] Handling call
0709 13:13:14.497918 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:14.498310 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.498337 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:14.498773 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:13:14.743747 (+244974us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:14.743809 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.743920 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:15.299240 (+555320us) raft_consensus.cc:1685] finished
0709 13:13:15.299270 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.299481 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2066,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":244527,"threads_started":1,"wal-append.queue_time_us":372035}
I20260709 13:13:15.301173 21462 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:13:15.304589 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.291589 28768 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:15.226831 28317 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:15.134531 28850 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:15.315296 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:15.318393 22041 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:15.279703 28410 raft_consensus.cc:740] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:15.247249 28715 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:13:15.115159 28856 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:15.333173 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.273352 28851 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:13:15.337023 21394 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
W20260709 13:13:15.307587 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 57873.4us
I20260709 13:13:15.299651 28348 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.347622 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:15.351270 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.298534 28805 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:15.350258 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 91346.7us
I20260709 13:13:15.352010 21393 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:13:15.376068 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:15.377799 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:15.378930 21462 raft_consensus.cc:2410] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:13:15.385550 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:15.376823 21468 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:15.339387 28316 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:15.328999 28716 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:15.392421 21462 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 22: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:15.398300 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.350453 28786 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:15.342995 28737 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:15.355379 28348 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:15.408105 21285 leader_election.cc:336] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.570s (SENT)
I20260709 13:13:15.410241 21463 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:13:15.413190 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:15.404302 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 124486us
I20260709 13:13:15.424225 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:15.387605 28835 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:13:15.325752 28636 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.430552 28801 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:15.431099 28801 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.431882 28636 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:15.432416 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.432531 28636 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:15.433143 28636 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:15.433660 28317 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:15.434221 28853 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.434015 28636 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.314425 21211 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 13 to 15, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 15 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.435643 21211 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 11 to 13, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 13 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.436849 28879 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:15.437481 28879 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.437867 21434 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:15.438022 28675 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:15.439356 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:15.439679 28879 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:15.328413 28740 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:13:15.439785 28675 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:13:15.440053 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.011s	sys 0.015s
W20260709 13:13:15.457830 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.012s	sys 0.015s
I20260709 13:13:15.457646 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:15.458218 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 947849us
I20260709 13:13:15.376437 28793 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:15.407117 28834 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:13:15.432667 28852 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:13:15.387056 28656 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:13:15.441253 28734 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:15.436900 28863 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:13:15.407384 28797 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:15.396441 28316 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.388535 28805 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.329596 28859 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.452252 28716 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.454031 28378 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:15.473146 22041 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
W20260709 13:13:15.542032 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 147639us
I20260709 13:13:15.543826 21395 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:13:15.531061 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 137209us
I20260709 13:13:15.592373 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.603255 21392 raft_consensus.cc:2393] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 22: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:15.599905 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.188239 28857 consensus_queue.cc:1175] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33be1cb5cfc143fc90e164888c96cc6f" responder_term: 21 status { last_received { term: 20 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: [20.15-20.15]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:15.521970 28316 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:15.448979 28737 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.610383 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:15.418788 28410 consensus_queue.cc:260] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:15.619339 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 149788us
I20260709 13:13:15.434778 28853 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:15.605525 28560 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 13:13:15.466639 28317 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.138s
I20260709 13:13:15.627395 21316 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:15.601318 28378 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.470764 28854 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.635367 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:15.636976 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.608716 28788 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:15.644685 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.645563 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.517891 28793 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:15.651604 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.653787 21392 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:15.661636 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:15.662220 21392 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:15.659794 21388 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:15.613642 28885 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:15.682122 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:15.683826 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.690769 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.648325 28378 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:15.645349 28560 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:15.694898 21316 raft_consensus.cc:2468] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 13.
I20260709 13:13:15.620152 28716 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:15.699756 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.700623 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 24.
I20260709 13:13:15.700338 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.697414 28675 raft_consensus.cc:697] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:15.749589 28675 consensus_queue.cc:237] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:15.786725 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:15.699740 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97675us
I20260709 13:13:15.702337 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:15.799894 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97665.7us
W20260709 13:13:15.800534 22002 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.539s (SENT)
I20260709 13:13:15.682370 28786 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:15.800372 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:15.820180 21388 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 27: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:15.831161 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:15.832011 21316 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:15.693276 28862 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:15.833527 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:15.837916 21395 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:13:15.828524 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 1095) took 1241 ms. Trace:
I20260709 13:13:15.681331 28880 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.385s
I20260709 13:13:15.842491 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:15.795825 28664 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:15.800770 28656 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.050s
I20260709 13:13:15.870877 21392 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:13:15.861512 21318 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:13:15.872639 21318 pending_rounds.cc:85] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 12
I20260709 13:13:15.872968 21318 pending_rounds.cc:107] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:13:15.873297 21318 raft_consensus.cc:2889] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:15.859252 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.860447 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.839215 22036 rpcz_store.cc:276] 0709 13:13:14.560612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.560742 (+   130us) service_pool.cc:224] Handling call
0709 13:13:14.565761 (+  5019us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:14.706480 (+140719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.706537 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:14.714329 (+  7792us) log.cc:844] Serialized 52 byte log entry
0709 13:13:14.898752 (+184423us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:14.898806 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.899868 (+  1062us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:15.801902 (+902034us) raft_consensus.cc:1685] finished
0709 13:13:15.801927 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.802122 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24354,"raft.queue_time_us":23537,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5775,"thread_start_us":153283,"threads_started":1,"wal-append.queue_time_us":528538}
I20260709 13:13:15.878562 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.879014 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:15.819993 28856 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:15.879566 21388 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:15.876637 21319 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:15.686659 28788 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.890609 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:15.851614 28870 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.446s	user 0.001s	sys 0.000s
I20260709 13:13:15.845975 28317 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.846581 28850 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:15.922653 28805 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:15.923318 28694 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.737s	user 0.017s	sys 0.000s
I20260709 13:13:15.925223 28716 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:15.928431 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.928668 28737 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:15.699662 28885 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:15.851480 28880 consensus_queue.cc:1243] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:15.837186 28862 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:15.898737 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 112155us
W20260709 13:13:15.912186 28875 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.442s	user 0.001s	sys 0.000s
I20260709 13:13:15.801194 28868 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.436s
I20260709 13:13:15.851838 28801 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:15.916862 28886 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:15.917886 28889 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:13:15.920137 28888 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:13:15.832953 28786 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.929764 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.851680 28487 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:15.907202 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.931954 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:15.933385 21316 raft_consensus.cc:2410] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:13:15.933666 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 133173us
W20260709 13:13:15.916514 28872 log.cc:927] Time spent T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:13:15.960180 28896 raft_consensus.cc:2764] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:13:15.942817 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:15.961051 28786 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:15.939605 28883 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.960700 28801 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.961179 21321 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:15.946715 21362 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:15.969782 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:15.942822 28802 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.004s
I20260709 13:13:15.967293 21314 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 25: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:15.967973 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:15.975934 21317 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:15.970410 21316 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:15.973506 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:15.977214 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:15.969300 28487 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.974107 28883 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.982357 28883 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:15.982856 28801 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:15.985023 28801 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:15.985204 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3123) took 1120 ms. Trace:
I20260709 13:13:15.985661 21461 rpcz_store.cc:276] 0709 13:13:14.864320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.864470 (+   150us) service_pool.cc:224] Handling call
0709 13:13:14.864855 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:14.976185 (+111330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.976267 (+    82us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:15.041475 (+ 65208us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.234030 (+192555us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:15.234099 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.234204 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:15.984984 (+750780us) raft_consensus.cc:1685] finished
0709 13:13:15.985007 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.985146 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70106,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5845,"thread_start_us":272678,"threads_started":2,"wal-append.queue_time_us":356500}
W20260709 13:13:15.979835 28873 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
I20260709 13:13:16.002022 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:16.002770 21316 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:16.006577 21321 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
W20260709 13:13:16.008306 21284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.003s	sys 0.007s
I20260709 13:13:15.923724 28694 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:16.009063 21284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.003s	sys 0.008s
W20260709 13:13:16.026429 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 638412us
I20260709 13:13:16.026607 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2477) took 1141 ms. Trace:
W20260709 13:13:16.028864 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.933357 28317 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.034802 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:15.991988 28768 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.665s	user 0.004s	sys 0.002s
I20260709 13:13:16.039151 22041 raft_consensus.cc:1240] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:16.042447 21319 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 16.
W20260709 13:13:16.012006 28676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.008s	sys 0.005s
I20260709 13:13:16.009057 21321 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:16.038517 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:16.051956 21316 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:13:16.027220 21391 rpcz_store.cc:276] 0709 13:13:14.869779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.911019 (+ 41240us) service_pool.cc:224] Handling call
0709 13:13:14.934043 (+ 23024us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:15.002530 (+ 68487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.002573 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:15.003234 (+   661us) log.cc:844] Serialized 52 byte log entry
0709 13:13:15.265119 (+261885us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:15.414125 (+149006us) log.cc:844] Serialized 14 byte log entry
0709 13:13:15.420901 (+  6776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.420975 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.010987 (+590012us) raft_consensus.cc:1685] finished
0709 13:13:16.011013 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.011187 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40671,"prepare.queue_time_us":167131,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":68104,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":21920,"thread_start_us":389428,"threads_started":2,"wal-append.queue_time_us":306616}
I20260709 13:13:16.053462 22031 raft_consensus.cc:1240] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
W20260709 13:13:16.054335 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 178996us
I20260709 13:13:16.056339 21312 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20. Ops: []
W20260709 13:13:16.047735 28676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.010s	sys 0.006s
I20260709 13:13:16.038115 28737 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:16.098554 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.100168 21315 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 27.
I20260709 13:13:16.031294 28910 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:13:16.116451 28910 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:16.116860 28910 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.117715 28910 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.119163 28910 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:13:16.120743 28917 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:13:16.121034 28908 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:13:16.121912 28906 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:16.122341 28906 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.123214 28906 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.124701 28906 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:16.130388 28905 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:13:16.130909 28905 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.132987 28885 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:16.136737 28867 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.953s	user 0.013s	sys 0.000s
I20260709 13:13:16.137221 28867 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.139493 28867 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:16.139863 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.045674 28862 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.141997 28862 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:16.096428 28664 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.107595 22041 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:13:16.111267 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2471) took 1248 ms. Trace:
I20260709 13:13:16.112124 28902 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:16.152997 28902 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:16.153467 28902 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:16.154717 28317 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:16.103627 28737 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.112524 28891 raft_consensus.cc:2804] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:16.156441 28891 raft_consensus.cc:697] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:16.156584 28788 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.094156 28801 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.157682 28914 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:16.157586 28801 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.158329 28914 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.152817 21387 rpcz_store.cc:276] 0709 13:13:14.863069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.866730 (+  3661us) service_pool.cc:224] Handling call
0709 13:13:16.111045 (+1244315us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001c7354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:16.111179 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604593920}
I20260709 13:13:16.157357 28891 consensus_queue.cc:237] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:16.161708 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 129867us
I20260709 13:13:16.131731 28905 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.172736 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:13:16.173501 28378 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.174093 28847 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:16.174886 28847 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.112780 28487 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:16.102535 21362 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:16.176790 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74333.4us
I20260709 13:13:16.177793 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:16.178026 28858 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:16.178638 28858 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.179037 28858 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:16.052320 28768 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.180579 28905 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:16.182199 28768 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:16.115499 28882 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:13:16.104380 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59692 (request call id 1222) took 1097 ms. Trace:
I20260709 13:13:16.183102 21467 rpcz_store.cc:276] 0709 13:13:15.006623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.006780 (+   157us) service_pool.cc:224] Handling call
0709 13:13:15.007144 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:15.020912 (+ 13768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.020959 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:15.028951 (+  7992us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.224549 (+195598us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:15.224609 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.224679 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.104188 (+879509us) raft_consensus.cc:1685] finished
0709 13:13:16.104208 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.104327 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103671,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":26346,"thread_start_us":161712,"threads_started":1,"wal-append.queue_time_us":356455}
I20260709 13:13:16.057315 28854 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:16.184949 28854 consensus_queue.cc:1059] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:16.185869 28714 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:16.186031 28854 raft_consensus.cc:3055] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:16.185947 28442 consensus_queue.cc:1059] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:16.186452 28714 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:16.186606 28854 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:16.187037 28442 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:16.157804 28793 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:16.187407 28714 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.184314 28914 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.190037 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:16.190830 21312 raft_consensus.cc:2393] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:16.198704 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:16.187572 28854 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.205238 28854 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:16.206580 21316 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:13:16.206898 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:16.206622 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:16.208212 21312 raft_consensus.cc:2468] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:16.147665 21320 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:16.214084 21396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3190) took 1627 ms. Trace:
I20260709 13:13:16.214663 21396 rpcz_store.cc:276] 0709 13:13:14.586896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.649787 (+ 62891us) service_pool.cc:224] Handling call
0709 13:13:14.679736 (+ 29949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.160525 (+480789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.213748 (+1053223us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54002cd154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:16.214006 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995524480}
I20260709 13:13:16.175769 28378 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:16.215067 28862 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:16.246817 28862 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.249025 28862 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:16.250129 28853 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:16.152165 28664 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.253018 28664 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:16.253250 28348 consensus_meta.cc:287] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.000s
I20260709 13:13:16.240909 28902 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.253852 28348 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.255270 21394 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:16.255690 28902 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:16.256479 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.998839 28886 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.260923 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:16.261819 21315 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:16.268232 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:16.269063 22039 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:16.107429 28316 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.272701 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:16.279057 28853 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.279274 21315 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:13:16.279727 28853 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.281026 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:16.281728 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.282161 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.282968 21463 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 16.
I20260709 13:13:16.282596 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.283893 21464 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:16.285074 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.282272 28853 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.286514 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:16.287036 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:16.287482 21320 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 28 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 13:13:16.287587 21468 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:16.287590 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.289759 21362 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:16.293344 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.296494 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:16.299942 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.102478 28907 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:13:16.302650 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.293352 28861 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:16.303925 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.304487 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.307410 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.307651 21394 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:13:16.308986 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.310458 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.311683 21393 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:16.312407 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.222167 28442 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:16.309226 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:16.315119 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.315758 21469 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 26.
I20260709 13:13:16.322386 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.323174 21388 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:16.324609 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.325491 22041 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:13:16.301869 28853 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:16.327407 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.327780 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.328500 21463 raft_consensus.cc:2393] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:16.307226 28902 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:16.328745 28737 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:16.329042 28902 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.329485 28801 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.329725 21463 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:13:16.330135 21463 pending_rounds.cc:85] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 15
I20260709 13:13:16.330343 21463 pending_rounds.cc:107] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:13:16.330556 21463 raft_consensus.cc:2889] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:16.331157 28902 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:16.332459 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.333640 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.334955 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.337145 28847 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:16.336663 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:16.338428 28847 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:13:16.339123 28847 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.340003 28847 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.340857 28866 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:16.341295 28866 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.341645 28866 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:16.343326 21434 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:16.331899 21463 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:16.334968 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:16.352243 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 73857.4us
I20260709 13:13:16.354768 22039 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 26.
I20260709 13:13:16.314713 28862 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:16.365061 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.368155 21468 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:16.370533 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:16.371176 22032 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:16.345500 28853 raft_consensus.cc:697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:16.345796 28907 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.381647 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:16.381815 21436 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.361013 28910 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:13:16.389575 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.316350 28861 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.378044 28681 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:13:16.413426 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.373613 28348 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.413426 21464 raft_consensus.cc:1240] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:16.379583 28664 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.426832 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.389513 28905 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:16.413776 28378 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:16.461616 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:16.509903 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 46886.8us
I20260709 13:13:16.509905 21388 raft_consensus.cc:2393] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 26: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:13:16.511979 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 85224.8us
I20260709 13:13:16.418504 28910 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.518754 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.521984 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:16.430280 28694 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.518635 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.526041 21388 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:13:16.401902 28862 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 13:13:16.528978 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.531147 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.509956 28880 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:16.509250 28808 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:16.537406 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:16.544373 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 127629us
I20260709 13:13:16.546810 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.548815 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:16.550257 21436 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.538875 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:16.536736 21997 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:16.555610 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:16.560137 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.562263 28918 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:16.563060 28918 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:16.566520 28866 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.568573 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:16.620688 21388 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 25: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:16.525348 28902 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:16.570569 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:16.621929 21465 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 28 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 13:13:16.438398 28664 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.624514 28664 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.424321 28442 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.625705 28442 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:16.628355 28919 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:13:16.535204 28715 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:16.589883 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:16.629788 28920 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:13:16.630159 21436 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:16.574282 28901 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:16.631896 28901 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.632403 28901 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:16.540796 28885 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:16.594630 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.634550 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:16.635183 21315 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:16.540072 28922 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:16.636538 28922 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.568305 28797 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:16.638989 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.640475 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.641192 21388 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:16.573688 28694 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:16.572573 28905 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:16.540372 28768 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:13:16.592767 28378 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:16.525260 28853 consensus_queue.cc:237] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:16.604319 21317 consensus_meta.cc:287] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.594s	user 0.002s	sys 0.006s
I20260709 13:13:16.613324 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:16.660394 21317 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:13:16.544790 28907 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.664651 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:16.665706 21321 raft_consensus.cc:2393] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:16.639202 28797 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.543776 28316 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.671373 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:16.672501 21320 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 25: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:16.646515 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:16.653141 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.597268 28886 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:16.654970 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:16.657886 21994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.658424 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:16.554778 28808 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.678074 28808 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.680820 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:16.681833 21312 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:16.687134 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:16.653708 28694 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.639019 28922 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:16.663405 28317 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:16.689904 21313 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:16.659927 28510 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:13:16.671180 28797 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:16.689244 21436 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.692734 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.714392 22039 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 15.
I20260709 13:13:16.711465 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.716735 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.718283 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.668246 28905 raft_consensus.cc:697] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.721124 28905 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:16.728019 21436 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.719642 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.737691 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.739033 21388 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:13:16.741398 22032 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:16.697762 28694 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:16.745565 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.762966 28862 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:16.646051 28910 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:16.781656 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 219794us
I20260709 13:13:16.742405 28317 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.785880 28317 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:16.712432 28861 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:16.743651 28675 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:16.795260 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:16.796277 21388 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:13:16.794739 28927 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:13:16.800863 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 115218us
I20260709 13:13:16.803596 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:16.803748 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.804659 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:16.805393 28929 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:13:16.813365 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.801632 28681 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:16.813365 28854 consensus_meta.cc:287] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.608s	user 0.006s	sys 0.005s
I20260709 13:13:16.806262 28715 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:16.827880 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.835711 22032 pending_rounds.cc:85] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 11
I20260709 13:13:16.810846 28880 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:16.850780 28926 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:16.850929 21393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2492) took 1423 ms. Trace:
I20260709 13:13:16.851300 21393 rpcz_store.cc:276] 0709 13:13:15.428103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.428414 (+   311us) service_pool.cc:224] Handling call
0709 13:13:15.428710 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.321643 (+892933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.850680 (+529037us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54003f4b54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:16.850868 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030209792}
I20260709 13:13:16.852577 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:16.853262 21393 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:16.847720 28866 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:16.849090 28410 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:16.856658 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:16.873034 22040 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:16.857461 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:16.846499 22032 pending_rounds.cc:107] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 15.12
W20260709 13:13:16.865932 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.873812 22032 raft_consensus.cc:2889] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:16.845100 22042 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 15.
I20260709 13:13:16.827481 28885 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:16.882339 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 69048.5us
I20260709 13:13:16.894585 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.895978 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.837532 28862 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:16.842923 28715 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.900480 28715 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:16.901445 22040 raft_consensus.cc:2410] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:13:16.885830 28911 raft_consensus.cc:3055] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:16.886840 28524 consensus_queue.cc:1059] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:16.887646 28913 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:16.903735 28808 raft_consensus.cc:3055] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:16.904206 28808 raft_consensus.cc:740] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:16.870937 22002 connection.cc:256] RPC call timeout handler was delayed by -1.0330119200000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 13:13:16.903465 28911 raft_consensus.cc:740] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.909919 21388 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
W20260709 13:13:16.913950 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.871917 28886 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.926822 21393 raft_consensus.cc:2468] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:16.927347 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:16.925657 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 197739us
I20260709 13:13:16.929172 21436 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.880420 28510 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:16.946506 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:16.947530 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:16.905006 28808 consensus_queue.cc:260] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.024135 28808 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:17.024536 28902 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:17.025015 28902 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:17.025199 21393 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:13:16.929689 28858 consensus_meta.cc:287] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.005s
W20260709 13:13:17.022642 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 96797.9us
W20260709 13:13:17.028286 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 132374us
I20260709 13:13:17.028616 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:17.046077 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:16.928205 28664 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.124s
I20260709 13:13:17.053078 28942 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:17.054553 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 125470us
I20260709 13:13:17.055606 28944 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:13:17.056365 28944 consensus_queue.cc:1059] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:17.057363 28944 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:17.047789 28510 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.013716 28886 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.059154 21313 raft_consensus.cc:1275] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:13:17.059531 21313 pending_rounds.cc:85] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 11
I20260709 13:13:17.059734 21313 pending_rounds.cc:107] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:13:17.059943 21313 raft_consensus.cc:2889] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:17.060408 28886 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:17.021209 28881 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:17.060989 22034 raft_consensus.cc:1813] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Handling vote request from an unknown peer 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:17.061196 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:17.016140 28936 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:17.061815 22034 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:13:17.061964 21320 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 18: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:17.057885 28944 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.063917 28936 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:17.065418 28944 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:17.063012 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 156655us
I20260709 13:13:17.063258 21321 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 13:13:17.069324 22002 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.577s (SENT)
I20260709 13:13:17.063068 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:17.069756 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:17.067181 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:17.070709 22039 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:17.072407 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:17.067027 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:17.074374 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:17.068470 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:17.079368 28905 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:17.079828 28905 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:17.080241 28905 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:13:17.081036 28930 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260709 13:13:17.082687 28675 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:17.083573 28883 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:17.074923 28858 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.086227 28858 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:17.086958 21394 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:17.021919 28885 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:13:17.105743 21390 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:17.106521 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:17.112315 21434 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:17.095414 28715 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.117527 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:17.075729 28881 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:17.099056 28936 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:17.105392 28885 consensus_queue.cc:1243] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:13:17.107806 28802 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.096966 28943 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:13:17.112941 28922 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:17.119918 28906 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:17.145496 28952 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:17.118932 28675 raft_consensus.cc:2804] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:17.100292 28944 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:13:17.170358 28675 raft_consensus.cc:697] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:17.154109 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:17.171537 28675 consensus_queue.cc:237] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.155494 21389 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:13:17.140089 28942 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:17.139900 28936 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.173532 28936 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:17.148068 28911 consensus_queue.cc:260] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:17.184624 28925 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
I20260709 13:13:17.186389 28936 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.159258 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:17.193879 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:17.160243 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:17.152196 28802 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.163276 28694 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.194784 22035 raft_consensus.cc:2376] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23. Re-sending same reply.
I20260709 13:13:17.164645 28906 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:17.195710 21319 raft_consensus.cc:1240] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:13:17.195815 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:17.196431 22035 raft_consensus.cc:2376] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 26. Re-sending same reply.
I20260709 13:13:17.196521 28906 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.194790 22031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42358 (request call id 1692) took 1006 ms. Trace:
W20260709 13:13:17.200366 28938 log.cc:927] Time spent T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:13:17.200322 22031 rpcz_store.cc:276] 0709 13:13:16.187975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.261191 (+ 73216us) service_pool.cc:224] Handling call
0709 13:13:17.193810 (+932619us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b5c003e388c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c2b82161 00007fc2c2d23a79 00007fc2c41dd9b6 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:17.194709 (+   899us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70758272}
I20260709 13:13:17.167024 28905 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.167217 28902 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.168751 28954 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:17.169649 28952 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.194192 22042 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:13:17.161484 28901 consensus_meta.cc:287] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 13:13:17.207648 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:17.207024 28942 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:13:17.205583 28922 consensus_queue.cc:1048] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:13:17.213248 28902 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:17.209420 28892 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.214084 28892 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.217216 28952 raft_consensus.cc:3060] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:17.219964 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 695516us
I20260709 13:13:17.223865 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:17.224239 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:17.230837 21316 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:17.242218 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.245512 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.250161 21319 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:13:17.251025 22002 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.820s (SENT)
I20260709 13:13:17.272306 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:17.273339 21389 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:17.217219 28866 consensus_queue.cc:1059] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:13:17.240243 28808 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:17.288451 28316 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.291324 28957 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:17.292670 28936 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:17.298007 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47014.7us
I20260709 13:13:17.293370 28866 raft_consensus.cc:3055] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:17.240510 28442 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:13:17.315932 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:17.254535 28902 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:17.318111 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.227341 28901 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:17.302114 28797 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.001s
I20260709 13:13:17.272068 28681 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:13:17.312695 28944 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.338773 22042 raft_consensus.cc:2468] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 17.
I20260709 13:13:17.314659 28910 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:17.353574 28905 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:17.354493 28442 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:17.354892 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:17.365864 21359 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:17.355129 28808 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:17.357635 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.381958 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 281022us
W20260709 13:13:17.360059 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.364679 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:17.366313 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:17.386433 21468 raft_consensus.cc:2393] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:17.372267 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.318015 28866 raft_consensus.cc:740] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:17.381577 22041 raft_consensus.cc:2368] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18.
I20260709 13:13:17.394665 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:17.399780 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:17.401923 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 324365us
I20260709 13:13:17.402475 21467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2506) took 1175 ms. Trace:
I20260709 13:13:17.318279 28316 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.379366 28681 consensus_queue.cc:1243] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:17.411600 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:17.405126 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:17.391330 28560 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.323824 28902 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.419903 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:17.323465 28797 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.425966 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:17.393800 28892 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:17.362780 28944 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.396875 28891 raft_consensus.cc:2804] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:17.405313 28847 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:17.428690 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42342 (request call id 1770) took 1471 ms. Trace:
I20260709 13:13:17.381171 28910 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.408428 21467 rpcz_store.cc:276] 0709 13:13:16.227481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.228440 (+   959us) service_pool.cc:224] Handling call
0709 13:13:16.228812 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.229078 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:16.300930 (+ 71852us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.853882 (+552952us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b18002d07c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:13:17.385557 (+531675us) log.cc:844] Serialized 14 byte log entry
0709 13:13:17.402028 (+ 16471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:17.402085 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:17.402138 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.402206 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.402323 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55993,"prepare.queue_time_us":70886,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":40839,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":141,"spinlock_wait_cycles":103581312,"thread_start_us":491227,"threads_started":3,"wal-append.queue_time_us":836379}
I20260709 13:13:17.436105 22036 rpcz_store.cc:276] 0709 13:13:15.957116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.957265 (+   149us) service_pool.cc:224] Handling call
0709 13:13:15.959872 (+  2607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.310921 (+351049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.310953 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.310998 (+    45us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:13:16.311037 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.428357 (+1117320us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54001c0054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:17.428428 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.428615 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794765184}
I20260709 13:13:17.319190 28957 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.432017 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:17.447173 28910 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:17.428840 28737 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:17.455798 28961 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:17.472888 21392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3207) took 1111 ms. Trace:
W20260709 13:13:17.467944 21390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2489) took 2137 ms (client timeout 2094 ms). Trace:
I20260709 13:13:17.479349 21392 rpcz_store.cc:276] 0709 13:13:16.361768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.362321 (+   553us) service_pool.cc:224] Handling call
0709 13:13:16.362656 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.462829 (+100173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.462872 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.462925 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:16.462969 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.472533 (+1009564us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b54003f5554. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:17.472596 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.472799 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229881088}
W20260709 13:13:17.481040 21390 rpcz_store.cc:269] 0709 13:13:15.330370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.330595 (+   225us) service_pool.cc:224] Handling call
0709 13:13:17.467649 (+2137054us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54001c3754. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:17.467836 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3994342144}
I20260709 13:13:17.425758 28560 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.457721 28737 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:17.469723 28802 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:17.456892 28962 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:17.458530 28891 raft_consensus.cc:697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:17.488873 28625 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:17.509894 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 155456us
W20260709 13:13:17.512992 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 121192us
I20260709 13:13:17.505540 28961 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:17.507591 28737 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:17.444743 28866 consensus_queue.cc:260] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.652830 28866 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:17.653690 28881 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:17.654274 28881 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.656850 28881 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:17.658262 28953 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 13:13:17.660125 21387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3205) took 1299 ms. Trace:
I20260709 13:13:17.660703 21387 rpcz_store.cc:276] 0709 13:13:16.361082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.361336 (+   254us) service_pool.cc:224] Handling call
0709 13:13:16.376147 (+ 14811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.392615 (+ 16468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.392668 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.888874 (+496206us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b2c000010a8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bdb11a11 00007fc2bdb21372 00007fc2bf253a01 00007fc2bf21843a 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2
0709 13:13:16.889319 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.146857 (+257538us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:17.156801 (+  9944us) log.cc:844] Serialized 14 byte log entry
0709 13:13:17.157076 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.157175 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.659761 (+502586us) raft_consensus.cc:1685] finished
0709 13:13:17.659901 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.660053 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36515,"prepare.queue_time_us":9346,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":24240,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":16208,"spinlock_wait_cycles":4269312,"thread_start_us":256537,"threads_started":1,"wal-append.queue_time_us":387345}
I20260709 13:13:17.663625 28957 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:17.664624 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 90613.7us
I20260709 13:13:17.637990 28886 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:17.638429 28958 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:13:17.638809 28560 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:17.672552 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:17.639391 28959 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:13:17.642850 21389 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:17.507346 28964 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:17.492444 28808 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:17.660174 28960 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 13:13:17.681535 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 249636us
I20260709 13:13:17.682344 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:17.504542 28442 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.523427 28625 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.698321 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.699080 21314 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:17.678364 28901 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:17.709688 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.687227 28961 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:17.710778 21319 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:17.713737 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.714497 21312 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:17.721865 28797 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:17.718021 28316 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:17.732393 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
W20260709 13:13:17.732718 28967 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:17.733105 21320 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:17.733363 28625 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:17.677842 28898 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:13:17.736436 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.737653 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.738248 21313 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:17.738476 28737 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.680274 28886 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.702636 28854 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.720413 28901 raft_consensus.cc:2764] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:13:17.741710 21319 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:17.742344 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.743291 28883 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:13:17.745012 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 54990.9us
I20260709 13:13:17.740936 21321 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:13:17.746122 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:17.754458 28883 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:13:17.766396 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 93933.3us
I20260709 13:13:17.758002 21320 raft_consensus.cc:2468] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:17.701009 28952 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.692508 28891 consensus_queue.cc:237] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.762379 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:17.773749 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:17.684010 28964 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.773042 21436 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:17.786239 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:17.774319 21467 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:17.750617 28854 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.789835 28737 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:17.790210 28854 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:17.788184 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:17.770664 28317 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:17.770146 28922 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.795363 21315 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 17: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:17.773414 28349 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.785092 28898 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.773618 28719 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:17.804064 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.806613 21313 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:13:17.771952 28625 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:13:17.791831 28910 raft_consensus.cc:2804] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:17.794834 28854 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:17.773870 28866 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:13:17.794544 28317 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.786155 28972 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:13:17.794973 28901 consensus_queue.cc:1059] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:13:17.827055 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:17.815920 28854 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.880684 22034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 1104) took 1024 ms. Trace:
I20260709 13:13:17.801887 28922 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.884434 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:17.905077 21462 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:17.827903 22035 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:17.805722 28349 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.817916 28317 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:17.881150 22034 rpcz_store.cc:276] 0709 13:13:16.856669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.857136 (+   467us) service_pool.cc:224] Handling call
0709 13:13:17.825438 (+968302us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540061b2d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:17.880607 (+ 55169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430389504}
I20260709 13:13:17.809116 28898 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.945380 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:17.946242 21468 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:17.948320 28675 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:17.948866 28675 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.950723 28978 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:17.951501 28978 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.958868 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:17.816881 28910 raft_consensus.cc:697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:17.953459 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.950927 28675 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:17.966341 28981 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.966897 28981 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.832274 28316 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:17.969307 28981 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:17.969875 21470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56756 (request call id 2510) took 1689 ms (client timeout 2054 ms). Trace:
I20260709 13:13:17.969692 28316 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.965166 21313 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:17.972364 28883 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:17.973578 28922 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:17.973817 28883 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:17.904495 28854 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:17.952549 28681 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:17.811472 28719 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.981177 28681 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.983497 28719 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:17.984239 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.984596 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:17.995440 21314 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:17.997900 28979 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.998698 28979 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:17.999778 28952 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.001678 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:18.002717 22042 raft_consensus.cc:2393] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 17: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:17.985844 28978 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:17.965121 28796 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.004958 28796 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:17.955237 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.009613 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.010396 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:18.011690 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.012269 21388 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:18.012420 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.012759 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.013274 21395 raft_consensus.cc:2376] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 25. Re-sending same reply.
I20260709 13:13:18.014469 21395 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: [19.13-21.14]
I20260709 13:13:18.014333 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.015347 21394 raft_consensus.cc:2368] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:18.015503 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.016142 21396 raft_consensus.cc:2376] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21. Re-sending same reply.
I20260709 13:13:18.017079 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.017684 21392 raft_consensus.cc:2376] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23. Re-sending same reply.
W20260709 13:13:17.970321 21470 rpcz_store.cc:269] 0709 13:13:16.280716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.280832 (+   116us) service_pool.cc:224] Handling call
0709 13:13:17.969675 (+1688843us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400216954. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:17.969812 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667632384}
I20260709 13:13:18.019218 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:17.946113 28898 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.022015 22031 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:13:17.946322 28715 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.025254 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:17.964190 28906 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.070739 21387 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:13:18.073015 21388 raft_consensus.cc:2410] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
W20260709 13:13:18.025674 28951 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.867s	user 0.003s	sys 0.002s
I20260709 13:13:18.077261 21390 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: [12.8-16.9]
W20260709 13:13:18.079909 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.035816 28681 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.087822 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:18.092455 21314 raft_consensus.cc:1217] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Deduplicated request from leader. Original: 15.8->[18.9-22.11]   Dedup: 19.10->[22.11-22.11]
I20260709 13:13:18.080647 28796 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.094574 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.095849 21314 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: [18.9-22.11]
I20260709 13:13:18.100960 21391 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:18.103189 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.103209 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:18.080281 28906 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.085510 28886 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:18.121958 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 99280.7us
I20260709 13:13:18.120915 28796 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.122042 28907 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.126067 28796 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.126447 28907 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.128782 28907 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.130697 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:18.137120 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.138401 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:18.138996 21321 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:18.139599 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:18.140219 22031 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 26.
I20260709 13:13:18.140609 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:18.113132 28910 consensus_queue.cc:237] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.143512 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:18.146427 21317 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:18.141062 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:18.146857 21317 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:18.147130 22031 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
W20260709 13:13:18.148196 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 159415us
I20260709 13:13:18.150388 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:18.147574 21317 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.153290 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:18.162670 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:18.168900 28847 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.169575 28847 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.172444 28349 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.175984 28911 raft_consensus.cc:3060] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:18.179528 28922 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:18.156139 28942 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:13:18.158860 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:18.163596 28796 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.182277 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:18.150146 28866 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:18.156680 28907 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:13:18.149741 28681 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:13:18.181277 21321 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:18.203470 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:18.215719 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.196534 22041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42342 (request call id 1786) took 1544 ms (client timeout 1958 ms). Trace:
I20260709 13:13:18.179980 28922 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.207242 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:18.190578 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1699) took 1124 ms. Trace:
W20260709 13:13:18.189095 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.228963 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.192741 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:18.219884 22041 rpcz_store.cc:269] 0709 13:13:16.652705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.652851 (+   146us) service_pool.cc:224] Handling call
0709 13:13:18.196251 (+1543400us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400506ed4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:18.196452 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597884672}
I20260709 13:13:18.199819 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.232640 21315 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:18.193830 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.235181 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.237046 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:18.230918 21319 raft_consensus.cc:2376] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18. Re-sending same reply.
I20260709 13:13:18.239050 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.227244 22038 rpcz_store.cc:276] 0709 13:13:17.066203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.066848 (+   645us) service_pool.cc:224] Handling call
0709 13:13:17.100197 (+ 33349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.149503 (+ 49306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.149546 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:17.149614 (+    68us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:13:17.149658 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.190315 (+1040657us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b5400693054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:18.190366 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.190511 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112775936}
I20260709 13:13:18.164319 28964 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.243170 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.238571 28681 consensus_queue.cc:1243] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:18.171823 28694 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:18.244889 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 64178.6us
I20260709 13:13:18.195667 28956 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:18.246114 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.183593 28349 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:13:18.225605 28978 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.181565 28847 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.252358 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.249161 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:18.245774 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:18.188489 28886 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:18.191716 28796 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.192771 28906 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.187285 28979 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.182358 28942 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.181489 28961 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:18.180400 28989 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:18.238982 28922 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:18.254966 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:18.253638 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 122959us
I20260709 13:13:18.255609 28886 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.285051 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:18.253600 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:18.274996 28855 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:18.245469 28972 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:18.257655 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.246992 28973 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:18.176009 28854 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.282680 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.256930 28802 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:18.250353 28956 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:18.248184 28719 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:18.322603 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:18.297582 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44067.1us
I20260709 13:13:18.323439 21466 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:18.257256 28978 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.292788 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.292282 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.308105 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.318342 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.281934 28942 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:13:18.299813 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.290383 28886 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:18.309424 28349 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:13:18.328011 21462 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:18.308858 28972 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.329586 21362 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:18.330325 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.336706 21316 raft_consensus.cc:2368] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:13:18.329164 21315 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:18.316450 28861 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:13:18.280856 28796 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.338838 21315 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:13:18.328389 21470 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:18.322885 28719 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.341490 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:18.343387 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.344089 21285 leader_election.cc:400] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:18.322041 28802 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.348799 21316 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:18.346674 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.327095 28994 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:13:18.338749 28972 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:18.342761 28973 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:18.358412 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.363245 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:18.340323 28861 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.356647 21315 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:18.370107 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:18.375365 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 104357us
I20260709 13:13:18.353024 28719 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:18.355409 28349 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:18.377068 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.356052 28802 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:18.385993 21464 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:13:18.387751 21468 raft_consensus.cc:1240] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:13:18.385913 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:18.377991 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.371899 28973 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.400321 21464 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:18.377223 28861 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:18.374953 28855 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:18.401873 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:18.398837 28923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.240s	user 0.009s	sys 0.035s
I20260709 13:13:18.389983 28349 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.384080 28994 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:18.388808 28979 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:18.422932 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 1105) took 1308 ms. Trace:
I20260709 13:13:18.408424 28973 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:18.400555 28990 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.409626 28694 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:18.352176 28961 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:18.414338 28923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.009s	sys 0.036s
I20260709 13:13:18.414124 28855 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.438138 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.420425 28349 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:18.424618 22039 rpcz_store.cc:276] 0709 13:13:17.108113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.109423 (+  1310us) service_pool.cc:224] Handling call
0709 13:13:17.109801 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.110067 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:17.143417 (+ 33350us) log.cc:844] Serialized 14 byte log entry
0709 13:13:18.136329 (+992912us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b1800327dc0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb823a 00007fc2bf222a2a
0709 13:13:18.414835 (+278506us) log.cc:844] Serialized 14 byte log entry
0709 13:13:18.415580 (+   745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.415647 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:18.415712 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.415803 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.415960 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7586,"prepare.queue_time_us":36293,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":620,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":13018,"spinlock_wait_cycles":5576448,"thread_start_us":277849,"threads_started":2,"wal-append.queue_time_us":1236891}
W20260709 13:13:18.444814 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73186.1us
I20260709 13:13:18.439877 21315 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:18.448199 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:18.449092 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:18.447620 28694 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:18.451184 21316 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:18.452270 28694 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.440164 28979 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:18.444221 28737 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:18.465669 21316 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:18.466810 21362 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:18.466298 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:18.479218 28975 consensus_queue.cc:1059] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:18.480302 28975 raft_consensus.cc:3055] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:18.480677 28975 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:18.481654 28975 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.482265 28944 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.439713 28990 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.488360 28854 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.489392 28854 raft_consensus.cc:2804] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:18.490007 28854 raft_consensus.cc:697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:18.492202 28737 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:18.493247 28737 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.491106 28854 consensus_queue.cc:237] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.498292 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:18.497668 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.498915 21468 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:18.499068 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.463454 28978 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.502064 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:18.509167 22002 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:18.509586 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.502671 28994 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.503384 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.504251 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.516004 21468 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:13:18.516839 21388 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:18.517002 21390 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:13:18.504582 29003 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:13:18.467296 28964 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:18.510426 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:18.496735 28906 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:13:18.519651 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.522598 29007 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:13:18.511176 28881 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:18.470083 28796 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.470068 28675 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:18.517531 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.539649 22002 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:18.553215 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:18.552917 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:18.538110 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.498685 28975 raft_consensus.cc:3060] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:18.544205 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:18.554265 21316 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:18.554477 21468 raft_consensus.cc:2410] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:18.543134 28906 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.516763 28990 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.556681 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3152) took 1193 ms. Trace:
W20260709 13:13:18.547631 28317 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:13:18.559907 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:18.537919 28998 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:18.544014 28978 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:18.568981 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:18.565920 21461 rpcz_store.cc:276] 0709 13:13:17.362807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.365295 (+  2488us) service_pool.cc:224] Handling call
0709 13:13:17.365627 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.438638 (+ 73011us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:17.505879 (+ 67241us) log.cc:844] Serialized 14 byte log entry
0709 13:13:17.572502 (+ 66623us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:17.579282 (+  6780us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:17.579343 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.556435 (+977092us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b5400217354. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:18.556488 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.556628 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":817,"prepare.queue_time_us":85492,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1918,"raft.queue_time_us":3270,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":167290112,"thread_start_us":126549,"threads_started":2,"wal-append.queue_time_us":194699}
I20260709 13:13:18.570030 21388 raft_consensus.cc:2410] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:18.572285 21390 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
W20260709 13:13:18.557286 29000 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:13:18.555491 28901 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:18.565470 28906 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:18.577387 21469 raft_consensus.cc:1240] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:18.574652 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.577131 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.581907 21316 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:18.568539 28881 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:18.567647 28988 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:13:18.578047 29002 log.cc:927] Time spent T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.157s	user 0.001s	sys 0.001s
I20260709 13:13:18.573062 28964 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:18.555456 28675 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.577601 28998 raft_consensus.cc:697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:18.592753 29006 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:13:18.574287 28317 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.581946 28990 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:18.593451 29005 log.cc:927] Time spent T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:13:18.624697 28998 consensus_queue.cc:237] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.565569 28979 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.606583 28964 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:18.649137 21467 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 24: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:18.615906 29020 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.616559 28855 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:18.656999 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 103836us
I20260709 13:13:18.658406 22002 leader_election.cc:400] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:13:18.658774 22002 leader_election.cc:403] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:18.673811 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.652272 28978 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.654310 28881 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.617951 28942 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.618152 28990 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:18.679999 28911 consensus_meta.cc:287] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.003s
I20260709 13:13:18.704769 21465 raft_consensus.cc:1275] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:18.709046 21466 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 26. Current term is 27. Ops: []
I20260709 13:13:18.719646 28990 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.677003 29020 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:18.731696 29013 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:13:18.736495 22032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 1102) took 1901 ms. Trace:
I20260709 13:13:18.736996 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:18.737574 29020 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.705062 28881 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.705447 29021 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 16. Current term is 17.
I20260709 13:13:18.740127 28881 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.740706 29021 consensus_queue.cc:1059] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:18.743083 28942 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.745770 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:18.746434 21389 raft_consensus.cc:1813] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Handling vote request from an unknown peer 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:18.747004 21389 raft_consensus.cc:2410] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:13:18.746912 28972 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:18.749902 28982 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.696s	user 0.002s	sys 0.000s
I20260709 13:13:18.728437 28964 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.737685 21467 raft_consensus.cc:3060] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:18.751931 21318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3656) took 1235 ms. Trace:
I20260709 13:13:18.775628 21470 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 24: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:18.775867 21318 rpcz_store.cc:276] 0709 13:13:17.516681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.517099 (+   418us) service_pool.cc:224] Handling call
0709 13:13:17.517448 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.799189 (+281741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.799220 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:17.799261 (+    41us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:17.799293 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.751688 (+952395us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540022cc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:18.751740 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.751873 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647370624}
I20260709 13:13:18.743156 28886 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.719671 28317 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.699268 28978 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:18.778965 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.737004 22032 rpcz_store.cc:276] 0709 13:13:16.834916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.835052 (+   136us) service_pool.cc:224] Handling call
0709 13:13:16.835430 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:16.874541 (+ 39111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.874569 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:16.875154 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 13:13:18.455597 (+1580443us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b18004303c0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:13:18.539343 (+ 83746us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:18.539406 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.539505 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.736106 (+196601us) raft_consensus.cc:1685] finished
0709 13:13:18.736134 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.736418 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5783,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"spinlock_wait_cycles":19905408,"thread_start_us":83509,"threads_started":1,"wal-append.queue_time_us":1695323}
I20260709 13:13:18.772948 28961 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.844532 28316 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.850453 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3156) took 1486 ms. Trace:
I20260709 13:13:18.851028 21465 rpcz_store.cc:276] 0709 13:13:17.367542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.367745 (+   203us) service_pool.cc:224] Handling call
0709 13:13:17.401348 (+ 33603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.705154 (+1303806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.850100 (+144946us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002495d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:18.850363 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996632960}
I20260709 13:13:18.873071 28317 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.873734 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.873886 28317 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.874729 21318 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:18.876958 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.877701 28317 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.878517 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:18.878783 28956 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.886304 28885 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.887060 28885 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.890048 28885 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.890709 28885 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.891268 28885 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.892899 28988 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:18.893592 28988 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.897897 21389 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:18.899701 28988 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:18.900862 21390 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:13:18.901484 21393 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:13:18.901454 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:18.902390 21389 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:18.903628 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.904425 21465 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 18.
I20260709 13:13:18.905550 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.907377 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.910014 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:18.910281 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:18.910640 21393 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:18.910794 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:18.911374 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:18.912712 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:18.778049 28675 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.943111 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:18.943284 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.947974 28957 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.948673 28957 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.951785 28510 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.952524 28510 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:18.956094 28510 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.959890 28867 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:18.960606 28867 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.951351 28957 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:18.962877 28867 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:18.963088 28957 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.963603 28957 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:18.966773 21317 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:13:18.969527 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 78765.7us
I20260709 13:13:18.969698 21387 raft_consensus.cc:1240] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:18.955919 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:18.978384 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.993319 21314 raft_consensus.cc:1275] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:18.999526 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.000492 21320 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:19.003902 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:18.968954 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3146) took 2517 ms. Trace:
I20260709 13:13:19.006840 21389 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:18.911353 28956 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:18.966060 28957 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:18.945003 29001 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:13:19.028447 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:19.005931 21463 rpcz_store.cc:276] 0709 13:13:16.417277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.437092 (+ 19815us) service_pool.cc:224] Handling call
0709 13:13:16.437408 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.526184 (+ 88776us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:16.540240 (+ 14056us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.713813 (+173573us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.713872 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:16.713913 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.934536 (+2220623us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b540024a4d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:18.934611 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.934819 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8008,"prepare.queue_time_us":14712,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":14893,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":12649,"spinlock_wait_cycles":203717376,"thread_start_us":171665,"threads_started":1,"wal-append.queue_time_us":283733,"wal-append.run_cpu_time_us":1242,"wal-append.run_wall_time_us":1055897}
I20260709 13:13:19.035421 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.019724 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.021098 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.029443 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.031558 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:18.919476 28625 raft_consensus.cc:3055] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:19.047178 28625 raft_consensus.cc:740] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:19.048094 28625 consensus_queue.cc:260] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.049134 28625 raft_consensus.cc:3060] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:19.046572 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.050573 21463 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 15.
I20260709 13:13:19.071177 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.073755 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.082089 21318 raft_consensus.cc:2393] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:19.088162 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.091805 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.094702 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:18.943707 28961 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.076583 28796 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:19.101102 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:19.095245 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 435401us
I20260709 13:13:19.115576 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.116690 21393 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:13:19.118170 21361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.018s	sys 0.030s
W20260709 13:13:19.118536 21361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.018s	sys 0.030s
W20260709 13:13:19.091603 28349 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.002s
I20260709 13:13:19.153843 21395 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 13:13:19.158514 21461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.016s	sys 0.024s
W20260709 13:13:19.158967 21461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.016s	sys 0.024s
I20260709 13:13:19.093452 28881 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:19.168501 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.176754 21394 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:13:19.171154 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.094189 28936 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:19.111241 28796 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.177773 21396 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 27.
W20260709 13:13:19.159162 28861 consensus_meta.cc:287] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.745s	user 0.013s	sys 0.000s
I20260709 13:13:19.222406 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:19.159392 28891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.010s	sys 0.030s
I20260709 13:13:19.083631 28316 consensus_queue.cc:1048] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:13:19.256248 21317 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:13:19.257045 21317 pending_rounds.cc:85] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 12
I20260709 13:13:19.257606 21317 pending_rounds.cc:107] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:13:19.228523 28998 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:19.258018 21317 raft_consensus.cc:2889] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.259961 21317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3669) took 1162 ms. Trace:
W20260709 13:13:19.229038 28719 consensus_meta.cc:287] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.836s	user 0.010s	sys 0.002s
W20260709 13:13:19.255887 28891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.011s	sys 0.030s
I20260709 13:13:19.281064 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:19.343441 21997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.002s	sys 0.010s
W20260709 13:13:19.343909 21997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.002s	sys 0.010s
I20260709 13:13:19.223881 28881 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.231482 28796 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:19.314764 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:19.158193 28349 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:19.271993 28973 consensus_meta.cc:287] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.832s	user 0.006s	sys 0.006s
W20260709 13:13:19.317314 21468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.018s	sys 0.037s
W20260709 13:13:19.265900 28979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.013s	sys 0.055s
I20260709 13:13:19.264528 29024 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.329226 21317 rpcz_store.cc:276] 0709 13:13:18.097446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.113106 (+ 15660us) service_pool.cc:224] Handling call
0709 13:13:18.146316 (+ 33210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.966590 (+820274us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b58007a99d0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf1740aa 00007fc2bf1f6447 00007fc2bf20efe7 00007fc2bf2107de 00007fc2bf21ab49 00007fc2bf21b416 00007fc2bf217d8f 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4
0709 13:13:19.259596 (+293006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.259871 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1869815680}
I20260709 13:13:19.346638 21395 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:19.368911 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:19.311034 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.008s
W20260709 13:13:19.370184 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.004s	sys 0.008s
I20260709 13:13:19.230119 28936 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:19.347757 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.272709 28998 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.268165 29022 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:19.347358 28854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.009s	sys 0.004s
I20260709 13:13:19.260347 28861 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.322963 28808 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:19.370936 29023 log.cc:927] Time spent T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:13:19.357065 21396 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:19.328301 28975 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.355753 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:19.342933 28906 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.002s
I20260709 13:13:19.346998 28886 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.324729 28972 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:19.364295 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 253639us
W20260709 13:13:19.365695 28939 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 2.223s	user 0.021s	sys 0.043s
I20260709 13:13:19.376966 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:19.371930 28979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.013s	sys 0.056s
I20260709 13:13:19.361850 28978 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.318256 28957 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.380079 21387 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 24: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:19.345989 28719 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.366500 28973 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.407348 21470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56746 (request call id 3164) took 1117 ms. Trace:
I20260709 13:13:19.409273 21469 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:19.372588 28675 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:13:19.413705 28950 log.cc:927] Time spent T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 2.256s	user 0.020s	sys 0.024s
W20260709 13:13:19.415660 29031 log.cc:927] Time spent T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:13:19.416271 28951 log.cc:927] Time spent T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.454s	user 0.008s	sys 0.001s
I20260709 13:13:19.417676 28349 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.422804 21461 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:19.426415 21467 consensus_meta.cc:287] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
W20260709 13:13:19.377895 28854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.009s	sys 0.004s
W20260709 13:13:19.426869 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.512636 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:19.428508 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.372412 28885 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.427065 28891 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:19.420360 28853 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.517393 28891 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:19.483389 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 127995us
I20260709 13:13:19.471462 29042 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:19.520558 29042 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:19.520517 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.521061 29042 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:19.521832 29042 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.522718 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.522981 29042 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:19.376219 29024 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.406410 28808 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.490252 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:19.488721 21434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.010s	sys 0.006s
W20260709 13:13:19.531414 21434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.010s	sys 0.006s
W20260709 13:13:19.478315 28802 consensus_meta.cc:287] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 1.070s	user 0.011s	sys 0.002s
W20260709 13:13:19.467267 28990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.031s
I20260709 13:13:19.496337 21470 rpcz_store.cc:276] 0709 13:13:18.290306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.369768 (+ 79462us) service_pool.cc:224] Handling call
0709 13:13:19.382202 (+1012434us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54001a6dd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:19.407261 (+ 25059us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918190336}
I20260709 13:13:19.412314 29022 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.500344 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.508543 21467 raft_consensus.cc:2468] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:19.516479 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.517513 28853 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.482309 28975 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.523874 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.501718 28978 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:19.510138 28922 consensus_meta.cc:287] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.200s	user 0.014s	sys 0.000s
I20260709 13:13:19.501091 28961 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:19.536284 21434 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:19.534555 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:19.477447 29035 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:13:19.488384 28906 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.487984 29032 consensus_queue.cc:1059] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:13:19.543700 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.537257 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:19.547523 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.547639 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.528824 28979 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:19.535667 28990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.008s	sys 0.031s
I20260709 13:13:19.497426 28957 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.551529 28681 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:13:19.551899 29047 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:19.535759 28885 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:19.530974 29051 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:19.556084 21470 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 24: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:19.563346 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:19.552184 28867 raft_consensus.cc:2804] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:19.556073 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:19.557825 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 149468us
I20260709 13:13:19.560915 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:19.602588 21394 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 25.
I20260709 13:13:19.566866 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.545032 29048 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:19.593623 21463 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 24. Current term is 25. Ops: []
I20260709 13:13:19.552503 28952 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:19.535396 28802 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:19.559166 28956 consensus_meta.cc:287] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.003s
I20260709 13:13:19.544631 29049 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:19.545895 28985 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:19.562525 28881 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.562009 28998 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.564551 28694 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:13:19.612669 29038 log.cc:927] Time spent T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:13:19.610684 29051 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:19.590459 28979 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:19.613327 29033 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:13:19.637255 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.554157 28922 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.599521 28905 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:19.596174 28885 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:13:19.629642 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 139518us
W20260709 13:13:19.637315 28625 consensus_meta.cc:287] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.588s	user 0.015s	sys 0.000s
I20260709 13:13:19.608450 28867 raft_consensus.cc:697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:19.615445 28964 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:13:19.712598 29050 log.cc:927] Time spent T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:13:19.712918 28964 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:19.633078 21391 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 24: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:19.713883 28964 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.714944 21388 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:19.715973 21391 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:19.597019 28847 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:13:19.717077 21390 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:19.717772 28867 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.593353 28910 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:13:19.720263 28910 consensus_queue.cc:1243] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 25.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:13:19.721903 21396 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:19.724924 28886 raft_consensus.cc:3055] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:19.725414 28886 raft_consensus.cc:740] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:19.725704 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.726265 28886 consensus_queue.cc:260] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.727288 28886 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:19.729168 28906 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:19.731155 28922 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:19.639169 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 75902.9us
I20260709 13:13:19.631894 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:19.731938 21464 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:19.732410 21394 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:19.635893 28936 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:19.703029 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.733529 21464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3168) took 1442 ms. Trace:
I20260709 13:13:19.733884 21464 rpcz_store.cc:276] 0709 13:13:18.291572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.412341 (+120769us) service_pool.cc:224] Handling call
0709 13:13:18.412649 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.732359 (+1319710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.733305 (+   946us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400216454. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:19.733464 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3033700096}
I20260709 13:13:19.735608 28989 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:19.735960 28978 raft_consensus.cc:3055] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:19.736332 28978 raft_consensus.cc:740] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:19.737154 28978 consensus_queue.cc:260] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.737689 28979 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.738324 28978 raft_consensus.cc:3060] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:19.739313 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.739907 29022 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:19.741375 29052 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:13:19.741744 28922 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:13:19.742956 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.743839 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.744514 22041 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:19.745723 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.746502 22041 raft_consensus.cc:2410] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:13:19.746670 28957 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:19.748570 28802 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.678721 28905 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:19.749435 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.749760 22038 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
W20260709 13:13:19.750010 29039 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
I20260709 13:13:19.750419 28922 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:19.751438 28973 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.751574 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:19.753379 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.753465 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.708690 28808 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.754022 22040 raft_consensus.cc:1813] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Handling vote request from an unknown peer 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:19.709515 28885 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.712149 29049 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:19.754559 22040 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 22: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:19.754777 29049 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.711462 28902 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:19.750118 22038 pending_rounds.cc:85] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 13
I20260709 13:13:19.757268 22038 pending_rounds.cc:107] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:13:19.757534 22038 raft_consensus.cc:2889] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.757608 28957 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:19.758028 28957 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:19.758353 28957 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:13:19.761680 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.764346 21468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2521) took 1266 ms. Trace:
I20260709 13:13:19.764889 21468 rpcz_store.cc:276] 0709 13:13:18.497861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.574487 (+ 76626us) service_pool.cc:224] Handling call
0709 13:13:18.574770 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.614898 (+ 40128us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:13:18.809340 (+194442us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.366652 (+557312us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.366810 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.366860 (+    50us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:19.366921 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.764022 (+397101us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b540025e254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:19.764102 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.764271 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5842,"prepare.queue_time_us":95591,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":2724,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":3974,"spinlock_wait_cycles":102499328,"thread_start_us":708926,"threads_started":2,"wal-append.queue_time_us":693363}
I20260709 13:13:19.767915 28957 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.768630 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:19.770256 28957 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:19.772552 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.773777 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.774044 28942 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:19.754148 22041 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:13:19.756871 29049 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.775943 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:19.777915 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.785035 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:19.749534 28905 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:19.782107 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:19.790545 22031 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:13:19.708225 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.785264 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:19.806468 21284 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:19.702364 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 158744us
I20260709 13:13:19.811962 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:19.820922 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.815675 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.782990 28902 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:19.840983 22039 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260709 13:13:19.830825 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.841435 22039 pending_rounds.cc:85] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 15
I20260709 13:13:19.817340 28961 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:19.712625 28975 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.841795 22039 pending_rounds.cc:107] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 13:13:19.845371 22039 raft_consensus.cc:2889] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.816854 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.841357 22034 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 21: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:19.817499 28936 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:13:19.840075 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 237494us
I20260709 13:13:19.843395 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.784083 28922 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:13:19.820093 28802 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:19.849095 22032 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:13:19.852190 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:19.853786 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.833464 28979 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.859402 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.859912 21312 raft_consensus.cc:1240] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:13:19.860199 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.841106 28954 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:19.847818 28942 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:19.865902 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:19.867506 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.868134 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.846652 28560 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:19.865446 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.870335 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.870884 21317 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:19.871022 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:19.871968 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:19.850149 28802 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.872511 22032 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:19.849800 28936 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:19.862476 28975 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:19.868726 22034 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:19.842574 28796 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.877888 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:19.848306 28952 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:13:19.880281 22041 raft_consensus.cc:1275] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:13:19.880677 22041 pending_rounds.cc:85] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 15
I20260709 13:13:19.880884 22041 pending_rounds.cc:107] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:13:19.881147 22041 raft_consensus.cc:2889] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.873699 28625 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:19.874673 28802 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:19.888177 22031 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 27.
I20260709 13:13:19.892758 21466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3169) took 1471 ms. Trace:
I20260709 13:13:19.856739 29011 consensus_queue.cc:1059] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:13:19.869076 29056 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:19.898027 28891 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.877355 28957 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:19.903611 21465 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:13:19.904495 28796 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:19.905160 21462 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:19.905705 21464 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:19.906287 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.906733 28737 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.907217 28737 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:19.873317 29060 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:19.910589 28905 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.911248 21470 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:19.876310 28936 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:19.893181 21466 rpcz_store.cc:276] 0709 13:13:18.420936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.421076 (+   140us) service_pool.cc:224] Handling call
0709 13:13:18.421296 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.709451 (+288155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.892514 (+1183063us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54003f07d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:19.892697 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654824832}
I20260709 13:13:19.911839 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.916750 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:19.877686 28975 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:19.940532 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.935110 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:19.894164 28625 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:19.941052 29011 raft_consensus.cc:3055] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:19.868950 29014 consensus_queue.cc:1048] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:13:19.942145 21318 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:19.866576 28979 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.943849 28737 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:19.937111 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3173) took 1223 ms. Trace:
I20260709 13:13:19.925853 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:19.984395 21461 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:13:19.918566 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.985801 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.986819 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.925294 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.968633 28961 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:13:19.949455 21466 raft_consensus.cc:1240] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:13:19.961323 28975 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:19.983907 21463 rpcz_store.cc:276] 0709 13:13:18.713551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.069491 (+355940us) service_pool.cc:224] Handling call
0709 13:13:19.076414 (+  6923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.610786 (+534372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.936846 (+326060us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400217d54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:19.937054 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189028096}
I20260709 13:13:19.992332 28349 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.992857 28349 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.965431 28625 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:19.995244 28349 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:19.964741 29011 raft_consensus.cc:740] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:19.996351 29011 consensus_queue.cc:260] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.997279 29011 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:19.997731 21461 raft_consensus.cc:2468] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:20.003046 29059 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:13:19.984095 28891 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:13:20.007499 28891 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:20.008440 28891 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:19.895704 29022 raft_consensus.cc:2764] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:13:19.948714 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:20.011015 21470 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 23: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:19.931283 22032 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:19.955860 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:19.949688 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.962632 21465 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 24: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:19.921753 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.964821 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:19.963581 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:19.970271 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:19.975611 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:20.014045 21467 raft_consensus.cc:3060] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:20.011758 21312 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:20.012490 21321 raft_consensus.cc:2410] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:20.006438 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:19.936580 28675 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:13:20.013055 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 50539us
I20260709 13:13:19.945677 28905 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:20.012485 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:19.891605 28802 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:19.982007 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:19.971485 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.012844 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:20.009433 28891 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.017607 28694 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:20.036876 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 67359.3us
I20260709 13:13:20.033716 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:20.031734 21997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.684s (SENT) [suppressed 15 similar messages]
I20260709 13:13:20.035224 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:20.037530 21387 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:20.037904 21395 raft_consensus.cc:2368] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21.
I20260709 13:13:20.034900 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:20.037523 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.034981 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:20.039592 21389 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:20.040997 22031 raft_consensus.cc:1240] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:20.042076 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:20.045388 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:20.048810 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.050689 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:20.051234 21391 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:20.054718 21467 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:20.055088 21392 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:13:20.057659 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.057510 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:20.058171 28964 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:20.058750 28964 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.059187 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:20.059618 28988 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:20.031396 28675 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:20.060724 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:20.061616 21360 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:20.063459 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:19.973877 28952 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:13:20.064117 22038 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:20.060921 28964 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:20.066010 22039 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 26. Current term is 27. Ops: []
I20260709 13:13:20.044821 21396 pending_rounds.cc:85] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 15
I20260709 13:13:20.066269 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.068523 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:20.080582 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:20.081634 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:20.025120 28961 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:20.048578 28560 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:20.070626 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:20.080001 21396 pending_rounds.cc:107] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 25.16
I20260709 13:13:20.082944 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:20.069984 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:20.033716 29059 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.187412 21313 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:13:20.256161 21319 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:20.107158 21395 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 24: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:20.040856 28989 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:20.257373 21396 raft_consensus.cc:2889] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:20.259732 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 176853us
W20260709 13:13:20.286933 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 255207us
I20260709 13:13:20.106742 21391 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
W20260709 13:13:20.117933 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 44032us
I20260709 13:13:20.108800 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:20.294557 21314 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:20.110114 28891 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:20.119302 28442 raft_consensus.cc:2804] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:13:20.318799 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 257230us
I20260709 13:13:20.091040 28918 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:13:20.089860 29056 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:20.065598 28694 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.107565 29054 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:20.259606 28922 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:20.373914 21320 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:13:20.283550 28989 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:20.396195 28989 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:20.089632 28349 consensus_queue.cc:1059] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.274s
I20260709 13:13:20.286628 29049 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:20.115223 28961 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:20.392227 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 98838.9us
I20260709 13:13:20.107468 28592 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.251s
I20260709 13:13:20.393328 28918 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.393596 29057 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:20.132493 28942 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.252s
I20260709 13:13:20.289960 29059 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.405448 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:20.363461 28979 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:20.110693 29022 consensus_queue.cc:1059] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.237s
I20260709 13:13:20.400347 28922 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.417632 28961 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:20.418102 29024 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:20.402345 28442 raft_consensus.cc:697] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:20.374814 28964 consensus_queue.cc:1059] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:13:20.408645 28918 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:13:20.403699 29049 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:20.438553 28978 consensus_meta.cc:287] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.700s	user 0.015s	sys 0.001s
W20260709 13:13:20.437008 28954 consensus_meta.cc:287] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.004s
I20260709 13:13:20.445611 28922 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:20.447201 21433 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:20.448666 22036 raft_consensus.cc:1275] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:13:20.449076 22036 pending_rounds.cc:85] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Aborting all ops after (but not including) 15
I20260709 13:13:20.449302 22036 pending_rounds.cc:107] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:13:20.449604 22036 raft_consensus.cc:2889] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:20.449844 21433 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:20.451453 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43888.2us
I20260709 13:13:20.453498 21319 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:13:20.454376 21433 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:20.443455 28442 consensus_queue.cc:237] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.442760 29049 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:13:20.464208 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 418215us
I20260709 13:13:20.427912 28625 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:20.476312 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 192009us
I20260709 13:13:20.452291 28954 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:20.446802 28802 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:20.482659 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.461722 28510 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:13:20.464234 28592 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:13:20.473332 28902 raft_consensus.cc:2804] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:13:20.503304 21468 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:13:20.506707 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:20.509317 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 56913.6us
I20260709 13:13:20.446161 28867 consensus_queue.cc:1048] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:13:20.510677 21467 raft_consensus.cc:1240] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:20.503350 21997 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:20.515012 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:20.516410 28625 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:20.485859 28922 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:20.518512 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:20.513588 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 47295.7us
I20260709 13:13:20.522078 21314 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:20.522197 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:20.542135 21362 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.542615 28802 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:20.543401 28802 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:20.520411 28922 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:20.545050 28922 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:20.551477 28694 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:20.501286 28378 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.552455 28378 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.556563 28905 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:20.558465 28905 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:20.559039 28905 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:20.537160 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:20.563690 21466 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 22: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:20.565644 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.500989 28592 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:20.579175 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.555209 28378 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:20.512858 28510 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:20.519531 28978 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:20.584048 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:20.588789 21468 raft_consensus.cc:1240] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:20.521217 28902 raft_consensus.cc:697] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 24 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:20.591089 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.585672 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:20.576579 28625 raft_consensus.cc:2804] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:20.517972 28675 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.584383 28284 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:20.587373 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.601881 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:20.591269 28898 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:20.589236 28802 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:13:20.603538 21359 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:20.593044 28560 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:20.606325 21462 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 23. Current term is 24. Ops: []
W20260709 13:13:20.607100 22002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.611724 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:20.598227 28524 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:20.602033 28284 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:20.620476 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:20.621098 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:20.606841 28625 raft_consensus.cc:697] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:20.591104 28592 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.636165 28592 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:13:20.612984 29042 consensus_queue.cc:1059] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:13:20.637812 29042 raft_consensus.cc:3055] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:20.638178 29042 raft_consensus.cc:740] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:20.638996 29042 consensus_queue.cc:260] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.640117 28978 consensus_queue.cc:1059] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:13:20.641109 28978 raft_consensus.cc:3055] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:20.641410 28978 raft_consensus.cc:740] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:20.642283 28978 consensus_queue.cc:260] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:20.646679 29077 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:13:20.648284 28978 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:20.653883 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2533) took 1575 ms. Trace:
I20260709 13:13:20.654439 21469 rpcz_store.cc:276] 0709 13:13:19.078203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.085280 (+  7077us) service_pool.cc:224] Handling call
0709 13:13:19.407216 (+321936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.498378 (+ 91162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.653604 (+1155226us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54001a6dd0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf2178ad 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:20.653802 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696536320}
I20260709 13:13:20.658676 28560 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:20.609051 29069 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:20.662623 29034 raft_consensus.cc:3055] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:20.663167 29034 raft_consensus.cc:740] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:20.633550 28898 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:13:20.664252 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.633658 29049 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.663962 29034 consensus_queue.cc:260] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.665755 29034 raft_consensus.cc:3060] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:20.666512 29049 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:20.662680 28975 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.001s
I20260709 13:13:20.670461 28975 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.674005 28975 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:20.671182 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.674676 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.684402 21285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.019s
W20260709 13:13:20.684872 21285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.000s	sys 0.019s
W20260709 13:13:20.685195 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 619460us
I20260709 13:13:20.632697 28284 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:20.698845 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:20.699077 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:20.711406 21393 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:20.712970 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:20.714131 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:20.714123 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.714948 21392 raft_consensus.cc:2376] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18. Re-sending same reply.
I20260709 13:13:20.716361 21387 raft_consensus.cc:2393] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:20.715903 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:20.678207 29042 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:20.718649 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:20.721050 21391 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:13:20.722067 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:20.681551 28719 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:20.679843 28861 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:20.737366 21997 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:20.736804 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:20.745419 21395 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:20.742445 21394 raft_consensus.cc:1240] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:20.750697 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:20.727878 28936 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.763s	user 0.005s	sys 0.006s
I20260709 13:13:20.728081 28975 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:20.736802 29021 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:20.739460 29049 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:20.623389 28510 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.762403 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:20.737193 28737 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:20.756887 29054 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:20.675863 28902 consensus_queue.cc:237] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:20.808444 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 46117.5us
I20260709 13:13:20.748381 28901 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:13:20.820501 22040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 1116) took 1063 ms. Trace:
I20260709 13:13:20.729374 28625 consensus_queue.cc:237] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.802852 29049 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:20.761140 28936 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.832654 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:20.806190 29089 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.806016 28885 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:20.836690 21388 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 25.
I20260709 13:13:20.816506 29056 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:20.823589 22040 rpcz_store.cc:276] 0709 13:13:19.757345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.774577 (+ 17232us) service_pool.cc:224] Handling call
0709 13:13:19.774925 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.775131 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:20.090308 (+315177us) log.cc:844] Serialized 14 byte log entry
0709 13:13:20.362665 (+272357us) log.cc:844] Serialized 14 byte log entry
0709 13:13:20.820046 (+457381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:20.820120 (+    74us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:20.820186 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.820276 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.820423 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":695763,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":68822,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"thread_start_us":1034426,"threads_started":3,"wal-append.queue_time_us":387929}
W20260709 13:13:20.855270 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 246751us
I20260709 13:13:20.798053 28975 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:20.855273 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 248182us
I20260709 13:13:20.858928 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:20.863045 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:20.844709 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 250084us
I20260709 13:13:20.866676 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:20.867455 21463 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:20.868414 21312 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:20.835755 29049 raft_consensus.cc:3060] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:20.816860 28737 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.874634 28911 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:13:20.863415 29081 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:13:20.906153 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:20.818786 22041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:44624
I20260709 13:13:20.860502 28988 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.908001 22041 raft_consensus.cc:606] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:20.857218 28675 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:20.855342 29056 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:20.868170 28891 consensus_meta.cc:287] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.006s
I20260709 13:13:20.913950 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:20.920756 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:20.914486 22041 raft_consensus.cc:614] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:20.917390 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:20.904119 28979 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:20.930325 21998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.857466 28885 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.922369 28883 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:20.941537 21462 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 24. Current term is 25. Ops: []
I20260709 13:13:20.944015 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:20.948841 21463 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:13:20.923681 29056 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:20.907725 28961 consensus_queue.cc:1059] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:13:20.928367 29088 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.912051 28911 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.937232 28901 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
W20260709 13:13:20.964623 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 43917us
W20260709 13:13:20.971289 29092 log.cc:927] Time spent T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:13:20.972162 29083 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:13:20.945849 28883 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.926759 28284 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.920468 28988 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.056861 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:21.069989 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 101308us
I20260709 13:13:21.070832 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:20.938927 28979 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:21.053810 29085 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:13:20.982707 29087 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:21.075753 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 123218us
I20260709 13:13:20.822571 28918 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.965206 29088 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:20.983402 28901 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:20.853554 29089 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:21.087630 29098 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:13:21.115707 28988 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.116879 29042 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.117511 29042 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:21.120369 28989 consensus_meta.cc:287] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.001s
I20260709 13:13:21.120797 28989 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.122816 28989 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.124581 28901 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:21.125188 28901 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:13:21.125506 28901 raft_consensus.cc:493] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:21.125837 28901 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:13:21.128742 29104 log.cc:927] Time spent T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:21.129520 29042 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:21.134258 29087 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:21.134384 29049 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:21.086169 29086 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.282s	user 0.006s	sys 0.006s
W20260709 13:13:21.105439 29102 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:13:21.110553 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 1119) took 1045 ms. Trace:
I20260709 13:13:21.148217 22038 rpcz_store.cc:276] 0709 13:13:20.065490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.066053 (+   563us) service_pool.cc:224] Handling call
0709 13:13:20.114105 (+ 48052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.124316 (+ 10211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.124345 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:20.124741 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 13:13:20.485852 (+361111us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:20.485893 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.485966 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.110334 (+624368us) raft_consensus.cc:1685] finished
0709 13:13:21.110356 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.110494 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50955,"raft.queue_time_us":91,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":15226,"thread_start_us":198748,"threads_started":1,"wal-append.queue_time_us":494838}
W20260709 13:13:21.154568 28922 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260709 13:13:21.155085 28922 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:21.156759 29109 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:21.162194 28853 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.164321 29024 raft_consensus.cc:3055] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:13:21.164831 28885 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.164912 29024 raft_consensus.cc:740] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:21.166206 29024 consensus_queue.cc:260] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.167357 28979 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.112768 28936 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:21.173394 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 312475us
I20260709 13:13:21.173800 29089 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:21.173476 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 312825us
I20260709 13:13:21.182338 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:21.179724 21320 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:21.185511 21465 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:21.186609 21321 raft_consensus.cc:1275] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:13:21.188542 28284 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.191584 22002 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:21.203801 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 147036us
W20260709 13:13:21.186806 28978 consensus_meta.cc:287] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.002s
I20260709 13:13:21.197455 29089 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:21.201287 28975 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:21.388978 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 206754us
I20260709 13:13:21.392570 21394 raft_consensus.cc:1240] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:21.393306 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.393740 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.375234 28886 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.380650 29042 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.403475 29117 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:21.404354 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:21.406901 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.410585 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.381616 28978 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.385224 28737 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.388903 29112 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.394317 28936 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:21.426221 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:21.435170 21321 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:21.398154 29089 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:21.396922 28284 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:21.418881 29046 log.cc:927] Time spent T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 1.818s	user 0.005s	sys 0.007s
I20260709 13:13:21.428767 21314 raft_consensus.cc:3055] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:21.594805 21314 raft_consensus.cc:740] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:21.417147 29117 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.532544 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:21.482317 29106 log.cc:927] Time spent T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:21.446794 21392 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:21.416479 28975 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.416800 29074 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.417251 29042 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.486151 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:21.485602 29056 consensus_meta.cc:287] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.001s
I20260709 13:13:21.490775 29088 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.415251 28886 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.604985 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.503328 29059 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.413977 28911 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:21.551064 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 140334us
I20260709 13:13:21.487756 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.487015 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.613907 21396 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:21.490005 29100 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:21.482561 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51917.1us
I20260709 13:13:21.615034 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:21.434305 28978 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.432961 28410 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:21.597705 21387 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:21.625140 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.595899 21314 consensus_queue.cc:260] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.476436 28936 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.433954 29112 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.603443 21321 raft_consensus.cc:2468] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
I20260709 13:13:21.477085 29116 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.612239 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1715) took 1831 ms. Trace:
I20260709 13:13:21.633683 22036 rpcz_store.cc:276] 0709 13:13:19.780865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.784004 (+  3139us) service_pool.cc:224] Handling call
0709 13:13:19.816852 (+ 32848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.450184 (+633332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.607249 (+1157065us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b540052b054. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:21.612176 (+  4927us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452159872}
I20260709 13:13:21.599576 29016 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.626065 21314 raft_consensus.cc:3060] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:21.609748 29124 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.630018 29117 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.633390 21362 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:21.595191 29089 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.640940 21392 raft_consensus.cc:2468] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:21.648857 21321 raft_consensus.cc:1240] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 24. Current term is 25. Ops: []
I20260709 13:13:21.653930 21390 raft_consensus.cc:1240] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 25. Current term is 26. Ops: []
W20260709 13:13:21.656180 21284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.005s	sys 0.018s
I20260709 13:13:21.624465 28988 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:21.657083 21284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.005s	sys 0.019s
I20260709 13:13:21.661763 21316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3630) took 1014 ms. Trace:
I20260709 13:13:21.606355 29056 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.662163 21316 rpcz_store.cc:276] 0709 13:13:20.647721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.669485 (+ 21764us) service_pool.cc:224] Handling call
0709 13:13:20.669808 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.670041 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.670065 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:20.670526 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:13:20.923308 (+252782us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:20.923346 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.923410 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.660998 (+737588us) raft_consensus.cc:1685] finished
0709 13:13:21.661021 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.661699 (+   678us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":252430,"threads_started":1,"wal-append.queue_time_us":705698}
I20260709 13:13:21.666004 21314 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:13:21.667733 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3698) took 1576 ms. Trace:
I20260709 13:13:21.668195 21312 rpcz_store.cc:276] 0709 13:13:20.091498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.091702 (+   204us) service_pool.cc:224] Handling call
0709 13:13:20.091967 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.868805 (+776838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.667485 (+798680us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b540022cc54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:21.667667 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785246592}
I20260709 13:13:21.672880 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:21.673259 21312 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:13:21.675473 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:21.606192 28975 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.674729 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:21.656324 28349 raft_consensus.cc:2804] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:21.681422 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:21.655937 29117 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.689149 21320 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:21.680378 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:21.690783 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:21.691123 22042 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:13:21.687201 21319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:21.687631 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:21.692250 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:21.692839 21321 raft_consensus.cc:2393] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 20: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:21.692950 21466 raft_consensus.cc:2393] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 23: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:21.679729 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:21.693485 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:21.689095 22032 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:21.632505 28442 consensus_queue.cc:1048] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
W20260709 13:13:21.697407 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.699699 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:21.700107 21317 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:21.632884 28861 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.032s
I20260709 13:13:21.635507 28410 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.703235 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:21.704478 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:21.612242 29074 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.708957 22038 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 13.
I20260709 13:13:21.705128 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.709474 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:21.706281 22040 raft_consensus.cc:2393] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 24: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:21.706216 21436 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:21.665316 28922 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.624984 29100 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.714071 22042 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:21.677825 28885 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:21.715099 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:21.730079 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.734889 22036 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:21.735021 21395 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:13:21.646807 29016 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.666579 21314 pending_rounds.cc:85] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 10
I20260709 13:13:21.689085 29095 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.738309 21314 pending_rounds.cc:107] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:13:21.741887 21314 raft_consensus.cc:2889] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:21.699245 29049 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.740243 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:21.665226 28988 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.645296 29116 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.744498 22038 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:21.714439 28853 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:13:21.704588 29097 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:21.704357 29060 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.730170 29103 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.651702 29124 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.751726 21395 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:21.710391 29117 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.733026 29088 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:21.739950 28902 raft_consensus.cc:2804] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:13:21.742940 29075 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:13:21.707942 28510 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
W20260709 13:13:21.760895 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48848.9us
I20260709 13:13:21.767721 29124 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.771615 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:21.772301 21392 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:21.772817 21387 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:13:21.773998 28978 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:21.775128 29042 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.776458 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.777619 28988 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.777968 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:21.778671 28952 raft_consensus.cc:3055] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:21.779078 28952 raft_consensus.cc:740] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:21.779790 28952 consensus_queue.cc:260] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.780856 28952 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:21.781689 29056 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.783197 29100 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.745801 29095 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.784134 28922 consensus_queue.cc:1048] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:21.740739 28885 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.785545 29095 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:21.786939 28922 consensus_queue.cc:1059] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:13:21.787673 28905 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 1.228s	user 0.009s	sys 0.005s
I20260709 13:13:21.788158 28905 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.788573 29089 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.790117 21389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3251) took 1749 ms. Trace:
I20260709 13:13:21.790256 28905 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.790827 28905 raft_consensus.cc:3055] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:21.791119 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.753118 29129 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.792022 29129 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.793455 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:21.793843 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:21.794297 29129 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:21.794827 21997 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:21.795208 29127 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:21.761688 29088 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.798061 29088 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.798524 28918 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.760311 29103 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.800619 28936 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.800741 29103 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.801187 21465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3192) took 1273 ms. Trace:
W20260709 13:13:21.776418 29123 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:13:21.801630 21465 rpcz_store.cc:276] 0709 13:13:20.527785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.529708 (+  1923us) service_pool.cc:224] Handling call
0709 13:13:20.530081 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.187505 (+657424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.800959 (+613454us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54003facd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:21.801134 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505644288}
I20260709 13:13:21.803009 28975 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.803181 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.803861 21388 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 25.
I20260709 13:13:21.804790 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.805028 29116 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.805389 29111 raft_consensus.cc:3055] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:21.805848 29116 raft_consensus.cc:2804] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:21.806219 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.806466 29116 raft_consensus.cc:697] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:21.807083 21390 raft_consensus.cc:2410] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 28 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
I20260709 13:13:21.765393 29097 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.809183 29024 raft_consensus.cc:3060] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:21.809780 29074 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.809964 29097 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:21.762355 29060 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.811357 29016 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.812572 29060 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:21.764149 28853 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:13:21.814183 29117 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.814229 28410 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.794850 29129 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:21.805876 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.828375 28410 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:21.764999 28902 raft_consensus.cc:697] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:21.829108 28410 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.829931 28902 consensus_queue.cc:237] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:21.831393 28410 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.831624 28886 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:21.767750 29112 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:21.856796 22036 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:21.822139 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.790514 21389 rpcz_store.cc:276] 0709 13:13:20.040738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.047503 (+  6765us) service_pool.cc:224] Handling call
0709 13:13:20.047879 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.474601 (+426722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.474646 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:20.483385 (+  8739us) log.cc:844] Serialized 26 byte log entry
0709 13:13:20.817220 (+333835us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:20.831627 (+ 14407us) log.cc:844] Serialized 14 byte log entry
0709 13:13:20.846592 (+ 14965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.846724 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.170967 (+324243us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b18003a6900. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc0a5c0a 00007fc2c57e5219 00007fc2c30ec58f 00007fc2bc12b571 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd
0709 13:13:21.754910 (+583943us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b2400285938. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc169fb0 00007fc2bede0488 00007fc2bede0be8 00007fc2bedb8398 00007fc2bedb376a 00007fc2bedb2bb6
0709 13:13:21.789927 (+ 35017us) raft_consensus.cc:1685] finished
0709 13:13:21.789946 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.790060 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43164,"prepare.queue_time_us":16013,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":81118,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":26700,"spinlock_wait_cycles":27946112,"thread_start_us":702934,"threads_started":2,"wal-append.queue_time_us":416667}
I20260709 13:13:21.791368 28905 raft_consensus.cc:740] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:21.786768 28885 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:21.824535 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.816183 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:21.828352 29129 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:21.833567 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:21.842424 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 82023us
I20260709 13:13:21.847432 21392 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:21.847514 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:21.848409 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:21.838092 28901 consensus_meta.cc:287] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.000s
I20260709 13:13:21.853569 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:21.856595 21463 raft_consensus.cc:1240] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:21.818930 28796 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.824402 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.860476 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:21.912739 21314 raft_consensus.cc:2393] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 28: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:21.807590 29116 consensus_queue.cc:237] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.897908 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:21.805850 29111 raft_consensus.cc:740] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:21.909773 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:21.885094 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.935709 21387 raft_consensus.cc:2410] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:21.852878 21465 raft_consensus.cc:1240] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:13:21.908059 21468 raft_consensus.cc:2410] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:13:21.885478 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:21.908390 21312 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:21.907567 21393 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:21.897135 21319 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:21.911646 22036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:44624
I20260709 13:13:21.939818 22036 raft_consensus.cc:606] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:21.940302 22036 raft_consensus.cc:614] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:21.915656 21316 raft_consensus.cc:2393] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:21.875869 29095 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.894416 28853 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.882247 29112 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:21.956213 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 250354us
I20260709 13:13:21.909327 29129 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:21.951263 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:21.965835 21436 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
W20260709 13:13:21.978436 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 269018us
I20260709 13:13:21.913678 29101 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.994837 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:21.949805 28885 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:22.002791 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:22.004799 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:22.007277 22032 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:21.937968 28349 raft_consensus.cc:697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:22.008495 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:22.025146 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:21.924001 28901 raft_consensus.cc:515] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.038035 21393 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:21.923467 28796 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:22.018919 28954 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.012s	sys 0.018s
I20260709 13:13:22.005714 29074 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:22.007331 29097 raft_consensus.cc:2804] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:21.991573 28886 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:22.006670 28885 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.982542 29016 consensus_queue.cc:1059] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.064s
I20260709 13:13:21.980157 28853 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.024605 28973 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.007529 29101 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:21.965348 29095 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.070917 21997 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:22.072644 22038 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 25. Current term is 26. Ops: []
I20260709 13:13:22.050977 29091 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:22.044557 29130 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:22.055984 28954 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.013s	sys 0.018s
I20260709 13:13:21.984242 29112 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.007061 29057 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.056s
I20260709 13:13:22.101052 29034 raft_consensus.cc:3055] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:22.066927 29074 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:21.997229 28905 consensus_queue.cc:260] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.080664 28885 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:22.121460 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.057068 28510 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:13:22.168807 21390 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:13:22.174665 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 407791us
I20260709 13:13:22.106567 29097 raft_consensus.cc:697] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:22.190279 21465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:13:22.191093 21465 raft_consensus.cc:606] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:22.191524 21465 raft_consensus.cc:614] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:22.024362 29111 consensus_queue.cc:260] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:22.170665 29123 log.cc:927] Time spent T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:13:22.169771 29074 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:22.081128 28886 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.109926 29091 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:22.074244 29060 consensus_queue.cc:1059] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:13:22.112946 29054 raft_consensus.cc:2804] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:13:22.208639 29058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.053s	sys 0.076s
I20260709 13:13:22.116676 29021 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:22.175917 29089 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.177588 29056 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:22.125638 29034 raft_consensus.cc:740] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:22.209854 21433 leader_election.cc:304] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:22.322995 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 113239us
I20260709 13:13:22.183467 28898 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.109439 28973 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:22.244580 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 195944us
I20260709 13:13:22.290623 22036 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
W20260709 13:13:22.249464 29058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.053s	sys 0.077s
I20260709 13:13:22.245499 29091 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:22.243369 28560 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:22.294807 29021 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:22.300935 29144 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:13:22.303153 28886 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:22.248178 29111 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:22.125643 28349 consensus_queue.cc:237] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.127468 29130 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.320402 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:22.232117 29116 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 13:13:22.069679 29134 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:22.296738 29133 raft_consensus.cc:3055] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:22.355875 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:22.354640 22031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c"
dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
mode: GRACEFUL
new_leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
 from {username='slave'} at 127.0.0.1:44624
I20260709 13:13:22.314112 29054 raft_consensus.cc:697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:22.335013 29060 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:22.375684 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:22.379819 21390 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:22.329778 28317 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:22.370947 21469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.016s	sys 0.012s
W20260709 13:13:22.660945 21469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.016s	sys 0.012s
I20260709 13:13:22.404592 28883 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:22.561719 29117 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:22.413168 28973 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:22.378091 28853 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:22.650563 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.703172 21465 raft_consensus.cc:2410] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:13:22.330499 29089 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.487207 28317 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.443656 29112 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:22.524971 28796 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:22.384218 28886 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.709633 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.710368 21465 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 23.
W20260709 13:13:22.404889 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.362876 28524 consensus_queue.cc:1059] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:13:22.402237 22031 raft_consensus.cc:606] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Received request to transfer leadership to TS d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:22.713631 22031 raft_consensus.cc:614] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:22.445050 29054 consensus_queue.cc:237] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:22.483564 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.718677 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.405611 29145 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:13:22.440263 28901 leader_election.cc:290] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 26 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:22.658664 28911 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:22.318406 29097 consensus_queue.cc:237] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.524386 29101 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:22.412142 29150 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:22.391794 29133 raft_consensus.cc:740] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:22.552311 29146 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:13:22.331177 29056 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.402683 29060 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:22.743650 29060 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:22.411230 29134 consensus_queue.cc:1059] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:22.369102 28560 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.750041 28560 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:22.424393 29024 consensus_meta.cc:287] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.003s
I20260709 13:13:22.338475 28898 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.750962 28317 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:22.752385 28898 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:22.660812 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.430797 21390 raft_consensus.cc:2468] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 26.
I20260709 13:13:22.663863 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.650228 29057 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:22.753872 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:22.754179 29057 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.755036 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.755306 21997 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:22.756554 29057 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:22.708714 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.757431 29159 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:22.757812 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.758054 29159 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.716509 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.759722 21464 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:13:22.760648 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.717586 21466 raft_consensus.cc:1240] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:22.731686 22042 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 13:13:22.729848 29152 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:13:22.762130 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.763000 21469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56756 (request call id 2548) took 1915 ms. Trace:
I20260709 13:13:22.763281 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:22.719604 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.732702 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.712670 28886 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.710587 29116 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:22.772460 29116 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.775463 29116 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:22.736255 29150 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.763451 21469 rpcz_store.cc:276] 0709 13:13:20.856133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.856256 (+   123us) service_pool.cc:224] Handling call
0709 13:13:20.856624 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.865838 (+  9214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.865868 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:20.866290 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.838053 (+971763us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b180049ca20. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b 00007fc2bedb7d23 00007fc2bedb80d1 00007fc2bf1d3a0f
0709 13:13:22.665211 (+827158us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:22.665252 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.665326 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.762711 (+ 97385us) raft_consensus.cc:1685] finished
0709 13:13:22.762733 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.762941 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12813,"raft.queue_time_us":9281,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":21259,"spinlock_wait_cycles":21930368,"thread_start_us":826953,"threads_started":1,"wal-append.queue_time_us":1684516}
I20260709 13:13:22.741412 29089 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:22.782006 28317 raft_consensus.cc:3055] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:13:22.782688 28885 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.003s
I20260709 13:13:22.779860 29150 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:22.752458 21391 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 25.
I20260709 13:13:22.783280 28885 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.739579 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:22.731426 29149 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
W20260709 13:13:22.786145 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.731063 28911 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.788767 28902 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:22.776634 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.789834 21464 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:13:22.782624 28317 raft_consensus.cc:740] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:22.760733 29156 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:22.731452 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.743168 29056 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:22.753873 21470 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 20.
I20260709 13:13:22.806627 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.790738 21396 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
W20260709 13:13:22.807179 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 469620us
I20260709 13:13:22.802243 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.809463 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.815917 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.840214 21462 raft_consensus.cc:2410] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:13:22.705313 29117 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.789258 28902 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:22.847595 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 92373.6us
I20260709 13:13:22.850634 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:22.851992 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.767918 28886 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:22.810847 28898 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:22.858560 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 93478.5us
I20260709 13:13:22.853047 21436 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:22.857383 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:22.859230 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0831571229999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 13:13:22.861336 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:22.862848 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.868839 21317 raft_consensus.cc:1240] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:13:22.869441 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:22.870918 28964 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:13:22.870592 21318 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:13:22.881840 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.884383 21321 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:13:22.858907 29163 raft_consensus.cc:2804] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:13:22.896831 29163 raft_consensus.cc:697] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 26 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:22.856652 28911 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:22.912119 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.913403 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:22.918516 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.784619 29133 consensus_queue.cc:260] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.858294 29159 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:22.962146 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.879601 29057 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:22.926962 21320 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:22.963706 21318 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
W20260709 13:13:22.964731 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51559.3us
I20260709 13:13:22.879367 28883 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:13:22.856292 29138 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:13:22.894299 29089 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.972494 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.971289 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:22.817122 29156 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.978070 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:22.979802 21465 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 25.
I20260709 13:13:22.980368 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.981384 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:22.858685 29091 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.974802 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:22.984880 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:22.981974 22040 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:22.873224 28898 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.991484 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.989509 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:22.984144 29133 raft_consensus.cc:3060] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:22.969712 29112 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:22.998124 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.978570 28883 consensus_queue.cc:1243] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:23.001574 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.003446 21436 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:23.004544 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.983397 29056 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:23.008894 21313 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:22.893337 28317 consensus_queue.cc:260] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:22.986215 29057 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:23.013077 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.014079 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.015215 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.016167 21317 raft_consensus.cc:2393] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 19: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:23.013077 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.998311 29054 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:13:23.017175 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.018535 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:22.983772 29159 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.032s
I20260709 13:13:23.019979 21320 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 21: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:23.010215 29097 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:22.980160 29089 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:22.969388 28902 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.027088 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.029626 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:23.031015 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.026081 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.041756 22002 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.042888 22002 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.043936 22002 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:23.050680 21318 raft_consensus.cc:2393] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 22: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:23.053610 22040 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:13:23.053726 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.059115 22002 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:23.060072 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.018764 29168 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:23.063899 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.057742 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:23.025730 28317 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:23.038756 29074 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.001s
I20260709 13:13:23.031652 29097 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:23.062148 29054 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:23.069290 28954 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:23.069694 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.070288 29142 consensus_queue.cc:1059] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:23.070822 29156 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:23.070869 29161 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:23.071992 29171 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:13:23.072762 29166 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:13:23.064783 29116 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:23.081404 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 74776.3us
I20260709 13:13:23.053215 29131 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:23.080716 21318 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:23.058672 29056 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:23.067370 28902 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:23.061497 28886 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:23.081382 29165 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:13:23.067636 28901 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:23.082226 29097 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:13:23.111901 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 43519us
I20260709 13:13:23.018858 29163 consensus_queue.cc:237] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.115573 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.085332 28954 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.121152 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:23.113716 29111 consensus_meta.cc:287] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.005s
I20260709 13:13:23.130645 29142 raft_consensus.cc:3055] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:23.131104 29142 raft_consensus.cc:740] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:23.132050 29142 consensus_queue.cc:260] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.133258 29142 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:23.111236 28885 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:23.082366 29074 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.137146 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.138789 21317 raft_consensus.cc:2410] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
W20260709 13:13:23.143707 29167 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:13:23.144744 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:23.128785 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:23.096284 29168 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 13:13:23.107622 28911 consensus_queue.cc:1059] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:13:23.124375 28954 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:23.171324 21312 raft_consensus.cc:1240] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:23.172343 21464 raft_consensus.cc:1217] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Deduplicated request from leader. Original: 18.9->[19.10-23.12]   Dedup: 19.10->[21.11-23.12]
I20260709 13:13:23.128094 29156 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.172988 21464 pending_rounds.cc:85] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 10
I20260709 13:13:23.176249 21464 pending_rounds.cc:107] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 22.11
I20260709 13:13:23.176589 21464 raft_consensus.cc:2889] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:23.119297 29159 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:13:23.175693 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:23.183894 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:23.184352 21285 leader_election.cc:336] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.568s (SENT)
I20260709 13:13:23.185096 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.186133 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.150321 29111 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:23.111123 29057 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:23.172441 29170 log.cc:927] Time spent T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:13:23.166137 28901 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:23.164947 28885 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:13:23.125908 29060 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:23.187340 29157 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.286s	user 0.003s	sys 0.000s
I20260709 13:13:23.192019 28886 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:23.192389 29112 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:23.211958 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.201385 29129 consensus_meta.cc:287] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 1.200s	user 0.010s	sys 0.005s
I20260709 13:13:23.192226 29056 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.197952 28898 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.217094 21463 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:23.205901 28885 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:23.206909 28901 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:23.203189 29160 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:23.206758 29116 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:23.232302 29116 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.213683 28886 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:23.219151 29173 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:13:23.229926 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.188997 29156 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:23.237210 29116 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.224408 28885 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:23.263243 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.264384 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.264958 21317 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:23.271469 21313 raft_consensus.cc:1275] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:13:23.225514 29089 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.236213 28901 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:23.237466 29056 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.248229 28886 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:23.222402 29129 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.284358 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:23.285799 21468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4"
dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
mode: GRACEFUL
new_leader_uuid: "058db415e9884ea0ba23f1e1ff59127a"
 from {username='slave'} at 127.0.0.1:57898
I20260709 13:13:23.286497 21468 raft_consensus.cc:606] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Received request to transfer leadership to TS 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:23.286857 21468 raft_consensus.cc:614] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:23.287142 21317 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:23.288544 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:23.289817 29116 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:23.290242 29116 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.290596 29116 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:23.291563 29156 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:23.293574 29034 consensus_queue.cc:260] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.295022 29034 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:23.295593 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:23.296736 22036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 1135) took 1294 ms. Trace:
I20260709 13:13:23.297147 22036 rpcz_store.cc:276] 0709 13:13:22.002374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.002531 (+   157us) service_pool.cc:224] Handling call
0709 13:13:23.296540 (+1294009us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54005c49d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:23.296677 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652404480}
I20260709 13:13:23.298664 22038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1740) took 1450 ms. Trace:
I20260709 13:13:23.299172 22038 rpcz_store.cc:276] 0709 13:13:21.848738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.848991 (+   253us) service_pool.cc:224] Handling call
0709 13:13:21.910715 (+ 61724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.107856 (+197141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.298372 (+1190516us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400506254. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:23.298597 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371894656}
I20260709 13:13:23.302286 29116 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.309346 29160 consensus_queue.cc:1048] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:23.310021 29160 consensus_queue.cc:1243] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer 058db415e9884ea0ba23f1e1ff59127a log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:13:23.310639 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.311105 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.311870 28883 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.312431 28883 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:23.314625 28883 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.316100 21317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:23.317059 21317 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:23.326215 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.327131 21468 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 24.
I20260709 13:13:23.328580 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:23.350839 21317 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:23.361187 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:23.362180 21434 leader_election.cc:336] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.525s (SENT)
I20260709 13:13:23.362552 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:23.365934 21313 pending_rounds.cc:85] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Aborting all ops after (but not including) 13
I20260709 13:13:23.366326 21313 pending_rounds.cc:107] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:13:23.366569 21313 raft_consensus.cc:2889] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:23.362658 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.363740 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:23.323652 29089 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:23.373648 22036 raft_consensus.cc:1275] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:13:23.374821 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.384908 22036 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:23.387251 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8909ec5d582450ba80932fa543ad4a1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:23.352174 28883 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:23.285791 29056 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.401851 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.402751 21396 raft_consensus.cc:3060] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:23.404729 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.408615 22040 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
W20260709 13:13:23.410346 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 48204.5us
I20260709 13:13:23.410974 29187 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:23.385739 29160 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:23.413584 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.417444 21394 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:23.418237 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:23.388979 29074 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:23.378759 29089 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:23.418874 22042 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:23.420729 29129 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:23.400851 28883 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.424333 28883 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:23.417156 29168 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
W20260709 13:13:23.425710 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.428267 29183 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:13:23.430421 28905 raft_consensus.cc:3060] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:23.434502 29089 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:23.437404 21312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45126 (request call id 3656) took 1352 ms. Trace:
I20260709 13:13:23.437968 29159 consensus_queue.cc:1059] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:13:23.437940 21312 rpcz_store.cc:276] 0709 13:13:22.085156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.085291 (+   135us) service_pool.cc:224] Handling call
0709 13:13:22.085609 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.171869 (+1086260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.437073 (+265204us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540021a7d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:23.437317 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2496411392}
I20260709 13:13:23.399858 29116 leader_election.cc:290] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:23.440464 21391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52946 (request call id 2536) took 1815 ms (client timeout 2134 ms). Trace:
W20260709 13:13:23.441025 21391 rpcz_store.cc:269] 0709 13:13:21.624756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.624881 (+   125us) service_pool.cc:224] Handling call
0709 13:13:23.440237 (+1815356us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400388e54. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:23.440378 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590898560}
I20260709 13:13:23.445933 29056 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:23.443944 29117 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:23.451938 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:13:23.452584 29181 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:13:23.458410 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.464222 21391 raft_consensus.cc:1240] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:23.465495 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.470830 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:23.471482 22042 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:23.475693 21396 raft_consensus.cc:2468] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:23.451993 28902 raft_consensus.cc:3055] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:13:23.474499 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.404779 29100 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:23.481637 21390 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:23.477906 22040 raft_consensus.cc:1240] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:23.477960 21320 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:13:23.482954 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:23.483253 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:23.478308 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.478389 21391 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:23.484875 21396 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:13:23.487296 29191 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:13:23.489869 29101 consensus_queue.cc:1059] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:23.491024 29101 raft_consensus.cc:3055] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:23.491389 29101 raft_consensus.cc:740] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:23.492213 29101 consensus_queue.cc:260] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.493472 29101 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:23.457077 29160 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.496279 29160 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:23.501657 29054 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:23.502424 22031 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:13:23.502820 29095 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.504721 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.508903 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:23.509668 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.510687 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.511236 21387 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:13:23.511446 21395 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 24.
I20260709 13:13:23.512264 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.511441 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.513182 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.516369 21389 raft_consensus.cc:2410] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
W20260709 13:13:23.517994 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 45117.3us
W20260709 13:13:23.519676 21434 leader_election.cc:336] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.528s (SENT)
I20260709 13:13:23.520694 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.525626 21392 raft_consensus.cc:1240] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:23.529718 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.535089 21392 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:23.552436 29095 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:23.553082 21394 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:23.553200 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.554402 22040 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:23.580215 28954 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:23.580710 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:23.555269 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:23.584769 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:23.586975 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.556793 29179 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:23.560523 21391 raft_consensus.cc:1275] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:13:23.477494 29024 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:23.589460 21391 pending_rounds.cc:85] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 16
I20260709 13:13:23.590057 21391 pending_rounds.cc:107] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:13:23.589875 29054 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:13:23.575495 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.477232 28902 raft_consensus.cc:740] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:23.591390 29054 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:23.591703 28902 consensus_queue.cc:260] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.592864 28902 raft_consensus.cc:3060] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:23.593127 29180 consensus_queue.cc:1059] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:13:23.594192 29180 raft_consensus.cc:3055] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:23.594518 29180 raft_consensus.cc:740] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:23.595382 28954 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.595247 29180 consensus_queue.cc:260] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:23.576937 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 141760us
I20260709 13:13:23.589651 29024 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:23.469203 29075 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:23.590351 21391 raft_consensus.cc:2889] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:23.610050 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.542353 29112 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.619614 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:23.620590 22040 raft_consensus.cc:2368] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21.
I20260709 13:13:23.607800 21392 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
W20260709 13:13:23.596964 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 77328.8us
W20260709 13:13:23.622133 21434 leader_election.cc:336] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.549s (SENT)
I20260709 13:13:23.622540 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.622967 21997 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:23.623404 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.591784 29054 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.589423 29179 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:23.625066 29054 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:23.631305 29116 raft_consensus.cc:2804] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:23.613652 29187 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:13:23.625417 29161 consensus_meta.cc:287] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:13:23.532691 29100 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:23.637248 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.639647 21391 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 24: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:23.598047 28885 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:23.652634 21434 leader_election.cc:336] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.564s (SENT)
I20260709 13:13:23.663190 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.612203 29095 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.636292 29180 raft_consensus.cc:3060] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:23.666343 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.676190 21469 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:23.676445 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:23.668324 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.677760 21434 leader_election.cc:336] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.622s (SENT)
I20260709 13:13:23.639343 28510 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:23.673171 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.683487 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.683625 21462 raft_consensus.cc:1275] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:13:23.625753 29112 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:23.667217 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.623557 29075 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.677431 21464 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:23.671823 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.647454 29161 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:23.691349 21468 raft_consensus.cc:2393] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:23.633805 29179 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:23.682931 21470 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:23.647083 29116 raft_consensus.cc:697] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:23.689929 21467 raft_consensus.cc:1240] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:23.689930 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:23.681944 29142 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.001s
W20260709 13:13:23.693289 29192 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:23.693529 29024 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.697335 22035 raft_consensus.cc:1240] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:23.698568 29100 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.699141 29095 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.707530 29014 raft_consensus.cc:3055] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:23.708112 29014 raft_consensus.cc:740] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:23.690253 28349 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.715049 28349 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.716580 29089 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.718737 29089 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:23.719043 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.710678 29112 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:23.710983 29097 consensus_meta.cc:287] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.566s	user 0.004s	sys 0.004s
I20260709 13:13:23.712273 29075 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:23.707559 29116 consensus_queue.cc:237] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.719689 21467 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:13:23.738576 21470 raft_consensus.cc:1275] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:13:23.729621 22036 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:23.726361 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.733955 21468 raft_consensus.cc:1275] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:13:23.734489 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.740981 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.726025 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.744714 21462 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:23.745191 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.725631 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:23.739892 21469 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 24.
W20260709 13:13:23.701421 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68173.8us
W20260709 13:13:23.705103 28317 consensus_meta.cc:287] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.001s
I20260709 13:13:23.750362 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:23.750118 29097 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.750874 29054 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.751811 22039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42358 (request call id 1744) took 1424 ms. Trace:
I20260709 13:13:23.754504 22039 rpcz_store.cc:276] 0709 13:13:22.327641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.327776 (+   135us) service_pool.cc:224] Handling call
0709 13:13:22.328077 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.742068 (+413991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.742101 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.742140 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:22.742172 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.751566 (+1009394us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54003d18d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:23.751616 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.751744 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951678336}
I20260709 13:13:23.757500 29054 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.758306 28349 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:23.758780 29060 leader_election.cc:290] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:23.758983 29014 consensus_queue.cc:260] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:23.760579 29132 log.cc:927] Time spent T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 1.519s	user 0.008s	sys 0.004s
I20260709 13:13:23.764124 29097 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:23.765251 29130 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.765919 29130 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Committing config change with OpId 20.15: config changed from index 8 to 15, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:23.696990 29160 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.695818 28883 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:23.729218 29021 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:23.722477 28885 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.767774 29179 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.771122 29014 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:23.708266 28886 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.719967 28901 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.780817 29160 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.782173 29179 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:23.820528 21312 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 25: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:23.699609 21388 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 24.
W20260709 13:13:23.823489 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 306179us
I20260709 13:13:23.829751 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.831535 28883 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:23.832701 28883 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:23.833659 28883 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:23.835196 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.835913 22034 raft_consensus.cc:2368] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:13:23.837450 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.837702 28883 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:23.838560 21394 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 26: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:23.840869 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.842751 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.843531 28886 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:23.844866 22038 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:23.829310 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.848899 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:23.851616 21434 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.718s (SENT)
I20260709 13:13:23.856925 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:23.853387 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:23.836342 21392 raft_consensus.cc:2376] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19. Re-sending same reply.
I20260709 13:13:23.860400 29097 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:23.861727 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:23.859665 21434 leader_election.cc:336] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.789s (SENT)
I20260709 13:13:23.839864 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:23.969874 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.965179 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.130025 28911 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:24.130393 21392 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 17.
I20260709 13:13:24.130897 28911 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:24.093649 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.034116 29138 raft_consensus.cc:3055] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:13:24.132642 29138 raft_consensus.cc:740] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:24.133069 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:24.133594 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 274187us
I20260709 13:13:23.875418 29103 consensus_queue.cc:1059] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.259s
I20260709 13:13:24.133760 28911 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:24.134189 29138 consensus_queue.cc:260] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:24.132829 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.873144 21433 leader_election.cc:400] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21.
I20260709 13:13:24.131685 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.888237 21463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1255) took 1166 ms. Trace:
I20260709 13:13:24.163529 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:23.869311 22041 raft_consensus.cc:1240] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:23.895776 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.886441 21461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3212) took 1165 ms. Trace:
I20260709 13:13:23.871609 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.196547 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:24.202611 29172 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 1.113s	user 0.005s	sys 0.001s
I20260709 13:13:24.161877 29097 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:24.193876 21433 leader_election.cc:403] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:13:24.034929 21393 raft_consensus.cc:2468] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
W20260709 13:13:23.888811 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.843585 21396 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:13:24.172696 21360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.015s
I20260709 13:13:24.150687 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:23.769529 21466 raft_consensus.cc:2468] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:24.181420 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:23.880416 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.135874 28349 raft_consensus.cc:3055] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:13:24.211886 21360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.009s	sys 0.015s
I20260709 13:13:24.135965 29138 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:13:24.194314 21463 rpcz_store.cc:276] 0709 13:13:22.721148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.757562 (+ 36414us) service_pool.cc:224] Handling call
0709 13:13:23.887600 (+1130038us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b540025a154. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:23.887821 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054556544}
I20260709 13:13:24.201910 21461 rpcz_store.cc:276] 0709 13:13:22.720525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.720878 (+   353us) service_pool.cc:224] Handling call
0709 13:13:22.733789 (+ 12911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.758771 (+ 24982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.758806 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.758852 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:22.758884 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.885755 (+1126871us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5400435dd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf218e01 00007fc2bf21783e 00007fc2c41dc419 00007fc2bd753bd4 00007fc2bd753b62 00007fc2bd753a91 00007fc2bd753a0c 00007fc2bd752cc2 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:23.885867 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.886221 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56949632}
I20260709 13:13:24.215270 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:24.220021 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:23.867417 28901 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:24.151340 21391 raft_consensus.cc:2468] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:13:24.224826 21316 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:13:24.225354 21393 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:24.226346 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:24.226905 21393 raft_consensus.cc:2376] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19. Re-sending same reply.
I20260709 13:13:24.227804 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:24.228648 29056 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:24.229408 29056 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.230988 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.231997 21390 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:24.213729 28349 raft_consensus.cc:740] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:24.234679 21393 raft_consensus.cc:2393] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:24.237854 29111 consensus_queue.cc:1059] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:24.239068 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.235677 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:24.240059 21315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 3714) took 1378 ms. Trace:
I20260709 13:13:24.240496 21315 rpcz_store.cc:276] 0709 13:13:22.861667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.861810 (+   143us) service_pool.cc:224] Handling call
0709 13:13:22.862141 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.867698 (+  5557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.867733 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.868290 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.966858 (+ 98568us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:22.966916 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.967018 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.155684 (+1188666us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bedb386e 00007fc2bedb2bb6 00007fc2bedb27d8 00007fc2bedbc221 00007fc2bedbc1d9 00007fc2bedbc169
0709 13:13:24.239451 (+ 83767us) raft_consensus.cc:1685] finished
0709 13:13:24.239474 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.239826 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5140,"raft.queue_time_us":5912,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":7094528,"thread_start_us":98151,"threads_started":1,"wal-append.queue_time_us":169614}
I20260709 13:13:24.237421 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:24.244558 21390 raft_consensus.cc:2376] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19. Re-sending same reply.
I20260709 13:13:24.237326 28349 consensus_queue.cc:260] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.252610 28349 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:24.233460 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.256645 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.257143 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.258533 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.232002 29056 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:24.244967 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:24.246064 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.246291 29180 raft_consensus.cc:3055] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:24.154150 29074 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.066833 29091 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:24.263161 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.264073 21387 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 13:13:24.267133 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.878393 29206 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.389s
I20260709 13:13:24.274415 21390 raft_consensus.cc:1275] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:13:24.273578 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.274830 22038 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:24.262531 29180 raft_consensus.cc:740] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:24.280720 21315 raft_consensus.cc:1240] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:24.283174 21387 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:24.286513 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:24.287010 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 154110us
I20260709 13:13:24.279630 21388 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
W20260709 13:13:24.282835 21389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.023s	sys 0.064s
I20260709 13:13:24.292798 21391 raft_consensus.cc:1240] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:13:24.296998 21394 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:13:24.297924 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:24.294255 21389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.023s	sys 0.065s
I20260709 13:13:24.301326 21395 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:24.296175 29056 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:24.307785 21393 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:24.313345 28922 raft_consensus.cc:3060] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:24.313287 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:24.311174 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 574392us
I20260709 13:13:24.320382 21394 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 26: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:24.285941 29074 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:24.323560 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:24.325838 29076 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:24.325937 21434 leader_election.cc:336] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.846s (SENT)
I20260709 13:13:24.313423 29097 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:24.310670 29056 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.334941 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:24.335121 21394 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:13:24.336159 21316 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 25: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:24.331086 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:24.315480 29180 consensus_queue.cc:260] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.351199 21315 raft_consensus.cc:2368] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21.
I20260709 13:13:24.331760 29056 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:24.378481 22002 leader_election.cc:304] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:24.379730 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 75384us
I20260709 13:13:24.381163 29116 raft_consensus.cc:2804] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:24.381551 21321 raft_consensus.cc:1240] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:13:24.378640 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:24.382805 29097 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.385582 29097 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:24.387820 29074 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:24.367224 29076 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.394757 29076 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:24.396217 21315 raft_consensus.cc:1240] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 25. Current term is 26. Ops: []
I20260709 13:13:24.397583 21284 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:24.399081 28796 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:24.400318 29091 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:24.400980 29091 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:13:24.401024 21466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59692 (request call id 1256) took 1679 ms (client timeout 2168 ms). Trace:
I20260709 13:13:24.401607 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:24.401679 21466 rpcz_store.cc:269] 0709 13:13:22.721400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.763048 (+ 41648us) service_pool.cc:224] Handling call
0709 13:13:24.400567 (+1637519us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b5400249fd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf181571 00007fc2bf21c2fa 00007fc2c41ddb17 00007fc2bd7586d4 00007fc2bd758662 00007fc2bd758591 00007fc2bd75850c 00007fc2bd7577c2 00007fc2bd55348c 00007fc2bd5528c6 00007fc2bd55226f
0709 13:13:24.400777 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295143808}
I20260709 13:13:24.402485 29091 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.403389 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:24.404573 21462 raft_consensus.cc:1275] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:13:24.405049 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:24.405951 21360 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:24.406754 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:24.407527 29211 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.262s	user 0.004s	sys 0.000s
I20260709 13:13:24.399943 28796 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:24.407944 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:24.412451 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.397629 21394 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:13:24.408604 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:24.408535 28898 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:24.415057 29014 consensus_meta.cc:287] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.005s
W20260709 13:13:24.441627 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 65265.1us
I20260709 13:13:24.444617 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:24.440537 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:24.410466 29194 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.408289 29174 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:24.463586 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 95721.5us
I20260709 13:13:24.460817 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:24.483711 21468 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:24.497465 21393 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 19. (term mismatch)
I20260709 13:13:24.497941 21393 pending_rounds.cc:85] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 18
I20260709 13:13:24.498188 21393 pending_rounds.cc:107] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 26.19
I20260709 13:13:24.498456 21393 raft_consensus.cc:2889] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:24.499183 21316 raft_consensus.cc:1275] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:24.499809 29194 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:24.493183 29180 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:24.502334 29194 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:24.500231 29021 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:24.504396 21396 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 25.
I20260709 13:13:24.508922 21392 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:24.486768 29206 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:13:24.524062 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 198176us
W20260709 13:13:24.525700 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.528813 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:24.512722 29206 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:24.547909 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:24.552175 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 121976us
I20260709 13:13:24.539546 29206 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:24.559847 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:24.544118 29194 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:24.580920 29194 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:24.584558 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:24.585445 21320 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:24.537197 29074 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.584446 21214 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 14 to 17, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 17 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:24.590499 21434 leader_election.cc:336] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 2.058s (SENT)
I20260709 13:13:24.596828 21315 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:24.539228 29116 raft_consensus.cc:697] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:24.597366 21395 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
W20260709 13:13:24.598166 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 190430us
I20260709 13:13:24.598711 21434 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:24.583887 29194 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:24.601728 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.595057 28922 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21.
I20260709 13:13:24.620669 29116 consensus_queue.cc:237] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.626269 29133 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:24.634406 21468 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 25.
I20260709 13:13:24.640401 21997 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:24.641682 21997 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:24.643297 29130 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:24.643349 29074 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.644228 29021 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:13:24.645340 29130 raft_consensus.cc:2804] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:13:24.645967 29130 raft_consensus.cc:697] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 25 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:24.646212 29021 raft_consensus.cc:2804] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:24.646883 29074 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:24.647733 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:24.650106 28796 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:24.650765 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:24.651486 29135 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:24.647161 29130 consensus_queue.cc:237] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:24.659341 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.661163 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:24.661845 29056 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.664613 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:24.665522 28349 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:24.665915 28349 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.666268 28349 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:24.646945 29021 raft_consensus.cc:697] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:24.668355 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 121723us
I20260709 13:13:24.667732 29021 consensus_queue.cc:237] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.671136 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:24.677256 29097 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:24.679988 28901 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:24.681332 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:13:24.680967 29220 log.cc:927] Time spent T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:24.682137 22039 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:24.680951 28901 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.685105 28901 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:24.686515 28901 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:24.688220 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:24.688350 28886 consensus_queue.cc:1048] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:13:24.689066 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.689615 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.687371 28901 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.688654 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:24.691004 29217 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:13:24.691740 28886 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:24.693595 29216 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:13:24.695609 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:24.702970 29103 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:24.710629 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 55154.9us
I20260709 13:13:24.710862 21360 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:24.714922 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.716521 29103 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:13:24.716988 29103 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:24.717368 29103 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:24.717753 29209 consensus_queue.cc:1059] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:24.710479 21214 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 19 to 23, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 23 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:24.718991 29209 raft_consensus.cc:3055] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:13:24.719974 29209 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:24.722882 29209 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:24.719317 21214 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 18 to 20, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 20 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:24.727943 21211 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 279) took 36167 ms (client timeout 15000 ms). Trace:
I20260709 13:13:24.726397 21214 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 17, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 17 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:24.730679 29209 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:24.679780 29097 consensus_queue.cc:1048] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:13:24.736586 29014 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:13:24.747521 29014 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:13:24.752097 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 321190us
I20260709 13:13:24.730319 21214 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:24.755681 21214 catalog_manager.cc:5697] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 18 to 21, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 21 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:24.728984 21211 rpcz_store.cc:269] 0709 13:12:48.558531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.558755 (+   224us) service_pool.cc:224] Handling call
0709 13:13:24.726283 (+36167528us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:16.597968 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:16.776315 (+178347us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:16.776400 (+    85us) write_op.cc:435] Acquired schema lock
0709 13:13:16.776428 (+    28us) tablet.cc:662] Decoding operations
0709 13:13:16.855388 (+ 78960us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:16.855483 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:16.855514 (+    31us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:13:16.858861 (+  3347us) tablet.cc:701] Row locks acquired
0709 13:13:16.858910 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:13:16.859073 (+   163us) write_op.cc:270] Start()
0709 13:13:16.859231 (+   158us) write_op.cc:276] Timestamp: P: 1783602796859008 usec, L: 0
0709 13:13:16.859252 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:13:17.098577 (+239325us) log.cc:844] Serialized 8702 byte log entry
0709 13:13:18.177403 (+1078826us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b4400022b4c. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc051c85 00007fc2bc0526a2 00007fc2bedc41db 00007fc2bedbfaaf 00007fc2bc10e0ac 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc12ac02 00007fc2bedb220b
0709 13:13:18.829785 (+652382us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18002477e0. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf195190 00007fc2bf18eae7 00007fc2bf18ddd9 00007fc2bf198930
0709 13:13:19.502435 (+672650us) op_driver.cc:464] REPLICATION: finished
0709 13:13:19.733712 (+231277us) write_op.cc:301] APPLY: starting
0709 13:13:19.733811 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:20.672723 (+938912us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:20.672766 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:21.499796 (+827030us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:21.509978 (+ 10182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:13:21.510025 (+    47us) write_op.cc:312] APPLY: finished
0709 13:13:21.510593 (+   568us) log.cc:844] Serialized 196 byte log entry
0709 13:13:22.374312 (+863719us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:22.402857 (+ 28545us) write_op.cc:454] Released schema lock
0709 13:13:22.447634 (+ 44777us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:22.448180 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:22.448221 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4424398,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":219037,"apply.run_cpu_time_us":181627,"apply.run_wall_time_us":2714437,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96351,"num_ops":22,"prepare.queue_time_us":396564,"prepare.run_cpu_time_us":54542,"prepare.run_wall_time_us":1871130,"raft.queue_time_us":1022619,"raft.run_cpu_time_us":6452,"raft.run_wall_time_us":156608,"replication_time_us":2623648,"spinlock_wait_cycles":105455360,"thread_start_us":2930076,"threads_started":5,"wal-append.queue_time_us":2206390,"wal-append.run_cpu_time_us":20908,"wal-append.run_wall_time_us":2995174}]]}
I20260709 13:13:24.757966 21214 catalog_manager.cc:5697] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 19 to 22, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 22 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:24.763620 29138 consensus_meta.cc:287] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: Time spent flushing consensus metadata: real 0.542s	user 0.005s	sys 0.003s
I20260709 13:13:24.765292 29021 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.735941 29056 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:24.704154 28901 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:24.780616 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 70764.6us
I20260709 13:13:24.783092 22039 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:24.770741 21214 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 13, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 13 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:24.796331 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 85629.3us
W20260709 13:13:24.800637 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 106796us
I20260709 13:13:24.798244 29076 raft_consensus.cc:2764] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:13:24.810520 29194 consensus_queue.cc:1059] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:24.811784 29021 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.813452 28796 raft_consensus.cc:3055] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:24.813948 28796 raft_consensus.cc:740] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:24.814718 29021 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:24.814972 28796 consensus_queue.cc:260] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.801743 28901 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:24.821020 28901 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:24.821447 28901 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:24.823980 28349 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.830456 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:24.830892 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:24.831317 21468 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 20: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:24.831543 21461 raft_consensus.cc:2468] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:24.830114 29097 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.832533 29097 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:24.829133 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.833966 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.840575 29097 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:24.843524 28349 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:24.844812 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.845436 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.846877 21316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:24.793040 29174 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.849189 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:24.851725 21316 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 24.
I20260709 13:13:24.851922 28796 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:24.853025 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:24.853613 21313 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:24.853885 21466 raft_consensus.cc:1275] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:13:24.859347 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:24.860140 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:24.860373 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:24.860854 21469 raft_consensus.cc:2376] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18. Re-sending same reply.
I20260709 13:13:24.861186 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:24.862061 21461 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 22: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:24.862926 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:24.864344 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:24.864593 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:24.867445 21433 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:24.851775 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:24.869489 21315 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:24.860136 21468 raft_consensus.cc:3060] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:24.885735 21313 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:24.851925 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:24.897152 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 48298.2us
I20260709 13:13:24.783643 29206 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:24.898097 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:24.976362 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 82405.2us
I20260709 13:13:24.912175 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:24.912339 21312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:24.929064 28886 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:24.931988 21314 raft_consensus.cc:2468] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 21.
I20260709 13:13:24.979085 21316 raft_consensus.cc:1275] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:13:24.944324 21214 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 20 to 22, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 22 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:24.919414 29103 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:24.981226 28886 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:24.983105 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:24.983709 28886 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:24.984380 28886 raft_consensus.cc:2749] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:24.984426 29231 consensus_queue.cc:1048] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:24.899258 29194 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:24.948462 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:24.949321 29116 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:24.952824 21315 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:24.954262 21468 raft_consensus.cc:2468] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:24.995307 21466 raft_consensus.cc:3060] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:13:24.961344 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 156909us
I20260709 13:13:24.962540 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:24.907706 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:24.973381 21318 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
W20260709 13:13:24.985467 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 168275us
I20260709 13:13:24.987497 21214 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:24.974457 29074 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:24.959301 29174 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.022827 22034 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:13:25.002846 29014 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:25.003165 29225 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:13:25.003261 21318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:25.004720 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:25.002206 21434 leader_election.cc:336] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 2.186s (SENT)
I20260709 13:13:25.009253 21320 raft_consensus.cc:1240] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:25.011896 21436 leader_election.cc:400] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Vote denied by peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701) with higher term. Message: Invalid argument: T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for earlier term 20. Current term is 21.
I20260709 13:13:25.032260 21318 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:25.016724 21214 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 20 to 21, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 21 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.018990 21312 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:25.026610 28898 consensus_queue.cc:1048] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:25.036060 29133 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:25.027078 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:25.037413 21314 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 14: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:25.036885 21214 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 13 to 15, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 15 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.026357 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:25.027197 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:25.039080 21214 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:25.040809 21436 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:25.044319 21318 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 25.
I20260709 13:13:25.046275 21434 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:25.049175 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 44576.7us
I20260709 13:13:25.052160 29231 consensus_queue.cc:1048] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:25.058159 29231 consensus_queue.cc:1048] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:13:25.061968 28901 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.057629 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:25.031642 29074 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.067281 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:25.068341 28886 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:25.068699 29074 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:25.043483 29014 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.070562 29103 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:25.071105 29014 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:25.024253 29116 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.022768 29174 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:25.031087 29194 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:25.027293 29111 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.077s
I20260709 13:13:25.046162 21214 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 10 to 15, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 15 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:25.081614 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.127275 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:25.156519 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 52385.6us
I20260709 13:13:25.124868 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.157550 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:25.157900 21462 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:25.158449 29138 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:25.107025 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:25.159721 29156 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:25.160756 28922 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:25.161110 28922 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:25.161250 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:25.125663 21467 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:13:25.161777 21321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
W20260709 13:13:25.162598 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 55688.1us
I20260709 13:13:25.163372 29229 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:25.160043 29074 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:25.148862 21320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a"
I20260709 13:13:25.162262 28922 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.107054 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.118134 21318 raft_consensus.cc:1240] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:25.121269 21315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:25.167513 21313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:25.184666 21313 raft_consensus.cc:2468] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:25.185829 21315 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 21.
I20260709 13:13:25.077214 21466 raft_consensus.cc:2468] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 25.
W20260709 13:13:25.088295 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.175140 21314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "058db415e9884ea0ba23f1e1ff59127a" is_pre_election: true
I20260709 13:13:25.175405 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:25.187866 21388 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 27.
I20260709 13:13:25.080246 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:25.117787 29130 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:13:25.168799 29238 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:25.194456 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:25.197119 21392 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:25.193782 21214 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 18 to 21, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 21 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.077301 29097 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:25.199466 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:25.200978 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 198812us
I20260709 13:13:25.121924 28901 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:25.124511 29133 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:25.208021 28560 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:25.209990 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.208014 21388 raft_consensus.cc:3060] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:25.156304 29103 consensus_queue.cc:1059] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:13:25.223455 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:25.224354 21392 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:13:25.225124 21390 raft_consensus.cc:1275] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:13:25.217569 21461 raft_consensus.cc:2955] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 8 to 15, VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:25.201884 29097 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.229709 21285 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:25.215240 21214 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 20, now has a pending config: VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194), VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195), VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 20 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:25.210162 28560 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.218079 29234 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.216848 29076 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
I20260709 13:13:25.252343 29097 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:25.227819 29135 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:25.190490 29194 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.278218 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:25.279642 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:25.280961 21214 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 18 to 23, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 23 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:25.283288 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 203118us
W20260709 13:13:25.288051 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.258703 29091 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:13:25.292954 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 80675us
I20260709 13:13:25.284334 29209 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election won for term 25
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:13:25.291071 28886 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:13:25.308066 22002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.820s (SENT) [suppressed 45 similar messages]
I20260709 13:13:25.292531 29231 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:25.309695 21469 raft_consensus.cc:1275] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:25.283459 29253 consensus_queue.cc:1059] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
I20260709 13:13:25.266707 29234 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.307219 21214 catalog_manager.cc:5697] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 20, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 20 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.273205 29076 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:25.329787 29246 log.cc:927] Time spent T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:25.330040 29076 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:25.331672 20199 tablet_server.cc:179] TabletServer@127.19.185.193:0 shutting down...
W20260709 13:13:25.327648 21359 connection.cc:256] RPC call timeout handler was delayed by -1.2841672700000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:13:25.332459 21359 connection.cc:256] RPC call timeout handler was delayed by -1.222067270000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 13:13:25.332749 21359 connection.cc:256] RPC call timeout handler was delayed by -1.1050672700000632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 13:13:25.333024 21359 connection.cc:256] RPC call timeout handler was delayed by -1.022267270000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 13:13:25.333736 21359 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:25.309780 29091 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 25 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:25.313585 29231 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.308420 29209 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.310518 28886 raft_consensus.cc:493] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:25.364421 21214 catalog_manager.cc:5697] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.326949 29206 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:25.368631 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 159236us
W20260709 13:13:25.369534 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 43652.9us
I20260709 13:13:25.370298 28886 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:13:25.325037 29135 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.381414 21362 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:25.383092 28922 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:25.383558 29249 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:25.384866 29247 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:25.386700 29256 raft_consensus.cc:3055] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:25.386400 29091 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.387115 29256 raft_consensus.cc:740] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:25.383409 29135 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:25.362896 29231 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:25.384371 29249 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.369503 29209 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:13:25.392444 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 183830us
I20260709 13:13:25.392637 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:25.393894 21214 catalog_manager.cc:5697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 24. New cstate: current_term: 24 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:25.395467 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 61886.5us
I20260709 13:13:25.375969 28898 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:13:25.401422 21214 catalog_manager.cc:5697] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 12 to 23, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 23 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:13:25.399616 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 91595.7us
I20260709 13:13:25.353358 29111 consensus_queue.cc:1059] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:13:25.383183 29112 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.430158 21214 catalog_manager.cc:5697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 4 to 16. New cstate: current_term: 16 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.396674 29014 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:25.380719 29074 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:13:25.425912 29076 raft_consensus.cc:3055] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:25.436407 21214 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 20, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 20 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:25.436550 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.437151 21359 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:25.437278 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:13:25.453760 21362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.430166 29116 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:25.456827 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.436987 29206 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:25.437036 29014 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.439417 29111 raft_consensus.cc:3055] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:13:25.464388 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 173776us
I20260709 13:13:25.466498 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:25.390774 29256 consensus_queue.cc:260] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.442768 29076 raft_consensus.cc:740] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:25.475605 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 96997.9us
I20260709 13:13:25.427834 29112 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.481724 21214 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 21 to 25, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 25 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.485540 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:25.465370 29206 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.485996 21214 catalog_manager.cc:5697] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:25.467860 29014 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:25.468313 29111 raft_consensus.cc:740] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:25.479282 29130 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:25.504983 21392 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:13:25.519506 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:25.487066 28898 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:25.480820 28560 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:25.529551 21214 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.500794 29206 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:25.538831 21214 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 20, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 20 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.487486 29021 consensus_queue.cc:1048] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:13:25.550761 29138 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:25.551252 29138 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:25.551640 29138 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:25.542384 29256 raft_consensus.cc:3060] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:25.556074 29182 consensus_queue.cc:1059] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.127s
W20260709 13:13:25.557293 29254 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:13:25.507484 29130 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:25.561059 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 52066.8us
I20260709 13:13:25.547183 21214 catalog_manager.cc:5697] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
W20260709 13:13:25.567490 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 133872us
I20260709 13:13:25.537052 28901 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.568593 21214 catalog_manager.cc:5697] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 20, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 20 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.542042 29194 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:25.576046 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 120607us
I20260709 13:13:25.583671 29133 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:25.566819 29074 raft_consensus.cc:3055] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:13:25.584612 29074 raft_consensus.cc:740] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:25.585590 29074 consensus_queue.cc:260] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:25.589807 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 198481us
I20260709 13:13:25.567330 29130 raft_consensus.cc:3060] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.537775 29116 consensus_queue.cc:1048] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
W20260709 13:13:25.610543 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.613732 21388 raft_consensus.cc:2468] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 25.
I20260709 13:13:25.625252 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.626834 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.627064 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.628002 21470 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:25.628115 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:25.629299 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.589610 29194 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:25.616261 21214 catalog_manager.cc:5697] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 7 to 11, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 11 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.594848 29112 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:25.644623 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 149667us
I20260709 13:13:25.647125 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.648196 21470 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 13:13:25.649025 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:25.649154 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.650425 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:25.650584 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:25.651214 21470 raft_consensus.cc:2410] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:13:25.589361 29255 consensus_queue.cc:1048] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:13:25.656809 29014 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.660301 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:25.662079 21462 raft_consensus.cc:1275] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:13:25.662410 29231 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.617683 28922 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.669148 28922 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.573503 29076 consensus_queue.cc:260] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.671655 29076 raft_consensus.cc:3060] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:25.679395 29231 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:25.681872 29249 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:25.684254 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:25.617537 29111 consensus_queue.cc:260] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.685854 29111 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:25.688326 21359 leader_election.cc:304] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:25.640628 29194 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:25.688267 21214 catalog_manager.cc:5697] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 6 to 10, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 10 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.692365 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:25.693017 21461 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:25.693689 29097 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.695776 29097 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:25.696579 21464 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 22.
I20260709 13:13:25.618886 28901 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:25.684513 21361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.699568 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 49066.1us
I20260709 13:13:25.685120 22034 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:13:25.700107 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.702309 21461 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
W20260709 13:13:25.708166 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.659840 29014 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:25.671826 28922 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:25.764528 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47003.3us
I20260709 13:13:25.712531 28560 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:13:25.773613 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.713876 29249 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:25.655625 28886 raft_consensus.cc:515] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.719082 29253 raft_consensus.cc:2749] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:25.770357 29091 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.684542 29209 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.795100 29261 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:25.796517 29258 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 13:13:25.797569 29258 consensus_queue.cc:1243] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:13:25.798190 29258 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:25.798552 29258 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:25.804711 29074 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:25.820825 29234 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:25.825325 28901 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:25.783412 29138 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:25.834733 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 190268us
I20260709 13:13:25.839051 21359 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:25.847606 29138 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:25.851692 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 87633.6us
I20260709 13:13:25.853025 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:25.856416 29112 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:25.789124 29091 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:25.859349 29260 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:25.861483 29091 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:25.868618 29260 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:25.855605 21434 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:25.916594 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 411474us
W20260709 13:13:25.917371 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 104851us
W20260709 13:13:25.904731 21362 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.777418 29255 consensus_queue.cc:1048] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:13:25.923032 21461 raft_consensus.cc:1275] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:13:25.923621 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:25.927394 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:25.923234 21362 leader_election.cc:336] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:25.929963 21362 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:25.936748 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:25.938282 21466 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:25.931824 21997 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:25.929757 22031 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:13:25.939345 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:25.940091 21395 raft_consensus.cc:2393] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 22: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:25.940016 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:25.941145 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 102203us
I20260709 13:13:25.791925 21360 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:25.936898 22034 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
W20260709 13:13:25.945722 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 153899us
I20260709 13:13:25.920410 28349 raft_consensus.cc:2749] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:13:25.946873 21362 leader_election.cc:336] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:25.949232 21362 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:25.942437 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:25.950222 21391 raft_consensus.cc:3060] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:25.929704 29234 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:25.959131 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:25.963205 21362 leader_election.cc:336] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:25.793542 29249 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:25.963929 21362 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:25.960932 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:25.942260 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.967231 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:25.799624 29258 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:25.971390 21362 leader_election.cc:336] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:25.972332 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 116836us
I20260709 13:13:25.974848 21362 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:25.920693 29253 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:13:25.948524 29256 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:25.960207 29135 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:13:25.986824 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61623.3us
I20260709 13:13:25.950894 29112 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:25.938462 29229 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 13:13:25.970788 29014 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:13:25.984442 21436 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:25.978096 29261 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:25.984267 22034 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 28 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 27. Current term is 28. Ops: []
I20260709 13:13:26.003352 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:26.004187 21468 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 24.
I20260709 13:13:25.972164 29091 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:13:25.993582 29267 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:13:25.998798 29280 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:26.049564 21466 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:25.966583 29206 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:26.046778 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 50268.9us
I20260709 13:13:25.993623 29158 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:26.017874 29258 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:26.001273 29256 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:26.000195 29194 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:26.024313 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:26.007161 29091 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.061921 21434 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:26.079101 21466 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
W20260709 13:13:26.071321 21285 connection.cc:256] RPC call timeout handler was delayed by -1.4439539640001158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:13:26.072139 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.022428 21461 raft_consensus.cc:1240] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:26.000454 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:26.091089 21359 leader_election.cc:400] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:13:26.091913 21359 leader_election.cc:403] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:26.058099 29158 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.096585 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:26.092713 21391 raft_consensus.cc:2468] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:26.061313 29112 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:26.062393 29275 raft_consensus.cc:2804] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:13:26.092890 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 92502.5us
W20260709 13:13:26.103327 21285 connection.cc:256] RPC call timeout handler was delayed by -1.438553964000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:13:26.110584 21463 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:26.081727 29091 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:13:26.110291 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2930446970000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:13:26.117091 21285 connection.cc:256] RPC call timeout handler was delayed by -1.2167083269999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:13:26.117411 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0327771520001079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:13:26.117738 21285 connection.cc:256] RPC call timeout handler was delayed by -1.0002539640000805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 13:13:26.125217 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.126070 21395 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:13:26.097510 28886 leader_election.cc:290] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 28 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:26.108469 29158 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:26.104919 28901 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:26.131910 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:26.137072 21466 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
W20260709 13:13:26.133813 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 54272.3us
I20260709 13:13:26.083297 29259 raft_consensus.cc:2764] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:13:26.159214 22002 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.055552 29280 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:26.139719 29277 log.cc:927] Time spent T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:13:26.170077 21395 raft_consensus.cc:2468] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 28.
I20260709 13:13:26.177210 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:26.143565 29111 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:26.178155 29278 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:13:26.177997 29111 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.172681 29135 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:26.172827 29261 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175) with higher term. Message: Invalid argument: T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for earlier term 19. Current term is 20.
I20260709 13:13:26.173380 21359 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:26.132550 29275 raft_consensus.cc:697] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 25 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:26.114166 29021 consensus_queue.cc:1048] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 13:13:26.112962 29112 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:26.192819 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 192488us
W20260709 13:13:26.195250 21285 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.542s (SENT)
W20260709 13:13:26.200984 21285 leader_election.cc:336] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.548s (SENT)
I20260709 13:13:26.201467 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:26.201717 29130 consensus_meta.cc:287] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.001s
I20260709 13:13:26.202208 29130 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.202472 29275 consensus_queue.cc:237] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.203241 29182 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:26.192370 28898 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:13:26.204456 28898 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:26.204829 28898 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:26.205571 21359 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:26.205685 28898 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.206799 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:26.207257 28898 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:26.208388 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49294us
I20260709 13:13:26.209069 29253 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:26.209750 29253 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:26.210345 29253 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:26.211445 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.212147 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.212590 21391 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:13:26.213074 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.213496 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.213950 21389 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 16.
I20260709 13:13:26.214042 21396 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:13:26.214907 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.215487 21393 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:26.216218 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.216470 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.215498 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.217657 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.217651 21389 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 26.
I20260709 13:13:26.220211 29231 raft_consensus.cc:2804] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:26.221855 29112 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:26.211373 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.222049 29130 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:26.226814 21395 raft_consensus.cc:2468] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:13:26.234264 21396 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:26.237044 29206 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:26.238610 29249 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:26.240581 21392 raft_consensus.cc:1240] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:26.244621 29280 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:26.180537 28901 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:26.245911 28901 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:26.249678 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.252249 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.219714 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.260075 21389 raft_consensus.cc:2368] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:26.182317 29111 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:26.265448 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 132153us
W20260709 13:13:26.272527 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 63428.7us
I20260709 13:13:26.273770 22002 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.279963 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.280921 21388 raft_consensus.cc:2368] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 21. Current term is 22.
I20260709 13:13:26.286995 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.300643 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.260910 29194 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:26.260076 29231 raft_consensus.cc:697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:26.304252 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.305263 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 53134.6us
I20260709 13:13:26.308578 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.308739 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.306941 22002 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:26.309343 21396 raft_consensus.cc:2368] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 24. Current term is 25.
I20260709 13:13:26.277714 29249 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:26.310999 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.309157 21997 leader_election.cc:304] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:26.279716 29130 consensus_queue.cc:1048] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:13:26.274756 29280 consensus_queue.cc:1048] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:13:26.311751 29021 raft_consensus.cc:2804] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:26.319283 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.353925 21391 raft_consensus.cc:2468] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:26.319802 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.320349 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.319904 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.320827 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.322235 21389 raft_consensus.cc:2468] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 14.
I20260709 13:13:26.324721 28886 raft_consensus.cc:2804] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:13:26.325665 29264 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:26.319296 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.359498 21393 raft_consensus.cc:2376] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18. Re-sending same reply.
I20260709 13:13:26.312249 29116 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:26.330422 21392 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19.
I20260709 13:13:26.341179 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:26.342835 29231 consensus_queue.cc:237] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.344000 29209 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:26.355724 21395 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:26.317941 29138 consensus_queue.cc:1048] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:13:26.357437 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 154726us
W20260709 13:13:26.369083 21436 leader_election.cc:336] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.358877 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.361346 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.367125 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.370182 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.378260 21391 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:26.371224 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.379665 21392 raft_consensus.cc:2393] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 26: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:26.379016 21389 raft_consensus.cc:2410] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 20 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:26.385728 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.373253 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.388000 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.388926 21395 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:26.374127 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:26.394912 21285 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.573s (SENT)
I20260709 13:13:26.395386 21396 raft_consensus.cc:2468] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
W20260709 13:13:26.367867 29284 log.cc:927] Time spent T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:13:26.373432 29292 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:26.398824 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:26.400626 21285 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.619s (SENT)
I20260709 13:13:26.401284 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.378470 21387 raft_consensus.cc:2376] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19. Re-sending same reply.
I20260709 13:13:26.402112 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.417501 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:26.412354 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 71336us
I20260709 13:13:26.397112 21388 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:26.413072 21393 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:26.418038 21389 raft_consensus.cc:2393] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:26.419032 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.378468 21394 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 26.
I20260709 13:13:26.360423 29021 raft_consensus.cc:697] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:26.413722 21436 leader_election.cc:336] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.420015 21395 raft_consensus.cc:2468] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:26.384251 29249 raft_consensus.cc:2764] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:13:26.421098 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.367108 28886 raft_consensus.cc:697] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 28 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:26.426049 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.423007 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:26.420953 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 111873us
I20260709 13:13:26.426614 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.428218 21396 raft_consensus.cc:2368] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 24. Current term is 25.
I20260709 13:13:26.427251 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.429524 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.430225 21387 raft_consensus.cc:2410] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 16.
W20260709 13:13:26.423658 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 112725us
W20260709 13:13:26.422134 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.431540 21395 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:26.432397 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.432996 21389 raft_consensus.cc:2468] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 22.
I20260709 13:13:26.433118 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.369889 29091 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.431665 21997 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:26.434978 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.436362 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:26.432124 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.429045 29209 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.366969 29135 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.442885 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.444418 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.444854 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.447882 29280 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:13:26.449038 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.449430 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 472234us
W20260709 13:13:26.450040 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.450593 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.451107 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.451596 21362 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:26.452437 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 51875.9us
I20260709 13:13:26.453190 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:26.453801 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.454267 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:26.455612 29182 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:26.456008 29182 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.456367 29182 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:26.460503 29209 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:26.461635 21396 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
W20260709 13:13:26.442298 21436 leader_election.cc:336] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.464408 21285 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:26.465122 21388 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:13:26.470175 21391 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
I20260709 13:13:26.470281 21394 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 24: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:13:26.472113 22002 leader_election.cc:336] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:26.472595 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.471297 29180 consensus_queue.cc:1059] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:13:26.473740 29249 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.003s
I20260709 13:13:26.422282 29292 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.482336 21391 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:26.487377 29281 raft_consensus.cc:2804] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:26.474669 29112 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:26.488075 29281 raft_consensus.cc:697] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:26.469113 29194 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:26.480811 21436 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.489405 21434 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:26.472071 29138 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:26.487823 29283 log.cc:927] Time spent T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.282s	user 0.004s	sys 0.000s
I20260709 13:13:26.474841 29021 consensus_queue.cc:237] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.478322 29074 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:26.514782 29282 log.cc:927] Time spent T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:13:26.517575 29250 raft_consensus.cc:2764] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 13:13:26.525391 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.525296 29281 consensus_queue.cc:237] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.528532 29182 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:26.516496 29259 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.529675 29255 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:26.534863 29234 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.480247 28886 consensus_queue.cc:237] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.557031 29234 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:26.552518 29255 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:26.570649 29255 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.548333 29138 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:26.537389 29280 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:26.538125 29091 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:26.540382 21997 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:26.546358 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.579417 29255 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:26.580374 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:26.581009 21466 raft_consensus.cc:3060] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:26.582427 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:26.582651 29252 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:26.583659 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:26.584442 21470 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 25: Already voted for candidate 058db415e9884ea0ba23f1e1ff59127a in this term.
I20260709 13:13:26.587917 29299 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:26.588582 29299 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.592447 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:26.548441 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 76397.9us
I20260709 13:13:26.555475 29259 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:26.595896 22002 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.601486 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:26.597477 21466 raft_consensus.cc:2468] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:13:26.600517 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.606452 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.607147 21396 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
W20260709 13:13:26.609804 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 145467us
I20260709 13:13:26.611166 29268 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:26.598830 21436 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.613428 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.613344 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.620016 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.620234 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.621273 21389 raft_consensus.cc:3060] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:26.621335 21396 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 26.
I20260709 13:13:26.583669 29264 raft_consensus.cc:2804] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:26.624506 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:26.625636 21396 raft_consensus.cc:2393] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
W20260709 13:13:26.614671 21436 leader_election.cc:336] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.559918 29234 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:26.635039 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 159240us
I20260709 13:13:26.646744 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.647737 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:26.660324 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64505us
I20260709 13:13:26.576267 29158 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.669943 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "077d2ef89a5347dc8b8e863085f1d4e2" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:26.623172 29116 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:26.661792 22002 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.678118 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:26.611768 29268 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:26.646546 29258 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.693874 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.715507 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:26.717200 21387 raft_consensus.cc:1240] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 13:13:26.719527 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:26.720120 21470 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:26.665174 29180 consensus_queue.cc:1059] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:13:26.680596 29209 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:26.692081 29091 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.731935 21389 raft_consensus.cc:2468] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
W20260709 13:13:26.738021 21285 leader_election.cc:336] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.661s (SENT)
I20260709 13:13:26.694959 29249 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:26.733006 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:26.748270 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.715056 29264 raft_consensus.cc:697] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:26.759187 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:26.759773 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.719424 29074 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:26.765717 21387 raft_consensus.cc:2376] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23. Re-sending same reply.
I20260709 13:13:26.768050 29130 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:13:26.779467 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.713821 29258 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:26.720068 29194 consensus_queue.cc:1059] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.048s
I20260709 13:13:26.764740 29180 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:26.800520 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 138746us
I20260709 13:13:26.796547 29264 consensus_queue.cc:237] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.805163 29194 raft_consensus.cc:3055] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:13:26.805721 29194 raft_consensus.cc:740] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:26.806756 29194 consensus_queue.cc:260] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.808830 29158 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:26.809832 29182 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:26.810562 29182 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.811061 29182 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.739130 29091 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:26.815119 29252 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:26.815845 29091 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:26.816597 29091 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:13:26.816699 29306 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:26.783478 29074 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:26.817906 29299 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:26.896128 21461 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
W20260709 13:13:26.899518 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 205678us
W20260709 13:13:26.907233 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 193666us
I20260709 13:13:26.910526 21433 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:26.930315 29280 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:26.926414 21434 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.942384 29280 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:26.944562 21360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.956359 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52086.4us
I20260709 13:13:26.973654 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:26.989116 29280 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:26.989717 29280 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.990092 29280 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:13:27.020826 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 59536.9us
I20260709 13:13:27.009574 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:26.764899 29249 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.030827 21470 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 23.
W20260709 13:13:27.048713 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 321917us
I20260709 13:13:27.017627 29194 raft_consensus.cc:3060] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:13:27.053428 21360 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:27.029629 29076 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:26.887215 29180 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.080391 29292 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:27.084687 29300 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:13:27.080260 29317 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:27.085192 29111 raft_consensus.cc:3055] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:27.085493 29074 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:27.089862 29309 log.cc:927] Time spent T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:13:27.093478 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:27.118014 21461 raft_consensus.cc:2393] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:27.101016 21285 leader_election.cc:336] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.665s (SENT)
I20260709 13:13:27.128623 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.098660 29111 raft_consensus.cc:740] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:27.091585 29076 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.162669 29074 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:27.156808 29135 raft_consensus.cc:2804] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:13:27.206532 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:27.152909 29312 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:27.165464 29259 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.160467 29250 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:27.102466 29317 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:27.242357 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 234641us
I20260709 13:13:27.243181 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:27.255548 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:27.272251 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 180453us
I20260709 13:13:27.198760 29268 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:27.284535 21285 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.738s (SENT)
I20260709 13:13:27.288779 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.290700 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.289717 22031 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
W20260709 13:13:27.292613 29314 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:13:27.274097 29301 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.271543 29259 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:13:27.250726 29135 raft_consensus.cc:697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:27.300657 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:13:27.305313 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 251951us
I20260709 13:13:27.288951 29294 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.288836 29074 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:27.308208 29255 consensus_meta.cc:287] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.001s
I20260709 13:13:27.302044 29182 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:27.344187 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 43621.2us
W20260709 13:13:27.344401 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 88969.3us
I20260709 13:13:27.364379 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.365640 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.306916 29301 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.349390 29158 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:27.349933 29334 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:27.303124 29259 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:27.351992 29135 consensus_queue.cc:237] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:27.356766 29331 log.cc:927] Time spent T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:13:27.360662 29303 log.cc:927] Time spent T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: Append to log took a long time: real 0.585s	user 0.000s	sys 0.003s
I20260709 13:13:27.362860 21394 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
W20260709 13:13:27.351325 29313 log.cc:927] Time spent T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:13:27.377578 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 302622us
W20260709 13:13:27.386633 21436 leader_election.cc:336] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.355444 29280 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.396831 29317 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:27.397656 29180 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:27.398274 29280 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:27.382560 21434 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:27.280320 29111 consensus_queue.cc:260] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:27.402525 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 129410us
I20260709 13:13:27.378255 29312 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:27.393873 29249 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:27.388110 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.377140 29334 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:27.431707 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 43653.3us
I20260709 13:13:27.434173 29322 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:13:27.383389 29259 raft_consensus.cc:3060] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:27.384862 29091 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:27.442723 29301 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.450248 29076 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.361498 29074 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.453773 29074 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.458173 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:27.461488 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:27.463358 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:27.464052 21393 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 13:13:27.464567 21396 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:13:27.465387 21469 raft_consensus.cc:1275] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 28 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 13:13:27.461606 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:27.471913 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:27.437065 21436 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.472761 22034 raft_consensus.cc:2393] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 17: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:27.472077 29112 raft_consensus.cc:3055] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:27.473701 29112 raft_consensus.cc:740] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:27.474588 29112 consensus_queue.cc:260] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.475675 29112 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:27.485049 29259 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.345428 29294 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.431945 29252 raft_consensus.cc:2804] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:27.438112 29334 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:27.501677 29324 log.cc:927] Time spent T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:13:27.504779 29111 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:27.506027 29259 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:27.506930 29252 raft_consensus.cc:697] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:27.505162 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 182246us
I20260709 13:13:27.523748 29255 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:27.524363 29255 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:27.527285 29116 consensus_meta.cc:287] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.001s
I20260709 13:13:27.527457 29255 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.527801 29116 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:27.512171 29231 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.011s
I20260709 13:13:27.528556 22038 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:27.528144 29255 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.531731 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3310) took 1103 ms. Trace:
I20260709 13:13:27.531605 29255 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.543512 21391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52936 (request call id 3309) took 1105 ms. Trace:
I20260709 13:13:27.532234 21390 rpcz_store.cc:276] 0709 13:13:26.428716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.522927 (+ 94211us) service_pool.cc:224] Handling call
0709 13:13:26.523281 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.523718 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:13:26.657270 (+133552us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.075656 (+418386us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.370498 (+294842us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:27.381939 (+ 11441us) log.cc:844] Serialized 26 byte log entry
0709 13:13:27.382681 (+   742us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:13:27.383181 (+   500us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.420298 (+ 37117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.420492 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.531501 (+111009us) raft_consensus.cc:1685] finished
0709 13:13:27.531524 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.531665 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73952,"prepare.queue_time_us":66778,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":5753,"raft.queue_time_us":329389,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":8478,"thread_start_us":736186,"threads_started":4,"wal-append.queue_time_us":679002}
I20260709 13:13:27.550838 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.545192 21391 rpcz_store.cc:276] 0709 13:13:26.428489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.503816 (+ 75327us) service_pool.cc:224] Handling call
0709 13:13:26.517210 (+ 13394us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:26.549100 (+ 31890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.549122 (+    22us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:26.575067 (+ 25945us) log.cc:844] Serialized 78 byte log entry
0709 13:13:26.740110 (+165043us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:27.050548 (+310438us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.533245 (+482697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.533319 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.533371 (+    52us) raft_consensus.cc:1685] finished
0709 13:13:27.533385 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.533522 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49553,"prepare.queue_time_us":300518,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":83592,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":78736,"thread_start_us":865405,"threads_started":3,"wal-append.queue_time_us":854885}
W20260709 13:13:27.593937 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 343846us
I20260709 13:13:27.543505 29299 consensus_queue.cc:1048] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.040s
I20260709 13:13:27.573048 29342 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.582068 28901 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:27.612864 29342 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.562606 29325 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 13:13:27.633879 22038 raft_consensus.cc:2468] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:27.647135 21387 raft_consensus.cc:1275] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:13:27.652691 21468 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:13:27.644896 21362 leader_election.cc:336] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.653700 21362 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:27.656342 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:27.656628 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:27.657621 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.657250 21467 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 28.
I20260709 13:13:27.661057 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:27.663125 22034 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 21. Current term is 22. Ops: []
W20260709 13:13:27.663195 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 175234us
W20260709 13:13:27.649493 29335 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:13:27.644165 29319 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:27.670708 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:27.671204 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:27.642184 29258 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:27.637061 29348 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:27.654088 28901 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:27.672279 21359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.658471 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:27.669448 21285 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.931s (SENT)
I20260709 13:13:27.673918 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:27.655169 29294 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.673431 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.677891 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.677933 22039 raft_consensus.cc:3060] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:27.659884 29261 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:13:27.677757 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:27.683379 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.672837 29328 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.689107 28560 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:13:27.689590 28560 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.689939 28560 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:13:27.692548 29348 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.695051 29348 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.698125 28560 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.701069 29328 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.702455 28560 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 29 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:27.703454 29328 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.680148 29319 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.716365 22039 raft_consensus.cc:2468] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:27.718885 29328 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:13:27.719964 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56098.2us
W20260709 13:13:27.721858 21285 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 2.154s (SENT)
I20260709 13:13:27.722415 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.723381 29328 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:27.633371 29252 consensus_queue.cc:237] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.726794 29342 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:27.725152 21285 leader_election.cc:336] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 1.982s (SENT)
W20260709 13:13:27.731099 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.739876 29021 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.744887 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:27.746810 21362 leader_election.cc:336] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:27.735247 29335 log.cc:927] Time spent T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:13:27.747695 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 63714.5us
I20260709 13:13:27.751549 22036 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Rejecting Update request from peer d41c71e861344f0b90e8d44a8d0a3173 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:27.752913 21462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56746 (request call id 3242) took 1217 ms. Trace:
I20260709 13:13:27.753274 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:27.754019 21470 raft_consensus.cc:3060] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:13:27.753284 21462 rpcz_store.cc:276] 0709 13:13:26.538969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.539094 (+   125us) service_pool.cc:224] Handling call
0709 13:13:26.604201 (+ 65107us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b5800004598. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f3a22 00007fc2c500cc09 00007fc2c4166ee0 00007fc2c42300ab 00007fc2c4230131 00007fc2c41f1fc0 00007fc2c41dc929 00007fc2c41dc3d2 00007fc2bd753bd4
0709 13:13:26.604425 (+   224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.622318 (+ 17893us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:26.659418 (+ 37100us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.124361 (+464943us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.124500 (+   139us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:27.157778 (+ 33278us) log.cc:844] Serialized 26 byte log entry
0709 13:13:27.157944 (+   166us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:27.158196 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.158421 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.183674 (+ 25253us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.443320 (+259646us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800076000. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:13:27.642768 (+199448us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b1800076000. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:13:27.752723 (+109955us) raft_consensus.cc:1685] finished
0709 13:13:27.752758 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.752864 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31844,"prepare.queue_time_us":46568,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":2634,"raft.queue_time_us":27136,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":24611,"spinlock_wait_cycles":98153856,"thread_start_us":367265,"threads_started":1,"wal-append.queue_time_us":634643}
I20260709 13:13:27.761778 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.762149 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.754098 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.763495 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.764969 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:27.766005 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.766336 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:27.766942 21436 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.769102 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.770390 29130 consensus_queue.cc:1048] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:13:27.772063 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.682227 29258 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:13:27.772490 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.773190 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:27.773831 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.682092 28901 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:27.772670 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:27.784188 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.795920 21467 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Rejecting Update request from peer bfcd9560f8f44414b25f8069384c5a73 for earlier term 22. Current term is 23. Ops: []
W20260709 13:13:27.781911 21362 leader_election.cc:336] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.797622 21362 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:27.798879 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.799892 21388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2596) took 1396 ms. Trace:
W20260709 13:13:27.796175 21436 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:27.807075 21362 leader_election.cc:336] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.811990 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:27.807493 21470 raft_consensus.cc:2468] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 29.
W20260709 13:13:27.808889 21436 leader_election.cc:336] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.811976 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.812510 22041 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:27.803016 21388 rpcz_store.cc:276] 0709 13:13:26.403148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.465927 (+ 62779us) service_pool.cc:224] Handling call
0709 13:13:26.466271 (+   344us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:26.479813 (+ 13542us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:26.515274 (+ 35461us) log.cc:844] Serialized 14 byte log entry
0709 13:13:26.660598 (+145324us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:26.661319 (+   721us) log.cc:844] Serialized 78 byte log entry
0709 13:13:26.661477 (+   158us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:26.777111 (+115634us) log.cc:844] Serialized 14 byte log entry
0709 13:13:26.895274 (+118163us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.069531 (+174257us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.201165 (+131634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.201246 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.354850 (+153604us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b48000b22d8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4141aa1 00007fc2c4138b37 00007fc2c41389ca 00007fc2c423026f 00007fc2c422ff37 00007fc2c424455c 00007fc2c4244508 00007fc2c4244488 00007fc2c4244443 00007fc2c42436ec 00007fc2c316da96
0709 13:13:27.760534 (+405684us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b2400285ae8. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bbfb19c4 00007fc2bbfafacb 00007fc2bc16adc9 00007fc2bc16aa55 00007fc2bc169fb0 00007fc2bede0488 00007fc2bede0be8 00007fc2bedb8398 00007fc2bedb376a 00007fc2bedb2bb6
0709 13:13:27.799672 (+ 39138us) raft_consensus.cc:1685] finished
0709 13:13:27.799702 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.799835 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":458032,"prepare.queue_time_us":609820,"prepare.run_cpu_time_us":211,"prepare.run_wall_time_us":81048,"raft.queue_time_us":251976,"raft.run_cpu_time_us":3395,"raft.run_wall_time_us":363865,"spinlock_wait_cycles":37230208,"thread_start_us":242719,"threads_started":3,"wal-append.queue_time_us":188012}
I20260709 13:13:27.814657 21360 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:27.814596 22035 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:13:27.796090 29255 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:27.810681 29342 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:27.816004 21436 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.826984 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:27.750083 29021 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:27.832684 21436 leader_election.cc:336] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.836445 29302 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:27.837289 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.837692 29021 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:27.838167 22042 raft_consensus.cc:2393] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 21: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:27.838491 22032 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
I20260709 13:13:27.838822 29345 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.839340 29345 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.841301 29319 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:27.817373 29294 raft_consensus.cc:2804] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:13:27.843829 21433 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:27.843466 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:27.845719 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 120592us
W20260709 13:13:27.833938 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:27.849149 21362 leader_election.cc:336] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.844259 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:27.850989 21362 leader_election.cc:336] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.842908 21388 raft_consensus.cc:1240] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 25. Current term is 26. Ops: []
I20260709 13:13:27.853632 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.854110 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:27.854303 22035 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:27.817370 29325 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:13:27.843051 29250 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:27.854864 21395 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:13:27.852077 21362 leader_election.cc:336] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:27.855737 21285 leader_election.cc:336] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 2.031s (SENT)
I20260709 13:13:27.866757 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:27.869851 21362 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.870566 21362 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:27.875459 21389 raft_consensus.cc:2468] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 26.
I20260709 13:13:27.855033 29294 raft_consensus.cc:697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 29 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:27.882409 21359 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:27.898458 21359 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:27.899933 21359 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:27.901052 21359 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:27.876362 29249 raft_consensus.cc:2804] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:27.905861 21359 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:27.859288 29334 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.880330 28901 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:27.909857 21359 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:27.897919 29342 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:13:27.902241 29182 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:27.901499 29255 raft_consensus.cc:2804] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:27.917776 21461 raft_consensus.cc:2368] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20.
I20260709 13:13:27.902422 29261 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:27.910812 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:27.905288 29348 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:27.932139 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:27.903219 29287 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:27.927171 21395 raft_consensus.cc:2468] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:27.929236 29255 raft_consensus.cc:697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
W20260709 13:13:27.930542 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 82948.4us
W20260709 13:13:27.935281 21285 leader_election.cc:336] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Timed out: RequestConsensusVote RPC to 127.19.185.194:41493 timed out after 2.051s (SENT)
I20260709 13:13:27.935820 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.913050 29349 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:27.912496 29249 raft_consensus.cc:697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:27.949234 21362 leader_election.cc:336] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:27.938323 29302 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:27.960218 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:27.962759 29280 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.963356 29280 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.963766 29334 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.964458 29334 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:27.964286 29294 consensus_queue.cc:237] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:27.964967 29334 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.965602 29280 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:27.966971 29334 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:27.967559 29334 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:27.972648 29249 consensus_queue.cc:237] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.942616 29182 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:27.975595 29182 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.941005 29350 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.976227 29182 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:27.941845 29351 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:27.982583 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.953266 29347 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:27.988834 29347 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.989275 29347 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:27.989431 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:27.953598 29302 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.990028 22034 raft_consensus.cc:3060] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:13:27.988708 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:27.986794 21436 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:27.991806 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 56566.1us
W20260709 13:13:27.993749 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.994141 21285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.967919 29334 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:27.996104 29334 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:27.995807 29111 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.997047 29111 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:27.998181 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:27.952129 29349 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:28.004519 21434 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:28.011690 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.011953 21434 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:27.991472 29302 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:28.016587 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:28.017303 21395 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:28.018366 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:28.021792 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:27.976492 29350 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.017786 29280 raft_consensus.cc:2804] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:13:28.021446 29369 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:13:28.007579 29328 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:28.011138 29349 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.026010 29368 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:28.028247 29351 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:28.030198 29250 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:28.032100 29348 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:28.010835 29268 consensus_queue.cc:1059] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:13:28.040470 22034 raft_consensus.cc:2468] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 20.
I20260709 13:13:28.011377 29111 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.053781 29348 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.044754 29368 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.093742 29294 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.094286 29349 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.087198 29351 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:28.021405 29255 consensus_queue.cc:237] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.085763 29328 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:28.090764 29368 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:28.119882 22041 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22.
W20260709 13:13:28.121336 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 89037.1us
I20260709 13:13:28.122515 21433 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:28.094390 29294 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:28.133185 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 129460us
I20260709 13:13:28.134033 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.120571 29328 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.126596 29268 raft_consensus.cc:2804] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:28.119707 29351 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:28.146519 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.183828 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 49859.3us
I20260709 13:13:28.129000 29280 raft_consensus.cc:697] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 26 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:28.189956 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.188550 29349 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.190717 29372 log.cc:927] Time spent T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.067s	user 0.002s	sys 0.003s
I20260709 13:13:28.186924 29111 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:28.193007 29249 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:28.193156 29268 raft_consensus.cc:697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:28.198571 29349 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.212455 29268 consensus_queue.cc:237] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.213356 29349 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.218353 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:28.219033 21389 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:13:28.224146 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:28.215276 29280 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.227751 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:28.232266 29348 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.232791 21394 raft_consensus.cc:1275] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:13:28.233752 29328 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.234457 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:28.234711 21470 raft_consensus.cc:1275] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:13:28.236755 21393 raft_consensus.cc:1275] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:13:28.237295 21285 leader_election.cc:400] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 24. Current term is 25.
I20260709 13:13:28.238194 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:28.239064 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:28.240269 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:28.235862 21394 raft_consensus.cc:1275] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:13:28.226959 29370 log.cc:927] Time spent T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:13:28.210546 29350 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.238241 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.203064 29369 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:28.252523 29292 consensus_queue.cc:1048] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:28.247629 29328 raft_consensus.cc:2804] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:28.253732 29328 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:28.254151 29328 raft_consensus.cc:3060] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:28.257362 29021 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:28.257800 29021 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:28.258646 29021 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.259841 29021 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:28.227509 29111 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:28.275480 22042 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:13:28.277187 29345 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.284296 29250 raft_consensus.cc:3055] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:13:28.284768 29250 raft_consensus.cc:740] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:28.285683 29250 consensus_queue.cc:260] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.287603 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.289206 29281 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.286113 28560 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:28.290071 22036 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:13:28.289945 28560 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.290971 29351 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.291541 29351 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:28.292166 28560 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.289166 29377 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:13:28.295045 29294 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.298236 29348 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.298451 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:28.298758 29348 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.299353 29334 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.300428 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:28.301222 29348 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.301115 29347 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:28.302481 29378 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:28.209003 29249 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.302757 29209 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:28.303478 29250 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:28.303956 29302 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.310359 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:28.310690 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:28.383415 22041 raft_consensus.cc:2376] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 22. Re-sending same reply.
I20260709 13:13:28.311517 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:28.312436 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 74280.5us
I20260709 13:13:28.263948 29368 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.289755 29281 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:28.328083 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.328528 29312 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:28.329922 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:28.401659 21461 raft_consensus.cc:2410] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 13:13:28.267431 29182 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.330751 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:28.332159 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:28.405287 21462 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 18: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:28.334442 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:28.336308 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:28.347476 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 73921.5us
W20260709 13:13:28.373718 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.405879 21392 raft_consensus.cc:1240] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:28.403357 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:28.405860 21469 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 24.
I20260709 13:13:28.418015 29182 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.425771 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:28.426463 21392 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:28.430104 29174 consensus_queue.cc:1059] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:28.423122 29368 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:28.431049 29174 raft_consensus.cc:3055] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:28.431458 29174 raft_consensus.cc:740] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:28.432060 21997 leader_election.cc:400] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20.
I20260709 13:13:28.432395 21997 leader_election.cc:403] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:28.440466 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.526s (SENT)
I20260709 13:13:28.441182 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:28.465723 22002 leader_election.cc:336] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 1.566s (SENT)
I20260709 13:13:28.426215 29374 raft_consensus.cc:2804] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:13:28.436357 21284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 165485us
I20260709 13:13:28.469777 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:28.468406 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:28.473399 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.467867 29318 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:28.484973 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:28.443936 29292 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 19. Current term is 20.
I20260709 13:13:28.494072 21392 raft_consensus.cc:2468] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:28.469386 29374 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:28.491626 21360 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:28.504745 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 119755us
W20260709 13:13:28.495795 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 112842us
I20260709 13:13:28.480751 29021 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:28.508158 29174 consensus_queue.cc:260] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.515713 29174 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:28.486115 29325 consensus_queue.cc:1048] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:13:28.517717 21360 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.518731 29348 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:28.517856 28560 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:13:28.522640 29379 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.523301 29379 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.526450 29379 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.528412 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:28.529906 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.533659 21436 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:28.534730 21436 leader_election.cc:336] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:28.535573 21436 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.535912 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.538090 29280 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:28.542503 29347 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.543716 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:28.428557 29369 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:28.550328 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:28.551504 21436 leader_election.cc:336] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.553714 29174 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:28.507853 29374 raft_consensus.cc:3060] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:28.554361 29174 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:28.560956 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.563648 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.561950 22041 raft_consensus.cc:2393] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 20: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:28.562320 21362 leader_election.cc:336] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.564630 21362 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:28.566416 29258 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:28.494657 29255 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:28.585875 29255 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.586294 29255 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:28.592257 21387 raft_consensus.cc:1275] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:13:28.592741 21434 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:28.593158 29334 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.594250 29158 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.594745 29158 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.595178 29268 raft_consensus.cc:2804] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:28.595913 29268 raft_consensus.cc:697] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:28.596993 29158 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:28.597172 29268 consensus_queue.cc:237] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.601625 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:28.608518 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:28.579246 29328 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.611119 29328 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.611801 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:28.613442 22034 raft_consensus.cc:2393] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f in current term 16: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
W20260709 13:13:28.613582 21436 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:28.579231 21362 leader_election.cc:336] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:28.618162 21362 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.618657 21362 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.585364 29280 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.620424 29280 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.621498 29342 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:28.560806 29021 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:28.623093 29280 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:28.623804 29383 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:13:28.625355 21362 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.625573 29281 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.626607 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.628402 29302 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:28.638154 21436 leader_election.cc:336] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.642968 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:28.628695 29374 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.630154 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:28.654719 22031 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:28.623090 29021 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:28.664826 21462 raft_consensus.cc:1275] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:13:28.665854 22032 raft_consensus.cc:1275] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:13:28.666078 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:28.668771 21467 raft_consensus.cc:1275] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:13:28.566668 29249 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:13:28.637460 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 164732us
I20260709 13:13:28.671698 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:28.672755 22032 raft_consensus.cc:2410] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33be1cb5cfc143fc90e164888c96cc6f for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:13:28.673344 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.673585 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.674419 29281 consensus_queue.cc:1048] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:13:28.643885 21390 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 26.
I20260709 13:13:28.650919 21388 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 16.
I20260709 13:13:28.675953 29234 consensus_queue.cc:1048] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:28.674801 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.677377 29250 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:28.678031 29130 consensus_queue.cc:1048] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:28.680047 29135 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.680791 29135 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.683106 29135 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.667912 21461 raft_consensus.cc:2410] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260709 13:13:28.647132 21362 leader_election.cc:336] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.685596 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:28.690032 21388 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:13:28.688676 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
W20260709 13:13:28.691674 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.689474 21362 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:28.694473 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 188927us
W20260709 13:13:28.700299 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53202.9us
W20260709 13:13:28.701442 21362 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.701803 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.654107 29209 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:28.704939 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:28.707019 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.707033 21434 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.705777 21462 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 16.
I20260709 13:13:28.693393 29351 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:13:28.703860 29344 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:28.703744 29349 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:28.726188 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.719246 29342 consensus_queue.cc:1048] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:13:28.715092 29377 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:28.713627 29194 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:13:28.734261 21436 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.735769 21436 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.706408 29294 consensus_queue.cc:1048] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:13:28.739161 22041 raft_consensus.cc:1275] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:28.741036 29332 consensus_queue.cc:1048] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:28.751853 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.756675 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:28.733893 29194 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.735850 29350 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:13:28.744181 29377 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:28.727020 29261 consensus_queue.cc:1048] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:13:28.763309 29376 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:28.764582 29319 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:28.766959 29302 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:28.765409 29194 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:13:28.787376 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.776655 29328 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.822358 29021 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.805274 29180 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.836669 22031 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
W20260709 13:13:28.838111 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 105185us
I20260709 13:13:28.839614 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:28.843748 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:28.840308 21284 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:28.838078 29174 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.860246 29381 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:13:28.872277 29021 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:28.847539 29180 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:28.875641 29180 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.893663 29182 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:28.827544 29328 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.854877 29374 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:28.904081 29182 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:28.906598 29182 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.894961 29302 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:28.910006 21362 leader_election.cc:336] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.849330 29351 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:13:28.910548 21362 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:28.911131 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 48029.4us
I20260709 13:13:28.917934 22031 raft_consensus.cc:1275] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:13:28.925614 29258 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:28.940485 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 96852us
I20260709 13:13:28.941339 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:28.941607 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.865958 29377 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:28.957029 29328 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:28.918927 29347 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:28.969884 22002 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Timed out: RequestConsensusVote RPC to 127.19.185.193:45701 timed out after 2.017s (SENT)
I20260709 13:13:28.971716 29328 raft_consensus.cc:2804] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:28.972137 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:28.972446 29328 raft_consensus.cc:697] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:28.973372 29328 consensus_queue.cc:237] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:28.975522 21436 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:28.980859 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:28.933008 29174 consensus_queue.cc:1048] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:13:28.962205 29312 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.997876 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.961028 29194 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:29.009168 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 67904.3us
I20260709 13:13:29.014161 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.013542 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.025683 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:29.026453 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:29.015231 29368 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:29.006093 29292 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:29.044540 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:29.045240 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.048202 21387 raft_consensus.cc:2393] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 23: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:29.048789 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.050791 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.051245 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.051860 21395 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:29.052985 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.053757 21389 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:29.053782 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.054555 21391 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 26.
I20260709 13:13:29.063033 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.038757 29351 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:29.070011 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.021952 29312 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.063735 21394 raft_consensus.cc:2376] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 19. Re-sending same reply.
I20260709 13:13:29.073426 21393 raft_consensus.cc:2393] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 14: Already voted for candidate bfcd9560f8f44414b25f8069384c5a73 in this term.
I20260709 13:13:29.078181 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.081348 29374 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:29.081928 29374 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:29.082693 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.083459 21394 raft_consensus.cc:2393] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 26: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:29.083941 29302 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:29.084522 29302 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:29.092325 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 397070us
I20260709 13:13:29.093597 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:29.094327 29021 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:29.094732 29021 raft_consensus.cc:493] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.095059 29021 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.095327 29194 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:29.096179 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.097522 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.098610 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.099635 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.100720 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.100978 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.102571 29021 raft_consensus.cc:515] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:29.104672 29021 leader_election.cc:290] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:29.108201 29387 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.215s	user 0.001s	sys 0.003s
I20260709 13:13:29.102111 21387 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:13:29.072997 29384 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:29.130635 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
W20260709 13:13:29.131592 29396 log.cc:927] Time spent T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:13:29.134133 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:29.138649 29392 log.cc:927] Time spent T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.258s	user 0.003s	sys 0.000s
I20260709 13:13:29.141631 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.147332 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.147961 21390 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:29.125270 29390 log.cc:927] Time spent T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:29.158438 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b73223e6ab497f810757f895658e8b" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:29.157526 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:29.159107 21389 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:29.161082 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:29.162169 29182 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.162935 29182 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:29.077616 29255 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.075299 29351 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.205247 21389 raft_consensus.cc:2468] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 17.
I20260709 13:13:29.156653 29384 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:29.206293 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43504.2us
I20260709 13:13:29.230948 29351 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:29.230832 29349 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:29.249877 29255 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:29.250540 29182 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:29.238126 29349 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.267675 29280 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.291108 29302 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:29.296675 29384 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:29.298939 29349 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:29.301644 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:29.303165 22036 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:29.305244 29312 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:29.318852 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:29.318991 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:29.321543 29403 log.cc:927] Time spent T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:13:29.282987 29280 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.326723 21390 raft_consensus.cc:2468] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
W20260709 13:13:29.332238 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.353073 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:29.377714 21997 leader_election.cc:304] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:29.340067 29302 consensus_queue.cc:1059] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
W20260709 13:13:29.372644 29402 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:13:29.383891 21436 leader_election.cc:336] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:29.426376 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:29.427577 29302 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:29.432610 29280 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:29.389588 29317 raft_consensus.cc:2804] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:29.439158 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:29.442710 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:29.443495 21467 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:13:29.471983 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.515260 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 133590us
I20260709 13:13:29.517771 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:29.528517 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 78666.6us
I20260709 13:13:29.530964 21461 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 24: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:29.528546 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 100578us
I20260709 13:13:29.532584 21997 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:29.537900 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:29.540185 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:29.544306 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:29.548996 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.519187 29317 raft_consensus.cc:697] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:29.544916 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.553366 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:29.544340 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.555567 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.532187 29302 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:29.536110 29413 raft_consensus.cc:2804] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:13:29.590453 22002 leader_election.cc:336] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:29.575749 29021 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:29.540010 29384 consensus_queue.cc:1059] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:13:29.583364 29302 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:29.594266 29317 consensus_queue.cc:237] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:29.624747 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 86299.4us
I20260709 13:13:29.628813 22041 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:13:29.659523 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 90966us
I20260709 13:13:29.614215 29351 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:29.628751 29381 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:29.741756 21467 raft_consensus.cc:2468] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 25.
I20260709 13:13:29.713757 29423 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.688825 29351 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.690595 29381 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.744246 29413 raft_consensus.cc:697] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:29.750142 29423 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.775379 29423 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:29.751147 29374 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:29.747043 29302 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:29.803968 29374 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:29.848776 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 101509us
I20260709 13:13:29.848776 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.845185 29424 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.849797 29425 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:29.888586 29425 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:29.864324 29413 consensus_queue.cc:237] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:29.891538 29425 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:29.851517 29430 raft_consensus.cc:493] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:29.892401 29430 raft_consensus.cc:515] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:29.894984 29430 leader_election.cc:290] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:29.896580 29428 log.cc:927] Time spent T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:13:29.897818 29381 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:29.855926 29424 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:29.907195 29424 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:29.887835 29351 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:29.885766 29436 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:29.850402 29374 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:29.924546 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 67707.2us
I20260709 13:13:29.925498 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:29.915746 29381 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:29.928392 29427 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:13:29.928290 21285 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.930420 21285 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.930606 29435 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:29.931279 29425 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:29.932971 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.935947 29425 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:13:29.936390 29436 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:13:29.936854 29436 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.936599 21285 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.926620 29302 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:29.937953 29425 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:29.938315 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.940392 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.940861 29379 raft_consensus.cc:3055] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:29.941188 29425 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:29.941321 29379 raft_consensus.cc:740] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:29.941484 29435 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:29.942487 29379 consensus_queue.cc:260] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.943931 29379 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:29.946125 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:29.946934 21388 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:13:29.947949 29410 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.627s	user 0.006s	sys 0.025s
W20260709 13:13:29.954073 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.957657 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.952816 21391 raft_consensus.cc:1275] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:13:29.959151 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.965358 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:29.966459 21388 raft_consensus.cc:2468] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 27.
I20260709 13:13:29.967162 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:29.954101 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 340951us
I20260709 13:13:29.968227 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:29.968873 21389 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 18.
I20260709 13:13:29.974582 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.969709 21360 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:29.985512 21393 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:13:29.937322 29436 raft_consensus.cc:3060] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:13:29.990106 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:30.002930 29351 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:13:29.994128 29435 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:30.004429 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:29.951046 29302 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:30.016844 21997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.928396 29381 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:29.997478 29423 raft_consensus.cc:2804] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:13:29.983843 29425 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
W20260709 13:13:30.051777 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 47443.1us
I20260709 13:13:30.037818 29423 raft_consensus.cc:697] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:30.059298 21461 raft_consensus.cc:1240] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:30.060745 21466 raft_consensus.cc:1240] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:30.062074 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.065939 21470 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:13:30.071921 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:30.073524 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.073812 29334 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.074462 29334 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.076457 29280 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.077122 29280 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.079327 29280 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:30.080844 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.085769 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.094861 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.095973 21468 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 27: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:30.098835 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.099421 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:30.049233 29373 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.103051 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.103777 21469 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 23.
I20260709 13:13:30.057613 29435 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:30.067744 29312 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.067898 29374 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.111521 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.117879 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:30.119280 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e50669ee6e496d9e5aaf0b2cc43c1c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.120673 29422 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:30.121021 28560 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.121272 29422 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.121591 28560 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:30.122426 29437 log.cc:927] Time spent T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:13:30.123518 29422 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.103567 29436 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.126129 29436 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 27 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.110736 29302 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.117070 29312 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.109368 29373 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.130506 21463 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 17.
I20260709 13:13:30.130903 29373 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:30.121670 29438 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:13:30.138053 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:30.139065 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 77695.4us
I20260709 13:13:30.142858 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:30.141784 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.144007 21464 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 24.
I20260709 13:13:30.123862 28560 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.157572 21467 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:30.151364 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97678.7us
I20260709 13:13:30.160928 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.163648 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.165592 21434 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:30.147320 29423 consensus_queue.cc:237] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.168452 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:30.169756 29444 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:30.170217 29444 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.170588 29444 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:30.175143 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.180521 21285 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.187951 29445 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:30.199050 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.192417 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.174898 29174 raft_consensus.cc:2804] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:13:30.167021 29441 consensus_queue.cc:1048] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:13:30.177074 29312 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:30.215829 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.189106 29379 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:30.227650 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.198017 29334 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:30.230717 29334 raft_consensus.cc:493] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:30.231280 29334 raft_consensus.cc:515] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.199616 29351 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:30.232726 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.233996 21461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.234615 29334 leader_election.cc:290] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:30.235111 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:30.236125 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.238062 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.240921 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.211125 29441 consensus_queue.cc:1243] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer d41c71e861344f0b90e8d44a8d0a3173 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:13:30.247746 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.249106 21468 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 26.
I20260709 13:13:30.251164 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:30.214862 29436 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.215319 29374 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:30.226327 29425 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.214727 21467 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:30.228621 29445 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:13:30.239516 29312 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:30.259620 21465 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:30.203980 29446 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:13:30.251988 29328 raft_consensus.cc:3055] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:30.266208 29328 raft_consensus.cc:740] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:30.250310 29351 raft_consensus.cc:3060] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:30.267095 29328 consensus_queue.cc:260] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.274370 21360 leader_election.cc:304] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:30.278105 28560 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:30.278843 29258 raft_consensus.cc:2749] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:30.278656 28560 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.280624 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:30.282205 22032 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:30.253886 29174 raft_consensus.cc:697] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:30.285579 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.287238 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.285181 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:30.254405 29256 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:30.291798 29256 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.260428 29425 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.257059 29379 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:30.288923 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.289873 21389 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:30.291242 29345 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:13:30.290530 22036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:30.299885 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.298264 22036 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:13:30.301107 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.295473 29456 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:30.303059 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:30.302983 29456 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.307169 29413 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:30.307607 29413 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:30.309171 29450 log.cc:927] Time spent T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:30.307948 29413 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:30.280788 29312 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.294165 29425 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.332047 29409 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:30.258222 29436 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.337620 21468 raft_consensus.cc:3055] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:30.341382 21468 raft_consensus.cc:740] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:30.260083 29374 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.298038 29345 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.323810 29312 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:30.331688 29456 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:30.358003 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.363385 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:30.364372 21390 raft_consensus.cc:2393] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 27: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:30.365935 21390 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:13:30.371063 29374 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.371541 21391 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:30.342717 29441 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:13:30.373473 29441 consensus_queue.cc:1243] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 17.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:13:30.373925 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.373502 21391 raft_consensus.cc:1275] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:13:30.377457 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.379395 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.379969 21392 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:30.382046 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.355652 29345 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:13:30.343139 29409 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.392413 29436 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.361862 29350 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.407627 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.393929 29409 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.429491 21392 pending_rounds.cc:85] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Aborting all ops after (but not including) 12
I20260709 13:13:30.429852 21392 pending_rounds.cc:107] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:13:30.430096 21392 raft_consensus.cc:2889] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:30.439189 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 161679us
W20260709 13:13:30.440367 21436 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 160 similar messages]
W20260709 13:13:30.451817 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 200724us
W20260709 13:13:30.450898 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:30.457647 21285 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:30.437680 29425 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:30.437767 29374 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:30.464855 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.415552 29444 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.466725 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.466846 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:30.463851 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:30.473618 21436 leader_election.cc:336] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:30.470337 29332 consensus_queue.cc:1059] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:13:30.459733 29405 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:13:30.480003 29424 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:30.470136 29435 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:30.472431 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:30.410580 29350 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.407091 29174 consensus_queue.cc:237] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.530336 21396 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
I20260709 13:13:30.489436 29456 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:30.535686 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce267b84e93f48afa7ad5caa450b982a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:30.535748 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68976.5us
I20260709 13:13:30.471163 29374 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.541430 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.519173 29258 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:30.484642 29424 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.481070 29425 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:30.561985 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 109973us
I20260709 13:13:30.481776 29442 consensus_queue.cc:1048] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:13:30.563359 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.540135 29456 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.542433 29405 raft_consensus.cc:3060] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:30.564736 29258 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.585963 29345 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.588243 29469 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:30.589892 29350 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:30.593077 21393 raft_consensus.cc:2368] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 26. Current term is 27.
I20260709 13:13:30.595681 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.577045 29456 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:30.576169 29468 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:30.601220 21285 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:30.567255 29443 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:30.601289 21359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 43795.5us
I20260709 13:13:30.606097 29471 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:30.609288 29444 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:30.610513 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.611303 29467 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:30.611698 29467 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.612139 29467 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:30.614595 29258 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.616149 29351 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:30.604619 21436 leader_election.cc:336] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:30.618481 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:30.599366 29312 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:30.629077 29312 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.631345 29312 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:30.627861 29460 log.cc:927] Time spent T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:13:30.603777 29435 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:13:30.640985 21463 raft_consensus.cc:1240] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:30.622854 29442 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:30.644822 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:30.646451 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:30.646848 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:30.651012 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:30.652395 22038 raft_consensus.cc:2410] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260709 13:13:30.653364 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.649150 22034 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:30.654496 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:30.655076 21392 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:30.611716 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:30.649400 29419 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.013s	sys 0.029s
I20260709 13:13:30.617556 29468 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:30.670360 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 58718.3us
I20260709 13:13:30.691309 21392 raft_consensus.cc:2468] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 19.
I20260709 13:13:30.649919 29345 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:30.694939 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43979.6us
W20260709 13:13:30.674557 29419 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.014s	sys 0.029s
I20260709 13:13:30.657388 29373 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:30.680105 29351 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:30.709836 29373 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.684293 29435 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 13:13:30.720512 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 67896us
I20260709 13:13:30.726258 29424 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:30.720497 29373 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:30.704010 29443 consensus_queue.cc:1059] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:13:30.732867 29443 consensus_queue.cc:1243] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer 33be1cb5cfc143fc90e164888c96cc6f log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:13:30.733652 29458 raft_consensus.cc:3055] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:30.734086 29458 raft_consensus.cc:740] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:30.753548 29468 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.787760 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.788058 21463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.788688 21392 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:30.789417 22002 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:30.789884 22002 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:30.790333 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.791597 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.792550 21461 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:13:30.792898 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.793534 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.794137 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:30.796512 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.797879 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.800675 29458 consensus_queue.cc:260] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.802906 29458 raft_consensus.cc:3060] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:30.795848 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.804418 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:30.806137 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 247446us
I20260709 13:13:30.807511 21463 raft_consensus.cc:2393] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 19: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:30.803917 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:30.808960 21462 raft_consensus.cc:2468] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
W20260709 13:13:30.821336 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:30.822103 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:30.821811 29373 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:30.822789 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:30.823408 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:30.824069 29373 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:30.824262 29429 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:30.825445 29413 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:13:30.826169 29413 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:30.840512 22002 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:30.843207 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:30.853075 29467 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.855310 29467 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.859292 21468 consensus_queue.cc:260] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.16, Last appended by leader: 16, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.860422 21468 raft_consensus.cc:3060] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:30.846585 22002 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:30.865348 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:30.888056 29381 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.893890 29256 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.862599 29405 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:30.897248 29413 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:30.913735 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 48458.9us
W20260709 13:13:30.924535 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:30.918007 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 207632us
W20260709 13:13:30.922158 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 178045us
I20260709 13:13:30.928085 21433 leader_election.cc:304] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:30.928771 22002 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:30.929165 21468 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 17 index: 16. (term mismatch)
I20260709 13:13:30.929678 21468 pending_rounds.cc:85] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Aborting all ops after (but not including) 15
I20260709 13:13:30.929996 21468 pending_rounds.cc:107] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Aborting uncommitted NO_OP operation due to leader change: 16.16
I20260709 13:13:30.930321 21468 raft_consensus.cc:2889] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:30.933362 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:30.926040 29334 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
W20260709 13:13:30.925192 29423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.002s	sys 0.010s
W20260709 13:13:30.934408 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:30.935858 29441 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:13:30.942725 29334 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.957180 29334 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:30.942399 29423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.003s	sys 0.010s
I20260709 13:13:30.930300 29456 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:30.946055 29345 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:30.959501 29345 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.963207 21387 raft_consensus.cc:1240] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 25. Ops: []
I20260709 13:13:30.965755 29456 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:30.946436 29256 raft_consensus.cc:493] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:30.974529 29256 raft_consensus.cc:515] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:30.935181 29446 raft_consensus.cc:2749] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:30.978863 28560 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:30.989804 29454 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:30.990463 29454 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.036474 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:31.037997 21394 raft_consensus.cc:1275] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:13:31.043162 29413 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:31.069628 21394 raft_consensus.cc:1275] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
W20260709 13:13:31.145543 29461 log.cc:927] Time spent T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.603s	user 0.003s	sys 0.000s
W20260709 13:13:31.213227 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.220969 29374 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:31.251740 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 682763us
I20260709 13:13:31.263020 29345 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:31.287904 29454 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:31.297019 29454 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.297578 29454 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.304745 29454 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:31.315542 21388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.009s	sys 0.012s
W20260709 13:13:31.321101 21388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.010s	sys 0.013s
I20260709 13:13:31.375123 29256 leader_election.cc:290] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:31.393626 29328 raft_consensus.cc:3060] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:31.422744 21390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52946 (request call id 2635) took 1055 ms. Trace:
I20260709 13:13:31.423319 21390 rpcz_store.cc:276] 0709 13:13:30.367185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.367320 (+   135us) service_pool.cc:224] Handling call
0709 13:13:30.367573 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.367757 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:13:30.368081 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:13:30.450869 (+ 82788us) log.cc:844] Serialized 14 byte log entry
0709 13:13:30.590027 (+139158us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b1800027d00. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:13:30.878955 (+288928us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b1800027d00. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b3f3 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:13:31.403313 (+524358us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b1800027d00. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc10de07 00007fc2c4f68ab9 00007fc2bc12a69b 00007fc2bc12893f 00007fc2bc128455 00007fc2bf210060 00007fc2bf222716 00007fc2bf233287 00007fc2bf233208
0709 13:13:31.422128 (+ 18815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:31.422186 (+    58us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:31.422235 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.422538 (+   303us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.422682 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6819,"prepare.queue_time_us":334,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":7939,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":14728,"spinlock_wait_cycles":26995200,"thread_start_us":99943,"threads_started":2,"wal-append.queue_time_us":102382}
W20260709 13:13:31.446100 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 512777us
I20260709 13:13:31.453018 22042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:31.453667 22042 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:13:31.453022 29425 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:31.456791 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:31.457234 22041 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: [16.16-16.16]
I20260709 13:13:31.458319 29482 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:31.461544 29482 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.463785 29482 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:31.466229 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.469018 29182 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:31.469580 29182 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.472741 29268 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:31.473160 29268 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:31.473507 29268 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:31.474126 22042 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:31.466284 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.528877 29347 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:31.530277 29347 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.538615 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:31.538628 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:31.542126 29347 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:31.528259 29182 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:31.543556 21362 leader_election.cc:336] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:31.548588 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:31.551374 21362 leader_election.cc:336] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:31.551862 21362 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:31.556470 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:31.557077 29347 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:31.561029 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:31.560539 22041 raft_consensus.cc:1240] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
W20260709 13:13:31.565937 29481 log.cc:927] Time spent T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.741s	user 0.000s	sys 0.004s
I20260709 13:13:31.568822 22031 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: []
I20260709 13:13:31.571343 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:31.570201 21362 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:31.574046 21362 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:31.551190 29268 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.574827 29482 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:13:31.575361 21362 leader_election.cc:336] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:31.575817 21362 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:31.576876 21362 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:31.578611 29482 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:31.588104 21362 leader_election.cc:336] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:31.588891 21362 leader_election.cc:336] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:31.581714 29268 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:31.598289 29347 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:31.599606 29433 consensus_queue.cc:1048] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:31.600950 29318 consensus_queue.cc:1048] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:13:31.616367 21362 leader_election.cc:336] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:31.618772 21362 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:31.622303 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:31.629763 29425 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:31.629673 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 163522us
I20260709 13:13:31.631121 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.632268 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:31.628202 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:31.636795 21284 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.637228 29467 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.643338 29467 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.645462 29467 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:31.637939 21287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.638236 29471 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.646005 21219 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 15 to 17, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 17 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:31.646850 29471 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.648979 29471 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:31.633244 29425 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:31.640538 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.641106 29494 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:31.655136 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.657207 29386 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:31.657779 29386 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.659897 29386 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:31.663326 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:31.665058 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.663965 21468 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:31.674806 21468 raft_consensus.cc:2468] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 24.
W20260709 13:13:31.659889 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 729155us
I20260709 13:13:31.681108 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.671805 29494 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:31.681288 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.650113 21219 catalog_manager.cc:5697] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 9 to 20. New cstate: current_term: 20 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:31.689015 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:31.678722 21434 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:31.694260 21465 raft_consensus.cc:2393] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 24: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:13:31.635332 21362 leader_election.cc:336] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:31.703076 29471 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:31.715106 21393 raft_consensus.cc:1240] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Rejecting Update request from peer 33be1cb5cfc143fc90e164888c96cc6f for earlier term 16. Current term is 17. Ops: [16.16-16.16]
I20260709 13:13:31.705910 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2d5354d62e4be08f444a5f6556b8dc" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.706967 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.707561 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.708532 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:31.717242 21467 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:13:31.717415 21285 leader_election.cc:400] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 26. Current term is 27.
I20260709 13:13:31.718014 21285 leader_election.cc:403] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:31.718699 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.720389 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:31.721078 21465 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:31.721879 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:31.722299 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.712663 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffab1617f544c36913eb55e6bad723c" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:31.722998 21390 raft_consensus.cc:3060] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:31.722453 21394 raft_consensus.cc:3060] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:31.723659 21469 raft_consensus.cc:1240] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:31.724812 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.696431 21362 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:31.676884 29445 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:31.730726 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 95846.9us
I20260709 13:13:31.752755 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.731556 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849cad40897e412da9a737986240fc35" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:31.763541 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.779498 21467 raft_consensus.cc:2468] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41c71e861344f0b90e8d44a8d0a3173 in term 27.
I20260709 13:13:31.726758 29194 raft_consensus.cc:2804] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:31.726689 29494 raft_consensus.cc:3060] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:13:31.726850 29328 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:31.727262 29425 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.860472 29425 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.863368 29425 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:31.708128 29467 consensus_queue.cc:1059] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 13:13:31.732200 29477 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:31.796684 21390 raft_consensus.cc:2468] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 24.
I20260709 13:13:31.748739 29490 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:31.865823 29490 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.800459 21465 raft_consensus.cc:1275] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:13:31.791275 29424 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:31.872473 29424 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.760447 29445 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.877696 29445 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:31.779939 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.833786 29319 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:31.879078 29319 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.879848 29424 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:31.858438 29328 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.901777 29328 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:31.880350 29268 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.902531 29268 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.880849 29194 raft_consensus.cc:697] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:31.905032 29194 consensus_queue.cc:237] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.812469 29480 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:31.908299 29480 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.910554 29480 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:31.856350 29471 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.881280 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:31.913363 29471 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.843896 21394 raft_consensus.cc:2468] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:13:31.912986 29268 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:31.915594 29471 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:31.918861 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:31.922219 21434 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:31.864269 29477 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.882318 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:31.923070 29268 raft_consensus.cc:2804] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:13:31.891126 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:31.923833 29268 raft_consensus.cc:697] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 24 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:31.892973 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:31.891872 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:31.924751 29477 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:31.893770 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:31.897305 29475 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:31.926273 29475 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:31.881683 29319 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:31.924237 21391 raft_consensus.cc:2393] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:31.895875 29490 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:31.930583 29475 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:31.931989 29268 consensus_queue.cc:237] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:31.933863 21219 catalog_manager.cc:5697] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 21 to 23, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 23 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.935844 21219 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.958022 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:31.959312 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:31.964143 21360 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:31.968111 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 188296us
I20260709 13:13:31.968896 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.971545 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.973853 21219 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:31.975258 21219 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 12 to 14, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 14 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.978075 21219 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 13 to 15, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 15 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.996595 21433 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.986855 21997 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:32.005300 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.970706 29467 consensus_queue.cc:1243] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer bfcd9560f8f44414b25f8069384c5a73 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:13:31.971666 29182 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:32.018491 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.019670 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.983151 29434 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.021270 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:31.983546 29471 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:32.015273 29425 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.024920 29318 raft_consensus.cc:2804] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:13:32.025266 29425 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.025753 29318 raft_consensus.cc:697] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 24 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:32.026906 29318 consensus_queue.cc:237] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.027956 29458 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:13:32.022377 29302 raft_consensus.cc:2804] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:32.030541 29302 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:32.030755 29261 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:32.031107 29302 raft_consensus.cc:3060] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:32.016395 29468 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:13:32.008526 29374 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.033274 29374 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.006389 29351 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:32.023608 29379 raft_consensus.cc:3060] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:32.039721 29374 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.029021 29347 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:32.041719 29347 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.045909 29347 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.041146 29425 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.002439 29480 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:32.053061 29445 raft_consensus.cc:3055] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:32.053553 29445 raft_consensus.cc:740] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:32.054417 29445 consensus_queue.cc:260] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.055656 29445 raft_consensus.cc:3060] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:32.062801 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:32.028921 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.043751 29494 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493) with higher term. Message: Invalid argument: T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a for earlier term 26. Current term is 27.
I20260709 13:13:32.066342 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.066609 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.067344 21462 raft_consensus.cc:2393] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 058db415e9884ea0ba23f1e1ff59127a in current term 25: Already voted for candidate d41c71e861344f0b90e8d44a8d0a3173 in this term.
I20260709 13:13:32.066380 29182 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:32.070479 21436 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.080327 21436 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.071285 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 50130.2us
W20260709 13:13:32.088375 21436 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.089083 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:32.061709 29434 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.023836 29467 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:32.094393 21436 leader_election.cc:336] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:32.114866 21436 leader_election.cc:336] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.115516 21436 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.090240 21219 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 15 to 17, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 17 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.127585 21462 raft_consensus.cc:1240] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Rejecting Update request from peer 058db415e9884ea0ba23f1e1ff59127a for earlier term 23. Current term is 24. Ops: [23.16-23.16]
W20260709 13:13:32.134344 21436 leader_election.cc:336] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.134920 21436 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.160827 21436 leader_election.cc:336] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.095573 29480 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:13:32.132642 29487 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:32.165081 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.165890 21285 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:32.136184 29490 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:32.162086 21436 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.166819 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:32.167279 21214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 290) took 16821 ms (client timeout 15000 ms). Trace:
I20260709 13:13:32.070871 29436 consensus_queue.cc:1059] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:13:32.166141 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:32.172043 21417 debug-util.cc:398] Leaking SignalData structure 0x7b080008e060 after lost signal to thread 20202
I20260709 13:13:32.173364 29434 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.173806 29374 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:32.161185 29328 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:32.186919 21417 debug-util.cc:398] Leaking SignalData structure 0x7b0800228480 after lost signal to thread 21253
W20260709 13:13:32.191311 21417 debug-util.cc:398] Leaking SignalData structure 0x7b0800329720 after lost signal to thread 21345
W20260709 13:13:32.191733 21417 debug-util.cc:398] Leaking SignalData structure 0x7b0800267620 after lost signal to thread 21346
W20260709 13:13:32.192955 21417 debug-util.cc:398] Leaking SignalData structure 0x7b0800343c60 after lost signal to thread 21420
W20260709 13:13:32.194106 21417 debug-util.cc:398] Leaking SignalData structure 0x7b080034ac80 after lost signal to thread 21494
W20260709 13:13:32.195793 21417 debug-util.cc:398] Leaking SignalData structure 0x7b08001153c0 after lost signal to thread 22066
I20260709 13:13:32.178791 29302 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.159402 29379 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:32.196146 21417 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2d20 after lost signal to thread 22067
I20260709 13:13:32.160792 29425 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:32.093429 29182 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:32.201818 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 237820us
I20260709 13:13:32.200398 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.184932 21214 rpcz_store.cc:269] 0709 13:13:15.404672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.440580 (+ 35908us) service_pool.cc:224] Handling call
0709 13:13:32.163087 (+16722507us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:26.408478 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:26.409194 (+   716us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:26.409252 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:13:26.409274 (+    22us) tablet.cc:662] Decoding operations
0709 13:13:26.448303 (+ 39029us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:26.448395 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:26.448425 (+    30us) tablet.cc:685] Acquiring locks for 31 operations
0709 13:13:26.450649 (+  2224us) tablet.cc:701] Row locks acquired
0709 13:13:26.450699 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:13:26.450878 (+   179us) write_op.cc:270] Start()
0709 13:13:26.451019 (+   141us) write_op.cc:276] Timestamp: P: 1783602806450801 usec, L: 0
0709 13:13:26.451043 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:13:26.451762 (+   719us) log.cc:844] Serialized 12514 byte log entry
0709 13:13:27.725671 (+1273909us) op_driver.cc:464] REPLICATION: finished
0709 13:13:27.912398 (+186727us) write_op.cc:301] APPLY: starting
0709 13:13:27.935028 (+ 22630us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:28.519474 (+584446us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:28.519587 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:29.430903 (+911316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:29.431554 (+   651us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 13:13:29.431625 (+    71us) write_op.cc:312] APPLY: finished
0709 13:13:29.432519 (+   894us) log.cc:844] Serialized 268 byte log entry
0709 13:13:29.724177 (+291658us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:29.748236 (+ 24059us) write_op.cc:454] Released schema lock
0709 13:13:29.761945 (+ 13709us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:29.842251 (+ 80306us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:29.847304 (+  5053us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":356168,"reported_tablets":49,"spinlock_wait_cycles":3840,"child_traces":[["op",{"apply.queue_time_us":159101,"apply.run_cpu_time_us":78118,"apply.run_wall_time_us":1913933,"cfile_cache_hit":126,"cfile_cache_hit_bytes":134079,"num_ops":31,"prepare.queue_time_us":272142,"prepare.run_cpu_time_us":27361,"prepare.run_wall_time_us":249151,"raft.queue_time_us":291901,"raft.run_cpu_time_us":23485,"raft.run_wall_time_us":135778,"replication_time_us":1274480,"thread_start_us":838875,"threads_started":5,"wal-append.queue_time_us":539553,"wal-append.run_cpu_time_us":21119,"wal-append.run_wall_time_us":2978270}]]}
I20260709 13:13:32.167344 29467 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.169025 29280 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:32.225195 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:32.234752 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 45692.2us
W20260709 13:13:32.255676 21362 leader_election.cc:336] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.226354 29468 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.227900 29429 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:32.226181 29493 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:32.266554 21362 leader_election.cc:336] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.271292 21362 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:32.218313 29328 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.226310 29425 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.231271 29467 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.294852 21387 raft_consensus.cc:1275] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:13:32.317632 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:32.337224 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 77757.5us
I20260709 13:13:32.336414 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:32.338356 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 79634.8us
I20260709 13:13:32.270179 29468 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:32.339470 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 91753.2us
I20260709 13:13:32.349419 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.354202 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.307678 29513 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:32.313143 29280 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:32.336457 29471 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.371196 21434 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:32.377915 21285 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.383435 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.346969 29422 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:32.394574 29351 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:32.423979 29436 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:32.424381 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 51741.2us
I20260709 13:13:32.371549 29434 raft_consensus.cc:3055] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:32.425386 29434 raft_consensus.cc:740] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
W20260709 13:13:32.425590 29506 log.cc:927] Time spent T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:13:32.480608 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:32.484375 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 83860.2us
W20260709 13:13:32.487039 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 148806us
I20260709 13:13:32.404719 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.481113 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 117664us
W20260709 13:13:32.492020 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 66946.6us
I20260709 13:13:32.492822 21360 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:32.494781 29374 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:13:32.394388 29261 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:32.487066 29351 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:32.369036 29516 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:32.399536 29334 raft_consensus.cc:2804] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:13:32.479208 29498 log.cc:927] Time spent T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:13:32.423141 29425 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.374451 29280 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.368561 29513 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:32.515060 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 110454us
I20260709 13:13:32.519338 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.505363 29502 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:13:32.402128 29471 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.529452 21360 leader_election.cc:304] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:32.522780 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:32.498342 29436 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.500408 29302 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.479609 29422 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.568491 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.562247 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.562932 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.563591 21390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.564599 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.566123 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.566987 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.571471 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.566237 21387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:32.573303 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.528539 29374 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:13:32.576534 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 47164.7us
I20260709 13:13:32.577312 21360 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:32.577704 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.572345 21393 raft_consensus.cc:2468] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 18.
I20260709 13:13:32.578413 21360 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:32.582988 21360 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:32.486588 29434 consensus_queue.cc:260] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.544870 29334 raft_consensus.cc:697] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:32.541895 29182 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.542218 29347 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:32.504634 29268 consensus_queue.cc:1048] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.056s
W20260709 13:13:32.576979 29504 log.cc:927] Time spent T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
W20260709 13:13:32.597391 29509 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:13:32.597519 29517 log.cc:927] Time spent T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:13:32.598253 29507 log.cc:927] Time spent T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:13:32.590646 29521 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:32.600658 29513 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.561826 29436 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.613608 29347 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:32.613894 29493 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:32.569029 29494 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:32.614602 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 68752.5us
I20260709 13:13:32.616734 29422 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.618587 29471 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.516330 29351 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.516680 29516 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.575752 29510 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.581647 29261 raft_consensus.cc:2749] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:32.575548 29379 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:32.678128 22038 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:13:32.624668 29468 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.621479 29522 raft_consensus.cc:493] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:32.621613 29467 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.639088 29328 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:32.701812 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:32.705047 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.708009 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:32.699977 20199 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 21346)
I20260709 13:13:32.710846 21462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.717003 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.718864 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.679488 29494 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.720000 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.722381 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.724287 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 141409us
I20260709 13:13:32.725437 21360 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:32.727411 21360 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:32.730505 29508 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:32.713888 29334 consensus_queue.cc:237] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.734249 29436 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.736421 29351 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.740243 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.728021 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:32.741809 21362 leader_election.cc:336] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.746917 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.747772 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:32.699445 29379 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.753132 29302 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:32.755194 29508 consensus_queue.cc:1048] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:32.698192 29510 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.696985 29522 raft_consensus.cc:515] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.768684 29280 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:32.739456 29467 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:32.779062 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 58336.1us
I20260709 13:13:32.771102 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.779982 22002 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.780596 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
W20260709 13:13:32.781316 22002 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.769205 29494 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.778247 29535 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:32.786437 29351 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:32.789625 29535 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.791834 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:32.796747 29445 consensus_meta.cc:287] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.001s
I20260709 13:13:32.752331 29482 raft_consensus.cc:2804] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:13:32.799168 29482 raft_consensus.cc:697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 27 LEADER]: Becoming Leader. State: Replica: d41c71e861344f0b90e8d44a8d0a3173, State: Running, Role: LEADER
I20260709 13:13:32.800176 29482 consensus_queue.cc:237] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.781738 22002 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:32.804226 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:32.804908 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.783905 21396 raft_consensus.cc:1275] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:32.805315 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.785161 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.785756 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.786126 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.788326 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.811434 29379 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.788470 21393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.779886 29302 raft_consensus.cc:3060] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:13:32.815846 21360 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:32.817158 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:32.818200 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:32.818475 21362 leader_election.cc:336] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:32.820955 21362 leader_election.cc:336] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.824258 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.824769 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.825295 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.828605 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.832074 29445 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:13:32.805042 29468 raft_consensus.cc:2804] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:32.833396 29468 raft_consensus.cc:493] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting leader election (detected failure of leader bfcd9560f8f44414b25f8069384c5a73)
I20260709 13:13:32.823634 29515 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:32.833858 29468 raft_consensus.cc:3060] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:32.841441 21394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:32.840416 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.844012 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:32.846534 21395 raft_consensus.cc:1275] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:13:32.848415 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:32.877264 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.848592 29456 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:32.871695 29516 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.848397 29445 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:32.878758 29494 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.872557 29510 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:32.872808 21468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:32.873788 21436 leader_election.cc:336] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.874179 29522 leader_election.cc:290] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.819274 29386 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:32.845306 29351 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:32.880137 21285 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.923255 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.884323 29445 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:32.879320 29494 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.886602 21360 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:32.823657 29537 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:32.888069 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.888499 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.933686 22032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:32.888509 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.891525 29194 consensus_queue.cc:1048] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:13:32.898219 29535 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.827627 29347 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:32.837707 29379 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:32.901772 21466 raft_consensus.cc:1275] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:13:32.905414 22031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:32.925894 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.927234 21360 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:32.936107 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:32.938719 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:32.931347 21362 leader_election.cc:336] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:32.940979 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:32.939466 21284 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.924376 29467 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:32.933154 29436 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:32.957015 21284 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:32.951103 21360 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:32.936151 29522 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:32.951193 29434 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:32.962720 29513 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:32.964388 29379 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:32.983533 29302 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:32.954046 29347 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:32.936313 29445 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:32.954546 29535 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:32.988571 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:32.991021 21286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.993005 29494 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:32.993129 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf17cca2e64e76b923a076142551ff" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:32.994530 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:32.960986 29328 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:32.997601 29468 raft_consensus.cc:515] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:32.998337 29445 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:33.000480 29468 leader_election.cc:290] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:33.006826 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:33.007494 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:33.008221 22002 leader_election.cc:336] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.008417 22034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:33.011278 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:32.957722 29515 consensus_queue.cc:1048] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:13:33.013759 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.015857 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ce5a5a1e3461d8e0031fdfef61569" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:33.020236 29468 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:33.020916 29445 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:33.020167 21284 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:33.030916 22002 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.031472 22002 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:33.032305 29429 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:33.032630 22002 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.033053 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:33.043610 21436 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.038986 21359 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:33.044198 21436 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:33.049683 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7710ca7bd20a4aa6959c7bf3ebd05f87" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:33.049808 21284 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:33.053925 21285 leader_election.cc:304] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:33.054293 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.058684 29468 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:33.058236 21436 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.063016 21392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:33.056438 29516 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:33.056583 29445 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:33.062597 21436 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.065856 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.046263 29429 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:33.073772 29542 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
I20260709 13:13:33.060588 29494 raft_consensus.cc:2749] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:13:33.084868 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:33.086380 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:33.086447 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.087163 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49465.7us
I20260709 13:13:33.087910 21359 leader_election.cc:304] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:33.093509 21284 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:33.096756 29261 raft_consensus.cc:2749] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:33.057977 29334 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:13:33.109680 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 43905.4us
I20260709 13:13:33.115114 29535 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.115098 29445 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:33.128870 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 73931.1us
W20260709 13:13:33.129755 21436 leader_election.cc:336] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.130223 21436 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.129249 29535 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
W20260709 13:13:33.162581 21436 leader_election.cc:336] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.121568 29194 consensus_queue.cc:1048] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:13:33.140703 29334 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:33.163753 21436 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.152438 29535 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:33.176532 21436 leader_election.cc:336] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.176983 21436 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:33.182047 21436 leader_election.cc:336] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.182578 21436 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.164639 29477 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:33.189373 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:33.182673 29484 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:33.185417 29487 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:13:33.189466 29494 raft_consensus.cc:493] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.192632 29174 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:33.252265 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:33.256368 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:33.294041 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:33.373575 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:33.376582 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 83952.5us
I20260709 13:13:33.379791 21389 raft_consensus.cc:1275] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:13:33.378479 29302 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.236418 29494 raft_consensus.cc:515] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:33.402485 29535 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:33.397769 29544 log.cc:927] Time spent T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:13:33.413331 29468 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:33.410996 29374 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:33.417492 29468 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:33.418314 29374 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:33.420516 29374 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:33.422734 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:33.424366 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:33.431603 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 144894us
W20260709 13:13:33.434819 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:33.437806 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:33.438580 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.449330 29494 leader_election.cc:290] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:33.451416 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:33.439160 21436 leader_election.cc:336] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:33.456274 21436 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.400818 29302 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:33.465227 29334 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:33.489354 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:33.480329 29494 raft_consensus.cc:493] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.497011 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:33.499375 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b7a12853fc411b980438f7ae62ad14" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:33.502060 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 200434us
I20260709 13:13:33.503366 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.494349 29468 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:33.506254 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.505498 29535 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:33.500494 29494 raft_consensus.cc:515] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:33.514669 29549 log.cc:927] Time spent T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:13:33.513625 29468 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:33.518661 29551 log.cc:927] Time spent T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:13:33.538378 21285 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.543706 29302 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:33.544359 29302 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:33.543509 29174 consensus_queue.cc:1048] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:33.555088 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:33.561218 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:33.527398 29374 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:33.582496 29374 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:33.584750 29374 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:33.588212 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:33.593436 21391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:33.594056 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:33.594671 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:33.588918 21467 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 10.
W20260709 13:13:33.590297 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 90133.3us
I20260709 13:13:33.595956 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:33.618276 29494 leader_election.cc:290] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:33.628937 21469 raft_consensus.cc:1275] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:13:33.613001 29559 raft_consensus.cc:2804] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:33.634078 29511 consensus_queue.cc:1048] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:33.649065 29559 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:33.628440 29535 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.649775 29535 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:33.652510 29535 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:33.655284 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.664388 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:33.666287 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:33.667248 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.654135 29559 raft_consensus.cc:3060] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:33.714897 20199 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 21346)
W20260709 13:13:33.720043 21219 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 283) took 25807 ms (client timeout 15000 ms). Trace:
I20260709 13:13:33.737547 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e2aa178e8e4c63a6f5f660d5314ba7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:33.742008 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:33.749807 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984d063a64ef47f7b0783e2181604515" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
W20260709 13:13:33.721411 21219 rpcz_store.cc:269] 0709 13:13:07.912358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.912662 (+   304us) service_pool.cc:224] Handling call
0709 13:13:33.719901 (+25807239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:32.524882 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:32.622239 (+ 97357us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:32.622276 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:13:32.622293 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:32.623162 (+   869us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:32.623224 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:32.623251 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:13:32.623894 (+   643us) tablet.cc:701] Row locks acquired
0709 13:13:32.623909 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:13:32.624078 (+   169us) write_op.cc:270] Start()
0709 13:13:32.624192 (+   114us) write_op.cc:276] Timestamp: P: 1783602812624007 usec, L: 0
0709 13:13:32.624211 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:13:32.688213 (+ 64002us) log.cc:844] Serialized 3252 byte log entry
0709 13:13:32.944295 (+256082us) op_driver.cc:464] REPLICATION: finished
0709 13:13:33.060004 (+115709us) write_op.cc:301] APPLY: starting
0709 13:13:33.060173 (+   169us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:33.079432 (+ 19259us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:33.079533 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:33.128197 (+ 48664us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:33.150073 (+ 21876us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:13:33.150140 (+    67us) write_op.cc:312] APPLY: finished
0709 13:13:33.150475 (+   335us) log.cc:844] Serialized 81 byte log entry
0709 13:13:33.150661 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:33.150827 (+   166us) write_op.cc:454] Released schema lock
0709 13:13:33.150881 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:33.151417 (+   536us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:33.151452 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2764195,"reported_tablets":48,"spinlock_wait_cycles":10624,"child_traces":[["op",{"apply.queue_time_us":115430,"apply.run_cpu_time_us":12248,"apply.run_wall_time_us":91386,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37663,"num_ops":8,"prepare.queue_time_us":321910,"prepare.run_cpu_time_us":23223,"prepare.run_wall_time_us":251068,"raft.queue_time_us":188445,"raft.run_cpu_time_us":26148,"raft.run_wall_time_us":66296,"replication_time_us":319915,"thread_start_us":406981,"threads_started":4,"wal-append.queue_time_us":55859}]]}
I20260709 13:13:33.805588 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603c27f4d3de4b40878c1d29bcc0708a" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:33.745230 29374 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:33.776000 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:33.818897 21284 leader_election.cc:304] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.826385 21284 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:33.827251 29535 raft_consensus.cc:2749] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:33.827984 29535 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:33.831355 21284 leader_election.cc:304] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.832285 29535 raft_consensus.cc:2749] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:33.833606 21284 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:33.834692 29535 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:33.839155 29535 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.839651 29535 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:33.841234 29559 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:33.841909 29535 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:33.843011 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:33.843351 29559 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:33.845963 29374 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:33.847150 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:33.848124 29374 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:33.848349 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:33.850792 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:33.851933 29374 raft_consensus.cc:493] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.852065 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:33.852432 29561 log.cc:927] Time spent T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:13:33.853809 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.854617 29328 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:33.852535 29374 raft_consensus.cc:515] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:33.857694 29374 leader_election.cc:290] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:33.857750 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.851629 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
I20260709 13:13:33.875268 29374 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:33.880872 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:33.882877 21285 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.882965 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3784e213304c30beba718dd813ab39" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:33.884099 29374 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:33.869936 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:33.872805 21215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 281) took 78201 ms (client timeout 15000 ms). Trace:
W20260709 13:13:33.893661 21215 rpcz_store.cc:269] 0709 13:12:15.671677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.671887 (+   210us) service_pool.cc:224] Handling call
0709 13:13:33.872583 (+78200696us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3012,"reported_tablets":48}
I20260709 13:13:33.900341 21285 leader_election.cc:304] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:33.904181 29374 raft_consensus.cc:2749] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:13:33.904670 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:33.913753 21212 catalog_manager.cc:5697] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 14 to 16, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 16 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.924198 21212 catalog_manager.cc:5697] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 10 to 12, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 12 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:33.928407 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.006585 29559 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.007226 29559 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:34.007864 29374 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.008392 29374 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:34.009455 29559 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:34.010442 29374 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:34.011956 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:34.014091 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:34.017005 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.018486 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.019183 21464 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 20.
I20260709 13:13:34.034193 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:34.035152 29374 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:34.035545 29374 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.035888 29374 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:34.035557 21285 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.039862 29559 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:34.041887 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:34.047396 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:34.049232 29374 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:34.054445 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:34.055299 21467 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:34.078276 21467 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058db415e9884ea0ba23f1e1ff59127a in term 21.
I20260709 13:13:34.091149 21285 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f; no voters: 
I20260709 13:13:34.093232 29559 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:34.093848 29559 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Becoming Leader. State: Replica: 058db415e9884ea0ba23f1e1ff59127a, State: Running, Role: LEADER
I20260709 13:13:34.094723 29559 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:34.095742 29374 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 election: Requested vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:34.099624 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:34.144598 21215 catalog_manager.cc:5697] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 18, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 18 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.149449 21215 catalog_manager.cc:5697] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.178546 29374 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.180307 29374 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:34.195447 29374 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:34.203301 21464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.207077 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:34.214687 21212 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 282) took 57928 ms (client timeout 15000 ms). Trace:
I20260709 13:13:34.214844 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.217895 29559 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:34.232589 21215 catalog_manager.cc:5697] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:34.242653 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.235273 21215 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 18, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.245743 21215 catalog_manager.cc:5697] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 25 to 28, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 28 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:13:34.215731 21212 rpcz_store.cc:269] 0709 13:12:36.285817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.291126 (+  5309us) service_pool.cc:224] Handling call
0709 13:12:36.417268 (+126142us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf182090 00007fc2bf220f3a 00007fc2c4fd71cc 00007fc2c50d537e 00007fc2c35962a4 00007fc2c3596232 00007fc2c3596161 00007fc2c35960dc 00007fc2c3595392 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:34.214419 (+57797151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:33.936227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:33.936894 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:33.936944 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:13:33.936965 (+    21us) tablet.cc:662] Decoding operations
0709 13:13:33.937390 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:33.937479 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:33.937511 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:13:33.937851 (+   340us) tablet.cc:701] Row locks acquired
0709 13:13:33.937870 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:13:33.938027 (+   157us) write_op.cc:270] Start()
0709 13:13:33.938156 (+   129us) write_op.cc:276] Timestamp: P: 1783602813937974 usec, L: 0
0709 13:13:33.938182 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:13:33.938941 (+   759us) log.cc:844] Serialized 935 byte log entry
0709 13:13:33.971413 (+ 32472us) op_driver.cc:464] REPLICATION: finished
0709 13:13:33.973401 (+  1988us) write_op.cc:301] APPLY: starting
0709 13:13:33.973480 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:33.975070 (+  1590us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:33.975171 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:33.987313 (+ 12142us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:33.987503 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:13:33.987546 (+    43us) write_op.cc:312] APPLY: finished
0709 13:13:33.989117 (+  1571us) log.cc:844] Serialized 33 byte log entry
0709 13:13:33.993588 (+  4471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:33.993689 (+   101us) write_op.cc:454] Released schema lock
0709 13:13:33.993729 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:33.994283 (+   554us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:33.994313 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":626296,"reported_tablets":48,"spinlock_wait_cycles":34140544,"child_traces":[["op",{"apply.queue_time_us":1740,"apply.run_cpu_time_us":4475,"apply.run_wall_time_us":20851,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12511,"num_ops":2,"prepare.queue_time_us":7016,"prepare.run_cpu_time_us":3056,"prepare.run_wall_time_us":3057,"replication_time_us":33060,"thread_start_us":11519,"threads_started":2}]]}
I20260709 13:13:34.393173 21215 catalog_manager.cc:5697] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 13 to 14, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 14 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.397567 29559 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:34.398571 29559 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:34.436754 29532 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:34.437638 29532 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:34.445142 29532 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:34.450335 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.449496 29559 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:34.453446 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.454558 21469 raft_consensus.cc:2368] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21.
W20260709 13:13:34.455031 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:34.456143 22002 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:34.458026 21215 catalog_manager.cc:5697] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 21 to 27, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 27 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.460402 21215 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.462387 21215 catalog_manager.cc:5697] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 23 to 27, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 27 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.466440 21997 leader_election.cc:400] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21.
I20260709 13:13:34.466847 21997 leader_election.cc:403] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:34.467890 29525 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:13:34.479099 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:34.479640 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59520.1us
W20260709 13:13:34.484581 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 45425.1us
I20260709 13:13:34.486919 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.488047 29559 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:34.488476 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.488767 29559 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:34.489559 29374 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:34.491269 29559 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:34.493240 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.493746 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff1f323e1c14a199b956742e2f69120" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.496116 21285 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:34.498433 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.484685 21215 catalog_manager.cc:5697] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 20, leader changed from bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 20 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.504123 29559 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:34.505744 21215 catalog_manager.cc:5697] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 22 to 23, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 23 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.507642 21215 catalog_manager.cc:5697] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 22, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 22 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.509332 21215 catalog_manager.cc:5697] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 22 to 25, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 25 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.516358 21215 catalog_manager.cc:5697] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 26 to 29, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 29 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.518595 21215 catalog_manager.cc:5697] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 21 to 23, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 23 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.520642 21215 catalog_manager.cc:5697] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 18 to 23, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 23 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.532629 21215 catalog_manager.cc:5697] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 20, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 20 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.534613 21215 catalog_manager.cc:5697] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 17, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 17 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.536432 21215 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 22 to 25, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 25 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.537707 29525 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119) with higher term. Message: Invalid argument: T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 for earlier term 20. Current term is 21.
I20260709 13:13:34.537863 21215 catalog_manager.cc:5697] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.540153 22039 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:13:34.540251 21215 catalog_manager.cc:5697] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 18 to 21, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 21 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.542869 21215 catalog_manager.cc:5697] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 8 to 15, term changed from 20 to 22, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196), VOTER 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) evicted, no longer has a pending config: VOTER d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194), VOTER 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195), VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 22 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.549002 29374 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.549317 29328 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:34.553678 29374 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:34.556803 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.565351 29374 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:34.566989 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.564134 21215 catalog_manager.cc:5697] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 14 to 21, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 21 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:13:34.572628 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:34.573844 21467 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Refusing update from remote peer 058db415e9884ea0ba23f1e1ff59127a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:13:34.573976 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.575619 29374 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:34.576364 29374 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:34.585711 29559 raft_consensus.cc:493] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.586520 29559 raft_consensus.cc:515] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:34.592525 21215 catalog_manager.cc:5697] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 23 to 25, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 25 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.601446 21215 catalog_manager.cc:5697] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.608594 21215 catalog_manager.cc:5697] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 24, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 24 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.612394 29559 leader_election.cc:290] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:34.629263 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.614638 21215 catalog_manager.cc:5697] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 24 to 25, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 25 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.630671 21215 catalog_manager.cc:5697] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 23 to 25, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 25 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.636163 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.639781 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c368bc506e8e4024b128c98b0a2a3ae4" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.644275 21285 leader_election.cc:304] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.647507 29328 raft_consensus.cc:2749] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:34.652362 21215 catalog_manager.cc:5697] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.655738 21215 catalog_manager.cc:5697] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.659443 21215 catalog_manager.cc:5697] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 24. New cstate: current_term: 24 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.660979 21215 catalog_manager.cc:5697] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 15 to 18, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 18 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:13:34.672938 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.688632 29572 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.689294 29572 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:34.693933 29572 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:34.694110 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:34.700178 21215 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 25 to 26, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 26 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.701922 21215 catalog_manager.cc:5697] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 12 to 13, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194). New cstate: current_term: 13 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.702632 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e997d08de0c4a8b9b07e0741628b23f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:34.704711 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.707474 21285 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:34.703775 21215 catalog_manager.cc:5697] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 12 to 19, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 19 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.709156 29374 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:34.710403 21215 catalog_manager.cc:5697] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 20, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 20 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.713205 21215 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:34.715611 20199 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 21346)
I20260709 13:13:34.718844 29374 raft_consensus.cc:493] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.719537 29374 raft_consensus.cc:515] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:34.730944 29374 leader_election.cc:290] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:34.732875 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.715382 21215 catalog_manager.cc:5697] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.738958 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b8185650734d438c79a9d575a2b2f5" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:34.739136 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.742031 21285 leader_election.cc:304] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.739945 21215 catalog_manager.cc:5697] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 20 to 23, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 23 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:34.743571 21215 catalog_manager.cc:5697] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 21 to 26. New cstate: current_term: 26 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:34.745661 29374 raft_consensus.cc:2749] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:34.747016 21215 catalog_manager.cc:5697] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 23. New cstate: current_term: 23 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:13:34.761933 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:34.784911 29374 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:34.785713 29374 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:34.789386 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.793527 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a81f5eab37044228b941f7eb2be5912" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:34.795416 21284 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.796326 29572 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:34.792784 29374 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:34.848238 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.876864 29374 raft_consensus.cc:493] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.877602 29374 raft_consensus.cc:515] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:34.879511 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:34.879745 29374 leader_election.cc:290] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:34.881971 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:34.883350 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3549d7d86f4c404f95fae0e1f6b84210" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.885475 21285 leader_election.cc:304] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.889127 29374 raft_consensus.cc:2749] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:34.911624 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:34.922147 29374 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.922842 29374 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:34.925024 29374 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:34.927740 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.932650 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.934605 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.935685 29374 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:13:34.971975 29374 raft_consensus.cc:493] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:34.972656 29374 raft_consensus.cc:515] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:34.974841 29374 leader_election.cc:290] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:34.976809 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:34.978235 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c1e6c7efbf499daf584842b0aca96c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:34.983215 21285 leader_election.cc:304] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:34.985675 29374 raft_consensus.cc:2749] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:35.007606 29572 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.008386 29572 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.010927 29572 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.011673 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.013554 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.016094 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.019016 29374 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:35.019791 29374 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:35.020517 29374 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.023922 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.023967 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f384b96e64eb4aa9a99fd8372643b01c" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.024674 29374 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.027544 21285 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.028395 29572 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:35.034348 29572 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.035360 29572 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.037981 29572 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.039460 21388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.040320 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85584105b0f74652871311c68f5de4db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.041641 21285 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.042846 29572 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:35.085893 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.136859 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.138358 29572 raft_consensus.cc:493] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.138985 29572 raft_consensus.cc:515] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.142351 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.142534 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d344e412d584b97b86c32794fb7fb2b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.144142 29572 leader_election.cc:290] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.146624 21285 leader_election.cc:304] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.148005 29374 raft_consensus.cc:2749] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:35.151760 29374 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:35.152431 29374 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.154937 29374 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.156484 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.156477 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099cc7d3a89e468b91e21306fa23a0be" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.160352 21284 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:35.161728 29572 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:35.198053 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:35.226480 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.233690 29374 raft_consensus.cc:493] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.234436 29374 raft_consensus.cc:515] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.239189 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.240747 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8ee0dfd2df46d583c09b3893e01a89" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.243333 21285 leader_election.cc:304] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.244720 29572 raft_consensus.cc:2749] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:35.236876 29374 leader_election.cc:290] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:35.251771 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:35.284904 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.292265 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.333447 29374 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:35.334815 29374 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.337234 29374 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.349606 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.352188 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c6ecc97b34d419d7290080bc4a2c8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.354249 21285 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.368291 29572 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:35.369048 29572 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:35.369573 29572 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.371959 29572 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.399111 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.401865 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40320a19af04e62afc637834ab759b2" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.404007 21285 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.405611 29572 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:13:35.413105 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:35.414518 29572 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:35.415351 29572 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.420176 29572 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.421589 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.426646 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06666c92a06645dc8a8977e923b51e37" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.433068 21285 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:35.449324 29572 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:35.451839 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.452584 22002 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 310 similar messages]
I20260709 13:13:35.477566 29374 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.478332 29374 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.466392 21210 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.490324 29374 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.496660 21210 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.503893 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.531389 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f870524af94ba487ca21790bc003cc" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.535764 21285 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.538204 29572 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:13:35.555091 29374 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:35.555946 29374 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.559401 29374 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.562748 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.574348 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cfcdfda7a4840b78d5a89acd61b8d23" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.575961 21284 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:35.591138 29572 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:35.596936 21215 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40758 (request call id 291) took 2198 ms. Trace:
W20260709 13:13:35.597070 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:35.597592 21215 rpcz_store.cc:276] 0709 13:13:33.398758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.895770 (+497012us) service_pool.cc:224] Handling call
0709 13:13:35.596856 (+1701086us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:34.848621 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:34.860188 (+ 11567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:34.860246 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:13:34.860265 (+    19us) tablet.cc:662] Decoding operations
0709 13:13:34.863232 (+  2967us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:34.863350 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:34.863379 (+    29us) tablet.cc:685] Acquiring locks for 41 operations
0709 13:13:34.914513 (+ 51134us) tablet.cc:701] Row locks acquired
0709 13:13:34.914568 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:13:34.914772 (+   204us) write_op.cc:270] Start()
0709 13:13:34.914978 (+   206us) write_op.cc:276] Timestamp: P: 1783602814914691 usec, L: 0
0709 13:13:34.915023 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:13:34.915952 (+   929us) log.cc:844] Serialized 16136 byte log entry
0709 13:13:35.007684 (+ 91732us) op_driver.cc:464] REPLICATION: finished
0709 13:13:35.034687 (+ 27003us) write_op.cc:301] APPLY: starting
0709 13:13:35.034796 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:35.103191 (+ 68395us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:35.103308 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:35.268529 (+165221us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:35.269282 (+   753us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=82,key_file_lookups=82,delta_file_lookups=82,mrs_lookups=0
0709 13:13:35.269382 (+   100us) write_op.cc:312] APPLY: finished
0709 13:13:35.272196 (+  2814us) log.cc:844] Serialized 348 byte log entry
0709 13:13:35.272420 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:35.272722 (+   302us) write_op.cc:454] Released schema lock
0709 13:13:35.272836 (+   114us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:35.321173 (+ 48337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:35.321201 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82348,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":26448,"apply.run_cpu_time_us":51659,"apply.run_wall_time_us":286452,"cfile_cache_hit":166,"cfile_cache_hit_bytes":175999,"num_ops":41,"prepare.queue_time_us":34638,"prepare.run_cpu_time_us":9521,"prepare.run_wall_time_us":88143,"replication_time_us":92471,"thread_start_us":42917,"threads_started":2}]]}
W20260709 13:13:35.603396 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.622166 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:35.617302 29572 raft_consensus.cc:493] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.627954 29572 raft_consensus.cc:515] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.631233 29572 leader_election.cc:290] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.651221 29572 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.653088 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.651851 29572 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.674060 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2812c891d248ecafa8f302d2b72c45" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.675920 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.680874 21285 leader_election.cc:304] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:35.683373 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:35.685216 29374 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.685849 29374 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.688269 29572 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.688843 29572 raft_consensus.cc:2749] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:35.690120 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.692469 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2910eb954d42858344d5b85eefd955" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:35.697392 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:35.696378 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:35.705801 21285 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:35.716141 20199 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 21346)
I20260709 13:13:35.687959 29374 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.717825 29374 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:35.718542 29374 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.722105 29374 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.722698 29374 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:13:35.724334 21206 catalog_manager.cc:4755] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7cc0b64eb784638b78409562870a2db: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:13:35.730929 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90920283ad9436b891dae0b916f29d7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.731683 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.732159 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc8cdcfe1ff495b82553486dbada070" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.745098 29374 raft_consensus.cc:493] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.745836 29374 raft_consensus.cc:515] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.744437 21284 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.749272 21285 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.752574 29374 leader_election.cc:290] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.756189 29587 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:35.765092 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.766002 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.767638 29587 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:35.769483 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24db01a278af4a82a16f038fedabf4d3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.774384 29587 raft_consensus.cc:493] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.775067 29587 raft_consensus.cc:515] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.777697 29587 leader_election.cc:290] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:35.815971 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:35.819680 21210 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 280) took 19907 ms (client timeout 15000 ms). Trace:
I20260709 13:13:35.828804 29589 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.829620 29589 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:35.831741 29589 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.783316 21285 leader_election.cc:304] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:35.835321 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 52104.1us
I20260709 13:13:35.837049 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.838501 29587 raft_consensus.cc:2749] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:35.838937 29589 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:35.839577 29589 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.842290 29589 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.842772 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.850059 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bf4c40f9a04c6290d5223c4a18640d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:35.852310 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:35.832397 21210 rpcz_store.cc:269] 0709 13:13:15.912103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.970419 (+ 58316us) service_pool.cc:224] Handling call
0709 13:13:35.819571 (+19849152us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:35.638962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:35.639916 (+   954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:35.639954 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:13:35.639974 (+    20us) tablet.cc:662] Decoding operations
0709 13:13:35.640432 (+   458us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:35.640520 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:35.640551 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:13:35.640896 (+   345us) tablet.cc:701] Row locks acquired
0709 13:13:35.640917 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:13:35.681020 (+ 40103us) write_op.cc:270] Start()
0709 13:13:35.696214 (+ 15194us) write_op.cc:276] Timestamp: P: 1783602815679012 usec, L: 0
0709 13:13:35.696264 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:13:35.699573 (+  3309us) log.cc:844] Serialized 925 byte log entry
0709 13:13:35.766544 (+ 66971us) op_driver.cc:464] REPLICATION: finished
0709 13:13:35.767050 (+   506us) write_op.cc:301] APPLY: starting
0709 13:13:35.767133 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:35.768481 (+  1348us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:35.768573 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:35.769817 (+  1244us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:35.769965 (+   148us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:13:35.770007 (+    42us) write_op.cc:312] APPLY: finished
0709 13:13:35.770205 (+   198us) log.cc:844] Serialized 33 byte log entry
0709 13:13:35.770379 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:35.770474 (+    95us) write_op.cc:454] Released schema lock
0709 13:13:35.770512 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":28678,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":3786,"apply.run_wall_time_us":4158,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8384,"num_ops":2,"prepare.queue_time_us":97467,"prepare.run_cpu_time_us":3384,"prepare.run_wall_time_us":80606,"replication_time_us":70124,"thread_start_us":98222,"threads_started":1}]]}
I20260709 13:13:35.855635 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67210417ec2d4ac885d194a18af541f3" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:35.867307 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.880848 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e856d5af49457aa83cfe00a413716d" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.882243 21215 catalog_manager.cc:5697] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 18 to 25. New cstate: current_term: 25 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:35.884601 21215 catalog_manager.cc:5697] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 21 to 24, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 24 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:35.886157 21215 catalog_manager.cc:5697] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: term changed from 16 to 19, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 19 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } }
I20260709 13:13:35.888741 21285 leader_election.cc:304] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:13:35.940208 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.944954 29587 raft_consensus.cc:2749] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:13:35.946355 21285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 57687.7us
I20260709 13:13:35.954952 21285 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.956180 21285 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.956929 29589 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:35.960662 29589 raft_consensus.cc:493] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.961258 29589 raft_consensus.cc:515] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:35.960666 21213 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 278) took 76623 ms (client timeout 15000 ms). Trace:
I20260709 13:13:35.967873 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:35.968231 21213 rpcz_store.cc:269] 0709 13:12:19.438267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.445669 (+  7402us) service_pool.cc:224] Handling call
0709 13:13:35.960437 (+76514768us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71800,"reported_tablets":48}
I20260709 13:13:35.966383 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daddf6dabfd442eb82ef13b979cf0aa7" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:35.963342 29589 leader_election.cc:290] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:35.969105 29587 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:35.970331 29572 raft_consensus.cc:493] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.976892 29572 raft_consensus.cc:515] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:35.977581 21285 leader_election.cc:304] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:35.979131 29587 raft_consensus.cc:2749] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:13:35.979671 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:35.981489 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:35.979305 29572 leader_election.cc:290] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:35.982474 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ec37b4f0643d4b4d60d35243b93d8" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
W20260709 13:13:35.990636 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:36.001401 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:36.005292 21285 leader_election.cc:304] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:36.008064 29572 raft_consensus.cc:2749] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:36.033922 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:36.031651 29572 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:13:36.036875 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.036981 29572 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:36.039353 29572 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:36.043751 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:36.052261 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e9f5b52ad74d0d8f492da1f7ef4721" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:36.054329 21285 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:36.055214 29572 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:36.093015 21219 catalog_manager.cc:5697] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 16 to 21, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 21 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.097275 21219 catalog_manager.cc:5697] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:36.120747 21219 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:36.122586 21219 catalog_manager.cc:5697] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.130784 21219 catalog_manager.cc:5697] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:36.134629 21217 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 277) took 95700 ms (client timeout 15000 ms). Trace:
W20260709 13:13:36.135321 21217 rpcz_store.cc:269] 0709 13:12:00.430305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.431002 (+   697us) service_pool.cc:224] Handling call
0709 13:13:36.130863 (+95699861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26693,"reported_tablets":48}
I20260709 13:13:36.137382 21219 catalog_manager.cc:5697] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.141877 21219 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:36.200660 29572 raft_consensus.cc:493] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.201400 29572 raft_consensus.cc:515] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:36.207712 21219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40774 (request call id 281) took 3476 ms. Trace:
I20260709 13:13:36.208496 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:36.209992 21214 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a reported cstate change: term changed from 17 to 19, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193). New cstate: current_term: 19 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.211285 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904858d649144d589875f088692f104f" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:36.208238 21219 rpcz_store.cc:276] 0709 13:13:32.731511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.823852 (+1092341us) service_pool.cc:224] Handling call
0709 13:13:33.906459 (+ 82607us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5400002210. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bbfb3db1 00007fc2bc0f3b71 00007fc2bc0f40b2 00007fc2c506da89 00007fc2c5005da6 00007fc2c4fd7088 00007fc2c50d537e 00007fc2c35962a4 00007fc2c3596232 00007fc2c3596161 00007fc2c35960dc
0709 13:13:36.207623 (+2301164us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:36.146795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:36.147441 (+   646us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:36.147480 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:13:36.147491 (+    11us) tablet.cc:662] Decoding operations
0709 13:13:36.148308 (+   817us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:36.148364 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:36.148397 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:13:36.148935 (+   538us) tablet.cc:701] Row locks acquired
0709 13:13:36.148949 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:13:36.149108 (+   159us) write_op.cc:270] Start()
0709 13:13:36.149235 (+   127us) write_op.cc:276] Timestamp: P: 1783602816149068 usec, L: 0
0709 13:13:36.149256 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:13:36.149895 (+   639us) log.cc:844] Serialized 2856 byte log entry
0709 13:13:36.152409 (+  2514us) op_driver.cc:464] REPLICATION: finished
0709 13:13:36.152930 (+   521us) write_op.cc:301] APPLY: starting
0709 13:13:36.153004 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:36.156991 (+  3987us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:36.157101 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:36.162018 (+  4917us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:36.162248 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:13:36.162309 (+    61us) write_op.cc:312] APPLY: finished
0709 13:13:36.162624 (+   315us) log.cc:844] Serialized 73 byte log entry
0709 13:13:36.166023 (+  3399us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b180031c420. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2c4ff3de1 00007fc2c50005b1 00007fc2bc12b522 00007fc2bc12d7c1 00007fc2bc12d779 00007fc2bc12d709 00007fc2bc12d6d1 00007fc2bc12c9cd 000000000038f354 000000000038f199 00007fc2bc10e83a
0709 13:13:36.166488 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:36.166623 (+   135us) write_op.cc:454] Released schema lock
0709 13:13:36.166678 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:36.167013 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:36.167049 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49221,"reported_tablets":48,"spinlock_wait_cycles":40575232,"child_traces":[["op",{"apply.queue_time_us":295,"apply.run_cpu_time_us":9967,"apply.run_wall_time_us":14033,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29344,"num_ops":7,"prepare.queue_time_us":360,"prepare.run_cpu_time_us":3517,"prepare.run_wall_time_us":12561,"replication_time_us":3040,"spinlock_wait_cycles":9381248}]]}
I20260709 13:13:36.215097 21284 leader_election.cc:304] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:36.216188 29587 raft_consensus.cc:2749] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:36.234679 29587 raft_consensus.cc:493] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:13:36.235369 29587 raft_consensus.cc:515] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:36.238453 29587 leader_election.cc:290] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:36.247474 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:36.264364 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:36.250170 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:36.254000 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adedb939e97489f9d96abf3bff7f1bd" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:36.203845 29572 leader_election.cc:290] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:36.272483 21284 leader_election.cc:304] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:36.275336 29587 raft_consensus.cc:2749] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:36.285338 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:36.293437 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:36.295334 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:36.356307 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:36.369119 21219 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "058db415e9884ea0ba23f1e1ff59127a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:36.372216 21219 catalog_manager.cc:5697] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 21 to 24, leader changed from 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 24 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:13:36.380170 21214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40750 (request call id 284) took 11258 ms (client timeout 15000 ms). Trace:
W20260709 13:13:36.421100 21214 rpcz_store.cc:269] 0709 13:13:25.121607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.268632 (+7147025us) service_pool.cc:224] Handling call
0709 13:13:36.260156 (+3991524us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:36.260184 (+    28us) write_op.cc:454] Released schema lock
0709 13:13:36.380091 (+119907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:36.252297 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:36.252833 (+   536us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:36.252882 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:13:36.252894 (+    12us) tablet.cc:662] Decoding operations
0709 13:13:36.253268 (+   374us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:36.253330 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:36.253357 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:36.253542 (+   185us) tablet.cc:701] Row locks acquired
0709 13:13:36.253556 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:13:36.253696 (+   140us) write_op.cc:270] Start()
0709 13:13:36.253800 (+   104us) write_op.cc:276] Timestamp: P: 1783602816253653 usec, L: 0
0709 13:13:36.253815 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:13:36.254403 (+   588us) log.cc:844] Serialized 539 byte log entry
0709 13:13:36.256274 (+  1871us) op_driver.cc:464] REPLICATION: finished
0709 13:13:36.256693 (+   419us) write_op.cc:301] APPLY: starting
0709 13:13:36.256771 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:36.257556 (+   785us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:36.257653 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:36.258467 (+   814us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:36.258613 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:13:36.258654 (+    41us) write_op.cc:312] APPLY: finished
0709 13:13:36.258830 (+   176us) log.cc:844] Serialized 25 byte log entry
0709 13:13:36.258988 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:36.259075 (+    87us) write_op.cc:454] Released schema lock
0709 13:13:36.259113 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":3562,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":236,"apply.run_cpu_time_us":2746,"apply.run_wall_time_us":2746,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4192,"num_ops":1,"prepare.queue_time_us":9807,"prepare.run_cpu_time_us":2375,"prepare.run_wall_time_us":2376,"replication_time_us":2325}]]}
I20260709 13:13:36.457930 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.464217 20199 tablet_replica.cc:333] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.466204 20199 raft_consensus.cc:2243] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.470463 20199 raft_consensus.cc:2272] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.477582 29587 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.480109 29587 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:36.483585 29587 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:36.486078 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:36.486754 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e3d859a1534f11ba508b90ad562a1b" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:36.488905 21285 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:36.490065 29587 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:36.498785 20199 tablet_replica.cc:333] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.500818 20199 raft_consensus.cc:2243] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.508672 20199 raft_consensus.cc:2272] T 984d063a64ef47f7b0783e2181604515 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.512378 20199 tablet_replica.cc:333] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.516151 20199 raft_consensus.cc:2243] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:36.516841 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:36.516742 21465 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:13:36.519308 21211 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 190) took 16786 ms (client timeout 15000 ms). Trace:
W20260709 13:13:36.519754 21211 rpcz_store.cc:269] 0709 13:13:19.733012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.758585 (+5025573us) service_pool.cc:224] Handling call
0709 13:13:24.828319 (+ 69734us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf182090 00007fc2bf220f3a 00007fc2c4fd71cc 00007fc2c50d537e 00007fc2c35962a4 00007fc2c3596232 00007fc2c3596161 00007fc2c35960dc 00007fc2c3595392 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:36.519137 (+11690818us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51933,"reported_tablets":35,"spinlock_wait_cycles":15645440}
I20260709 13:13:36.524823 20199 raft_consensus.cc:2272] T 3549d7d86f4c404f95fae0e1f6b84210 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.528424 20199 tablet_replica.cc:333] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.532985 20199 raft_consensus.cc:2243] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.534000 20199 raft_consensus.cc:2272] T 3c3784e213304c30beba718dd813ab39 P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.538586 20199 tablet_replica.cc:333] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.550154 20199 raft_consensus.cc:2243] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.555686 20199 raft_consensus.cc:2272] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.562613 21433 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c0d19b3841a44cdbbb32daa4e1ddc06. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.565135 21389 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:13:36.565338 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.566541 20199 tablet_replica.cc:333] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.572973 20199 raft_consensus.cc:2243] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:36.562659 21216 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 187) took 85152 ms (client timeout 15000 ms). Trace:
W20260709 13:13:36.574309 21216 rpcz_store.cc:269] 0709 13:12:11.409693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.409880 (+   187us) service_pool.cc:224] Handling call
0709 13:12:11.606392 (+196512us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54000352d4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf182090 00007fc2bf220f3a 00007fc2c4fd71cc 00007fc2c50d537e 00007fc2c35962a4 00007fc2c3596232 00007fc2c3596161 00007fc2c35960dc 00007fc2c3595392 00007fc2bd55348c 00007fc2bd5528c6
0709 13:13:36.562425 (+84956033us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58504,"reported_tablets":35,"spinlock_wait_cycles":102972672}
I20260709 13:13:36.573817 20199 raft_consensus.cc:2272] T 603c27f4d3de4b40878c1d29bcc0708a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.577297 29487 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:36.579744 20199 tablet_replica.cc:333] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.616189 29280 raft_consensus.cc:2955] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:36.617929 21389 raft_consensus.cc:2955] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:36.643421 20199 raft_consensus.cc:2243] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.647540 20199 raft_consensus.cc:2272] T ff7ec37b4f0643d4b4d60d35243b93d8 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.657511 29587 raft_consensus.cc:493] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:36.658162 29587 raft_consensus.cc:515] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:36.660667 29587 leader_election.cc:290] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:36.663630 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
W20260709 13:13:36.664819 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:36.667608 21216 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index -1 to 11, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 17 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:36.675063 21218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 189) took 37953 ms (client timeout 15000 ms). Trace:
W20260709 13:13:36.675527 21218 rpcz_store.cc:269] 0709 13:12:58.721958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.722124 (+   166us) service_pool.cc:224] Handling call
0709 13:13:36.674860 (+37952736us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36090,"reported_tablets":35}
I20260709 13:13:36.686928 20199 tablet_replica.cc:333] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.688017 20199 raft_consensus.cc:2243] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.693504 20199 raft_consensus.cc:2272] T 4a81f5eab37044228b941f7eb2be5912 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.700205 20199 tablet_replica.cc:333] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.700994 20199 raft_consensus.cc:2243] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.702080 20199 raft_consensus.cc:2272] T 424be00d78cc41f1a80d41735ad881ae P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.705111 20199 tablet_replica.cc:333] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.706235 20199 raft_consensus.cc:2243] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.707558 20199 raft_consensus.cc:2272] T 85584105b0f74652871311c68f5de4db P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.716359 20199 tablet_replica.cc:333] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.717414 20199 raft_consensus.cc:2243] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.725684 20199 raft_consensus.cc:2272] T 6629858a6e4c4461a471763a94f0effa P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.735708 20199 tablet_replica.cc:333] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.737278 20199 raft_consensus.cc:2243] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.745186 20199 raft_consensus.cc:2272] T daddf6dabfd442eb82ef13b979cf0aa7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.748745 20199 tablet_replica.cc:333] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.749830 20199 raft_consensus.cc:2243] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.750532 20199 raft_consensus.cc:2272] T efd59ed9e9fc41bbae9dde704923fee4 P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.754310 20199 tablet_replica.cc:333] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.755291 20199 raft_consensus.cc:2243] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.759447 21212 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38388 (request call id 191) took 1983 ms. Trace:
I20260709 13:13:36.759924 21212 rpcz_store.cc:276] 0709 13:13:34.776314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.776513 (+   199us) service_pool.cc:224] Handling call
0709 13:13:36.759381 (+1982868us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57535,"reported_tablets":35}
I20260709 13:13:36.779371 29587 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.780151 29587 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:36.782480 29587 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:36.784312 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:36.791607 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf4b245b41e47f6bf08fa982e5c1db1" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:36.791926 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da4a8cf8f0864a8390aba6652b02015e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:36.794530 21285 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:36.795365 29587 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:13:36.800997 20199 raft_consensus.cc:2272] T c0b7a12853fc411b980438f7ae62ad14 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.805090 20199 tablet_replica.cc:333] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.806164 20199 raft_consensus.cc:2243] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.807201 20199 raft_consensus.cc:2272] T d1e856d5af49457aa83cfe00a413716d P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.811829 21389 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:36.827970 29587 raft_consensus.cc:493] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.828958 21285 leader_election.cc:304] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:36.828850 29587 raft_consensus.cc:515] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } attrs { replace: true } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:36.829759 29572 raft_consensus.cc:2749] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:36.834038 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:36.834640 29587 leader_election.cc:290] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:36.834794 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:36.836365 21284 leader_election.cc:304] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:36.838893 29587 raft_consensus.cc:2749] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:13:36.842208 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cc0b64eb784638b78409562870a2db" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:36.851204 20199 tablet_replica.cc:333] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
W20260709 13:13:36.851852 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 54144.5us
I20260709 13:13:36.860679 20199 raft_consensus.cc:2243] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.865083 20199 raft_consensus.cc:2272] T d7bf8c65f80c468c8e47986515ea7c80 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.872335 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:36.875921 20199 tablet_replica.cc:333] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.879796 20199 raft_consensus.cc:2243] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.884958 21465 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:13:36.888098 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.889070 29599 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:36.889441 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:36.889787 21359 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efd59ed9e9fc41bbae9dde704923fee4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.893162 29587 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:13:36.893707 20199 raft_consensus.cc:2272] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.893838 29587 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:36.897070 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:36.897598 20199 tablet_replica.cc:333] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.897415 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0d19b3841a44cdbbb32daa4e1ddc06" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:36.895839 29587 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:36.899049 21285 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:36.899489 20199 raft_consensus.cc:2243] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.900352 20199 raft_consensus.cc:2272] T 099cc7d3a89e468b91e21306fa23a0be P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.904311 29587 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:36.908476 20199 tablet_replica.cc:333] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.909431 20199 raft_consensus.cc:2243] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.910434 20199 raft_consensus.cc:2272] T 89e2aa178e8e4c63a6f5f660d5314ba7 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.928126 29587 raft_consensus.cc:493] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.928748 29587 raft_consensus.cc:515] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:36.930315 20199 tablet_replica.cc:333] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.931021 29587 leader_election.cc:290] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:36.944145 21206 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 53966.9us
I20260709 13:13:36.945173 21389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:36.932272 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624d76b3bc214b53b7565f644d236663" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:36.931288 20199 raft_consensus.cc:2243] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.948369 21284 leader_election.cc:304] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: bfcd9560f8f44414b25f8069384c5a73, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:36.949134 29587 raft_consensus.cc:2749] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:36.949457 21206 catalog_manager.cc:4755] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7cc0b64eb784638b78409562870a2db: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:13:36.949895 20199 raft_consensus.cc:2272] T c368bc506e8e4024b128c98b0a2a3ae4 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.957947 20199 tablet_replica.cc:333] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.958982 20199 raft_consensus.cc:2243] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.959682 20199 raft_consensus.cc:2272] T 06666c92a06645dc8a8977e923b51e37 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.974367 29580 raft_consensus.cc:2955] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Committing config change with OpId 10.5: config changed from index -1 to 5, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:36.976076 20199 tablet_replica.cc:333] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.982203 20199 raft_consensus.cc:2243] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.983577 20199 raft_consensus.cc:2272] T c90920283ad9436b891dae0b916f29d7 P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.987015 20199 tablet_replica.cc:333] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:36.986938 21465 raft_consensus.cc:2955] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Committing config change with OpId 10.5: config changed from index -1 to 5, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:36.988363 20199 raft_consensus.cc:2243] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.989203 20199 pending_rounds.cc:70] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Trying to abort 3 pending ops.
I20260709 13:13:36.989570 20199 pending_rounds.cc:77] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 23 index: 15 } timestamp: 7305637106254893056 op_type: NO_OP noop_request { }
I20260709 13:13:36.989987 20199 raft_consensus.cc:2889] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:36.990311 20199 pending_rounds.cc:77] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305637044336431104 op_type: NO_OP noop_request { }
I20260709 13:13:36.990722 20199 raft_consensus.cc:2889] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:36.991276 20199 pending_rounds.cc:77] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 19 index: 13 } timestamp: 7305637013345812480 op_type: NO_OP noop_request { }
I20260709 13:13:36.991688 20199 raft_consensus.cc:2889] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:36.992081 20199 raft_consensus.cc:2272] T 71b8185650734d438c79a9d575a2b2f5 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.001822 21467 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:37.006552 21212 catalog_manager.cc:5697] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 5, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 10 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.009341 20199 tablet_replica.cc:333] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.010654 20199 raft_consensus.cc:2243] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.015602 20199 pending_rounds.cc:70] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Trying to abort 1 pending ops.
W20260709 13:13:37.015869 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:37.021826 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:37.016001 20199 pending_rounds.cc:77] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 17 index: 13 } timestamp: 7305636951383134208 op_type: NO_OP noop_request { }
I20260709 13:13:37.025206 20199 raft_consensus.cc:2889] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:37.027194 20199 raft_consensus.cc:2272] T 904858d649144d589875f088692f104f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.031641 20199 tablet_replica.cc:333] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.032755 20199 raft_consensus.cc:2243] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.033941 20199 raft_consensus.cc:2272] T 6d5dc87735964c6b97851e73311aee5a P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.037955 20199 tablet_replica.cc:333] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.039077 20199 raft_consensus.cc:2243] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.039912 20199 raft_consensus.cc:2272] T aff1f323e1c14a199b956742e2f69120 P 058db415e9884ea0ba23f1e1ff59127a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.043392 20199 tablet_replica.cc:333] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.044346 20199 raft_consensus.cc:2243] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.045136 20199 pending_rounds.cc:70] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Trying to abort 1 pending ops.
I20260709 13:13:37.045435 20199 pending_rounds.cc:77] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 23 index: 16 } timestamp: 7305637109296537600 op_type: NO_OP noop_request { }
I20260709 13:13:37.045846 20199 raft_consensus.cc:2889] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:37.046257 20199 raft_consensus.cc:2272] T 3b2812c891d248ecafa8f302d2b72c45 P 058db415e9884ea0ba23f1e1ff59127a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.064002 21389 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:13:37.064913 21433 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67210417ec2d4ac885d194a18af541f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.076464 29280 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:37.077847 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:37.085072 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.090708 20199 tablet_replica.cc:333] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.093169 20199 raft_consensus.cc:2243] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.093933 20199 raft_consensus.cc:2272] T f384b96e64eb4aa9a99fd8372643b01c P 058db415e9884ea0ba23f1e1ff59127a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.097245 20199 tablet_replica.cc:333] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.098196 20199 raft_consensus.cc:2243] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.099007 20199 raft_consensus.cc:2272] T ee8ee0dfd2df46d583c09b3893e01a89 P 058db415e9884ea0ba23f1e1ff59127a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.106964 29597 raft_consensus.cc:2955] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:37.110072 21396 raft_consensus.cc:2955] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
W20260709 13:13:37.113376 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:37.118782 20199 tablet_replica.cc:333] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.120163 20199 raft_consensus.cc:2243] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.121490 20199 raft_consensus.cc:2272] T 1adedb939e97489f9d96abf3bff7f1bd P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.131482 29587 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.132100 29587 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:37.134410 29587 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:37.136615 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:37.142042 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462e641564c94eedaaaa398b75fb188e" candidate_uuid: "058db415e9884ea0ba23f1e1ff59127a" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:37.143649 21285 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058db415e9884ea0ba23f1e1ff59127a; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:13:37.139336 21212 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 11, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:37.144841 29587 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:37.147228 21467 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:37.152482 20199 tablet_replica.cc:333] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.153450 20199 raft_consensus.cc:2243] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.154110 20199 raft_consensus.cc:2272] T fbc8cdcfe1ff495b82553486dbada070 P 058db415e9884ea0ba23f1e1ff59127a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.160528 20199 tablet_replica.cc:333] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.161603 20199 raft_consensus.cc:2243] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.162401 20199 raft_consensus.cc:2272] T 9d2910eb954d42858344d5b85eefd955 P 058db415e9884ea0ba23f1e1ff59127a [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.165500 20199 tablet_replica.cc:333] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.166375 20199 raft_consensus.cc:2243] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.166877 20199 raft_consensus.cc:2272] T 26e3d859a1534f11ba508b90ad562a1b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.171088 20199 tablet_replica.cc:333] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.171926 20199 raft_consensus.cc:2243] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.173182 20199 raft_consensus.cc:2272] T d0f870524af94ba487ca21790bc003cc P 058db415e9884ea0ba23f1e1ff59127a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.184556 20199 tablet_replica.cc:333] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.186475 20199 raft_consensus.cc:2243] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.191025 20199 raft_consensus.cc:2272] T a55c6ecc97b34d419d7290080bc4a2c8 P 058db415e9884ea0ba23f1e1ff59127a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.191855 21433 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175): Couldn't send request to peer bfcd9560f8f44414b25f8069384c5a73. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0f870524af94ba487ca21790bc003cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.194000 21396 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:13:37.194618 20199 tablet_replica.cc:333] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.195519 20199 raft_consensus.cc:2243] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.196130 20199 raft_consensus.cc:2272] T 1e997d08de0c4a8b9b07e0741628b23f P 058db415e9884ea0ba23f1e1ff59127a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.196882 29604 ts_tablet_manager.cc:933] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:37.197147 29597 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:37.199371 20199 tablet_replica.cc:333] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.200495 20199 raft_consensus.cc:2243] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.201956 20199 raft_consensus.cc:2272] T da4a8cf8f0864a8390aba6652b02015e P 058db415e9884ea0ba23f1e1ff59127a [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.203146 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.213306 20199 tablet_replica.cc:333] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.223187 20199 raft_consensus.cc:2243] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.224622 20199 raft_consensus.cc:2272] T 624d76b3bc214b53b7565f644d236663 P 058db415e9884ea0ba23f1e1ff59127a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.228943 20199 tablet_replica.cc:333] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.239041 20199 raft_consensus.cc:2243] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.240062 20199 raft_consensus.cc:2272] T 96bf4c40f9a04c6290d5223c4a18640d P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.243300 20199 tablet_replica.cc:333] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.244235 20199 raft_consensus.cc:2243] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.245074 20199 pending_rounds.cc:70] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Trying to abort 1 pending ops.
I20260709 13:13:37.249461 20199 pending_rounds.cc:77] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 25 index: 15 } timestamp: 7305637076308328448 op_type: NO_OP noop_request { }
I20260709 13:13:37.250046 20199 raft_consensus.cc:2889] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:37.250496 20199 raft_consensus.cc:2272] T fcf4b245b41e47f6bf08fa982e5c1db1 P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.247896 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:37.250663 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:37.264601 20199 tablet_replica.cc:333] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.265563 20199 raft_consensus.cc:2243] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.266220 20199 raft_consensus.cc:2272] T 24db01a278af4a82a16f038fedabf4d3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.267045 21396 raft_consensus.cc:2955] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Committing config change with OpId 26.14: config changed from index -1 to 14, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:37.260674 29597 raft_consensus.cc:2955] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 26 LEADER]: Committing config change with OpId 26.14: config changed from index -1 to 14, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:37.274603 20199 tablet_replica.cc:333] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.301183 20199 raft_consensus.cc:2243] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.302194 29604 tablet_copy_client.cc:323] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:13:37.303539 20199 raft_consensus.cc:2272] T e7cc0b64eb784638b78409562870a2db P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.306245 21211 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index -1 to 14, NON_VOTER bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) added. New cstate: current_term: 26 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } }
I20260709 13:13:37.307417 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 1c0d19b3841a44cdbbb32daa4e1ddc06 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:13:37.308109 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 1c0d19b3841a44cdbbb32daa4e1ddc06 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-1c0d19b3841a44cdbbb32daa4e1ddc06
I20260709 13:13:37.313449 20199 tablet_replica.cc:333] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.314451 20199 raft_consensus.cc:2243] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.315513 20199 pending_rounds.cc:70] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Trying to abort 1 pending ops.
I20260709 13:13:37.315827 20199 pending_rounds.cc:77] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 17 index: 10 } timestamp: 7305637067654914048 op_type: NO_OP noop_request { }
I20260709 13:13:37.316299 20199 raft_consensus.cc:2889] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:37.316699 20199 raft_consensus.cc:2272] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 058db415e9884ea0ba23f1e1ff59127a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.320004 20199 tablet_replica.cc:333] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.320886 20199 raft_consensus.cc:2243] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.321672 20199 raft_consensus.cc:2272] T 9d344e412d584b97b86c32794fb7fb2b P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.328629 20199 tablet_replica.cc:333] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.329381 21480 tablet_copy_source_session.cc:215] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:37.330862 20199 raft_consensus.cc:2243] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.335677 20199 pending_rounds.cc:70] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Trying to abort 2 pending ops.
I20260709 13:13:37.336124 20199 pending_rounds.cc:77] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305637080177295360 op_type: NO_OP noop_request { }
I20260709 13:13:37.336553 20199 raft_consensus.cc:2889] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:37.336915 20199 pending_rounds.cc:77] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 17 index: 13 } timestamp: 7305637035399516160 op_type: NO_OP noop_request { }
I20260709 13:13:37.337301 20199 raft_consensus.cc:2889] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:37.339401 20199 raft_consensus.cc:2272] T e6c1e6c7efbf499daf584842b0aca96c P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.342996 20199 tablet_replica.cc:333] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.344048 20199 raft_consensus.cc:2243] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.344687 20199 raft_consensus.cc:2272] T 67210417ec2d4ac885d194a18af541f3 P 058db415e9884ea0ba23f1e1ff59127a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.356324 29604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0d19b3841a44cdbbb32daa4e1ddc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.362828 20199 tablet_replica.cc:333] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.363883 20199 raft_consensus.cc:2243] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.364749 20199 raft_consensus.cc:2272] T a40320a19af04e62afc637834ab759b2 P 058db415e9884ea0ba23f1e1ff59127a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.368245 20199 tablet_replica.cc:333] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: stopping tablet replica
I20260709 13:13:37.369094 20199 raft_consensus.cc:2243] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.369863 20199 pending_rounds.cc:70] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Trying to abort 1 pending ops.
I20260709 13:13:37.370159 20199 pending_rounds.cc:77] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a: Aborting op as it isn't in flight: id { term: 23 index: 12 } timestamp: 7305637062767296512 op_type: NO_OP noop_request { }
I20260709 13:13:37.370584 20199 raft_consensus.cc:2889] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:37.370987 20199 raft_consensus.cc:2272] T 462e641564c94eedaaaa398b75fb188e P 058db415e9884ea0ba23f1e1ff59127a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.401386 29608 ts_tablet_manager.cc:933] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:37.416939 29608 tablet_copy_client.cc:323] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.194:41493
I20260709 13:13:37.420982 21406 tablet_copy_service.cc:140] P d41c71e861344f0b90e8d44a8d0a3173: Received BeginTabletCopySession request for tablet efd59ed9e9fc41bbae9dde704923fee4 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:36486)
I20260709 13:13:37.421831 21406 tablet_copy_service.cc:161] P d41c71e861344f0b90e8d44a8d0a3173: Beginning new tablet copy session on tablet efd59ed9e9fc41bbae9dde704923fee4 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:36486: session id = bfcd9560f8f44414b25f8069384c5a73-efd59ed9e9fc41bbae9dde704923fee4
I20260709 13:13:37.458634 21406 tablet_copy_source_session.cc:215] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:13:37.474959 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:37.507426 29608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd59ed9e9fc41bbae9dde704923fee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.509446 29604 tablet_copy_client.cc:806] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:37.510128 29604 tablet_copy_client.cc:670] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
W20260709 13:13:37.529716 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:37.548812 29610 ts_tablet_manager.cc:933] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:37.588326 29610 tablet_copy_client.cc:323] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
W20260709 13:13:37.647898 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 64387.7us
W20260709 13:13:37.649202 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:37.686493 29608 tablet_copy_client.cc:806] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:37.687253 29608 tablet_copy_client.cc:670] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
W20260709 13:13:37.699025 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47011.4us
W20260709 13:13:37.704090 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 123544us
I20260709 13:13:37.709403 29604 tablet_copy_client.cc:538] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:37.722994 29604 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
W20260709 13:13:37.708173 21433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:44175, user_credentials={real_user=slave}} blocked reactor thread for 127248us
W20260709 13:13:37.759213 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:37.761162 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:37.762457 29614 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:37.767218 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet 67210417ec2d4ac885d194a18af541f3 from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:13:37.767860 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet 67210417ec2d4ac885d194a18af541f3 from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-67210417ec2d4ac885d194a18af541f3
I20260709 13:13:37.763319 29614 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:37.775818 29614 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:37.777097 21480 tablet_copy_source_session.cc:215] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:13:37.785567 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:37.803038 22002 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:37.812882 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61516.7us
I20260709 13:13:37.814222 29608 tablet_copy_client.cc:538] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:13:37.844484 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:37.853046 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:37.876969 29610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67210417ec2d4ac885d194a18af541f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.880899 29608 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
W20260709 13:13:37.885084 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:37.886725 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:37.894765 29618 ts_tablet_manager.cc:933] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: Initiating tablet copy from peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:37.924948 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:13:37.934492 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:37.942015 29610 tablet_copy_client.cc:806] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:37.930049 29525 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:37.951212 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:37.966683 29610 tablet_copy_client.cc:670] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
W20260709 13:13:37.978291 21436 connection.cc:769] client connection to 127.19.185.193:45701 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:13:38.020134 29610 tablet_copy_client.cc:538] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:38.022089 29618 tablet_copy_client.cc:323] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Beginning tablet copy session from remote peer at address 127.19.185.195:45119
I20260709 13:13:38.027817 29597 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.028458 29597 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.030380 29597 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:38.031613 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:38.033344 21480 tablet_copy_service.cc:140] P 33be1cb5cfc143fc90e164888c96cc6f: Received BeginTabletCopySession request for tablet d0f870524af94ba487ca21790bc003cc from peer bfcd9560f8f44414b25f8069384c5a73 ({username='slave'} at 127.0.0.1:59692)
I20260709 13:13:38.033969 21480 tablet_copy_service.cc:161] P 33be1cb5cfc143fc90e164888c96cc6f: Beginning new tablet copy session on tablet d0f870524af94ba487ca21790bc003cc from peer bfcd9560f8f44414b25f8069384c5a73 at {username='slave'} at 127.0.0.1:59692: session id = bfcd9560f8f44414b25f8069384c5a73-d0f870524af94ba487ca21790bc003cc
I20260709 13:13:38.048434 21480 tablet_copy_source_session.cc:215] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:38.060832 29616 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.061498 29616 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.065160 29616 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:38.079001 29615 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.080322 29580 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.080840 29580 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:38.079546 29615 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:13:38.084501 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173" is_pre_election: true
I20260709 13:13:38.085081 21396 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 25.
I20260709 13:13:38.085407 29618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f870524af94ba487ca21790bc003cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.086437 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 
I20260709 13:13:38.087211 29597 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:13:38.087756 29597 raft_consensus.cc:493] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.088198 29597 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:38.088474 29615 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:38.089913 29580 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:38.093176 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "d41c71e861344f0b90e8d44a8d0a3173" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:38.095772 29280 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.096482 29280 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:38.098215 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:38.105170 29280 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:38.106518 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:38.107286 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.108649 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:38.113546 21465 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:13:38.121358 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:38.121702 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:38.122040 22039 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 21.
I20260709 13:13:38.122745 29424 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:38.123118 29424 raft_consensus.cc:493] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.123448 29424 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:38.125475 29610 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
W20260709 13:13:38.106606 21206 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 61983.4us
W20260709 13:13:38.138473 21206 catalog_manager.cc:4755] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7cc0b64eb784638b78409562870a2db: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:13:38.139362 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:38.139850 21436 leader_election.cc:336] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:13:38.140519 21436 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:13:38.141125 21436 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:13:38.141467 21436 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:38.129009 29597 raft_consensus.cc:515] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:38.142331 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.148653 21467 raft_consensus.cc:2393] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d41c71e861344f0b90e8d44a8d0a3173 in current term 26: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
I20260709 13:13:38.149745 29597 leader_election.cc:290] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:13:38.152850 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8c65f80c468c8e47986515ea7c80" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "d41c71e861344f0b90e8d44a8d0a3173"
W20260709 13:13:38.152796 21362 leader_election.cc:336] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:13:38.153524 21396 raft_consensus.cc:3060] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:13:38.147912 29608 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.156370 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:38.156715 29597 raft_consensus.cc:2749] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:38.157282 29280 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:38.157744 29280 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.158154 29280 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:38.158094 21360 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:13:38.165315 29424 raft_consensus.cc:515] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.156680 29608 tablet_bootstrap.cc:492] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:13:38.177335 29608 ts_tablet_manager.cc:1403] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.304s	user 0.017s	sys 0.021s
I20260709 13:13:38.180148 29618 tablet_copy_client.cc:806] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:38.180858 29618 tablet_copy_client.cc:670] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:38.181066 29608 raft_consensus.cc:359] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:13:38.169642 21436 leader_election.cc:336] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:13:38.174165 29280 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.182204 29608 raft_consensus.cc:740] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:13:38.184249 29280 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:13:38.190112 29597 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.184278 21467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424be00d78cc41f1a80d41735ad881ae" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:38.190807 21467 raft_consensus.cc:3060] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:38.190619 29597 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.188256 29424 leader_election.cc:290] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:38.189383 22039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6629858a6e4c4461a471763a94f0effa" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
I20260709 13:13:38.191879 22039 raft_consensus.cc:3060] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:38.192871 29597 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:13:38.189879 21436 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:13:38.194631 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:13:38.190986 29618 tablet_copy_client.cc:538] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:38.196681 29608 consensus_queue.cc:260] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:38.204854 29608 ts_tablet_manager.cc:1434] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 13:13:38.217010 21396 raft_consensus.cc:2468] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 26.
I20260709 13:13:38.174165 29604 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:13:38.208431 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.217788 29580 raft_consensus.cc:2749] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:13:38.217942 21406 tablet_copy_service.cc:342] P d41c71e861344f0b90e8d44a8d0a3173: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-efd59ed9e9fc41bbae9dde704923fee4 received from {username='slave'} at 127.0.0.1:36486
I20260709 13:13:38.218482 21406 tablet_copy_service.cc:434] P d41c71e861344f0b90e8d44a8d0a3173: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-efd59ed9e9fc41bbae9dde704923fee4 on tablet efd59ed9e9fc41bbae9dde704923fee4 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:38.221587 29604 tablet_bootstrap.cc:492] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:13:38.223668 29604 ts_tablet_manager.cc:1403] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.501s	user 0.057s	sys 0.008s
I20260709 13:13:38.222644 21467 raft_consensus.cc:2468] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 20.
I20260709 13:13:38.223836 21434 leader_election.cc:304] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:38.225620 29597 raft_consensus.cc:2804] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:13:38.226163 29597 raft_consensus.cc:697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
I20260709 13:13:38.227054 29597 consensus_queue.cc:237] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:13:38.227608 21436 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:13:38.228122 21436 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:38.229343 29449 raft_consensus.cc:2749] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:38.233505 22039 raft_consensus.cc:2468] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
W20260709 13:13:38.185546 22002 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:13:38.236431 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 50912.4us
I20260709 13:13:38.237296 21997 leader_election.cc:304] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:38.239884 29424 raft_consensus.cc:2804] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:38.240669 29424 raft_consensus.cc:697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
I20260709 13:13:38.242411 29424 consensus_queue.cc:237] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.256731 29604 raft_consensus.cc:359] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:38.271925 21212 catalog_manager.cc:5697] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 25 to 26, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 26 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.267436 29604 raft_consensus.cc:740] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:13:38.276703 29604 consensus_queue.cc:260] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:38.281632 29604 ts_tablet_manager.cc:1434] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.003s
I20260709 13:13:38.287705 21433 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:38.317217 29597 raft_consensus.cc:2804] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:38.317860 29597 raft_consensus.cc:697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:13:38.314625 22002 leader_election.cc:336] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:13:38.318837 29597 consensus_queue.cc:237] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.327806 29610 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.340289 29610 tablet_bootstrap.cc:492] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:13:38.352720 29610 ts_tablet_manager.cc:1403] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.227s	user 0.033s	sys 0.017s
W20260709 13:13:38.349562 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.342727 29618 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: Bootstrap starting.
I20260709 13:13:38.366412 29610 raft_consensus.cc:359] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:38.369108 29610 raft_consensus.cc:740] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:13:38.369886 29610 consensus_queue.cc:260] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:38.385934 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-1c0d19b3841a44cdbbb32daa4e1ddc06 received from {username='slave'} at 127.0.0.1:59692
I20260709 13:13:38.395309 22041 raft_consensus.cc:1217] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:13:38.395426 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-1c0d19b3841a44cdbbb32daa4e1ddc06 on tablet 1c0d19b3841a44cdbbb32daa4e1ddc06 with peer bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:38.398147 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:38.398998 21211 catalog_manager.cc:5697] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 19 to 20, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 20 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.403241 29610 ts_tablet_manager.cc:1434] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
W20260709 13:13:38.403505 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.412871 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 50870.5us
I20260709 13:13:38.446768 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-67210417ec2d4ac885d194a18af541f3 received from {username='slave'} at 127.0.0.1:59692
I20260709 13:13:38.447190 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-67210417ec2d4ac885d194a18af541f3 on tablet 67210417ec2d4ac885d194a18af541f3 with peer bfcd9560f8f44414b25f8069384c5a73
I20260709 13:13:38.450367 22039 raft_consensus.cc:1217] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:13:38.466996 29424 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.467676 29424 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.472644 29424 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:13:38.474838 22002 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:13:38.475577 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:13:38.478441 21469 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 18.
I20260709 13:13:38.479656 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a
I20260709 13:13:38.480990 29424 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:38.481398 29424 raft_consensus.cc:493] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 058db415e9884ea0ba23f1e1ff59127a)
I20260709 13:13:38.481803 29424 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:38.503252 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.535308 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:38.540613 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.555619 29424 raft_consensus.cc:515] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.569550 21469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5dc87735964c6b97851e73311aee5a" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f"
I20260709 13:13:38.570142 21469 raft_consensus.cc:3060] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:38.576316 29424 leader_election.cc:290] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Requested vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:13:38.577100 21469 raft_consensus.cc:2468] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfcd9560f8f44414b25f8069384c5a73 in term 19.
I20260709 13:13:38.580649 21997 leader_election.cc:304] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:13:38.582902 29424 raft_consensus.cc:2804] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:38.583355 29424 raft_consensus.cc:697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Becoming Leader. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Running, Role: LEADER
W20260709 13:13:38.585774 22002 leader_election.cc:336] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:13:38.596385 29424 consensus_queue.cc:237] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:38.608006 29618 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.609055 29618 tablet_bootstrap.cc:492] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: Bootstrap complete.
I20260709 13:13:38.609826 29618 ts_tablet_manager.cc:1403] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: Time spent bootstrapping tablet: real 0.289s	user 0.062s	sys 0.015s
W20260709 13:13:38.614573 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.621832 21212 catalog_manager.cc:5697] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 21 to 22, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 22 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.638060 22041 raft_consensus.cc:1217] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.4->[10.5-10.5]   Dedup: 10.5->[]
W20260709 13:13:38.654160 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.659307 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:38.661911 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:38.673990 21211 catalog_manager.cc:5697] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: term changed from 18 to 19, leader changed from 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193) to bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196). New cstate: current_term: 19 leader_uuid: "bfcd9560f8f44414b25f8069384c5a73" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.682578 29618 raft_consensus.cc:359] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
I20260709 13:13:38.686280 29618 raft_consensus.cc:740] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: bfcd9560f8f44414b25f8069384c5a73, State: Initialized, Role: LEARNER
I20260709 13:13:38.687124 29618 consensus_queue.cc:260] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } }
W20260709 13:13:38.690122 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.705536 29618 ts_tablet_manager.cc:1434] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.002s
I20260709 13:13:38.725040 21480 tablet_copy_service.cc:342] P 33be1cb5cfc143fc90e164888c96cc6f: Request end of tablet copy session bfcd9560f8f44414b25f8069384c5a73-d0f870524af94ba487ca21790bc003cc received from {username='slave'} at 127.0.0.1:59692
I20260709 13:13:38.725540 21480 tablet_copy_service.cc:434] P 33be1cb5cfc143fc90e164888c96cc6f: ending tablet copy session bfcd9560f8f44414b25f8069384c5a73-d0f870524af94ba487ca21790bc003cc on tablet d0f870524af94ba487ca21790bc003cc with peer bfcd9560f8f44414b25f8069384c5a73
W20260709 13:13:38.744083 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:38.777074 22041 raft_consensus.cc:1217] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 LEARNER]: Deduplicated request from leader. Original: 26.13->[26.14-26.14]   Dedup: 26.14->[]
W20260709 13:13:38.795403 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:38.800603 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.823822 21464 raft_consensus.cc:1275] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:13:38.833765 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:38.836933 21389 raft_consensus.cc:1275] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:13:38.839129 29280 consensus_queue.cc:1048] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:38.839457 29614 consensus_queue.cc:1048] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:38.941516 22041 raft_consensus.cc:1275] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:13:38.967499 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:38.984341 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:39.003360 29597 consensus_queue.cc:1048] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:39.013794 29449 raft_consensus.cc:1064] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:13:39.016361 29597 raft_consensus.cc:1064] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:13:39.019342 29597 consensus_queue.cc:237] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:39.023204 29449 consensus_queue.cc:237] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:13:39.036736 20199 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21342)
I20260709 13:13:39.037006 21464 raft_consensus.cc:1275] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Refusing update from remote peer bfcd9560f8f44414b25f8069384c5a73: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:39.042655 29424 consensus_queue.cc:1048] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:39.055442 21389 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:13:39.057920 29643 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:13:39.074553 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:39.078644 29592 raft_consensus.cc:1064] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
I20260709 13:13:39.084448 29592 consensus_queue.cc:237] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 4, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:39.096208 22039 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:39.102996 21396 raft_consensus.cc:1275] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:13:39.105257 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:39.106163 29449 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:39.113301 22041 raft_consensus.cc:1275] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:13:39.129298 29449 consensus_queue.cc:1048] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:13:39.138561 29648 consensus_queue.cc:1048] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:13:39.194146 21360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:45119, user_credentials={real_user=slave}} blocked reactor thread for 57100.5us
I20260709 13:13:39.203552 21464 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:39.205456 22038 raft_consensus.cc:1275] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 LEARNER]: Refusing update from remote peer d41c71e861344f0b90e8d44a8d0a3173: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:39.220772 29613 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:39.252350 29654 consensus_queue.cc:1048] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:13:39.330735 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:39.418622 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 78700.8us
W20260709 13:13:39.523937 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 95960.4us
I20260709 13:13:39.590634 29597 raft_consensus.cc:1064] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: attempting to promote NON_VOTER bfcd9560f8f44414b25f8069384c5a73 to VOTER
W20260709 13:13:39.594579 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:39.598939 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:39.602113 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 74950.8us
W20260709 13:13:39.612243 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:39.593209 29597 consensus_queue.cc:237] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 12, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:13:39.623185 29643 raft_consensus.cc:2955] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.635078 22031 raft_consensus.cc:2955] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.638695 29661 raft_consensus.cc:2955] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:13:39.641309 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:39.649219 21396 raft_consensus.cc:2955] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.650142 29662 raft_consensus.cc:2955] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Committing config change with OpId 10.6: config changed from index 5 to 6, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.655097 22040 raft_consensus.cc:2955] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Committing config change with OpId 10.6: config changed from index 5 to 6, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.657902 21389 raft_consensus.cc:2955] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
W20260709 13:13:39.680223 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:39.684741 21388 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:13:39.689442 29449 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:13:39.706494 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:39.711467 21216 catalog_manager.cc:5697] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 reported cstate change: config changed from index 11 to 12, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.714488 22031 raft_consensus.cc:2955] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.715850 22038 raft_consensus.cc:1275] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 LEARNER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:13:39.727849 21212 catalog_manager.cc:5697] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 reported cstate change: config changed from index 11 to 12, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.723496 21467 raft_consensus.cc:2955] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Committing config change with OpId 10.6: config changed from index 5 to 6, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.741108 29449 consensus_queue.cc:1048] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:13:39.730406 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:39.773559 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:39.791428 29648 raft_consensus.cc:2955] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 26 LEADER]: Committing config change with OpId 26.15: config changed from index 14 to 15, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.805035 22031 raft_consensus.cc:2955] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Committing config change with OpId 26.15: config changed from index 14 to 15, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.808902 21396 raft_consensus.cc:2955] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Committing config change with OpId 26.15: config changed from index 14 to 15, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.842360 21211 catalog_manager.cc:5697] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 5 to 6, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "d41c71e861344f0b90e8d44a8d0a3173" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } } }
I20260709 13:13:39.921295 21211 catalog_manager.cc:5697] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: config changed from index 14 to 15, bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:39.997717 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.014422 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.037400 20199 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:40.040323 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.093725 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.108120 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.129716 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.233062 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.308763 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 71024.1us
W20260709 13:13:40.328874 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.330875 21206 catalog_manager.cc:4755] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7cc0b64eb784638b78409562870a2db: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:13:40.354959 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.405112 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 49508.5us
W20260709 13:13:40.462571 22002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111) [suppressed 455 similar messages]
W20260709 13:13:40.474639 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.487388 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.554108 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.556900 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.572386 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.624135 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 51803.2us
W20260709 13:13:40.693684 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.722381 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.763284 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.775578 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.776535 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.802357 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.874190 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.890978 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:40.992563 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.037916 20199 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:41.059779 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.074393 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.178128 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.180742 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.247004 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.277784 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.306296 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.410082 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.414240 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.421447 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.441107 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.488441 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.516865 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.545233 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.627152 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.693392 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.718200 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.721311 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.822834 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.833926 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.955641 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:41.963097 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:42.038511 20199 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:42.271441 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:42.329160 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:42.439720 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:42.483827 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:42.645051 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:42.688351 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:42.703123 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:42.743448 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:42.844978 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:42.873842 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:42.921538 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:42.962103 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:42.962944 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:42.968773 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.039008 20199 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:43.089112 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.221665 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.246111 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.310702 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.340808 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.385824 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.399426 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.502619 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.516184 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.517021 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.535434 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.620937 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.691375 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.737243 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.744567 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.802006 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.806619 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.841852 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.886344 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 97317.4us
W20260709 13:13:43.935331 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:43.963388 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 44651.9us
W20260709 13:13:43.982229 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.018837 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:44.039507 20199 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:44.103397 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.041116 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:44.107717 21362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 66649.1us
W20260709 13:13:44.143326 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:44.149338 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.155747 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:44.197443 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.287951 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.292734 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.461577 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.512106 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:44.588020 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:44.638228 22002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 47240.3us
W20260709 13:13:44.643603 21206 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44317.5us
W20260709 13:13:44.676190 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:44.679744 21206 catalog_manager.cc:4755] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7cc0b64eb784638b78409562870a2db: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:13:44.781270 21434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 60222.4us
W20260709 13:13:44.842059 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:44.934365 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.011837 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:45.040247 20199 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:45.223332 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.243301 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.262518 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.312283 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.330307 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.350066 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.369176 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.421393 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.467923 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.470616 22002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260709 13:13:45.620736 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.654666 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.680061 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.703728 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.755967 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.760084 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.783237 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.817762 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.877238 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.968675 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.969509 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:45.980785 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.022022 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.040773 20199 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:46.077153 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.150969 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.168988 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.191527 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.221258 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.259240 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.281698 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.288475 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.389683 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.475281 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.524515 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.525208 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.715235 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.751339 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.782549 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.836054 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:46.860643 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.960644 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.962213 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.031231 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.041297 20199 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:47.058842 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:47.147701 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 57857.3us
W20260709 13:13:47.198037 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.205353 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.494832 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:47.538028 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:47.674474 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.723892 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:47.745873 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.893055 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.898303 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.910986 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:47.898988 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:47.914697 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.041793 20199 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:48.066136 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.069854 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.119462 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.146338 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.160972 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.198221 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.245544 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.295994 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.305964 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.349390 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.459561 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.561156 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.581871 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.591373 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.618300 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.653524 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.654027 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.670171 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.721005 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:48.783391 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.784202 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:48.844839 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.042312 20199 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:49.535285 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:49.543004 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.542913 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.553203 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:49.572659 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:49.586310 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.591377 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.596740 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:49.600572 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:49.630079 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.647459 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.763954 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.775970 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.913918 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.042948 20199 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:50.065362 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.093875 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:50.188789 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.246513 21250 debug-util.cc:398] Leaking SignalData structure 0x7b0800345fc0 after lost signal to thread 20202
W20260709 13:13:50.247624 21250 debug-util.cc:398] Leaking SignalData structure 0x7b0800375fa0 after lost signal to thread 21253
W20260709 13:13:50.249059 21250 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9bc0 after lost signal to thread 21420
W20260709 13:13:50.250339 21250 debug-util.cc:398] Leaking SignalData structure 0x7b08000eff20 after lost signal to thread 21494
W20260709 13:13:50.254627 21250 debug-util.cc:398] Leaking SignalData structure 0x7b080005b160 after lost signal to thread 22066
W20260709 13:13:50.309203 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.423612 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.485087 21362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111) [suppressed 447 similar messages]
W20260709 13:13:50.490820 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.533298 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.565786 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:50.589627 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.605608 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.688162 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.690665 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.711371 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.735445 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.860455 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.875720 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.880671 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.910705 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.940291 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:50.960367 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.043874 20199 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:51.046586 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.053157 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.142426 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.146770 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.147264 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.255306 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.278175 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.430583 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.535353 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.572089 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:51.575862 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:51.595235 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.721884 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.764890 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.816752 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.816885 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.901700 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.941321 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:51.946661 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:51.958638 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:52.045296 20199 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:52.117012 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:52.213296 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:52.225704 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:52.226595 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:52.272758 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:13:52.292279 21208 maintenance_manager.cc:419] P 5338d281947a4ef192ba752d67ec0067: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033339
W20260709 13:13:52.324651 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:13:52.391436 21207 maintenance_manager.cc:643] P 5338d281947a4ef192ba752d67ec0067: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.098s	user 0.026s	sys 0.010s Metrics: {"bytes_written":6882,"delete_count":0,"lbm_write_time_us":1029,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":18505,"threads_started":1,"update_count":271,"wal-append.queue_time_us":11547}
I20260709 13:13:52.413851 21208 maintenance_manager.cc:419] P 5338d281947a4ef192ba752d67ec0067: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.342423
W20260709 13:13:52.463722 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:52.526340 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:52.556679 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:52.731878 21207 maintenance_manager.cc:643] P 5338d281947a4ef192ba752d67ec0067: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.317s	user 0.086s	sys 0.023s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":28406,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":12750,"dirs.run_cpu_time_us":530,"dirs.run_wall_time_us":1470,"lbm_read_time_us":7032,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":24,"lbm_write_time_us":9775,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":11,"peak_mem_usage":305303,"reinsert_count":0,"thread_start_us":16578,"threads_started":2,"update_count":291}
I20260709 13:13:52.734915 21208 maintenance_manager.cc:419] P 5338d281947a4ef192ba752d67ec0067: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:13:52.735817 21207 maintenance_manager.cc:643] P 5338d281947a4ef192ba752d67ec0067: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:13:52.847290 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:52.899147 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:52.937810 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:52.997665 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.012318 21206 catalog_manager.cc:4755] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7cc0b64eb784638b78409562870a2db: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:13:53.021067 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:53.021579 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.045800 20199 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:53.125980 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.128571 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.137013 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.160768 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.167388 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.224571 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.302695 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.311751 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.388727 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.415705 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.564219 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.584815 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.590062 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.665267 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.683965 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.704820 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.900430 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:53.908262 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.928316 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:53.975098 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:54.038623 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.046339 20199 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:54.095376 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.174698 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.190639 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.229369 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.282620 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.339469 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.385521 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:54.397001 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.402180 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.559693 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:54.642938 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.646617 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.661456 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.673341 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:54.856843 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:54.907976 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:54.964761 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:55.038843 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.046998 20199 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:55.183342 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.296425 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:55.341790 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.342365 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.413357 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:55.500456 21362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260709 13:13:55.507104 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:55.561914 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:55.628923 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.631001 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.670624 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:55.717367 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.736343 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:55.754662 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.763464 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.768316 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.836637 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.858158 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:55.867218 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:55.971222 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.974154 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:55.989369 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:56.047487 20199 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:56.118280 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.128978 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.151414 21997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:41493, user_credentials={real_user=slave}} blocked reactor thread for 61414.7us
W20260709 13:13:56.317149 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.346975 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:56.354014 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.367672 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:56.403715 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.465255 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.482254 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:56.550498 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.623700 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:56.652700 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:56.704630 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.811712 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.929713 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:56.974095 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.048002 20199 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:57.056757 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.087570 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.104777 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:57.121955 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.173012 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:57.266196 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.337920 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.445756 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.479914 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:57.563129 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:57.571626 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:57.770772 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.824131 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.912092 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.935247 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.965395 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:57.999754 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.002173 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.021885 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:58.048540 20199 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:58.097316 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:58.130898 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.173832 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.191267 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.214569 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.286782 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:58.414130 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:58.414351 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:58.448990 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:58.577275 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.578890 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.595856 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.608009 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:58.695374 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.787145 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:58.821416 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:58.914713 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:58.952111 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.021929 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:13:59.025712 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.049104 20199 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 21342)
W20260709 13:13:59.087198 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:59.193970 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.263731 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.270296 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.343096 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:59.350822 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.390192 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.409029 21362 consensus_peers.cc:597] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.529894 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:59.594936 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.629963 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.721370 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:59.764292 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.780155 21362 consensus_peers.cc:597] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.883279 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:13:59.981289 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:59.982836 21362 consensus_peers.cc:597] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.049657 20199 thread.cc:527] Waited for 22000ms trying to join with diag-logger (tid 21342)
W20260709 13:14:00.110083 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:14:00.142307 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.282764 21362 consensus_peers.cc:597] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.300834 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:14:00.527155 21436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111) [suppressed 459 similar messages]
W20260709 13:14:00.586120 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 59015.9us
W20260709 13:14:00.621608 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.624336 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:00.648501 21362 consensus_peers.cc:597] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:00.649725 21362 consensus_peers.cc:597] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.650957 21362 consensus_peers.cc:597] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:00.654644 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.697346 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.698315 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:00.706966 21362 consensus_peers.cc:597] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:00.718088 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.760449 21362 consensus_peers.cc:597] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:00.868094 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:00.912895 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:01.046751 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.078480 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:01.146453 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.147179 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.227203 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:01.286588 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:01.335820 21362 consensus_peers.cc:597] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.386345 21362 consensus_peers.cc:597] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.443943 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:14:01.450225 20199 tablet_server.cc:196] TabletServer@127.19.185.193:0 shutdown complete.
W20260709 13:14:01.490520 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.539189 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.553315 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:01.576368 21362 consensus_peers.cc:597] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:14:01.585908 21362 consensus_peers.cc:597] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.600127 22063 debug-util.cc:398] Leaking SignalData structure 0x7b08003b28c0 after lost signal to thread 20202
W20260709 13:14:01.601383 22063 debug-util.cc:398] Leaking SignalData structure 0x7b080028e980 after lost signal to thread 21253
W20260709 13:14:01.602852 22063 debug-util.cc:398] Leaking SignalData structure 0x7b080040b1c0 after lost signal to thread 21420
W20260709 13:14:01.607291 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800288420 after lost signal to thread 21494
W20260709 13:14:01.610553 22063 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1880 after lost signal to thread 22066
W20260709 13:14:01.651907 21362 consensus_peers.cc:597] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.652559 21362 consensus_peers.cc:597] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:14:01.660372 20199 tablet_server.cc:179] TabletServer@127.19.185.194:0 shutting down...
W20260709 13:14:01.689570 21362 consensus_peers.cc:597] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:01.720203 21997 consensus_peers.cc:597] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.726045 21997 consensus_peers.cc:597] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.732497 21997 consensus_peers.cc:597] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.755931 21434 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.756867 21997 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.766507 21434 consensus_peers.cc:597] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.777597 21434 consensus_peers.cc:597] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.781145 21997 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.811010 21434 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:01.812996 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:01.829543 21997 consensus_peers.cc:597] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.835466 21434 consensus_peers.cc:597] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:01.836421 20199 tablet_replica.cc:333] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.837661 20199 raft_consensus.cc:2243] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:01.839506 20199 raft_consensus.cc:2272] T c4e9f5b52ad74d0d8f492da1f7ef4721 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:01.854393 21434 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.859498 21434 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.860821 21997 consensus_peers.cc:597] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:01.863904 20199 tablet_replica.cc:333] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.865036 20199 raft_consensus.cc:2243] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.865975 20199 raft_consensus.cc:2272] T 3c3784e213304c30beba718dd813ab39 P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.869323 20199 tablet_replica.cc:333] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.873099 20199 raft_consensus.cc:2243] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.874657 20199 raft_consensus.cc:2272] T 3549d7d86f4c404f95fae0e1f6b84210 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.881778 20199 tablet_replica.cc:333] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.883074 20199 raft_consensus.cc:2243] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.883919 20199 raft_consensus.cc:2272] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.888700 20199 tablet_replica.cc:333] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.889791 20199 raft_consensus.cc:2243] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.890496 20199 raft_consensus.cc:2272] T 603c27f4d3de4b40878c1d29bcc0708a P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:01.905493 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.908692 21434 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.913916 21997 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.914428 21434 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.915107 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:01.919778 21434 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.930467 21434 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:01.929039 20199 tablet_replica.cc:333] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.932687 20199 raft_consensus.cc:2243] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.933657 20199 raft_consensus.cc:2272] T e7b73223e6ab497f810757f895658e8b P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.937350 20199 tablet_replica.cc:333] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.938757 20199 raft_consensus.cc:2243] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:01.940706 20199 raft_consensus.cc:2272] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:01.945859 21997 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:01.946739 20199 tablet_replica.cc:333] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.949180 20199 raft_consensus.cc:2243] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.950055 20199 raft_consensus.cc:2272] T ff7ec37b4f0643d4b4d60d35243b93d8 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.953151 20199 tablet_replica.cc:333] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.954030 20199 raft_consensus.cc:2243] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.955399 20199 raft_consensus.cc:2272] T 91e50669ee6e496d9e5aaf0b2cc43c1c P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.959518 20199 tablet_replica.cc:333] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.960460 20199 raft_consensus.cc:2243] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:01.961721 20199 raft_consensus.cc:2272] T c0b7a12853fc411b980438f7ae62ad14 P d41c71e861344f0b90e8d44a8d0a3173 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.970067 20199 tablet_replica.cc:333] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
W20260709 13:14:01.970515 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:14:01.971910 20199 raft_consensus.cc:2243] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.972667 20199 raft_consensus.cc:2272] T dffab1617f544c36913eb55e6bad723c P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.975512 20199 tablet_replica.cc:333] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.976464 20199 raft_consensus.cc:2243] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.977120 20199 raft_consensus.cc:2272] T d7bf8c65f80c468c8e47986515ea7c80 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.979976 20199 tablet_replica.cc:333] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.980962 20199 raft_consensus.cc:2243] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:14:01.982252 20199 raft_consensus.cc:2272] T d1e856d5af49457aa83cfe00a413716d P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:01.984972 20199 tablet_replica.cc:333] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.985724 20199 raft_consensus.cc:2243] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:01.987403 20199 raft_consensus.cc:2272] T 85584105b0f74652871311c68f5de4db P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:01.988286 21997 consensus_peers.cc:597] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:01.990118 20199 tablet_replica.cc:333] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:01.992126 20199 raft_consensus.cc:2243] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:01.994576 20199 raft_consensus.cc:2272] T bb2ce5a5a1e3461d8e0031fdfef61569 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:01.999504 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:14:02.000721 20199 tablet_replica.cc:333] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.001681 20199 raft_consensus.cc:2243] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.005185 20199 raft_consensus.cc:2272] T aff1f323e1c14a199b956742e2f69120 P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.010281 20199 tablet_replica.cc:333] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.011277 20199 raft_consensus.cc:2243] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.012290 20199 raft_consensus.cc:2272] T 849cad40897e412da9a737986240fc35 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.015298 20199 tablet_replica.cc:333] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.016227 20199 raft_consensus.cc:2243] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.017894 20199 raft_consensus.cc:2272] T efd59ed9e9fc41bbae9dde704923fee4 P d41c71e861344f0b90e8d44a8d0a3173 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.020681 20199 tablet_replica.cc:333] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.021585 20199 raft_consensus.cc:2243] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.022334 20199 raft_consensus.cc:2272] T daddf6dabfd442eb82ef13b979cf0aa7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.025386 20199 tablet_replica.cc:333] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.026350 20199 raft_consensus.cc:2243] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.027222 20199 raft_consensus.cc:2272] T f8909ec5d582450ba80932fa543ad4a1 P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.036823 20199 tablet_replica.cc:333] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
W20260709 13:14:02.043085 21434 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.041524 20199 raft_consensus.cc:2243] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.045481 20199 raft_consensus.cc:2272] T 89e2aa178e8e4c63a6f5f660d5314ba7 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.048245 20199 tablet_replica.cc:333] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.049172 20199 raft_consensus.cc:2243] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.049966 20199 raft_consensus.cc:2272] T c368bc506e8e4024b128c98b0a2a3ae4 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.053815 20199 tablet_replica.cc:333] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
W20260709 13:14:02.054495 21997 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.054633 20199 raft_consensus.cc:2243] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.056794 20199 raft_consensus.cc:2272] T c90920283ad9436b891dae0b916f29d7 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.061866 21434 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.067606 21434 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.069096 20199 tablet_replica.cc:333] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.070047 20199 raft_consensus.cc:2243] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.070904 20199 raft_consensus.cc:2272] T 71b8185650734d438c79a9d575a2b2f5 P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.073621 20199 tablet_replica.cc:333] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.074548 20199 raft_consensus.cc:2243] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.075834 20199 raft_consensus.cc:2272] T 26e3d859a1534f11ba508b90ad562a1b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.082660 20199 tablet_replica.cc:333] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.083590 20199 raft_consensus.cc:2243] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.084856 20199 raft_consensus.cc:2272] T f384b96e64eb4aa9a99fd8372643b01c P d41c71e861344f0b90e8d44a8d0a3173 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.103089 21997 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.121716 20199 tablet_replica.cc:333] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.122777 20199 raft_consensus.cc:2243] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.123520 20199 raft_consensus.cc:2272] T ee8ee0dfd2df46d583c09b3893e01a89 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.127349 20199 tablet_replica.cc:333] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.128279 20199 raft_consensus.cc:2243] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.129287 20199 raft_consensus.cc:2272] T d0f870524af94ba487ca21790bc003cc P d41c71e861344f0b90e8d44a8d0a3173 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.132053 20199 tablet_replica.cc:333] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.133222 20199 raft_consensus.cc:2243] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.134277 20199 raft_consensus.cc:2272] T a55c6ecc97b34d419d7290080bc4a2c8 P d41c71e861344f0b90e8d44a8d0a3173 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.136451 21997 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.138024 20199 tablet_replica.cc:333] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.138993 20199 raft_consensus.cc:2243] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.139745 20199 raft_consensus.cc:2272] T 30bf17cca2e64e76b923a076142551ff P d41c71e861344f0b90e8d44a8d0a3173 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.143069 20199 tablet_replica.cc:333] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.143965 20199 raft_consensus.cc:2243] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.144680 20199 raft_consensus.cc:2272] T 1adedb939e97489f9d96abf3bff7f1bd P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.147535 20199 tablet_replica.cc:333] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.148653 20199 raft_consensus.cc:2243] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.149906 20199 raft_consensus.cc:2272] T fbc8cdcfe1ff495b82553486dbada070 P d41c71e861344f0b90e8d44a8d0a3173 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.159578 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:02.160223 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:14:02.162439 20199 tablet_replica.cc:333] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.163347 20199 raft_consensus.cc:2243] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:02.163576 21997 consensus_peers.cc:597] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.164461 20199 raft_consensus.cc:2272] T ce267b84e93f48afa7ad5caa450b982a P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.166756 21997 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.168196 20199 tablet_replica.cc:333] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
W20260709 13:14:02.174083 21434 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.177107 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:14:02.179840 20199 raft_consensus.cc:2243] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.181710 20199 raft_consensus.cc:2272] T 9d2910eb954d42858344d5b85eefd955 P d41c71e861344f0b90e8d44a8d0a3173 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.185599 20199 tablet_replica.cc:333] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.186391 20199 raft_consensus.cc:2243] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.187503 20199 raft_consensus.cc:2272] T 4a81f5eab37044228b941f7eb2be5912 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.190272 20199 tablet_replica.cc:333] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.191484 20199 raft_consensus.cc:2243] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:14:02.196519 21434 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.197506 20199 raft_consensus.cc:2272] T da4a8cf8f0864a8390aba6652b02015e P d41c71e861344f0b90e8d44a8d0a3173 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.210706 20199 tablet_replica.cc:333] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.211675 20199 raft_consensus.cc:2243] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.212877 20199 raft_consensus.cc:2272] T 624d76b3bc214b53b7565f644d236663 P d41c71e861344f0b90e8d44a8d0a3173 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.216235 20199 tablet_replica.cc:333] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.217293 20199 raft_consensus.cc:2243] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.218155 20199 raft_consensus.cc:2272] T 96bf4c40f9a04c6290d5223c4a18640d P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.220885 20199 tablet_replica.cc:333] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.221870 20199 raft_consensus.cc:2243] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.222497 20199 raft_consensus.cc:2272] T fcf4b245b41e47f6bf08fa982e5c1db1 P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.226541 20199 tablet_replica.cc:333] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.227380 20199 raft_consensus.cc:2243] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.227974 20199 raft_consensus.cc:2272] T 24db01a278af4a82a16f038fedabf4d3 P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.231508 20199 tablet_replica.cc:333] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
W20260709 13:14:02.231932 21997 consensus_peers.cc:597] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.232429 20199 raft_consensus.cc:2243] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.233161 20199 raft_consensus.cc:2272] T 5c2d5354d62e4be08f444a5f6556b8dc P d41c71e861344f0b90e8d44a8d0a3173 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.236121 20199 tablet_replica.cc:333] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.243088 20199 raft_consensus.cc:2243] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.243829 20199 raft_consensus.cc:2272] T e7cc0b64eb784638b78409562870a2db P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.246953 20199 tablet_replica.cc:333] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.247689 20199 raft_consensus.cc:2243] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.248958 20199 raft_consensus.cc:2272] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P d41c71e861344f0b90e8d44a8d0a3173 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.251529 20199 tablet_replica.cc:333] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.252274 20199 raft_consensus.cc:2243] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.253564 20199 raft_consensus.cc:2272] T 077d2ef89a5347dc8b8e863085f1d4e2 P d41c71e861344f0b90e8d44a8d0a3173 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.299209 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:14:02.309473 20199 tablet_replica.cc:333] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.311053 20199 raft_consensus.cc:2243] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.311792 20199 raft_consensus.cc:2272] T 9d344e412d584b97b86c32794fb7fb2b P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.314667 20199 tablet_replica.cc:333] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.315428 20199 raft_consensus.cc:2243] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.316937 20199 raft_consensus.cc:2272] T e6c1e6c7efbf499daf584842b0aca96c P d41c71e861344f0b90e8d44a8d0a3173 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.319700 20199 tablet_replica.cc:333] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
W20260709 13:14:02.320062 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:14:02.320498 20199 raft_consensus.cc:2243] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.321826 20199 raft_consensus.cc:2272] T 462e641564c94eedaaaa398b75fb188e P d41c71e861344f0b90e8d44a8d0a3173 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.335613 20199 tablet_replica.cc:333] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.336483 20199 raft_consensus.cc:2243] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:14:02.347376 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:14:02.349141 20199 raft_consensus.cc:2272] T a40320a19af04e62afc637834ab759b2 P d41c71e861344f0b90e8d44a8d0a3173 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.351936 20199 tablet_replica.cc:333] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173: stopping tablet replica
I20260709 13:14:02.352659 20199 raft_consensus.cc:2243] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.353835 20199 raft_consensus.cc:2272] T 67210417ec2d4ac885d194a18af541f3 P d41c71e861344f0b90e8d44a8d0a3173 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.082508 29768 raft_consensus.cc:493] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.083268 29768 raft_consensus.cc:515] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.085835 29768 leader_election.cc:290] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.092370 29762 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.093083 29762 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.095182 29762 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:03.229969 21436 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.009s	sys 0.015s
W20260709 13:14:03.230515 21436 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.015s
I20260709 13:14:03.237581 29765 raft_consensus.cc:493] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.238130 29765 raft_consensus.cc:515] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.240200 29765 leader_election.cc:290] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.234352 29759 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.245422 29768 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.231051 29762 raft_consensus.cc:493] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.311784 29762 raft_consensus.cc:515] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.314553 29762 leader_election.cc:290] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.240924 29765 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.320011 29765 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:14:03.322113 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:14:03.322880 29765 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:14:03.301743 29775 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.303135 29768 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.303023 29759 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:03.334852 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:14:03.336264 22038 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:14:03.341195 29768 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.342963 29759 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.332016 29775 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:03.347957 29775 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
W20260709 13:14:03.354090 21436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:45701, user_credentials={real_user=slave}} blocked reactor thread for 44475.8us
I20260709 13:14:03.358616 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:14:03.359297 22038 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 22.
I20260709 13:14:03.360280 29771 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.360836 29771 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:03.362972 29771 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.364748 29734 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.365238 29734 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:03.365547 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
I20260709 13:14:03.367255 29734 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.368001 29776 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:03.368448 29776 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting leader election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.368870 29776 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:03.370030 29775 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.370584 29775 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.372550 29775 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.364460 29770 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.374032 29770 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:03.387202 29770 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:03.383709 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:14:03.388670 29779 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.393564 29779 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:14:03.394058 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:03.377526 21436 leader_election.cc:336] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:03.398419 21436 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:03.400156 21466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "bfcd9560f8f44414b25f8069384c5a73" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "33be1cb5cfc143fc90e164888c96cc6f" is_pre_election: true
I20260709 13:14:03.400285 29779 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:03.400620 21436 leader_election.cc:336] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:03.402706 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:14:03.402647 29775 raft_consensus.cc:493] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
W20260709 13:14:03.404227 21436 leader_election.cc:336] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:03.399586 29776 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:03.403923 29775 raft_consensus.cc:515] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:14:03.405086 21436 leader_election.cc:336] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:03.406667 29775 leader_election.cc:290] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.408332 21466 raft_consensus.cc:2393] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfcd9560f8f44414b25f8069384c5a73 in current term 23: Already voted for candidate 33be1cb5cfc143fc90e164888c96cc6f in this term.
W20260709 13:14:03.409492 21997 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.409811 29776 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Requested vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:14:03.409988 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:14:03.403277 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:03.411521 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:03.411604 22038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3f0ee4cdba4795b8a75e55bdfd0512" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73"
W20260709 13:14:03.412101 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:03.412218 22038 raft_consensus.cc:3060] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:14:03.412600 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:03.413769 21997 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.414196 21997 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.415010 29759 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:03.411103 29770 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:03.421685 21436 leader_election.cc:336] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:03.422214 22038 raft_consensus.cc:2468] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 23.
W20260709 13:14:03.425079 21436 leader_election.cc:336] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:03.424046 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:03.425846 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:03.415045 21997 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.427052 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.428880 29770 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:03.426465 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:14:03.429899 21436 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:14:03.430094 21433 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 
W20260709 13:14:03.430523 21436 consensus_peers.cc:597] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:03.430821 21434 leader_election.cc:336] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.431051 29776 raft_consensus.cc:2804] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:03.444298 21434 leader_election.cc:304] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.444552 29776 raft_consensus.cc:697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Becoming Leader. State: Replica: 33be1cb5cfc143fc90e164888c96cc6f, State: Running, Role: LEADER
W20260709 13:14:03.445616 21434 leader_election.cc:336] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.446074 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.445756 29776 consensus_queue.cc:237] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:03.446972 29775 raft_consensus.cc:2749] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:03.445691 29773 raft_consensus.cc:2749] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:03.435721 21436 leader_election.cc:336] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:03.457178 21436 consensus_peers.cc:597] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:03.437026 21997 leader_election.cc:336] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:03.446987 21434 leader_election.cc:336] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.466769 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.466846 21434 leader_election.cc:304] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.467587 29770 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:03.471051 21212 catalog_manager.cc:5697] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f reported cstate change: term changed from 22 to 23, leader changed from d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194) to 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195). New cstate: current_term: 23 leader_uuid: "33be1cb5cfc143fc90e164888c96cc6f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:03.472602 21997 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.473183 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.474838 29770 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:03.475382 29776 raft_consensus.cc:2749] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:03.491935 29773 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.492635 29773 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.495249 29773 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.498142 29776 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.506413 29776 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:14:03.497052 21434 leader_election.cc:336] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.508538 21434 leader_election.cc:304] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.508924 29776 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:03.509351 29773 raft_consensus.cc:2749] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:03.509532 21434 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:03.509938 21436 leader_election.cc:336] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:03.512126 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:14:03.513228 21434 leader_election.cc:336] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.513621 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:14:03.514426 21434 leader_election.cc:336] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:03.515070 21434 leader_election.cc:336] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.515394 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.516064 29776 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:14:03.516016 29773 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:03.518133 21436 leader_election.cc:336] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:03.519137 21434 leader_election.cc:336] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.530844 21434 leader_election.cc:304] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.533002 29776 raft_consensus.cc:2749] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:14:03.533195 21434 leader_election.cc:336] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.519668 29773 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:14:03.543635 21436 consensus_peers.cc:597] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:14:03.545547 29776 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.546177 29776 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.548676 29776 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:03.556885 21436 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:03.560777 21434 leader_election.cc:336] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.561558 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.580282 29773 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:03.582406 21434 leader_election.cc:336] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.585412 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.586526 29773 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:03.598055 21434 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:03.601786 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.605608 29773 raft_consensus.cc:2749] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:14:03.686717 21436 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:14:03.761940 29773 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:03.762490 29773 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:03.764699 29773 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:03.776077 21434 leader_election.cc:336] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:03.778926 21436 leader_election.cc:336] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:03.779379 21436 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:03.781235 29773 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:14:03.805426 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:03.829350 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:03.844697 21436 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:03.846101 21436 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:14:03.936112 22038 raft_consensus.cc:1275] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Refusing update from remote peer 33be1cb5cfc143fc90e164888c96cc6f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:03.937755 29776 consensus_queue.cc:1048] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:14:03.988560 21434 consensus_peers.cc:597] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:04.056275 21436 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:04.140671 21436 consensus_peers.cc:597] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:04.241647 22063 debug-util.cc:398] Leaking SignalData structure 0x7b08003df840 after lost signal to thread 20202
W20260709 13:14:04.242931 22063 debug-util.cc:398] Leaking SignalData structure 0x7b080031d920 after lost signal to thread 21253
W20260709 13:14:04.244396 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800373280 after lost signal to thread 21494
W20260709 13:14:04.245645 22063 debug-util.cc:398] Leaking SignalData structure 0x7b0800250d40 after lost signal to thread 22066
W20260709 13:14:04.284458 21436 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:14:04.310002 21434 consensus_peers.cc:597] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.313891 21436 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:04.343559 21997 consensus_peers.cc:597] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.365674 21434 consensus_peers.cc:597] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.367236 21436 consensus_peers.cc:597] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:14:04.391723 21436 consensus_peers.cc:597] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:04.404492 21434 consensus_peers.cc:597] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.409245 21997 consensus_peers.cc:597] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.443439 21434 consensus_peers.cc:597] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.463852 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:04.512687 21997 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.558466 21997 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.567903 21997 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.723219 21997 consensus_peers.cc:597] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.733603 21434 consensus_peers.cc:597] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.734537 21434 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.739025 21436 consensus_peers.cc:597] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:04.744287 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:04.745759 21997 consensus_peers.cc:597] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.748006 21434 consensus_peers.cc:597] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.753458 21434 consensus_peers.cc:597] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.787469 21997 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.792925 21434 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.795974 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:14:04.802778 21434 consensus_peers.cc:597] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.810424 21997 consensus_peers.cc:597] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.815018 21997 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:04.825927 20199 tablet_server.cc:196] TabletServer@127.19.185.194:0 shutdown complete.
W20260709 13:14:04.833833 21436 consensus_peers.cc:597] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:14:04.854200 21434 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.884907 21434 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.892556 21434 consensus_peers.cc:597] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.894934 21997 consensus_peers.cc:597] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.907790 21997 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:04.913136 21997 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:05.013072 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:14:05.035143 21997 consensus_peers.cc:597] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:05.037330 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:05.065614 21997 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:05.083741 29773 raft_consensus.cc:493] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.084813 29773 raft_consensus.cc:515] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:14:05.089116 21436 consensus_peers.cc:597] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:14:05.096325 29794 raft_consensus.cc:493] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.097144 29794 raft_consensus.cc:515] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:05.102824 29794 leader_election.cc:290] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:05.106796 29773 leader_election.cc:290] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:05.108873 29796 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.109637 29796 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:05.112141 29796 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:05.117587 21997 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:05.118319 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:05.118862 22002 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:05.120299 29796 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:05.121299 21436 leader_election.cc:336] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:05.128865 21436 leader_election.cc:336] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:05.128340 20199 tablet_server.cc:179] TabletServer@127.19.185.195:0 shutting down...
I20260709 13:14:05.134666 29773 raft_consensus.cc:493] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.135414 29773 raft_consensus.cc:515] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:05.143597 29773 leader_election.cc:290] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:05.148306 21436 leader_election.cc:336] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:05.186913 21997 consensus_peers.cc:597] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:05.201911 21436 consensus_peers.cc:597] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:05.188458 21997 consensus_peers.cc:597] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:05.235572 21997 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.241431 29796 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.244251 29773 raft_consensus.cc:493] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.244869 29773 raft_consensus.cc:515] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:05.246999 29773 leader_election.cc:290] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:05.242026 29796 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:05.249029 29796 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:05.252146 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:05.256175 21436 leader_election.cc:336] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:05.257014 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:05.262974 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:05.238296 21997 consensus_peers.cc:597] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.264376 20199 tablet_replica.cc:333] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.268165 20199 raft_consensus.cc:2243] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.269639 20199 raft_consensus.cc:2272] T 984d063a64ef47f7b0783e2181604515 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.273305 20199 tablet_replica.cc:333] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.274236 20199 raft_consensus.cc:2243] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.276705 20199 raft_consensus.cc:2272] T 3c3784e213304c30beba718dd813ab39 P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.279829 20199 tablet_replica.cc:333] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.280710 20199 raft_consensus.cc:2243] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:14:05.280791 21997 consensus_peers.cc:597] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.281925 20199 raft_consensus.cc:2272] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:05.286507 21997 consensus_peers.cc:597] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.289361 20199 tablet_replica.cc:333] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.290859 20199 raft_consensus.cc:2243] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:05.289863 21997 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:05.291711 20199 raft_consensus.cc:2272] T c4e9f5b52ad74d0d8f492da1f7ef4721 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.295616 21997 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:05.296495 29796 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:05.298082 21997 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.299608 20199 tablet_replica.cc:333] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.303344 20199 raft_consensus.cc:2243] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.305691 20199 raft_consensus.cc:2272] T 91e50669ee6e496d9e5aaf0b2cc43c1c P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:05.304910 21997 consensus_peers.cc:597] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.308925 20199 tablet_replica.cc:333] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.309938 20199 raft_consensus.cc:2243] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.313850 29796 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.314530 29796 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:05.317368 29796 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:05.323899 21997 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:05.324185 22002 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:05.325712 21997 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:05.326493 21997 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:05.327214 29796 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:05.329443 20199 raft_consensus.cc:2272] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:05.330763 21997 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:05.335079 20199 tablet_replica.cc:333] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.336369 20199 raft_consensus.cc:2243] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.338483 20199 raft_consensus.cc:2272] T dffab1617f544c36913eb55e6bad723c P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.341212 20199 tablet_replica.cc:333] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.342015 20199 raft_consensus.cc:2243] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.343086 20199 raft_consensus.cc:2272] T d7bf8c65f80c468c8e47986515ea7c80 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.346012 20199 tablet_replica.cc:333] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.346859 20199 raft_consensus.cc:2243] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.347681 20199 raft_consensus.cc:2272] T 424be00d78cc41f1a80d41735ad881ae P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.350656 20199 tablet_replica.cc:333] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.351469 20199 raft_consensus.cc:2243] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.352533 29794 raft_consensus.cc:493] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.353076 29794 raft_consensus.cc:515] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:05.355140 29794 leader_election.cc:290] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:05.356101 20199 raft_consensus.cc:2272] T 85584105b0f74652871311c68f5de4db P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.358736 20199 tablet_replica.cc:333] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.359604 20199 raft_consensus.cc:2243] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:14:05.360450 21436 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:05.361053 20199 raft_consensus.cc:2272] T 6629858a6e4c4461a471763a94f0effa P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:05.370330 21997 consensus_peers.cc:597] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.374722 20199 tablet_replica.cc:333] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.375769 20199 raft_consensus.cc:2243] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.377533 29794 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.378125 29794 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:05.383914 22041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd59ed9e9fc41bbae9dde704923fee4" candidate_uuid: "33be1cb5cfc143fc90e164888c96cc6f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bfcd9560f8f44414b25f8069384c5a73" is_pre_election: true
I20260709 13:14:05.384769 22041 raft_consensus.cc:2468] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33be1cb5cfc143fc90e164888c96cc6f in term 10.
I20260709 13:14:05.386686 29794 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), bfcd9560f8f44414b25f8069384c5a73 (127.19.185.196:44175)
I20260709 13:14:05.387187 20199 raft_consensus.cc:2272] T 71b8185650734d438c79a9d575a2b2f5 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:05.391456 21436 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:05.392373 21997 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.395718 20199 tablet_replica.cc:333] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
W20260709 13:14:05.398864 21997 consensus_peers.cc:597] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:05.396130 21436 consensus_peers.cc:597] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:14:05.399677 20199 raft_consensus.cc:2243] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.400593 20199 raft_consensus.cc:2272] T bb2ce5a5a1e3461d8e0031fdfef61569 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.407501 20199 tablet_replica.cc:333] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.408416 20199 raft_consensus.cc:2243] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.409633 20199 raft_consensus.cc:2272] T daddf6dabfd442eb82ef13b979cf0aa7 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.412556 20199 tablet_replica.cc:333] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.413374 20199 raft_consensus.cc:2243] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.414137 20199 raft_consensus.cc:2272] T f8909ec5d582450ba80932fa543ad4a1 P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.417140 20199 tablet_replica.cc:333] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.422519 20199 raft_consensus.cc:2243] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.423573 20199 raft_consensus.cc:2272] T 904858d649144d589875f088692f104f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.426375 20199 tablet_replica.cc:333] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.427093 20199 raft_consensus.cc:2243] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.427786 20199 raft_consensus.cc:2272] T 6d5dc87735964c6b97851e73311aee5a P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.430516 20199 tablet_replica.cc:333] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.433104 20199 raft_consensus.cc:2243] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.433898 20199 raft_consensus.cc:2272] T aff1f323e1c14a199b956742e2f69120 P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.436707 20199 tablet_replica.cc:333] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.437502 20199 raft_consensus.cc:2243] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:05.437990 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.438221 20199 raft_consensus.cc:2272] T 3b2812c891d248ecafa8f302d2b72c45 P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:05.468478 21997 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.474623 20199 tablet_replica.cc:333] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.475517 20199 raft_consensus.cc:2243] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.476619 20199 raft_consensus.cc:2272] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.479480 20199 tablet_replica.cc:333] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.480213 20199 raft_consensus.cc:2243] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.481007 20199 raft_consensus.cc:2272] T 849cad40897e412da9a737986240fc35 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.484719 20199 tablet_replica.cc:333] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.485502 20199 raft_consensus.cc:2243] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.486819 20199 raft_consensus.cc:2272] T 4cfcdfda7a4840b78d5a89acd61b8d23 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.490854 20199 tablet_replica.cc:333] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.491743 20199 raft_consensus.cc:2243] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.493024 20199 raft_consensus.cc:2272] T 099cc7d3a89e468b91e21306fa23a0be P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.495960 20199 tablet_replica.cc:333] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.496742 20199 raft_consensus.cc:2243] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.503371 20199 raft_consensus.cc:2272] T c368bc506e8e4024b128c98b0a2a3ae4 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.506738 20199 tablet_replica.cc:333] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.508023 20199 raft_consensus.cc:2243] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.509508 20199 raft_consensus.cc:2272] T 06666c92a06645dc8a8977e923b51e37 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.512321 20199 tablet_replica.cc:333] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.513545 20199 raft_consensus.cc:2243] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.514541 20199 raft_consensus.cc:2272] T ee8ee0dfd2df46d583c09b3893e01a89 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.522497 20199 tablet_replica.cc:333] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.523729 20199 raft_consensus.cc:2243] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.524520 20199 raft_consensus.cc:2272] T 26e3d859a1534f11ba508b90ad562a1b P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.528885 29734 raft_consensus.cc:493] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.529443 29734 raft_consensus.cc:515] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:14:05.532696 22002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111) [suppressed 621 similar messages]
W20260709 13:14:05.541596 21997 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:05.544396 29734 leader_election.cc:290] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:05.546754 22002 leader_election.cc:336] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:05.547997 22002 leader_election.cc:304] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:05.550722 29734 raft_consensus.cc:2749] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:05.558900 20199 tablet_replica.cc:333] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.559860 20199 raft_consensus.cc:2243] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.560802 20199 raft_consensus.cc:2272] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.563879 20199 tablet_replica.cc:333] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.564682 20199 raft_consensus.cc:2243] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.565845 20199 raft_consensus.cc:2272] T 96bf4c40f9a04c6290d5223c4a18640d P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.568689 20199 tablet_replica.cc:333] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.569542 20199 raft_consensus.cc:2243] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.571522 20199 raft_consensus.cc:2272] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.574504 20199 tablet_replica.cc:333] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.575372 20199 raft_consensus.cc:2243] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.576851 20199 raft_consensus.cc:2272] T fcf4b245b41e47f6bf08fa982e5c1db1 P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.580547 20199 tablet_replica.cc:333] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:05.581496 20199 raft_consensus.cc:2243] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:14:05.599416 21997 consensus_peers.cc:597] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:05.803580 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.826272 29793 raft_consensus.cc:493] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.827067 29793 raft_consensus.cc:515] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
I20260709 13:14:05.829926 29793 leader_election.cc:290] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:05.837227 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.872443 21434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.910969 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.911478 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.912166 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.912587 21433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.918556 21436 consensus_peers.cc:597] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:14:05.919250 21436 leader_election.cc:336] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:05.924954 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.925529 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.926883 29793 raft_consensus.cc:493] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.927435 29793 raft_consensus.cc:515] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } }
W20260709 13:14:05.930611 21435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.930964 29793 leader_election.cc:290] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:05.933564 21436 leader_election.cc:336] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:05.949334 29802 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:05.949996 29802 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:14:05.962816 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:05.963604 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:14:05.970120 29802 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:05.976238 21436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.978965 21434 leader_election.cc:336] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:05.979491 21434 leader_election.cc:304] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:05.980248 29773 raft_consensus.cc:2749] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:14:05.981841 21434 leader_election.cc:336] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:05.982229 21434 leader_election.cc:304] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:14:05.982859 21434 raft_consensus.cc:2686] T da4a8cf8f0864a8390aba6652b02015e P 33be1cb5cfc143fc90e164888c96cc6f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:14:05.983479 21434 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:05.983826 21434 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f, bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:14:05.984426 21434 raft_consensus.cc:2686] T efd59ed9e9fc41bbae9dde704923fee4 P 33be1cb5cfc143fc90e164888c96cc6f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:14:05.985426 21434 leader_election.cc:336] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:05.985931 21434 leader_election.cc:304] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:05.986631 29773 raft_consensus.cc:2749] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:05.987766 21434 leader_election.cc:336] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:05.988195 21434 leader_election.cc:304] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:05.988932 29773 raft_consensus.cc:2749] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:05.989964 20199 raft_consensus.cc:2272] T 24db01a278af4a82a16f038fedabf4d3 P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:06.011303 21997 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:06.012570 21997 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:06.013473 29805 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:06.014513 20199 tablet_replica.cc:333] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.015542 20199 raft_consensus.cc:2243] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.017019 20199 raft_consensus.cc:2272] T 1adedb939e97489f9d96abf3bff7f1bd P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:06.026420 21434 consensus_peers.cc:597] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:06.027053 21434 leader_election.cc:336] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:06.027444 21434 leader_election.cc:304] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:06.028297 29794 raft_consensus.cc:2749] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:06.028498 21434 leader_election.cc:336] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:06.029001 21434 leader_election.cc:304] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:14:06.029577 21434 raft_consensus.cc:2686] T c0b7a12853fc411b980438f7ae62ad14 P 33be1cb5cfc143fc90e164888c96cc6f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:14:06.030938 21434 leader_election.cc:336] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:06.031330 21434 leader_election.cc:304] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33be1cb5cfc143fc90e164888c96cc6f; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:06.032063 29794 raft_consensus.cc:2749] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:06.035050 20199 tablet_replica.cc:333] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.037423 20199 raft_consensus.cc:2243] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.038182 20199 raft_consensus.cc:2272] T fbc8cdcfe1ff495b82553486dbada070 P 33be1cb5cfc143fc90e164888c96cc6f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:06.048187 22002 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:14:06.050315 20199 tablet_replica.cc:333] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.051155 20199 raft_consensus.cc:2243] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.051831 20199 raft_consensus.cc:2272] T ce267b84e93f48afa7ad5caa450b982a P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.058501 20199 tablet_replica.cc:333] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.059273 20199 raft_consensus.cc:2243] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.059973 20199 raft_consensus.cc:2272] T 9d2910eb954d42858344d5b85eefd955 P 33be1cb5cfc143fc90e164888c96cc6f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.062564 20199 tablet_replica.cc:333] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.063277 20199 raft_consensus.cc:2243] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.066107 20199 raft_consensus.cc:2272] T 30bf17cca2e64e76b923a076142551ff P 33be1cb5cfc143fc90e164888c96cc6f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.068888 20199 tablet_replica.cc:333] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.069639 20199 raft_consensus.cc:2243] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.071699 20199 raft_consensus.cc:2272] T d0f870524af94ba487ca21790bc003cc P 33be1cb5cfc143fc90e164888c96cc6f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.074461 20199 tablet_replica.cc:333] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.075163 20199 raft_consensus.cc:2243] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.075728 20199 raft_consensus.cc:2272] T a55c6ecc97b34d419d7290080bc4a2c8 P 33be1cb5cfc143fc90e164888c96cc6f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.078392 20199 tablet_replica.cc:333] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.079133 20199 raft_consensus.cc:2243] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.080282 20199 raft_consensus.cc:2272] T 1e997d08de0c4a8b9b07e0741628b23f P 33be1cb5cfc143fc90e164888c96cc6f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.084319 20199 tablet_replica.cc:333] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.085062 20199 raft_consensus.cc:2243] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.085716 20199 raft_consensus.cc:2272] T 077d2ef89a5347dc8b8e863085f1d4e2 P 33be1cb5cfc143fc90e164888c96cc6f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.088562 20199 tablet_replica.cc:333] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.089257 20199 raft_consensus.cc:2243] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.090441 20199 raft_consensus.cc:2272] T 5c2d5354d62e4be08f444a5f6556b8dc P 33be1cb5cfc143fc90e164888c96cc6f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.093118 20199 tablet_replica.cc:333] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.093822 20199 raft_consensus.cc:2243] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.095335 20199 raft_consensus.cc:2272] T e6c1e6c7efbf499daf584842b0aca96c P 33be1cb5cfc143fc90e164888c96cc6f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.098026 20199 tablet_replica.cc:333] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.098672 20199 raft_consensus.cc:2243] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.099309 20199 raft_consensus.cc:2272] T e7b73223e6ab497f810757f895658e8b P 33be1cb5cfc143fc90e164888c96cc6f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.101943 20199 tablet_replica.cc:333] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.102632 20199 raft_consensus.cc:2243] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.103420 20199 raft_consensus.cc:2272] T e7cc0b64eb784638b78409562870a2db P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.105957 20199 tablet_replica.cc:333] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.106583 20199 raft_consensus.cc:2243] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.107228 20199 raft_consensus.cc:2272] T 462e641564c94eedaaaa398b75fb188e P 33be1cb5cfc143fc90e164888c96cc6f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.109714 20199 tablet_replica.cc:333] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.110425 20199 raft_consensus.cc:2243] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.111004 20199 raft_consensus.cc:2272] T a40320a19af04e62afc637834ab759b2 P 33be1cb5cfc143fc90e164888c96cc6f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.117530 20199 tablet_replica.cc:333] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f: stopping tablet replica
I20260709 13:14:06.118160 20199 raft_consensus.cc:2243] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.119941 20199 raft_consensus.cc:2272] T 67210417ec2d4ac885d194a18af541f3 P 33be1cb5cfc143fc90e164888c96cc6f [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:06.121685 22002 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:14:06.350762 29805 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:06.351263 29805 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.353096 29805 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:06.359126 21997 leader_election.cc:336] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:06.362107 21997 leader_election.cc:336] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:06.362607 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:06.363296 29805 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:06.398160 29797 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:06.398691 29797 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.400578 29797 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:06.405807 22002 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:06.406489 21997 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:06.406963 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:06.407686 29797 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:06.469178 22002 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:06.503322 22002 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:14:06.597652 29805 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:06.598167 29805 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.600049 29805 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:06.604071 22002 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:06.605657 21997 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:06.606051 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:06.606653 29805 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:06.683091 29805 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:06.683620 29805 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.686043 29805 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:06.692219 21997 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
W20260709 13:14:06.694512 22002 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:06.694903 22002 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:06.695551 29805 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:06.696190 29797 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:06.696718 29797 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.698892 29797 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:06.703471 21997 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:06.704205 21997 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:06.704562 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:06.705163 29797 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:14:06.723110 22002 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:14:06.780565 21997 consensus_peers.cc:597] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:06.833103 21997 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:06.839012 29797 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:06.839565 29797 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.841733 29797 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:06.848171 22002 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:06.854166 21997 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:06.854616 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:06.855266 29797 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:14:06.866964 21491 debug-util.cc:398] Leaking SignalData structure 0x7b080010d8e0 after lost signal to thread 20202
W20260709 13:14:06.867980 21491 debug-util.cc:398] Leaking SignalData structure 0x7b0800143480 after lost signal to thread 21253
W20260709 13:14:06.868520 21491 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef260 after lost signal to thread 21494
W20260709 13:14:06.869514 21491 debug-util.cc:398] Leaking SignalData structure 0x7b0800141940 after lost signal to thread 22066
I20260709 13:14:06.904438 29797 raft_consensus.cc:493] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:06.905216 29797 raft_consensus.cc:515] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.909034 29797 leader_election.cc:290] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:14:06.927531 29805 raft_consensus.cc:493] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:06.928203 29805 raft_consensus.cc:515] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.930348 29805 leader_election.cc:290] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:06.933205 22002 leader_election.cc:336] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:06.937546 21997 leader_election.cc:336] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:06.938031 21997 leader_election.cc:304] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:14:06.938274 22002 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:06.939169 21997 leader_election.cc:336] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:06.939169 29805 raft_consensus.cc:2749] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:06.943641 21997 consensus_peers.cc:597] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:06.944257 21997 leader_election.cc:336] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:06.944653 21997 leader_election.cc:304] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:06.945393 29805 raft_consensus.cc:2749] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:06.966176 29797 raft_consensus.cc:493] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:06.966784 29797 raft_consensus.cc:515] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:06.969188 29797 leader_election.cc:290] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:06.975239 22002 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:06.980399 21997 leader_election.cc:336] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:06.980942 21997 leader_election.cc:304] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:06.981719 29797 raft_consensus.cc:2749] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:07.160702 22002 consensus_peers.cc:597] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:14:07.216154 21997 consensus_peers.cc:597] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.255668 20199 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21491)
W20260709 13:14:07.292354 21997 consensus_peers.cc:597] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.315088 22002 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:14:07.353013 21997 consensus_peers.cc:597] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.371497 21997 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.376257 21997 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.384195 22002 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:14:07.417527 29805 raft_consensus.cc:493] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:07.418259 29805 raft_consensus.cc:515] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:07.418882 29797 raft_consensus.cc:493] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:07.419481 29797 raft_consensus.cc:515] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:07.421188 29805 leader_election.cc:290] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:14:07.421590 29797 leader_election.cc:290] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:07.428738 21997 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:07.433527 29797 raft_consensus.cc:493] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:07.434201 29797 raft_consensus.cc:515] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
W20260709 13:14:07.435132 21997 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
W20260709 13:14:07.435808 21997 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:07.436260 21997 leader_election.cc:304] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:07.436585 29797 leader_election.cc:290] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
I20260709 13:14:07.436937 29805 raft_consensus.cc:2749] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:14:07.438984 29805 raft_consensus.cc:493] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:07.439702 29805 raft_consensus.cc:515] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:07.442816 29805 leader_election.cc:290] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:07.443639 22002 leader_election.cc:336] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:07.445199 22002 leader_election.cc:336] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:07.445696 22002 leader_election.cc:304] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
W20260709 13:14:07.447381 21997 leader_election.cc:336] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:07.446568 29805 raft_consensus.cc:2749] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:07.452312 21997 leader_election.cc:336] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:07.452860 21997 leader_election.cc:304] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:07.453612 29805 raft_consensus.cc:2749] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:14:07.454604 21997 leader_election.cc:336] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
W20260709 13:14:07.455106 22002 leader_election.cc:336] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:07.455636 21997 leader_election.cc:336] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:07.456138 21997 leader_election.cc:304] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 1 yes votes; 3 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:07.456857 29805 raft_consensus.cc:2749] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:07.463407 29805 raft_consensus.cc:493] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:07.464083 29805 raft_consensus.cc:515] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:07.467154 29805 leader_election.cc:290] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:07.471055 22002 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:07.475327 21997 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:07.476825 21997 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:07.477326 21997 leader_election.cc:304] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
W20260709 13:14:07.477980 22002 leader_election.cc:336] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:07.478053 29805 raft_consensus.cc:2749] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:07.506115 29805 raft_consensus.cc:493] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:07.506731 29805 raft_consensus.cc:515] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:07.508927 29805 leader_election.cc:290] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:07.521457 21997 leader_election.cc:336] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
W20260709 13:14:07.523283 21997 leader_election.cc:336] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:07.523697 21997 leader_election.cc:304] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:07.524467 29805 raft_consensus.cc:2749] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:07.532339 21997 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:07.535269 29805 raft_consensus.cc:493] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:07.535950 29805 raft_consensus.cc:515] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:07.538561 29805 leader_election.cc:290] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
W20260709 13:14:07.546443 21997 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:07.552673 22002 leader_election.cc:336] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:07.553262 22002 leader_election.cc:304] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:07.554064 29805 raft_consensus.cc:2749] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:07.572296 21997 consensus_peers.cc:597] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.586645 21997 consensus_peers.cc:597] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.594851 21997 consensus_peers.cc:597] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.637538 21997 consensus_peers.cc:597] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.696902 21997 consensus_peers.cc:597] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:07.708993 21997 consensus_peers.cc:597] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:07.739637 22002 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:14:07.755856 21997 consensus_peers.cc:597] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:07.774679 22002 consensus_peers.cc:597] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:14:07.807621 21997 consensus_peers.cc:597] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:07.838438 21997 consensus_peers.cc:597] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:07.888757 21997 consensus_peers.cc:597] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:07.895975 29797 raft_consensus.cc:493] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:07.896580 29797 raft_consensus.cc:515] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:07.898623 29797 leader_election.cc:290] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:07.902896 21997 leader_election.cc:336] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:07.904850 21997 leader_election.cc:336] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:07.905244 21997 leader_election.cc:304] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:07.906004 29797 raft_consensus.cc:2749] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:14:07.943871 21997 consensus_peers.cc:597] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:07.975548 21997 consensus_peers.cc:597] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:07.986932 21997 consensus_peers.cc:597] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:08.009418 29797 raft_consensus.cc:493] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:08.010150 29797 raft_consensus.cc:515] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:08.012441 29797 leader_election.cc:290] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:08.016693 22002 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:08.018514 21997 leader_election.cc:336] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:08.018959 21997 leader_election.cc:304] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:08.019642 29797 raft_consensus.cc:2749] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:08.024998 21997 consensus_peers.cc:597] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.051003 21997 consensus_peers.cc:597] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:08.057049 21997 consensus_peers.cc:597] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.102970 21997 consensus_peers.cc:597] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.118691 21997 consensus_peers.cc:597] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.138135 21997 consensus_peers.cc:597] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 -> Peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Couldn't send request to peer 33be1cb5cfc143fc90e164888c96cc6f. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.198909 21997 consensus_peers.cc:597] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 -> Peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Couldn't send request to peer d41c71e861344f0b90e8d44a8d0a3173. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:08.221135 29805 raft_consensus.cc:493] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:08.221858 29805 raft_consensus.cc:515] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:08.224293 29805 leader_election.cc:290] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:08.231029 22002 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:08.233697 21997 leader_election.cc:336] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:08.234222 21997 leader_election.cc:304] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:08.235397 29805 raft_consensus.cc:2749] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:08.361660 20199 tablet_server.cc:196] TabletServer@127.19.185.195:0 shutdown complete.
I20260709 13:14:08.409781 29805 raft_consensus.cc:493] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:08.410517 29805 raft_consensus.cc:515] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:08.413136 29805 leader_election.cc:290] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:08.418253 22002 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:08.419118 21997 leader_election.cc:336] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:08.419588 21997 leader_election.cc:304] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:08.420517 29805 raft_consensus.cc:2749] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:08.429638 29805 raft_consensus.cc:493] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:08.430271 29805 raft_consensus.cc:515] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:08.432832 29805 leader_election.cc:290] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:08.440733 22002 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
W20260709 13:14:08.444866 21997 leader_election.cc:336] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:08.445493 21997 leader_election.cc:304] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, 33be1cb5cfc143fc90e164888c96cc6f
I20260709 13:14:08.446321 29797 raft_consensus.cc:2749] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:08.463209 20199 tablet_server.cc:179] TabletServer@127.19.185.196:0 shutting down...
I20260709 13:14:08.467480 29797 raft_consensus.cc:493] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 33be1cb5cfc143fc90e164888c96cc6f)
I20260709 13:14:08.468114 29797 raft_consensus.cc:515] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:08.471134 29797 leader_election.cc:290] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493), 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119)
W20260709 13:14:08.475384 21997 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
W20260709 13:14:08.476392 21997 leader_election.cc:336] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 33be1cb5cfc143fc90e164888c96cc6f (127.19.185.195:45119): Network error: Client connection negotiation failed: client connection to 127.19.185.195:45119: connect: Connection refused (error 111)
I20260709 13:14:08.477103 21997 leader_election.cc:304] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 33be1cb5cfc143fc90e164888c96cc6f, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:08.477962 29797 raft_consensus.cc:2749] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:14:08.506212 22002 consensus_peers.cc:597] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 -> Peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Couldn't send request to peer 058db415e9884ea0ba23f1e1ff59127a. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:14:08.517413 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:08.519452 20199 tablet_replica.cc:333] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.520447 20199 raft_consensus.cc:2243] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.521162 20199 raft_consensus.cc:2272] T 67210417ec2d4ac885d194a18af541f3 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.524286 20199 tablet_replica.cc:333] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.525105 20199 raft_consensus.cc:2243] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.525774 20199 raft_consensus.cc:2272] T 1c0d19b3841a44cdbbb32daa4e1ddc06 P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.527951 20199 tablet_replica.cc:333] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.528613 20199 raft_consensus.cc:2243] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Raft consensus shutting down.
I20260709 13:14:08.529033 20199 pending_rounds.cc:70] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Trying to abort 1 pending ops.
I20260709 13:14:08.529207 20199 pending_rounds.cc:77] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305636339920105472 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "24db01a278af4a82a16f038fedabf4d3" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "33be1cb5cfc143fc90e164888c96cc6f" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45119 } attrs { replace: true } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: NON_VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: true } } } }
I20260709 13:14:08.530038 20199 raft_consensus.cc:2917] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73 [term 1 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:14:08.530476 20199 raft_consensus.cc:2889] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73 [term 1 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:14:08.530740 20199 raft_consensus.cc:2272] T 24db01a278af4a82a16f038fedabf4d3 P bfcd9560f8f44414b25f8069384c5a73 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:14:08.534145 20199 tablet_replica.cc:333] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.535161 20199 raft_consensus.cc:2243] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.536365 20199 raft_consensus.cc:2272] T 91e50669ee6e496d9e5aaf0b2cc43c1c P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.537707 29797 raft_consensus.cc:493] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d41c71e861344f0b90e8d44a8d0a3173)
I20260709 13:14:08.538161 29797 raft_consensus.cc:515] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "058db415e9884ea0ba23f1e1ff59127a" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45701 } } peers { permanent_uuid: "d41c71e861344f0b90e8d44a8d0a3173" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 41493 } } peers { permanent_uuid: "bfcd9560f8f44414b25f8069384c5a73" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 44175 } attrs { promote: false } }
I20260709 13:14:08.539764 20199 tablet_replica.cc:333] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.540366 29797 leader_election.cc:290] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701), d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493)
I20260709 13:14:08.540802 20199 raft_consensus.cc:2243] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.542214 20199 raft_consensus.cc:2272] T f384b96e64eb4aa9a99fd8372643b01c P bfcd9560f8f44414b25f8069384c5a73 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:08.545032 21997 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d41c71e861344f0b90e8d44a8d0a3173 (127.19.185.194:41493): Network error: Client connection negotiation failed: client connection to 127.19.185.194:41493: connect: Connection refused (error 111)
I20260709 13:14:08.545473 20199 tablet_replica.cc:333] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
W20260709 13:14:08.545631 22002 leader_election.cc:336] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:08.546079 22002 leader_election.cc:304] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfcd9560f8f44414b25f8069384c5a73; no voters: 058db415e9884ea0ba23f1e1ff59127a, d41c71e861344f0b90e8d44a8d0a3173
I20260709 13:14:08.546465 20199 raft_consensus.cc:2243] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.546772 29797 raft_consensus.cc:2749] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:08.547670 20199 raft_consensus.cc:2272] T 077d2ef89a5347dc8b8e863085f1d4e2 P bfcd9560f8f44414b25f8069384c5a73 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.550757 20199 tablet_replica.cc:333] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.551538 20199 raft_consensus.cc:2243] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.553005 20199 raft_consensus.cc:2272] T 1adedb939e97489f9d96abf3bff7f1bd P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.555771 20199 tablet_replica.cc:333] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.556478 20199 raft_consensus.cc:2243] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.557415 20199 raft_consensus.cc:2272] T ce267b84e93f48afa7ad5caa450b982a P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.559561 20199 tablet_replica.cc:333] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.560274 20199 raft_consensus.cc:2243] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.561021 20199 raft_consensus.cc:2272] T 4cfcdfda7a4840b78d5a89acd61b8d23 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.563445 20199 tablet_replica.cc:333] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.564208 20199 raft_consensus.cc:2243] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.565083 20199 raft_consensus.cc:2272] T e7cc0b64eb784638b78409562870a2db P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.567355 20199 tablet_replica.cc:333] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.567912 20199 raft_consensus.cc:2243] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.568884 20199 raft_consensus.cc:2272] T e7b73223e6ab497f810757f895658e8b P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.571236 20199 tablet_replica.cc:333] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.571805 20199 raft_consensus.cc:2243] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.572326 20199 raft_consensus.cc:2272] T dffab1617f544c36913eb55e6bad723c P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.574568 20199 tablet_replica.cc:333] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.575152 20199 raft_consensus.cc:2243] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.576141 20199 raft_consensus.cc:2272] T 89e2aa178e8e4c63a6f5f660d5314ba7 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.578168 20199 tablet_replica.cc:333] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.578760 20199 raft_consensus.cc:2243] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.579348 20199 raft_consensus.cc:2272] T 4a3f0ee4cdba4795b8a75e55bdfd0512 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.581504 20199 tablet_replica.cc:333] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.582068 20199 raft_consensus.cc:2243] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.582933 20199 raft_consensus.cc:2272] T 904858d649144d589875f088692f104f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.585273 20199 tablet_replica.cc:333] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.586050 20199 raft_consensus.cc:2243] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.587697 20199 raft_consensus.cc:2272] T ff7ec37b4f0643d4b4d60d35243b93d8 P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.590863 20199 tablet_replica.cc:333] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.591568 20199 raft_consensus.cc:2243] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.592754 20199 raft_consensus.cc:2272] T 9d344e412d584b97b86c32794fb7fb2b P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.595100 20199 tablet_replica.cc:333] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.595675 20199 raft_consensus.cc:2243] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.596992 20199 raft_consensus.cc:2272] T 424be00d78cc41f1a80d41735ad881ae P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.599049 20199 tablet_replica.cc:333] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.599614 20199 raft_consensus.cc:2243] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.600330 20199 raft_consensus.cc:2272] T 06666c92a06645dc8a8977e923b51e37 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.602696 20199 tablet_replica.cc:333] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.603286 20199 raft_consensus.cc:2243] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.603924 20199 raft_consensus.cc:2272] T 099cc7d3a89e468b91e21306fa23a0be P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.606276 20199 tablet_replica.cc:333] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.606873 20199 raft_consensus.cc:2243] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.607484 20199 raft_consensus.cc:2272] T d1e856d5af49457aa83cfe00a413716d P bfcd9560f8f44414b25f8069384c5a73 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.609740 20199 tablet_replica.cc:333] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.610353 20199 raft_consensus.cc:2243] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.611380 20199 raft_consensus.cc:2272] T 3549d7d86f4c404f95fae0e1f6b84210 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.613556 20199 tablet_replica.cc:333] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.614117 20199 raft_consensus.cc:2243] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.615176 20199 raft_consensus.cc:2272] T 6d5dc87735964c6b97851e73311aee5a P bfcd9560f8f44414b25f8069384c5a73 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.617318 20199 tablet_replica.cc:333] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.617900 20199 raft_consensus.cc:2243] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.618803 20199 raft_consensus.cc:2272] T 3b2812c891d248ecafa8f302d2b72c45 P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.620997 20199 tablet_replica.cc:333] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.621662 20199 raft_consensus.cc:2243] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.622277 20199 raft_consensus.cc:2272] T d0f870524af94ba487ca21790bc003cc P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.624825 20199 tablet_replica.cc:333] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.625399 20199 raft_consensus.cc:2243] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.625912 20199 raft_consensus.cc:2272] T c90920283ad9436b891dae0b916f29d7 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.628010 20199 tablet_replica.cc:333] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.628615 20199 raft_consensus.cc:2243] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.629148 20199 raft_consensus.cc:2272] T 1e997d08de0c4a8b9b07e0741628b23f P bfcd9560f8f44414b25f8069384c5a73 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.631304 20199 tablet_replica.cc:333] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.631901 20199 raft_consensus.cc:2243] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.632663 20199 raft_consensus.cc:2272] T 984d063a64ef47f7b0783e2181604515 P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.634693 20199 tablet_replica.cc:333] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.635216 20199 raft_consensus.cc:2243] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.635753 20199 raft_consensus.cc:2272] T 30bf17cca2e64e76b923a076142551ff P bfcd9560f8f44414b25f8069384c5a73 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.638036 20199 tablet_replica.cc:333] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.638564 20199 raft_consensus.cc:2243] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.639189 20199 raft_consensus.cc:2272] T 6629858a6e4c4461a471763a94f0effa P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.641520 20199 tablet_replica.cc:333] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.642109 20199 raft_consensus.cc:2243] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.643067 20199 raft_consensus.cc:2272] T 603c27f4d3de4b40878c1d29bcc0708a P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.645129 20199 tablet_replica.cc:333] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.645664 20199 raft_consensus.cc:2243] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.646564 20199 raft_consensus.cc:2272] T bb2ce5a5a1e3461d8e0031fdfef61569 P bfcd9560f8f44414b25f8069384c5a73 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.648661 20199 tablet_replica.cc:333] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.649161 20199 raft_consensus.cc:2243] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.649993 20199 raft_consensus.cc:2272] T 7710ca7bd20a4aa6959c7bf3ebd05f87 P bfcd9560f8f44414b25f8069384c5a73 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.652365 20199 tablet_replica.cc:333] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.652894 20199 raft_consensus.cc:2243] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.653734 20199 raft_consensus.cc:2272] T f8909ec5d582450ba80932fa543ad4a1 P bfcd9560f8f44414b25f8069384c5a73 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.655791 20199 tablet_replica.cc:333] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.656394 20199 raft_consensus.cc:2243] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.657038 20199 raft_consensus.cc:2272] T efd59ed9e9fc41bbae9dde704923fee4 P bfcd9560f8f44414b25f8069384c5a73 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.659608 20199 tablet_replica.cc:333] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.660277 20199 raft_consensus.cc:2243] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.661150 20199 raft_consensus.cc:2272] T 849cad40897e412da9a737986240fc35 P bfcd9560f8f44414b25f8069384c5a73 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.663204 20199 tablet_replica.cc:333] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.663740 20199 raft_consensus.cc:2243] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.664271 20199 raft_consensus.cc:2272] T 5c2d5354d62e4be08f444a5f6556b8dc P bfcd9560f8f44414b25f8069384c5a73 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.666680 20199 tablet_replica.cc:333] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.667253 20199 raft_consensus.cc:2243] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.667768 20199 raft_consensus.cc:2272] T 4a81f5eab37044228b941f7eb2be5912 P bfcd9560f8f44414b25f8069384c5a73 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.669991 20199 tablet_replica.cc:333] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73: stopping tablet replica
I20260709 13:14:08.670495 20199 raft_consensus.cc:2243] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.671414 20199 raft_consensus.cc:2272] T 624d76b3bc214b53b7565f644d236663 P bfcd9560f8f44414b25f8069384c5a73 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.049751 20199 tablet_server.cc:196] TabletServer@127.19.185.196:0 shutdown complete.
I20260709 13:14:09.120127 20199 master.cc:562] Master@127.19.185.254:40067 shutting down...
W20260709 13:14:09.158519 21267 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:14:09.158846 21267 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:14:09.159073 21267 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:14:09.414259 21206 catalog_manager.cc:4755] TS 058db415e9884ea0ba23f1e1ff59127a (127.19.185.193:45701): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7cc0b64eb784638b78409562870a2db: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45701: connect: Connection refused (error 111)
I20260709 13:14:09.419783 20199 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.420435 20199 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.420719 20199 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5338d281947a4ef192ba752d67ec0067: stopping tablet replica
I20260709 13:14:09.554453 20199 master.cc:584] Master@127.19.185.254:40067 shutdown complete.
I20260709 13:14:09.595769 20199 test_util.cc:182] -----------------------------------------------
I20260709 13:14:09.596009 20199 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602552983791-20199-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (273122 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:14:09.599085 20199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.185.254:34975
I20260709 13:14:09.600231 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.606462 29813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.606577 29812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.607070 29815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.607951 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:09.611375 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:09.611569 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.611779 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602849611744 us; error 0 us; skew 500 ppm
I20260709 13:14:09.612351 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.614862 20199 webserver.cc:533] Webserver started at http://127.19.185.254:43815/ using document root <none> and password file <none>
I20260709 13:14:09.615352 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.615541 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.615829 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.617115 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/master-0-root/instance:
uuid: "7050905dc68b4287b91cfda87917dfd8"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-rrf3"
I20260709 13:14:09.621621 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:09.625275 29820 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.626060 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:09.626322 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/master-0-root
uuid: "7050905dc68b4287b91cfda87917dfd8"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-rrf3"
I20260709 13:14:09.626643 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.653090 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.654404 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.692965 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.254:34975
I20260709 13:14:09.693059 29871 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.254:34975 every 8 connection(s)
I20260709 13:14:09.696992 29872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.707517 29872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8: Bootstrap starting.
I20260709 13:14:09.712407 29872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.716667 29872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8: No bootstrap required, opened a new log
I20260709 13:14:09.718794 29872 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7050905dc68b4287b91cfda87917dfd8" member_type: VOTER }
I20260709 13:14:09.719167 29872 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.719341 29872 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7050905dc68b4287b91cfda87917dfd8, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.719938 29872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7050905dc68b4287b91cfda87917dfd8" member_type: VOTER }
I20260709 13:14:09.720417 29872 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:09.720607 29872 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:09.720813 29872 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.725301 29872 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7050905dc68b4287b91cfda87917dfd8" member_type: VOTER }
I20260709 13:14:09.725788 29872 leader_election.cc:304] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7050905dc68b4287b91cfda87917dfd8; no voters: 
I20260709 13:14:09.726977 29872 leader_election.cc:290] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:09.727300 29875 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:09.728845 29875 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 1 LEADER]: Becoming Leader. State: Replica: 7050905dc68b4287b91cfda87917dfd8, State: Running, Role: LEADER
I20260709 13:14:09.729571 29875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7050905dc68b4287b91cfda87917dfd8" member_type: VOTER }
I20260709 13:14:09.730149 29872 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:09.734143 29876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7050905dc68b4287b91cfda87917dfd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7050905dc68b4287b91cfda87917dfd8" member_type: VOTER } }
I20260709 13:14:09.734874 29876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:09.735955 29877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7050905dc68b4287b91cfda87917dfd8. Latest consensus state: current_term: 1 leader_uuid: "7050905dc68b4287b91cfda87917dfd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7050905dc68b4287b91cfda87917dfd8" member_type: VOTER } }
I20260709 13:14:09.736621 29877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:09.736726 29882 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:09.743062 29882 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:09.745136 20199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:09.752278 29882 catalog_manager.cc:1383] Generated new cluster ID: dca2f7f1ccb7495d8f928fbc3d83dadb
I20260709 13:14:09.752575 29882 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:09.784590 29882 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:09.785923 29882 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:09.796993 29882 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8: Generated new TSK 0
I20260709 13:14:09.797616 29882 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:09.811632 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.818069 29893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.819286 29894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.822124 20199 server_base.cc:1061] running on GCE node
W20260709 13:14:09.822520 29896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.824846 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:09.825101 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.825285 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602849825262 us; error 0 us; skew 500 ppm
I20260709 13:14:09.825824 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.828368 20199 webserver.cc:533] Webserver started at http://127.19.185.193:33811/ using document root <none> and password file <none>
I20260709 13:14:09.828879 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.829092 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.829371 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.830533 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/instance:
uuid: "b9712e59a1774be08aa8e368566dcfed"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-rrf3"
I20260709 13:14:09.835356 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:09.838671 29901 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.839605 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:09.839974 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "b9712e59a1774be08aa8e368566dcfed"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-rrf3"
I20260709 13:14:09.840413 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.860813 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.862051 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.863554 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:09.865906 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:09.866132 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.866384 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:09.866575 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.910880 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:38129
I20260709 13:14:09.910986 29963 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:38129 every 8 connection(s)
I20260709 13:14:09.916216 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.923813 29968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.924289 29969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.927520 29971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.928869 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:09.931378 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:09.931592 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.931799 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602849931781 us; error 0 us; skew 500 ppm
I20260709 13:14:09.932444 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.934913 20199 webserver.cc:533] Webserver started at http://127.19.185.194:34969/ using document root <none> and password file <none>
I20260709 13:14:09.935424 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.935622 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.935933 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.937124 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/instance:
uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-rrf3"
I20260709 13:14:09.942128 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:14:09.943614 29964 heartbeater.cc:344] Connected to a master server at 127.19.185.254:34975
I20260709 13:14:09.944123 29964 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:09.945037 29964 heartbeater.cc:507] Master 127.19.185.254:34975 requested a full tablet report, sending...
I20260709 13:14:09.946519 29976 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.947389 29837 ts_manager.cc:194] Registered new tserver with Master: b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:09.947499 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:14:09.947906 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-1-root
uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-rrf3"
I20260709 13:14:09.948258 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.949436 29837 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38204
I20260709 13:14:09.959853 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.961261 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.962760 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:09.965111 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:09.965353 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.965610 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:09.965797 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:10.008533 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.194:34209
I20260709 13:14:10.008630 30038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.194:34209 every 8 connection(s)
I20260709 13:14:10.013487 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:10.021193 30042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:10.022998 30043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:10.025779 30045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:10.026738 30039 heartbeater.cc:344] Connected to a master server at 127.19.185.254:34975
I20260709 13:14:10.027410 30039 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:10.028731 30039 heartbeater.cc:507] Master 127.19.185.254:34975 requested a full tablet report, sending...
I20260709 13:14:10.032024 29837 ts_manager.cc:194] Registered new tserver with Master: 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:10.032996 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:10.033567 29837 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38210
I20260709 13:14:10.034179 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:10.034452 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:10.034650 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602850034635 us; error 0 us; skew 500 ppm
I20260709 13:14:10.035439 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:10.037941 20199 webserver.cc:533] Webserver started at http://127.19.185.195:42681/ using document root <none> and password file <none>
I20260709 13:14:10.038363 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:10.038515 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:10.038722 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:10.039822 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/instance:
uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
format_stamp: "Formatted at 2026-07-09 13:14:10 on dist-test-slave-rrf3"
I20260709 13:14:10.044699 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:14:10.048415 30050 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:10.049419 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:14:10.049755 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-2-root
uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
format_stamp: "Formatted at 2026-07-09 13:14:10 on dist-test-slave-rrf3"
I20260709 13:14:10.050014 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:10.066277 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:10.067567 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:10.069103 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:10.071375 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:10.071605 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:10.071854 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:10.072072 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:10.112443 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.195:42729
I20260709 13:14:10.112538 30112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.195:42729 every 8 connection(s)
I20260709 13:14:10.117424 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:10.125633 30116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:10.126233 30117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:10.129457 30119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:10.130560 30113 heartbeater.cc:344] Connected to a master server at 127.19.185.254:34975
I20260709 13:14:10.130545 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:10.131276 30113 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:10.132064 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:14:10.132272 30113 heartbeater.cc:507] Master 127.19.185.254:34975 requested a full tablet report, sending...
W20260709 13:14:10.132387 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:10.132741 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602850132722 us; error 0 us; skew 500 ppm
I20260709 13:14:10.133498 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:10.134786 29837 ts_manager.cc:194] Registered new tserver with Master: fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:10.136245 20199 webserver.cc:533] Webserver started at http://127.19.185.196:33565/ using document root <none> and password file <none>
I20260709 13:14:10.136737 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:10.136933 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:10.136835 29837 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38220
I20260709 13:14:10.137398 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:10.138872 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-3-root/instance:
uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
format_stamp: "Formatted at 2026-07-09 13:14:10 on dist-test-slave-rrf3"
I20260709 13:14:10.143687 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 13:14:10.147125 30124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:10.147965 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:10.148366 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-3-root
uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
format_stamp: "Formatted at 2026-07-09 13:14:10 on dist-test-slave-rrf3"
I20260709 13:14:10.148625 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:10.173625 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:10.174865 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:10.176443 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:10.178655 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:10.178838 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:10.179145 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:10.179320 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:10.220530 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.196:46305
I20260709 13:14:10.220659 30186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.196:46305 every 8 connection(s)
I20260709 13:14:10.235457 30187 heartbeater.cc:344] Connected to a master server at 127.19.185.254:34975
I20260709 13:14:10.235954 30187 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:10.236923 30187 heartbeater.cc:507] Master 127.19.185.254:34975 requested a full tablet report, sending...
I20260709 13:14:10.239254 29837 ts_manager.cc:194] Registered new tserver with Master: 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:10.240399 20199 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016569359s
I20260709 13:14:10.241286 29837 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38222
I20260709 13:14:10.270387 29837 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38232:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:14:10.512542 30152 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3ddfecc18142ca96ca46730679e15d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:10.514313 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3ddfecc18142ca96ca46730679e15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.524896 30151 tablet_service.cc:1511] Processing CreateTablet for tablet 8c481032d44545c1bfcdb474fab199ac (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:10.526419 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c481032d44545c1bfcdb474fab199ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.527617 29929 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3ddfecc18142ca96ca46730679e15d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:10.529186 29929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3ddfecc18142ca96ca46730679e15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.529220 30150 tablet_service.cc:1511] Processing CreateTablet for tablet 29e8c3cdaf33402dbdedf5ac7b0d5f69 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:10.530826 30150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e8c3cdaf33402dbdedf5ac7b0d5f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.533113 29927 tablet_service.cc:1511] Processing CreateTablet for tablet 8c481032d44545c1bfcdb474fab199ac (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:10.530918 30148 tablet_service.cc:1511] Processing CreateTablet for tablet c039a4adb4a94b4983b0bd4ba5936b85 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:10.534664 29927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c481032d44545c1bfcdb474fab199ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.534763 30148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c039a4adb4a94b4983b0bd4ba5936b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.532382 30149 tablet_service.cc:1511] Processing CreateTablet for tablet d64e98dbb807428aaa77b766013b2d3e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:10.536794 30149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e98dbb807428aaa77b766013b2d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.537199 29926 tablet_service.cc:1511] Processing CreateTablet for tablet 7459878da0fd4511bdb65ad263c4697e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:10.539157 29926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7459878da0fd4511bdb65ad263c4697e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.541635 29925 tablet_service.cc:1511] Processing CreateTablet for tablet d64e98dbb807428aaa77b766013b2d3e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:10.543581 29925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e98dbb807428aaa77b766013b2d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.546391 29923 tablet_service.cc:1511] Processing CreateTablet for tablet d65b829ec05f405d8d11888322430664 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:10.534694 30147 tablet_service.cc:1511] Processing CreateTablet for tablet 3533d54b9a67432bb09ec05957de7241 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:10.549022 29928 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9f8efa2d564711b2d5c65c4f7de9cd (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:10.549548 30147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3533d54b9a67432bb09ec05957de7241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.550715 29924 tablet_service.cc:1511] Processing CreateTablet for tablet c039a4adb4a94b4983b0bd4ba5936b85 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:10.551487 30146 tablet_service.cc:1511] Processing CreateTablet for tablet 9869b01845b944d8b60d71f7ab3e1934 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:10.552923 30146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9869b01845b944d8b60d71f7ab3e1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.558367 29923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65b829ec05f405d8d11888322430664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.564378 29924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c039a4adb4a94b4983b0bd4ba5936b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.580472 29928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9f8efa2d564711b2d5c65c4f7de9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.598354 29922 tablet_service.cc:1511] Processing CreateTablet for tablet 9869b01845b944d8b60d71f7ab3e1934 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:10.599922 29922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9869b01845b944d8b60d71f7ab3e1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.606001 30145 tablet_service.cc:1511] Processing CreateTablet for tablet b7b95bfcf7cd48e5aa9e14f40f7b9118 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:10.607472 30145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b95bfcf7cd48e5aa9e14f40f7b9118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.614049 29921 tablet_service.cc:1511] Processing CreateTablet for tablet b7b95bfcf7cd48e5aa9e14f40f7b9118 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:10.615620 29921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b95bfcf7cd48e5aa9e14f40f7b9118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.616385 30144 tablet_service.cc:1511] Processing CreateTablet for tablet b5a07a99809b452d97abd212707856e4 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:10.617338 29920 tablet_service.cc:1511] Processing CreateTablet for tablet 1860b4022529422197e01c32e02598f4 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:10.617815 30144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a07a99809b452d97abd212707856e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.618733 29920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1860b4022529422197e01c32e02598f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.621222 30143 tablet_service.cc:1511] Processing CreateTablet for tablet 381657a3006a4f52b1268ecae19b2922 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:10.622714 30143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381657a3006a4f52b1268ecae19b2922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.622388 30003 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9f8efa2d564711b2d5c65c4f7de9cd (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:10.623795 30003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9f8efa2d564711b2d5c65c4f7de9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.621225 30004 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3ddfecc18142ca96ca46730679e15d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:10.625280 30002 tablet_service.cc:1511] Processing CreateTablet for tablet 29e8c3cdaf33402dbdedf5ac7b0d5f69 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:10.627187 30001 tablet_service.cc:1511] Processing CreateTablet for tablet 7459878da0fd4511bdb65ad263c4697e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:10.625280 30000 tablet_service.cc:1511] Processing CreateTablet for tablet d64e98dbb807428aaa77b766013b2d3e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:10.637032 30207 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:10.637290 29998 tablet_service.cc:1511] Processing CreateTablet for tablet d65b829ec05f405d8d11888322430664 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:10.639281 29999 tablet_service.cc:1511] Processing CreateTablet for tablet 3533d54b9a67432bb09ec05957de7241 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:10.634543 30000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e98dbb807428aaa77b766013b2d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.654264 30151 tablet_service.cc:1511] Processing CreateTablet for tablet 01d37e8e23ef4f4fa7507c9f20cdda87 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:10.655735 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d37e8e23ef4f4fa7507c9f20cdda87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.660483 29924 tablet_service.cc:1511] Processing CreateTablet for tablet 381657a3006a4f52b1268ecae19b2922 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:10.661057 29995 tablet_service.cc:1511] Processing CreateTablet for tablet 1860b4022529422197e01c32e02598f4 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:10.662051 29924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381657a3006a4f52b1268ecae19b2922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.661181 29921 tablet_service.cc:1511] Processing CreateTablet for tablet b5a07a99809b452d97abd212707856e4 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:10.664172 29996 tablet_service.cc:1511] Processing CreateTablet for tablet f80e36941c78483ebd0edba43ec63b83 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:10.666175 30004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3ddfecc18142ca96ca46730679e15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.647820 29997 tablet_service.cc:1511] Processing CreateTablet for tablet 9869b01845b944d8b60d71f7ab3e1934 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:10.668118 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9869b01845b944d8b60d71f7ab3e1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.668684 30207 tablet_bootstrap.cc:654] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.666141 29921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a07a99809b452d97abd212707856e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.693593 29998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65b829ec05f405d8d11888322430664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.696545 30001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7459878da0fd4511bdb65ad263c4697e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.701901 29995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1860b4022529422197e01c32e02598f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.705518 30152 tablet_service.cc:1511] Processing CreateTablet for tablet 13b502d61f804f169b0f20adba55efa5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:10.705569 29996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80e36941c78483ebd0edba43ec63b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.631150 30150 tablet_service.cc:1511] Processing CreateTablet for tablet f80e36941c78483ebd0edba43ec63b83 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:10.715277 30143 tablet_service.cc:1511] Processing CreateTablet for tablet 232202ef61084cb1b794c297a13e0a07 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:10.722606 30206 tablet_bootstrap.cc:492] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:10.722942 30002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e8c3cdaf33402dbdedf5ac7b0d5f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.679715 29925 tablet_service.cc:1511] Processing CreateTablet for tablet e8c323dfa54847f1890203bcc0f931c9 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:10.727306 29999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3533d54b9a67432bb09ec05957de7241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.727725 29925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c323dfa54847f1890203bcc0f931c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.732511 29928 tablet_service.cc:1511] Processing CreateTablet for tablet 13b502d61f804f169b0f20adba55efa5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:10.733959 29928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b502d61f804f169b0f20adba55efa5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:10.741778 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:10.733637 29926 tablet_service.cc:1511] Processing CreateTablet for tablet 232202ef61084cb1b794c297a13e0a07 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:10.770931 30149 tablet_service.cc:1511] Processing CreateTablet for tablet 9c97b9de751e4869a4675dfa47486840 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:10.771526 29926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232202ef61084cb1b794c297a13e0a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.780184 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b502d61f804f169b0f20adba55efa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.780972 30150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80e36941c78483ebd0edba43ec63b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.784438 30143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232202ef61084cb1b794c297a13e0a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.788411 30149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c97b9de751e4869a4675dfa47486840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.794049 29923 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5ad95d8d5e43d9888dc66173bdae9c (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:10.796375 30206 tablet_bootstrap.cc:654] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.804019 30207 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:10.804700 30207 ts_tablet_manager.cc:1403] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.039s
I20260709 13:14:10.805084 30003 tablet_service.cc:1511] Processing CreateTablet for tablet b5a07a99809b452d97abd212707856e4 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:10.806556 30003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a07a99809b452d97abd212707856e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.807992 30207 raft_consensus.cc:359] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:10.809180 30207 raft_consensus.cc:385] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.809620 30207 raft_consensus.cc:740] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.810442 30207 consensus_queue.cc:260] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:10.799573 29923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5ad95d8d5e43d9888dc66173bdae9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.823552 30001 tablet_service.cc:1511] Processing CreateTablet for tablet 01d37e8e23ef4f4fa7507c9f20cdda87 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:10.825392 30001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d37e8e23ef4f4fa7507c9f20cdda87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.852491 30078 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9f8efa2d564711b2d5c65c4f7de9cd (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:10.854053 30078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9f8efa2d564711b2d5c65c4f7de9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.855257 30152 tablet_service.cc:1511] Processing CreateTablet for tablet ae95e4a365df4e69b385a8da4f7d0357 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:10.857182 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae95e4a365df4e69b385a8da4f7d0357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.857093 30077 tablet_service.cc:1511] Processing CreateTablet for tablet 8c481032d44545c1bfcdb474fab199ac (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:10.858573 30077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c481032d44545c1bfcdb474fab199ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.861199 30076 tablet_service.cc:1511] Processing CreateTablet for tablet 29e8c3cdaf33402dbdedf5ac7b0d5f69 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:10.862880 30076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e8c3cdaf33402dbdedf5ac7b0d5f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.865350 30075 tablet_service.cc:1511] Processing CreateTablet for tablet 7459878da0fd4511bdb65ad263c4697e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:10.866786 30075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7459878da0fd4511bdb65ad263c4697e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.869029 29927 tablet_service.cc:1511] Processing CreateTablet for tablet ae95e4a365df4e69b385a8da4f7d0357 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:10.871023 29927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae95e4a365df4e69b385a8da4f7d0357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.871171 30073 tablet_service.cc:1511] Processing CreateTablet for tablet 3533d54b9a67432bb09ec05957de7241 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:10.873620 30072 tablet_service.cc:1511] Processing CreateTablet for tablet d65b829ec05f405d8d11888322430664 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:10.869310 30074 tablet_service.cc:1511] Processing CreateTablet for tablet c039a4adb4a94b4983b0bd4ba5936b85 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:10.876159 30004 tablet_service.cc:1511] Processing CreateTablet for tablet 13b502d61f804f169b0f20adba55efa5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:10.876055 30071 tablet_service.cc:1511] Processing CreateTablet for tablet b7b95bfcf7cd48e5aa9e14f40f7b9118 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:10.878585 30070 tablet_service.cc:1511] Processing CreateTablet for tablet f80e36941c78483ebd0edba43ec63b83 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:10.881287 30069 tablet_service.cc:1511] Processing CreateTablet for tablet 1860b4022529422197e01c32e02598f4 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:10.882517 30070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80e36941c78483ebd0edba43ec63b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.883395 30074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c039a4adb4a94b4983b0bd4ba5936b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.884392 30072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65b829ec05f405d8d11888322430664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.885031 30069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1860b4022529422197e01c32e02598f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.886086 30073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3533d54b9a67432bb09ec05957de7241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.887159 30004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b502d61f804f169b0f20adba55efa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.887635 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b95bfcf7cd48e5aa9e14f40f7b9118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.857093 30001 tablet_service.cc:1511] Processing CreateTablet for tablet e8c323dfa54847f1890203bcc0f931c9 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:10.912256 30001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c323dfa54847f1890203bcc0f931c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.918823 30002 tablet_service.cc:1511] Processing CreateTablet for tablet 9c97b9de751e4869a4675dfa47486840 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:10.932080 30002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c97b9de751e4869a4675dfa47486840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.952585 29964 heartbeater.cc:499] Master 127.19.185.254:34975 was elected leader, sending a full tablet report...
I20260709 13:14:10.967157 29998 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5ad95d8d5e43d9888dc66173bdae9c (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:10.968688 29998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5ad95d8d5e43d9888dc66173bdae9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.974905 30151 tablet_service.cc:1511] Processing CreateTablet for tablet 3af3771620b0455ba5105bfb4d256427 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:10.979612 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af3771620b0455ba5105bfb4d256427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.005347 30212 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:11.006175 29920 tablet_service.cc:1511] Processing CreateTablet for tablet 3af3771620b0455ba5105bfb4d256427 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:11.007532 29920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af3771620b0455ba5105bfb4d256427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.011790 30212 tablet_bootstrap.cc:654] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.967826 29997 tablet_service.cc:1511] Processing CreateTablet for tablet ae95e4a365df4e69b385a8da4f7d0357 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:11.017143 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae95e4a365df4e69b385a8da4f7d0357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.016898 30074 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5ad95d8d5e43d9888dc66173bdae9c (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:11.018288 30074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5ad95d8d5e43d9888dc66173bdae9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.019320 30207 ts_tablet_manager.cc:1434] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.214s	user 0.071s	sys 0.103s
I20260709 13:14:11.020495 30207 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:11.036757 30039 heartbeater.cc:499] Master 127.19.185.254:34975 was elected leader, sending a full tablet report...
I20260709 13:14:11.037825 30206 tablet_bootstrap.cc:492] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:11.038389 30206 ts_tablet_manager.cc:1403] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.316s	user 0.012s	sys 0.000s
I20260709 13:14:11.041579 30206 raft_consensus.cc:359] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.042542 30206 raft_consensus.cc:385] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.042838 30206 raft_consensus.cc:740] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.043591 30206 consensus_queue.cc:260] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.074353 30071 tablet_service.cc:1511] Processing CreateTablet for tablet 381657a3006a4f52b1268ecae19b2922 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:11.075961 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381657a3006a4f52b1268ecae19b2922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.075989 29996 tablet_service.cc:1511] Processing CreateTablet for tablet 07e24eb550644b86a27b84105bfbc044 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:11.077392 30151 tablet_service.cc:1511] Processing CreateTablet for tablet 07e24eb550644b86a27b84105bfbc044 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:11.080153 30207 tablet_bootstrap.cc:654] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.090055 30215 raft_consensus.cc:493] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.090269 30209 tablet_bootstrap.cc:492] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:11.090807 29996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e24eb550644b86a27b84105bfbc044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.090786 30215 raft_consensus.cc:515] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.090572 30187 heartbeater.cc:499] Master 127.19.185.254:34975 was elected leader, sending a full tablet report...
I20260709 13:14:11.096714 30069 tablet_service.cc:1511] Processing CreateTablet for tablet 01d37e8e23ef4f4fa7507c9f20cdda87 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:11.098183 30069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d37e8e23ef4f4fa7507c9f20cdda87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.091831 29925 tablet_service.cc:1511] Processing CreateTablet for tablet c43ee291f79741eebbaeff079b730c10 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:11.101043 29925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43ee291f79741eebbaeff079b730c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.103302 30206 ts_tablet_manager.cc:1434] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.065s	user 0.015s	sys 0.000s
I20260709 13:14:11.122494 30215 leader_election.cc:290] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:11.124826 30076 tablet_service.cc:1511] Processing CreateTablet for tablet e8c323dfa54847f1890203bcc0f931c9 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:11.125860 30075 tablet_service.cc:1511] Processing CreateTablet for tablet 232202ef61084cb1b794c297a13e0a07 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:11.121650 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e24eb550644b86a27b84105bfbc044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.138207 30212 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:11.138976 30212 ts_tablet_manager.cc:1403] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.134s	user 0.036s	sys 0.017s
I20260709 13:14:11.139998 30113 heartbeater.cc:499] Master 127.19.185.254:34975 was elected leader, sending a full tablet report...
I20260709 13:14:11.144690 30206 tablet_bootstrap.cc:492] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:11.153807 30152 tablet_service.cc:1511] Processing CreateTablet for tablet b196c8778ba948e3a8684b5b06a20876 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:11.160506 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b196c8778ba948e3a8684b5b06a20876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.161245 30209 tablet_bootstrap.cc:654] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.166514 30075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232202ef61084cb1b794c297a13e0a07. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:11.167126 29965 tablet.cc:2406] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:11.172989 30070 tablet_service.cc:1511] Processing CreateTablet for tablet 3af3771620b0455ba5105bfb4d256427 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:11.173666 30206 tablet_bootstrap.cc:654] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.174432 30070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af3771620b0455ba5105bfb4d256427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.177927 30003 tablet_service.cc:1511] Processing CreateTablet for tablet c43ee291f79741eebbaeff079b730c10 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:11.180305 30003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43ee291f79741eebbaeff079b730c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.187382 30075 tablet_service.cc:1511] Processing CreateTablet for tablet 07e24eb550644b86a27b84105bfbc044 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:11.178337 30076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c323dfa54847f1890203bcc0f931c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.165087 30212 raft_consensus.cc:359] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:11.191927 30212 raft_consensus.cc:385] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.192305 30212 raft_consensus.cc:740] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.193341 30207 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:11.193151 30212 consensus_queue.cc:260] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:11.193265 29928 tablet_service.cc:1511] Processing CreateTablet for tablet b196c8778ba948e3a8684b5b06a20876 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:11.194005 30207 ts_tablet_manager.cc:1403] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.174s	user 0.017s	sys 0.005s
I20260709 13:14:11.194739 29928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b196c8778ba948e3a8684b5b06a20876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.204097 30149 tablet_service.cc:1511] Processing CreateTablet for tablet e01d3f73348f4deca6026b42f4e83fab (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:11.205456 30149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01d3f73348f4deca6026b42f4e83fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.205188 29927 tablet_service.cc:1511] Processing CreateTablet for tablet e01d3f73348f4deca6026b42f4e83fab (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:11.206528 29927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01d3f73348f4deca6026b42f4e83fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.217033 30210 raft_consensus.cc:493] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.222855 30075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e24eb550644b86a27b84105bfbc044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.223069 30210 raft_consensus.cc:515] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:11.223362 30072 tablet_service.cc:1511] Processing CreateTablet for tablet 9c97b9de751e4869a4675dfa47486840 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:11.243232 30072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c97b9de751e4869a4675dfa47486840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.242091 30210 leader_election.cc:290] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:11.255769 30078 tablet_service.cc:1511] Processing CreateTablet for tablet c43ee291f79741eebbaeff079b730c10 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:11.257210 30078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43ee291f79741eebbaeff079b730c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.280117 30152 tablet_service.cc:1511] Processing CreateTablet for tablet bfd7f09ce7b043caa93dbd036bf072d2 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:11.281668 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd7f09ce7b043caa93dbd036bf072d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.291538 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:11.291651 30002 tablet_service.cc:1511] Processing CreateTablet for tablet b196c8778ba948e3a8684b5b06a20876 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:11.293138 30002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b196c8778ba948e3a8684b5b06a20876. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:11.293501 30127 leader_election.cc:343] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.296707 30206 tablet_bootstrap.cc:492] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:11.297297 30206 ts_tablet_manager.cc:1403] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.168s	user 0.018s	sys 0.012s
I20260709 13:14:11.299853 30212 ts_tablet_manager.cc:1434] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.161s	user 0.016s	sys 0.033s
I20260709 13:14:11.300549 30207 raft_consensus.cc:359] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.301021 30212 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:11.301345 30207 raft_consensus.cc:385] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.301692 30207 raft_consensus.cc:740] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.301774 30206 raft_consensus.cc:359] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.318037 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:11.322108 30151 tablet_service.cc:1511] Processing CreateTablet for tablet 449e14ef64d34e178c4b2a56e512e761 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:11.323524 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449e14ef64d34e178c4b2a56e512e761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.325915 30149 tablet_service.cc:1511] Processing CreateTablet for tablet e0e23d4c3c2b4b57b9e83c088db43d8c (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:11.327257 30149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e23d4c3c2b4b57b9e83c088db43d8c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:11.327658 30127 leader_election.cc:343] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.328258 30127 leader_election.cc:304] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:11.328187 30207 consensus_queue.cc:260] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.330914 30207 ts_tablet_manager.cc:1434] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.137s	user 0.008s	sys 0.000s
I20260709 13:14:11.340399 30214 raft_consensus.cc:2749] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:11.341179 29997 tablet_service.cc:1511] Processing CreateTablet for tablet bfd7f09ce7b043caa93dbd036bf072d2 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:11.342103 30070 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4b15c88c1748e9b84a6fbe8dcfb073 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:11.341805 30074 tablet_service.cc:1511] Processing CreateTablet for tablet bfd7f09ce7b043caa93dbd036bf072d2 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:11.343549 30069 tablet_service.cc:1511] Processing CreateTablet for tablet e01d3f73348f4deca6026b42f4e83fab (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:11.306314 30206 raft_consensus.cc:385] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.355053 30069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01d3f73348f4deca6026b42f4e83fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.355609 29996 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4b15c88c1748e9b84a6fbe8dcfb073 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:11.362521 30143 tablet_service.cc:1511] Processing CreateTablet for tablet 34a5ee0643f24ee996670cdf22181c76 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:11.363646 30146 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7c6f3de6904607952cb2b6c95d45a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:11.365906 30000 tablet_service.cc:1511] Processing CreateTablet for tablet 449e14ef64d34e178c4b2a56e512e761 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:11.366504 30073 tablet_service.cc:1511] Processing CreateTablet for tablet e0e23d4c3c2b4b57b9e83c088db43d8c (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:11.367307 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd7f09ce7b043caa93dbd036bf072d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.367828 30073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e23d4c3c2b4b57b9e83c088db43d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.367899 29999 tablet_service.cc:1511] Processing CreateTablet for tablet 34a5ee0643f24ee996670cdf22181c76 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:11.368566 30207 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:11.373376 30070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4b15c88c1748e9b84a6fbe8dcfb073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.373026 29998 tablet_service.cc:1511] Processing CreateTablet for tablet 93319818a15f4d37a35a004c1f533803 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:11.378269 30074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd7f09ce7b043caa93dbd036bf072d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.364015 30143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a5ee0643f24ee996670cdf22181c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.380752 30146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7c6f3de6904607952cb2b6c95d45a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.386305 30076 tablet_service.cc:1511] Processing CreateTablet for tablet 34a5ee0643f24ee996670cdf22181c76 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:11.387694 30076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a5ee0643f24ee996670cdf22181c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.387384 30150 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2aff9b036d42d98af552cbecc893a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:11.352450 30206 raft_consensus.cc:740] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.388674 30150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2aff9b036d42d98af552cbecc893a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.388852 30206 consensus_queue.cc:260] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.390331 30071 tablet_service.cc:1511] Processing CreateTablet for tablet 93319818a15f4d37a35a004c1f533803 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:11.391093 30206 ts_tablet_manager.cc:1434] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.000s
I20260709 13:14:11.394395 29995 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7c6f3de6904607952cb2b6c95d45a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:11.395076 30077 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2aff9b036d42d98af552cbecc893a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:11.396868 30207 tablet_bootstrap.cc:654] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.408756 29999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a5ee0643f24ee996670cdf22181c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.409765 30000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449e14ef64d34e178c4b2a56e512e761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.410771 29925 tablet_service.cc:1511] Processing CreateTablet for tablet e0e23d4c3c2b4b57b9e83c088db43d8c (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:11.412323 29925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e23d4c3c2b4b57b9e83c088db43d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.410858 29926 tablet_service.cc:1511] Processing CreateTablet for tablet 449e14ef64d34e178c4b2a56e512e761 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:11.412636 29995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7c6f3de6904607952cb2b6c95d45a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.413316 29926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449e14ef64d34e178c4b2a56e512e761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.414796 29920 tablet_service.cc:1511] Processing CreateTablet for tablet 93319818a15f4d37a35a004c1f533803 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:11.416178 29920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93319818a15f4d37a35a004c1f533803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.416100 29928 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4b15c88c1748e9b84a6fbe8dcfb073 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:11.417456 29928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4b15c88c1748e9b84a6fbe8dcfb073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.418903 30212 tablet_bootstrap.cc:654] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.418695 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:11.418695 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:11.419009 29921 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7c6f3de6904607952cb2b6c95d45a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:11.419432 30088 raft_consensus.cc:2468] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:11.420377 29921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7c6f3de6904607952cb2b6c95d45a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.420801 29904 leader_election.cc:304] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:11.421731 30210 raft_consensus.cc:2804] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:11.422099 30210 raft_consensus.cc:493] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.422449 30210 raft_consensus.cc:3060] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.428910 29998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93319818a15f4d37a35a004c1f533803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.431813 30077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2aff9b036d42d98af552cbecc893a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.434412 30206 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:11.474092 30072 tablet_service.cc:1511] Processing CreateTablet for tablet 340f6e2bf07e464a9f0c78041367953d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:11.449894 29996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4b15c88c1748e9b84a6fbe8dcfb073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.454197 30148 tablet_service.cc:1511] Processing CreateTablet for tablet 53a958826a704e629d021a83d965c74e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:11.481460 30148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a958826a704e629d021a83d965c74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.456193 30078 tablet_service.cc:1511] Processing CreateTablet for tablet 53a958826a704e629d021a83d965c74e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:11.457047 30003 tablet_service.cc:1511] Processing CreateTablet for tablet 53a958826a704e629d021a83d965c74e (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:11.458125 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93319818a15f4d37a35a004c1f533803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.467553 30145 tablet_service.cc:1511] Processing CreateTablet for tablet 8960d9fe4dcc48798391f67ce47e9f24 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:11.470845 30001 tablet_service.cc:1511] Processing CreateTablet for tablet 340f6e2bf07e464a9f0c78041367953d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:14:11.440011 29904 leader_election.cc:343] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.440434 30210 raft_consensus.cc:515] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:11.490649 29904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 52598.5us
I20260709 13:14:11.496569 30001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 340f6e2bf07e464a9f0c78041367953d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.498246 30004 tablet_service.cc:1511] Processing CreateTablet for tablet 8960d9fe4dcc48798391f67ce47e9f24 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:11.499148 30075 tablet_service.cc:1511] Processing CreateTablet for tablet 04d8796d68924971b6214133c03fef63 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:11.499532 30004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8960d9fe4dcc48798391f67ce47e9f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.501101 30003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a958826a704e629d021a83d965c74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.503123 30145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8960d9fe4dcc48798391f67ce47e9f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.520566 30207 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:11.521179 30207 ts_tablet_manager.cc:1403] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.010s
I20260709 13:14:11.510205 30072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 340f6e2bf07e464a9f0c78041367953d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.527953 30209 tablet_bootstrap.cc:492] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:11.528520 30209 ts_tablet_manager.cc:1403] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.497s	user 0.012s	sys 0.009s
I20260709 13:14:11.528570 29923 tablet_service.cc:1511] Processing CreateTablet for tablet 8960d9fe4dcc48798391f67ce47e9f24 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:11.530144 29923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8960d9fe4dcc48798391f67ce47e9f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.536645 30078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a958826a704e629d021a83d965c74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.537384 30212 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:11.537371 30209 raft_consensus.cc:359] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.538136 30212 ts_tablet_manager.cc:1403] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.237s	user 0.042s	sys 0.025s
I20260709 13:14:11.538228 30209 raft_consensus.cc:385] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.538697 30209 raft_consensus.cc:740] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.525398 30207 raft_consensus.cc:359] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.544411 30207 raft_consensus.cc:385] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.544747 30207 raft_consensus.cc:740] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.545480 30075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d8796d68924971b6214133c03fef63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.545724 30207 consensus_queue.cc:260] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.551483 30210 leader_election.cc:290] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:11.551213 29924 tablet_service.cc:1511] Processing CreateTablet for tablet 04d8796d68924971b6214133c03fef63 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:11.552649 29924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d8796d68924971b6214133c03fef63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.541225 30212 raft_consensus.cc:359] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.554775 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:11.554239 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:11.556313 30088 raft_consensus.cc:3060] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.563642 30088 raft_consensus.cc:2468] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:11.565147 30152 tablet_service.cc:1511] Processing CreateTablet for tablet 04d8796d68924971b6214133c03fef63 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:11.566552 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d8796d68924971b6214133c03fef63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.554788 30212 raft_consensus.cc:385] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.573088 30212 raft_consensus.cc:740] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.576505 30214 raft_consensus.cc:493] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.584422 30214 raft_consensus.cc:515] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.539520 30209 consensus_queue.cc:260] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.577909 30206 tablet_bootstrap.cc:654] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.579504 29997 tablet_service.cc:1511] Processing CreateTablet for tablet 4887ffedd97e42cf858676b10f32bd09 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:11.565107 29904 leader_election.cc:304] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:11.589152 30214 leader_election.cc:290] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:11.590106 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887ffedd97e42cf858676b10f32bd09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.565042 29926 tablet_service.cc:1511] Processing CreateTablet for tablet 340f6e2bf07e464a9f0c78041367953d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:11.593713 30210 raft_consensus.cc:2804] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:11.594398 30210 raft_consensus.cc:697] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:11.594514 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:11.596133 30127 leader_election.cc:343] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.595559 30210 consensus_queue.cc:237] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:11.597604 29927 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2aff9b036d42d98af552cbecc893a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:11.605086 30069 tablet_service.cc:1511] Processing CreateTablet for tablet 4887ffedd97e42cf858676b10f32bd09 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:11.606480 30069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887ffedd97e42cf858676b10f32bd09. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:11.612265 29904 leader_election.cc:343] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.614681 30143 tablet_service.cc:1511] Processing CreateTablet for tablet 4887ffedd97e42cf858676b10f32bd09 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:11.616083 30143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887ffedd97e42cf858676b10f32bd09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.627396 29928 tablet_service.cc:1511] Processing CreateTablet for tablet b2ff06a319654c8b81ee03263d338afa (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:11.629666 30000 tablet_service.cc:1511] Processing CreateTablet for tablet b2ff06a319654c8b81ee03263d338afa (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:11.629666 30073 tablet_service.cc:1511] Processing CreateTablet for tablet b2ff06a319654c8b81ee03263d338afa (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:11.631219 30073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ff06a319654c8b81ee03263d338afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.631219 30000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ff06a319654c8b81ee03263d338afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.654407 30143 tablet_service.cc:1511] Processing CreateTablet for tablet 6438e7353ed64f82b4991b777c290e39 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:11.655906 30143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6438e7353ed64f82b4991b777c290e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.662357 29920 tablet_service.cc:1511] Processing CreateTablet for tablet 6438e7353ed64f82b4991b777c290e39 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:11.668875 30071 tablet_service.cc:1511] Processing CreateTablet for tablet b267e53446f24bfab5e48e060d0250d0 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:11.670301 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b267e53446f24bfab5e48e060d0250d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.674033 30149 tablet_service.cc:1511] Processing CreateTablet for tablet b267e53446f24bfab5e48e060d0250d0 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:11.676249 30149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b267e53446f24bfab5e48e060d0250d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.686269 29921 tablet_service.cc:1511] Processing CreateTablet for tablet b267e53446f24bfab5e48e060d0250d0 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:11.599402 29927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2aff9b036d42d98af552cbecc893a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.687695 29921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b267e53446f24bfab5e48e060d0250d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.700184 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:11.699074 29928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ff06a319654c8b81ee03263d338afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.700985 30014 raft_consensus.cc:2468] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:11.713340 30209 ts_tablet_manager.cc:1434] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.184s	user 0.017s	sys 0.003s
I20260709 13:14:11.710139 30127 leader_election.cc:304] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:11.729360 30207 ts_tablet_manager.cc:1434] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.208s	user 0.008s	sys 0.013s
I20260709 13:14:11.730903 30214 raft_consensus.cc:2804] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:11.731295 30214 raft_consensus.cc:493] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.731442 30207 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:11.731680 30214 raft_consensus.cc:3060] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.709095 29926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 340f6e2bf07e464a9f0c78041367953d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.734822 29920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6438e7353ed64f82b4991b777c290e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.720019 29995 tablet_service.cc:1511] Processing CreateTablet for tablet 8320902d3532452e843e170bb7405f44 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:11.736891 29995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8320902d3532452e843e170bb7405f44. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:11.744414 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:11.721326 30000 tablet_service.cc:1511] Processing CreateTablet for tablet 6438e7353ed64f82b4991b777c290e39 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:11.745618 30000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6438e7353ed64f82b4991b777c290e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.721230 30077 tablet_service.cc:1511] Processing CreateTablet for tablet 8320902d3532452e843e170bb7405f44 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:11.748943 30077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8320902d3532452e843e170bb7405f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.722883 30228 raft_consensus.cc:493] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.726718 30148 tablet_service.cc:1511] Processing CreateTablet for tablet 8320902d3532452e843e170bb7405f44 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:11.749768 29923 tablet_service.cc:1511] Processing CreateTablet for tablet affbd9c95c834993a100eeadb412d208 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:11.752697 30148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8320902d3532452e843e170bb7405f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.753265 29923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet affbd9c95c834993a100eeadb412d208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.749959 30228 raft_consensus.cc:515] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.756866 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:11.759070 30228 leader_election.cc:290] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:11.726977 29834 catalog_manager.cc:5697] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.727010 30229 raft_consensus.cc:493] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.702101 30212 consensus_queue.cc:260] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.769675 30219 raft_consensus.cc:493] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.770206 30219 raft_consensus.cc:515] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.772230 30088 raft_consensus.cc:2468] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:11.773677 30207 tablet_bootstrap.cc:654] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.776417 30214 raft_consensus.cc:515] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.780426 29904 leader_election.cc:304] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:11.781697 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:11.786612 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
W20260709 13:14:11.788021 30127 leader_election.cc:343] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.788483 30219 leader_election.cc:290] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:11.787998 30209 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:11.780651 30214 leader_election.cc:290] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:11.798700 30228 raft_consensus.cc:2804] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:11.799363 30228 raft_consensus.cc:493] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.800626 30228 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.813773 30229 raft_consensus.cc:515] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.814899 30014 raft_consensus.cc:3060] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.745647 30206 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:11.830852 30206 ts_tablet_manager.cc:1403] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.439s	user 0.018s	sys 0.004s
I20260709 13:14:11.834360 30076 tablet_service.cc:1511] Processing CreateTablet for tablet affbd9c95c834993a100eeadb412d208 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:11.835853 30076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet affbd9c95c834993a100eeadb412d208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.836531 30210 raft_consensus.cc:493] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.834360 29997 tablet_service.cc:1511] Processing CreateTablet for tablet affbd9c95c834993a100eeadb412d208 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:11.836736 30209 tablet_bootstrap.cc:654] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.839506 30212 ts_tablet_manager.cc:1434] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.301s	user 0.009s	sys 0.006s
I20260709 13:14:11.837139 30210 raft_consensus.cc:515] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.844695 29999 tablet_service.cc:1511] Processing CreateTablet for tablet 37416d89f4674706a02df9a84c7f3ae3 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:11.845593 30152 tablet_service.cc:1511] Processing CreateTablet for tablet 37416d89f4674706a02df9a84c7f3ae3 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:11.847213 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37416d89f4674706a02df9a84c7f3ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.848119 30071 tablet_service.cc:1511] Processing CreateTablet for tablet 90d7a42309c748f0a0ee3236a7e019a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:11.850029 30207 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:11.845965 30210 leader_election.cc:290] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:11.850598 30207 ts_tablet_manager.cc:1403] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.119s	user 0.029s	sys 0.009s
I20260709 13:14:11.846089 29999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37416d89f4674706a02df9a84c7f3ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.855073 30228 raft_consensus.cc:515] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.856493 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet affbd9c95c834993a100eeadb412d208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.860515 30206 raft_consensus.cc:359] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.861312 30206 raft_consensus.cc:385] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.861708 30206 raft_consensus.cc:740] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.862185 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:11.865725 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:11.868743 29903 leader_election.cc:343] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:11.870901 29903 leader_election.cc:343] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.871528 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:11.873517 30052 leader_election.cc:343] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.876600 30014 raft_consensus.cc:2468] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:11.881280 30127 leader_election.cc:304] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:11.882489 30214 raft_consensus.cc:2804] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:11.893695 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d7a42309c748f0a0ee3236a7e019a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.894335 30149 tablet_service.cc:1511] Processing CreateTablet for tablet 90d7a42309c748f0a0ee3236a7e019a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:11.895773 30149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d7a42309c748f0a0ee3236a7e019a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.883080 30207 raft_consensus.cc:359] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:11.910874 30229 leader_election.cc:290] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:11.899145 30214 raft_consensus.cc:697] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:11.912899 30207 raft_consensus.cc:385] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.927107 30207 raft_consensus.cc:740] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.927990 30207 consensus_queue.cc:260] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:11.930473 30207 ts_tablet_manager.cc:1434] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.068s	user 0.003s	sys 0.003s
I20260709 13:14:11.931581 30207 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:11.913431 30228 leader_election.cc:290] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:11.932937 30212 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:11.907343 30206 consensus_queue.cc:260] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:11.957227 29926 tablet_service.cc:1511] Processing CreateTablet for tablet 37416d89f4674706a02df9a84c7f3ae3 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:11.959237 29926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37416d89f4674706a02df9a84c7f3ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.960150 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:11.961884 29923 tablet_service.cc:1511] Processing CreateTablet for tablet 90d7a42309c748f0a0ee3236a7e019a5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:11.962330 30214 consensus_queue.cc:237] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:11.964362 29928 tablet_service.cc:1511] Processing CreateTablet for tablet d13ad599db1d42519e573887087d5a0f (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:11.969081 30209 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:11.969867 30209 ts_tablet_manager.cc:1403] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.182s	user 0.011s	sys 0.015s
I20260709 13:14:11.979099 30206 ts_tablet_manager.cc:1434] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.147s	user 0.008s	sys 0.001s
I20260709 13:14:11.979437 30077 tablet_service.cc:1511] Processing CreateTablet for tablet 8789ef1eb3f346e480405a1544cd57d5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:11.980870 30077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8789ef1eb3f346e480405a1544cd57d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.973042 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:11.984843 30000 tablet_service.cc:1511] Processing CreateTablet for tablet d13ad599db1d42519e573887087d5a0f (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:14:11.986261 29904 leader_election.cc:343] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.986768 29904 leader_election.cc:304] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:11.987313 29999 tablet_service.cc:1511] Processing CreateTablet for tablet c39528ca9ed34510aabaa30ddbf33da1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:11.988250 30228 raft_consensus.cc:2749] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:11.992980 29995 tablet_service.cc:1511] Processing CreateTablet for tablet 8789ef1eb3f346e480405a1544cd57d5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:11.995280 30212 tablet_bootstrap.cc:654] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.996459 29923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d7a42309c748f0a0ee3236a7e019a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.997998 29927 tablet_service.cc:1511] Processing CreateTablet for tablet c39528ca9ed34510aabaa30ddbf33da1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:11.998488 30242 raft_consensus.cc:493] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.999452 29927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39528ca9ed34510aabaa30ddbf33da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.999109 30242 raft_consensus.cc:515] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.008818 30143 tablet_service.cc:1511] Processing CreateTablet for tablet 8789ef1eb3f346e480405a1544cd57d5 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:12.010221 30143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8789ef1eb3f346e480405a1544cd57d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.009568 30147 tablet_service.cc:1511] Processing CreateTablet for tablet c3925f4bfb894ab1b6890463f034478b (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:12.011656 30147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3925f4bfb894ab1b6890463f034478b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.012955 30075 tablet_service.cc:1511] Processing CreateTablet for tablet d13ad599db1d42519e573887087d5a0f (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:12.014240 30075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13ad599db1d42519e573887087d5a0f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:12.016325 29903 leader_election.cc:343] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.019752 30073 tablet_service.cc:1511] Processing CreateTablet for tablet 244205f3a8df4e07b6dd48c47779e712 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:12.020994 30145 tablet_service.cc:1511] Processing CreateTablet for tablet c39528ca9ed34510aabaa30ddbf33da1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:12.021221 30069 tablet_service.cc:1511] Processing CreateTablet for tablet c319af3352cf463fa873785b1acfb5bd (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:12.022636 30070 tablet_service.cc:1511] Processing CreateTablet for tablet 986e5222b0a848fe998624fedd70c7a9 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:12.023085 30146 tablet_service.cc:1511] Processing CreateTablet for tablet 91006ce206784668a848904ea662f60d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:12.021389 30073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244205f3a8df4e07b6dd48c47779e712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.002605 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:12.036844 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:12.037151 29998 tablet_service.cc:1511] Processing CreateTablet for tablet c319af3352cf463fa873785b1acfb5bd (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:12.037698 30087 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.038893 30001 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb1d96bc2a74b3096fcedd6db889969 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:12.032814 30072 tablet_service.cc:1511] Processing CreateTablet for tablet c3925f4bfb894ab1b6890463f034478b (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:12.041330 30146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91006ce206784668a848904ea662f60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.042063 30145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39528ca9ed34510aabaa30ddbf33da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.040591 30004 tablet_service.cc:1511] Processing CreateTablet for tablet 91006ce206784668a848904ea662f60d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:12.042688 29996 tablet_service.cc:1511] Processing CreateTablet for tablet 986e5222b0a848fe998624fedd70c7a9 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:12.048310 30150 tablet_service.cc:1511] Processing CreateTablet for tablet 986e5222b0a848fe998624fedd70c7a9 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:12.050806 30150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986e5222b0a848fe998624fedd70c7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.053570 30078 tablet_service.cc:1511] Processing CreateTablet for tablet c3677eacee9c41669b921c2143570547 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:12.023085 30151 tablet_service.cc:1511] Processing CreateTablet for tablet 244205f3a8df4e07b6dd48c47779e712 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:14:12.062146 30127 leader_election.cc:343] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.063392 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244205f3a8df4e07b6dd48c47779e712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.032737 30003 tablet_service.cc:1511] Processing CreateTablet for tablet c3677eacee9c41669b921c2143570547 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:12.004289 30242 leader_election.cc:290] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:12.035079 29928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13ad599db1d42519e573887087d5a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.075125 30144 tablet_service.cc:1511] Processing CreateTablet for tablet 27287279f1d34d898c530c2e961f1ea1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:12.076649 30144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27287279f1d34d898c530c2e961f1ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.077101 30148 tablet_service.cc:1511] Processing CreateTablet for tablet c319af3352cf463fa873785b1acfb5bd (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:12.078498 30206 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:12.078536 30148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c319af3352cf463fa873785b1acfb5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.088146 30078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3677eacee9c41669b921c2143570547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.090663 30209 raft_consensus.cc:359] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.091229 30000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13ad599db1d42519e573887087d5a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.091491 30209 raft_consensus.cc:385] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.097303 29999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39528ca9ed34510aabaa30ddbf33da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.098798 30074 tablet_service.cc:1511] Processing CreateTablet for tablet 1609495998e14d48914fd9d7dce5a3d1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:12.100180 30074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1609495998e14d48914fd9d7dce5a3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.101291 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:12.101477 30002 tablet_service.cc:1511] Processing CreateTablet for tablet 27287279f1d34d898c530c2e961f1ea1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:12.102213 29939 raft_consensus.cc:2393] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 1: Already voted for candidate b9712e59a1774be08aa8e368566dcfed in this term.
I20260709 13:14:12.102273 29920 tablet_service.cc:1511] Processing CreateTablet for tablet 244205f3a8df4e07b6dd48c47779e712 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:12.103643 29920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244205f3a8df4e07b6dd48c47779e712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.103221 29924 tablet_service.cc:1511] Processing CreateTablet for tablet c3925f4bfb894ab1b6890463f034478b (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:12.104239 29925 tablet_service.cc:1511] Processing CreateTablet for tablet 91006ce206784668a848904ea662f60d (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:12.103215 29921 tablet_service.cc:1511] Processing CreateTablet for tablet c3677eacee9c41669b921c2143570547 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:12.105782 29995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8789ef1eb3f346e480405a1544cd57d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.105633 29929 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb1d96bc2a74b3096fcedd6db889969 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:12.107278 29925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91006ce206784668a848904ea662f60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.105542 29922 tablet_service.cc:1511] Processing CreateTablet for tablet 27287279f1d34d898c530c2e961f1ea1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:12.108630 29929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb1d96bc2a74b3096fcedd6db889969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.109088 29998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c319af3352cf463fa873785b1acfb5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.109319 29922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27287279f1d34d898c530c2e961f1ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.109409 30152 tablet_service.cc:1511] Processing CreateTablet for tablet 1609495998e14d48914fd9d7dce5a3d1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:12.110670 29924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3925f4bfb894ab1b6890463f034478b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.110929 30001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb1d96bc2a74b3096fcedd6db889969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.112142 29921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3677eacee9c41669b921c2143570547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.111704 30052 leader_election.cc:304] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:12.120618 30207 tablet_bootstrap.cc:700] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Time spent opening tablet: real 0.105s	user 0.005s	sys 0.000s
I20260709 13:14:12.121353 30207 tablet_bootstrap.cc:654] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.121400 30004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91006ce206784668a848904ea662f60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.124707 29996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986e5222b0a848fe998624fedd70c7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.125350 30003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3677eacee9c41669b921c2143570547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.128355 30002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27287279f1d34d898c530c2e961f1ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.136562 30072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3925f4bfb894ab1b6890463f034478b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.091892 30209 raft_consensus.cc:740] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.157379 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:12.159425 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:12.164286 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1609495998e14d48914fd9d7dce5a3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.149883 30070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986e5222b0a848fe998624fedd70c7a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:12.184864 29979 leader_election.cc:343] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.185391 29979 leader_election.cc:304] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:12.186242 30229 raft_consensus.cc:2749] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:12.188401 29904 consensus_peers.cc:597] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:12.189669 30209 consensus_queue.cc:260] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.191968 30209 ts_tablet_manager.cc:1434] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.222s	user 0.008s	sys 0.000s
I20260709 13:14:12.193107 30209 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:12.199138 30069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c319af3352cf463fa873785b1acfb5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.171773 30087 raft_consensus.cc:2468] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:12.209290 30235 raft_consensus.cc:2749] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.212604 29904 leader_election.cc:304] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:12.213546 30228 raft_consensus.cc:2804] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.214071 30228 raft_consensus.cc:697] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:12.206233 30071 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb1d96bc2a74b3096fcedd6db889969 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:12.230798 30228 consensus_queue.cc:237] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.232956 29836 catalog_manager.cc:5697] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.261729 30206 tablet_bootstrap.cc:654] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.263130 30071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb1d96bc2a74b3096fcedd6db889969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.270460 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
W20260709 13:14:12.272172 30126 leader_election.cc:343] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.272656 30126 leader_election.cc:304] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:12.273847 30214 raft_consensus.cc:2749] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.292855 30210 consensus_queue.cc:1048] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:12.303282 30207 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:12.303315 30212 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:12.324870 29929 tablet_service.cc:1511] Processing CreateTablet for tablet 1609495998e14d48914fd9d7dce5a3d1 (DEFAULT_TABLE table=test-workload [id=0aa94c1eff684e7a950db9c20aa0031c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:12.326932 29929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1609495998e14d48914fd9d7dce5a3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.299660 30229 raft_consensus.cc:493] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.336644 30229 raft_consensus.cc:515] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.341005 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:12.343252 29978 leader_election.cc:343] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.348943 30229 leader_election.cc:290] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:12.317137 30207 ts_tablet_manager.cc:1403] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.386s	user 0.033s	sys 0.018s
I20260709 13:14:12.361161 30209 tablet_bootstrap.cc:654] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.323747 30212 ts_tablet_manager.cc:1403] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.413s	user 0.026s	sys 0.007s
I20260709 13:14:12.363502 30207 raft_consensus.cc:359] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.380188 30207 raft_consensus.cc:385] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.386518 30207 raft_consensus.cc:740] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.387444 30207 consensus_queue.cc:260] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.390087 30207 ts_tablet_manager.cc:1434] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:14:12.391247 30207 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:12.399454 30210 raft_consensus.cc:493] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.400856 30210 raft_consensus.cc:515] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.402725 30212 raft_consensus.cc:359] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.403369 30210 leader_election.cc:290] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:12.403659 30212 raft_consensus.cc:385] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.405449 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e98dbb807428aaa77b766013b2d3e" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:12.409157 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e98dbb807428aaa77b766013b2d3e" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:12.410768 29904 leader_election.cc:343] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:12.413451 29903 leader_election.cc:343] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.414136 29903 leader_election.cc:304] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:12.411767 30212 raft_consensus.cc:740] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.415678 30212 consensus_queue.cc:260] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.416723 29834 catalog_manager.cc:5697] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.417876 30212 ts_tablet_manager.cc:1434] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 13:14:12.418980 30212 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:12.419040 30214 consensus_queue.cc:1048] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:12.425642 30212 tablet_bootstrap.cc:654] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.428452 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
W20260709 13:14:12.430063 29978 leader_election.cc:343] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.430516 29978 leader_election.cc:304] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:12.431633 30229 raft_consensus.cc:2749] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.433980 30206 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:12.437191 30206 ts_tablet_manager.cc:1403] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.359s	user 0.038s	sys 0.064s
I20260709 13:14:12.440529 30206 raft_consensus.cc:359] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.441286 30206 raft_consensus.cc:385] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.444186 30206 raft_consensus.cc:740] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.445201 30206 consensus_queue.cc:260] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.452404 30206 ts_tablet_manager.cc:1434] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:14:12.452733 30228 raft_consensus.cc:2749] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.453614 30206 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:12.462989 30207 tablet_bootstrap.cc:654] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.472221 30206 tablet_bootstrap.cc:654] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.476852 30212 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:12.477414 30212 ts_tablet_manager.cc:1403] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.028s
I20260709 13:14:12.477936 30235 raft_consensus.cc:493] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.478478 30235 raft_consensus.cc:515] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.480403 30212 raft_consensus.cc:359] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.481156 30212 raft_consensus.cc:385] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.481436 30212 raft_consensus.cc:740] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.485415 30235 leader_election.cc:290] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:12.482192 30212 consensus_queue.cc:260] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.496836 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:12.502799 30212 ts_tablet_manager.cc:1434] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
W20260709 13:14:12.502926 30127 consensus_peers.cc:597] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:12.504668 30052 leader_election.cc:343] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.504985 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:12.505695 29939 raft_consensus.cc:2468] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:12.507099 30052 leader_election.cc:304] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:12.517113 30263 raft_consensus.cc:2804] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.517673 30263 raft_consensus.cc:493] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.518111 30263 raft_consensus.cc:3060] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.523945 30209 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:12.524603 30209 ts_tablet_manager.cc:1403] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.332s	user 0.016s	sys 0.004s
I20260709 13:14:12.527741 30209 raft_consensus.cc:359] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.528668 30209 raft_consensus.cc:385] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.528973 30209 raft_consensus.cc:740] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.533965 30209 consensus_queue.cc:260] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.536306 30209 ts_tablet_manager.cc:1434] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:14:12.540189 30263 raft_consensus.cc:515] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.542351 30212 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:12.544994 30209 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:12.548616 30206 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:12.549190 30206 ts_tablet_manager.cc:1403] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.015s
I20260709 13:14:12.552626 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:12.551776 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:12.554502 29939 raft_consensus.cc:3060] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.550539 30263 leader_election.cc:290] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
W20260709 13:14:12.556461 30052 leader_election.cc:343] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.553232 30206 raft_consensus.cc:359] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.557801 30206 raft_consensus.cc:385] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.558101 30206 raft_consensus.cc:740] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.558838 30206 consensus_queue.cc:260] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.562543 30207 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:12.563068 30207 ts_tablet_manager.cc:1403] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.009s
I20260709 13:14:12.564980 29939 raft_consensus.cc:2468] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:12.566396 30052 leader_election.cc:304] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:12.567389 30263 raft_consensus.cc:2804] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.567920 30212 tablet_bootstrap.cc:654] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.568776 30263 raft_consensus.cc:697] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:12.571753 30206 ts_tablet_manager.cc:1434] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:14:12.572252 30207 raft_consensus.cc:359] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.572929 30206 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:12.573022 30207 raft_consensus.cc:385] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.573484 30207 raft_consensus.cc:740] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.569761 30263 consensus_queue.cc:237] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.575639 30209 tablet_bootstrap.cc:654] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.579892 30206 tablet_bootstrap.cc:654] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.579702 30207 consensus_queue.cc:260] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.589556 30207 ts_tablet_manager.cc:1434] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:14:12.591225 30207 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:12.591624 30212 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:12.598024 30209 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:12.598626 30209 ts_tablet_manager.cc:1403] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.004s
I20260709 13:14:12.599570 30207 tablet_bootstrap.cc:654] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.603724 30212 ts_tablet_manager.cc:1403] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.010s
I20260709 13:14:12.602160 29836 catalog_manager.cc:5697] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.601608 30209 raft_consensus.cc:359] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.606693 30209 raft_consensus.cc:385] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.606932 30212 raft_consensus.cc:359] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.607746 30212 raft_consensus.cc:385] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.608119 30212 raft_consensus.cc:740] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.608289 30209 raft_consensus.cc:740] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.608965 30212 consensus_queue.cc:260] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.609069 30209 consensus_queue.cc:260] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.611286 30212 ts_tablet_manager.cc:1434] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:14:12.612344 30212 tablet_bootstrap.cc:492] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:12.619241 30209 ts_tablet_manager.cc:1434] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 13:14:12.619483 30212 tablet_bootstrap.cc:654] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.621600 30206 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:12.622159 30206 ts_tablet_manager.cc:1403] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 13:14:12.626436 30206 raft_consensus.cc:359] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.627519 30206 raft_consensus.cc:385] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.631371 30209 tablet_bootstrap.cc:492] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:12.632285 30212 tablet_bootstrap.cc:492] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:12.632838 30212 ts_tablet_manager.cc:1403] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:14:12.627884 30206 raft_consensus.cc:740] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.635950 30212 raft_consensus.cc:359] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.636796 30212 raft_consensus.cc:385] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.637132 30212 raft_consensus.cc:740] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.637933 30206 consensus_queue.cc:260] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.638027 30212 consensus_queue.cc:260] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.638731 30207 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:12.639272 30207 ts_tablet_manager.cc:1403] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.025s
I20260709 13:14:12.640247 30206 ts_tablet_manager.cc:1434] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.007s
I20260709 13:14:12.640406 30212 ts_tablet_manager.cc:1434] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:12.641569 30212 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:12.642369 30207 raft_consensus.cc:359] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.643178 30207 raft_consensus.cc:385] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.643478 30207 raft_consensus.cc:740] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.644049 30206 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:12.644337 30207 consensus_queue.cc:260] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.648856 30207 ts_tablet_manager.cc:1434] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:14:12.649885 30207 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:12.651614 30209 tablet_bootstrap.cc:654] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.656095 30206 tablet_bootstrap.cc:654] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.656466 30207 tablet_bootstrap.cc:654] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.662554 30207 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:12.663019 30207 ts_tablet_manager.cc:1403] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:14:12.664098 30206 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:12.664634 30212 tablet_bootstrap.cc:654] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.665567 30207 raft_consensus.cc:359] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.666271 30207 raft_consensus.cc:385] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.666538 30207 raft_consensus.cc:740] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.664634 30206 ts_tablet_manager.cc:1403] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:14:12.667202 30207 consensus_queue.cc:260] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.670756 30014 raft_consensus.cc:3060] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.670599 30206 raft_consensus.cc:359] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.671774 30206 raft_consensus.cc:385] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.672205 30206 raft_consensus.cc:740] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.675303 30228 raft_consensus.cc:493] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.676013 30228 raft_consensus.cc:515] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
W20260709 13:14:12.677990 29903 consensus_peers.cc:597] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed -> Peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Couldn't send request to peer 0c8ac4f0fa334a16b65c6a52a89b8d49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:12.678279 30228 leader_election.cc:290] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:12.675209 30209 tablet_bootstrap.cc:492] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:12.679272 30209 ts_tablet_manager.cc:1403] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.048s	user 0.004s	sys 0.012s
I20260709 13:14:12.679044 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:12.679751 30268 raft_consensus.cc:493] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.679836 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:12.680593 30162 raft_consensus.cc:2468] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:12.682335 30263 raft_consensus.cc:493] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:12.682547 29904 leader_election.cc:343] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.680433 30268 raft_consensus.cc:515] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.685303 30268 leader_election.cc:290] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:12.684792 30209 raft_consensus.cc:359] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.685700 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:12.685875 30209 raft_consensus.cc:385] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.686343 30209 raft_consensus.cc:740] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.686386 29939 raft_consensus.cc:2468] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:12.686637 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:12.687350 30013 raft_consensus.cc:2468] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:12.688097 30126 leader_election.cc:304] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:12.682857 30263 raft_consensus.cc:515] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.689240 30268 raft_consensus.cc:2804] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.689657 30268 raft_consensus.cc:493] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.690050 30268 raft_consensus.cc:3060] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.690662 30263 leader_election.cc:290] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:12.691531 30209 consensus_queue.cc:260] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.693212 30206 consensus_queue.cc:260] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.694680 29903 leader_election.cc:304] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:12.695966 30210 raft_consensus.cc:493] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.696480 30210 raft_consensus.cc:515] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.698509 30210 leader_election.cc:290] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:12.698326 30268 raft_consensus.cc:515] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.699066 30210 raft_consensus.cc:2804] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.699448 30210 raft_consensus.cc:493] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.699791 30210 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.701624 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:12.701848 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:12.702023 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:12.702250 29939 raft_consensus.cc:3060] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:12.705328 29904 leader_election.cc:343] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:12.706075 30052 leader_election.cc:343] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.708580 30214 raft_consensus.cc:493] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.709103 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:12.709307 30214 raft_consensus.cc:515] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.710707 29939 raft_consensus.cc:2468] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:12.709848 30162 raft_consensus.cc:2468] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:12.712984 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
W20260709 13:14:12.715400 30126 leader_election.cc:343] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.713014 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:12.716656 30013 raft_consensus.cc:3060] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.716710 30214 leader_election.cc:290] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:12.717968 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:12.718770 30206 ts_tablet_manager.cc:1434] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.003s
W20260709 13:14:12.719468 30127 leader_election.cc:343] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.719902 30206 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:12.719930 30127 leader_election.cc:304] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:12.721377 30214 raft_consensus.cc:2749] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.722579 29903 leader_election.cc:304] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:12.723730 30228 raft_consensus.cc:2804] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.699774 30209 ts_tablet_manager.cc:1434] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:14:12.724908 30126 leader_election.cc:304] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:12.725225 30209 tablet_bootstrap.cc:492] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:12.725848 30214 raft_consensus.cc:2804] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.724118 30228 raft_consensus.cc:493] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.726488 30214 raft_consensus.cc:697] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:12.726665 30228 raft_consensus.cc:3060] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.727538 30214 consensus_queue.cc:237] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.711898 30268 leader_election.cc:290] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:12.733536 30013 raft_consensus.cc:2468] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:12.733618 30210 raft_consensus.cc:515] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.737506 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
W20260709 13:14:12.739532 29904 leader_election.cc:343] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.745513 30210 leader_election.cc:290] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:12.746692 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
W20260709 13:14:12.747131 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:12.747392 30162 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.748528 30209 tablet_bootstrap.cc:654] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.752322 30206 tablet_bootstrap.cc:654] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.758369 30207 ts_tablet_manager.cc:1434] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 13:14:12.759811 30207 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:12.774647 30162 raft_consensus.cc:2468] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:12.741489 30228 raft_consensus.cc:515] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.781653 29903 leader_election.cc:304] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:12.784571 30210 raft_consensus.cc:2804] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.781859 30214 raft_consensus.cc:493] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.786648 30214 raft_consensus.cc:515] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.789498 29836 catalog_manager.cc:5697] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.792807 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:12.793431 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e98dbb807428aaa77b766013b2d3e" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:12.794106 29939 raft_consensus.cc:2468] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
W20260709 13:14:12.794332 29904 leader_election.cc:343] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.795486 30126 leader_election.cc:304] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:12.796396 30268 raft_consensus.cc:2804] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.796780 30268 raft_consensus.cc:493] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.797106 30268 raft_consensus.cc:3060] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.798151 30228 leader_election.cc:290] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:12.798718 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:12.798987 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:12.799336 30162 raft_consensus.cc:3060] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:12.804648 30053 leader_election.cc:343] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.805266 30053 leader_election.cc:304] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:12.806799 30210 raft_consensus.cc:697] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:12.807839 30207 tablet_bootstrap.cc:654] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.808128 30210 consensus_queue.cc:237] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.809171 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e98dbb807428aaa77b766013b2d3e" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:12.810636 30127 leader_election.cc:343] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.811209 30214 leader_election.cc:290] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:12.806928 30263 raft_consensus.cc:2749] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.817842 30212 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:12.818491 30212 ts_tablet_manager.cc:1403] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.177s	user 0.036s	sys 0.069s
I20260709 13:14:12.818783 30268 raft_consensus.cc:515] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.821653 30209 tablet_bootstrap.cc:492] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:12.821604 30212 raft_consensus.cc:359] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.822460 30209 ts_tablet_manager.cc:1403] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.002s
I20260709 13:14:12.823274 30212 raft_consensus.cc:385] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.823642 30212 raft_consensus.cc:740] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.824234 30268 leader_election.cc:290] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:12.824595 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e98dbb807428aaa77b766013b2d3e" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:12.824834 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e98dbb807428aaa77b766013b2d3e" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:12.824587 30212 consensus_queue.cc:260] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.825479 29939 raft_consensus.cc:3060] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:12.826287 30127 leader_election.cc:343] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.827252 30212 ts_tablet_manager.cc:1434] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:12.828383 30212 tablet_bootstrap.cc:492] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:12.828838 30209 raft_consensus.cc:359] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.829584 30209 raft_consensus.cc:385] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.829877 30209 raft_consensus.cc:740] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.830736 30209 consensus_queue.cc:260] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.834637 30229 raft_consensus.cc:493] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.834823 30212 tablet_bootstrap.cc:654] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.835091 29939 raft_consensus.cc:2468] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:12.835232 30229 raft_consensus.cc:515] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.836391 30126 leader_election.cc:304] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:12.838707 30206 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:12.839139 30206 ts_tablet_manager.cc:1403] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.006s
I20260709 13:14:12.838260 30229 leader_election.cc:290] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:12.841686 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9f8efa2d564711b2d5c65c4f7de9cd" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:12.842295 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9f8efa2d564711b2d5c65c4f7de9cd" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:12.842445 30088 raft_consensus.cc:2468] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 0.
I20260709 13:14:12.843117 29939 raft_consensus.cc:2468] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 0.
I20260709 13:14:12.843418 30283 consensus_queue.cc:1048] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:12.843963 29979 leader_election.cc:304] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:12.843593 30268 raft_consensus.cc:2804] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.846235 30268 raft_consensus.cc:697] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:12.846932 30206 raft_consensus.cc:359] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.843618 30207 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:12.847708 30206 raft_consensus.cc:385] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.848083 30206 raft_consensus.cc:740] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.848138 30207 ts_tablet_manager.cc:1403] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.000s
I20260709 13:14:12.848804 30206 consensus_queue.cc:260] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.855090 30162 raft_consensus.cc:2468] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:12.857074 30207 raft_consensus.cc:359] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.847098 30268 consensus_queue.cc:237] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.868446 30206 ts_tablet_manager.cc:1434] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:14:12.861653 30212 tablet_bootstrap.cc:492] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:12.869573 30212 ts_tablet_manager.cc:1403] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.007s
I20260709 13:14:12.862423 30229 raft_consensus.cc:2804] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.869993 30229 raft_consensus.cc:493] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.861416 29903 leader_election.cc:304] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:12.870415 30229 raft_consensus.cc:3060] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.872561 30212 raft_consensus.cc:359] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.873329 30212 raft_consensus.cc:385] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.873598 30212 raft_consensus.cc:740] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.874305 30212 consensus_queue.cc:260] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.874900 29835 catalog_manager.cc:5697] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.876442 30212 ts_tablet_manager.cc:1434] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:12.877480 30212 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:12.879047 30210 raft_consensus.cc:2804] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.879299 30229 raft_consensus.cc:515] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.883425 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9f8efa2d564711b2d5c65c4f7de9cd" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:12.884096 30087 raft_consensus.cc:3060] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.886260 30212 tablet_bootstrap.cc:654] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.879707 30210 raft_consensus.cc:697] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:12.889479 30210 consensus_queue.cc:237] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.891549 30087 raft_consensus.cc:2468] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:12.880618 30207 raft_consensus.cc:385] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.893690 30207 raft_consensus.cc:740] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.894400 30207 consensus_queue.cc:260] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.896463 30207 ts_tablet_manager.cc:1434] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:14:12.896651 29979 leader_election.cc:304] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:12.897198 30212 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:12.897394 30207 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:12.897666 30212 ts_tablet_manager.cc:1403] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 13:14:12.901775 30206 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:12.903956 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9f8efa2d564711b2d5c65c4f7de9cd" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:12.903898 30212 raft_consensus.cc:359] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.904860 29939 raft_consensus.cc:3060] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.905138 30212 raft_consensus.cc:385] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.905988 30212 raft_consensus.cc:740] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.906996 30212 consensus_queue.cc:260] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.909687 30212 ts_tablet_manager.cc:1434] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:14:12.910127 29836 catalog_manager.cc:5697] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.911155 30212 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:12.912204 30229 leader_election.cc:290] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:12.916726 30229 raft_consensus.cc:2804] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.917320 30229 raft_consensus.cc:697] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:12.916199 29939 raft_consensus.cc:2468] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:12.918217 30229 consensus_queue.cc:237] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.919796 30206 tablet_bootstrap.cc:654] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.922484 30207 tablet_bootstrap.cc:654] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.941555 30212 tablet_bootstrap.cc:654] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.952258 30209 ts_tablet_manager.cc:1434] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.129s	user 0.018s	sys 0.027s
I20260709 13:14:12.956017 30263 raft_consensus.cc:493] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.956559 30206 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:12.957223 30206 ts_tablet_manager.cc:1403] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.016s
I20260709 13:14:12.956606 30263 raft_consensus.cc:515] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.959681 29835 catalog_manager.cc:5697] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.961489 30209 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:12.963326 30263 leader_election.cc:290] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:12.965173 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65b829ec05f405d8d11888322430664" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:12.966668 30053 leader_election.cc:343] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.968497 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65b829ec05f405d8d11888322430664" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:12.969225 29939 raft_consensus.cc:2468] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:12.969738 30209 tablet_bootstrap.cc:654] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.970297 30052 leader_election.cc:304] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:12.971239 30263 raft_consensus.cc:2804] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.960717 30206 raft_consensus.cc:359] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.972476 30206 raft_consensus.cc:385] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.972807 30206 raft_consensus.cc:740] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.974624 30212 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:12.971609 30263 raft_consensus.cc:493] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.975102 30263 raft_consensus.cc:3060] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.975128 30212 ts_tablet_manager.cc:1403] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.003s
I20260709 13:14:12.974145 29836 catalog_manager.cc:5697] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.978377 30212 raft_consensus.cc:359] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.979112 30212 raft_consensus.cc:385] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.978540 30206 consensus_queue.cc:260] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:12.979410 30212 raft_consensus.cc:740] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.979589 30235 raft_consensus.cc:493] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.980189 30212 consensus_queue.cc:260] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:12.982702 30212 ts_tablet_manager.cc:1434] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:12.983745 30212 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:12.985980 30207 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:12.986464 30207 ts_tablet_manager.cc:1403] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.004s
I20260709 13:14:12.985747 30235 raft_consensus.cc:515] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:12.989179 30207 raft_consensus.cc:359] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:12.989562 30235 leader_election.cc:290] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:12.989880 30207 raft_consensus.cc:385] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.990164 30207 raft_consensus.cc:740] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.990593 30206 ts_tablet_manager.cc:1434] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:14:12.992188 30206 tablet_bootstrap.cc:492] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:12.992108 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:12.997475 30212 tablet_bootstrap.cc:654] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.998396 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.000175 30053 leader_election.cc:304] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:13.001924 30235 raft_consensus.cc:2749] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.990826 30207 consensus_queue.cc:260] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.006193 30207 ts_tablet_manager.cc:1434] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:14:13.007429 30207 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:13.015342 30207 tablet_bootstrap.cc:654] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.016798 30206 tablet_bootstrap.cc:654] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.021395 30235 consensus_queue.cc:1048] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.054970 30088 raft_consensus.cc:3060] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.061831 30162 raft_consensus.cc:3060] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.089030 30207 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:13.089596 30207 ts_tablet_manager.cc:1403] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.021s
I20260709 13:14:13.090024 30268 raft_consensus.cc:493] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.090557 30268 raft_consensus.cc:515] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.092547 30207 raft_consensus.cc:359] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.093297 30207 raft_consensus.cc:385] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.093148 30264 consensus_queue.cc:1048] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.093602 30207 raft_consensus.cc:740] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.094497 30207 consensus_queue.cc:260] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.094807 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:13.095048 30268 leader_election.cc:290] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:13.096460 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:13.097967 30126 leader_election.cc:304] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:13.101974 30206 tablet_bootstrap.cc:492] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:13.102536 30206 ts_tablet_manager.cc:1403] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.026s
I20260709 13:14:13.105376 30206 raft_consensus.cc:359] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.106074 30206 raft_consensus.cc:385] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.106424 30206 raft_consensus.cc:740] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.106895 30263 raft_consensus.cc:515] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.107172 30206 consensus_queue.cc:260] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.110404 30242 consensus_queue.cc:1048] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.133989 30214 raft_consensus.cc:493] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.111726 30207 ts_tablet_manager.cc:1434] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:14:13.134501 30214 raft_consensus.cc:515] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.135550 30207 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:13.137220 30214 leader_election.cc:290] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:13.139890 30206 ts_tablet_manager.cc:1434] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.001s
I20260709 13:14:13.141223 30206 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:13.128995 30307 raft_consensus.cc:493] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.142268 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65b829ec05f405d8d11888322430664" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:13.142184 30307 raft_consensus.cc:515] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.142894 29939 raft_consensus.cc:3060] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.129897 30268 raft_consensus.cc:2749] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:13.143815 30210 raft_consensus.cc:493] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.144342 30210 raft_consensus.cc:515] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.146142 30207 tablet_bootstrap.cc:654] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.146432 30210 leader_election.cc:290] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:13.147047 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65b829ec05f405d8d11888322430664" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:13.148308 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80e36941c78483ebd0edba43ec63b83" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.148594 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.148897 30263 leader_election.cc:290] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
W20260709 13:14:13.149755 30053 leader_election.cc:343] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.149005 30013 raft_consensus.cc:2468] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
W20260709 13:14:13.152735 29903 leader_election.cc:343] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.154381 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.155102 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80e36941c78483ebd0edba43ec63b83" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:13.156149 30212 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.155972 30290 raft_consensus.cc:493] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.156555 30307 leader_election.cc:290] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:13.155735 30088 raft_consensus.cc:2468] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:13.157174 30290 raft_consensus.cc:515] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.159153 30290 leader_election.cc:290] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
W20260709 13:14:13.156514 29904 leader_election.cc:343] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.156656 30212 ts_tablet_manager.cc:1403] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.173s	user 0.070s	sys 0.056s
I20260709 13:14:13.159914 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:13.160430 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.159963 29904 leader_election.cc:304] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
W20260709 13:14:13.162045 29978 leader_election.cc:343] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:13.162937 29979 leader_election.cc:343] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.163005 30212 raft_consensus.cc:359] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.163513 29979 leader_election.cc:304] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:13.163818 30212 raft_consensus.cc:385] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.168282 30212 raft_consensus.cc:740] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.168623 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:13.169281 30212 consensus_queue.cc:260] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.172501 30212 ts_tablet_manager.cc:1434] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:14:13.173442 30263 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.174103 30263 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.178866 30161 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.180622 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:13.184810 30052 leader_election.cc:343] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.187484 30264 raft_consensus.cc:493] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.188066 30264 raft_consensus.cc:515] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.191471 30210 raft_consensus.cc:2749] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.191673 30290 raft_consensus.cc:2749] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.190950 30264 leader_election.cc:290] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:13.165000 30127 leader_election.cc:304] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:13.193718 30212 tablet_bootstrap.cc:492] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.196450 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232202ef61084cb1b794c297a13e0a07" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:13.197043 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
W20260709 13:14:13.200973 30127 leader_election.cc:343] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.199133 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232202ef61084cb1b794c297a13e0a07" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.199154 30263 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:13.200600 30307 raft_consensus.cc:2804] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:13.213263 30052 leader_election.cc:343] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.213687 30307 raft_consensus.cc:493] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.214077 30207 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:13.203536 30209 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:13.214207 30307 raft_consensus.cc:3060] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.195806 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.214800 30209 ts_tablet_manager.cc:1403] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.254s	user 0.039s	sys 0.050s
I20260709 13:14:13.215335 30206 tablet_bootstrap.cc:654] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:13.216220 30127 leader_election.cc:343] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.216712 30127 leader_election.cc:304] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:13.214643 30207 ts_tablet_manager.cc:1403] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.018s
I20260709 13:14:13.202709 29939 raft_consensus.cc:2468] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:13.220927 30207 raft_consensus.cc:359] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.221659 30207 raft_consensus.cc:385] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.221938 30207 raft_consensus.cc:740] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.222597 30207 consensus_queue.cc:260] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.223004 30307 raft_consensus.cc:515] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:13.214104 30052 leader_election.cc:343] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.224519 30052 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:13.225255 30263 raft_consensus.cc:2749] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:13.225754 30052 leader_election.cc:343] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.226215 30052 leader_election.cc:304] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:13.227123 30263 raft_consensus.cc:2749] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.227615 30052 leader_election.cc:304] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:13.228473 30263 raft_consensus.cc:2804] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.228994 30263 raft_consensus.cc:697] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:13.229027 30209 raft_consensus.cc:359] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.229897 30209 raft_consensus.cc:385] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.230242 30209 raft_consensus.cc:740] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.229982 30263 consensus_queue.cc:237] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.231040 30209 consensus_queue.cc:260] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.217911 30268 raft_consensus.cc:2749] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.234543 30209 ts_tablet_manager.cc:1434] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:14:13.235577 30209 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:13.242483 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80e36941c78483ebd0edba43ec63b83" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:13.243120 30013 raft_consensus.cc:3060] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.245110 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80e36941c78483ebd0edba43ec63b83" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:13.245747 30088 raft_consensus.cc:3060] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.243707 30207 ts_tablet_manager.cc:1434] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:14:13.247135 30210 raft_consensus.cc:493] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.247845 30210 raft_consensus.cc:515] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.251408 30210 leader_election.cc:290] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:13.252050 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ad95d8d5e43d9888dc66173bdae9c" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.244820 30307 leader_election.cc:290] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:13.252502 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ad95d8d5e43d9888dc66173bdae9c" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:13.253616 29904 leader_election.cc:343] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.253664 30087 raft_consensus.cc:2468] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:13.255508 29904 leader_election.cc:304] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:13.256979 30210 raft_consensus.cc:2804] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.257366 30210 raft_consensus.cc:493] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.257606 30088 raft_consensus.cc:2468] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:13.258905 30127 leader_election.cc:304] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:13.259929 30307 raft_consensus.cc:2804] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.252841 30212 tablet_bootstrap.cc:654] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.261178 30307 raft_consensus.cc:697] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:13.257710 30210 raft_consensus.cc:3060] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.262120 30307 consensus_queue.cc:237] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.264828 30207 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:13.265836 30206 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:13.266363 30206 ts_tablet_manager.cc:1403] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.031s
I20260709 13:14:13.269663 30206 raft_consensus.cc:359] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.270367 30206 raft_consensus.cc:385] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.270742 30206 raft_consensus.cc:740] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.271761 30206 consensus_queue.cc:260] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.274421 30206 ts_tablet_manager.cc:1434] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:13.275604 30206 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:13.278090 30210 raft_consensus.cc:515] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.280992 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ad95d8d5e43d9888dc66173bdae9c" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:13.282231 29904 leader_election.cc:343] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.283834 30207 tablet_bootstrap.cc:654] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.285648 30212 tablet_bootstrap.cc:492] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.286275 30212 ts_tablet_manager.cc:1403] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.002s
I20260709 13:14:13.287298 29835 catalog_manager.cc:5697] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.289784 30212 raft_consensus.cc:359] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.290556 30212 raft_consensus.cc:385] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.290864 30212 raft_consensus.cc:740] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.291564 30212 consensus_queue.cc:260] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.293850 30209 tablet_bootstrap.cc:654] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.294277 30212 ts_tablet_manager.cc:1434] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:14:13.295588 30212 tablet_bootstrap.cc:492] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.283834 30206 tablet_bootstrap.cc:654] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.296433 30242 consensus_queue.cc:1048] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.299901 30013 raft_consensus.cc:2468] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:13.308259 30212 tablet_bootstrap.cc:654] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.309715 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ad95d8d5e43d9888dc66173bdae9c" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:13.310423 30088 raft_consensus.cc:3060] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.310067 29837 catalog_manager.cc:5697] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.314419 30206 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:13.314932 30206 ts_tablet_manager.cc:1403] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.000s
I20260709 13:14:13.318266 30206 raft_consensus.cc:359] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.319092 30206 raft_consensus.cc:385] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.318270 30088 raft_consensus.cc:2468] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:13.319527 30206 raft_consensus.cc:740] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.322119 30206 consensus_queue.cc:260] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.325560 30206 ts_tablet_manager.cc:1434] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:13.326581 30206 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:13.320986 29904 leader_election.cc:304] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:13.329054 30212 tablet_bootstrap.cc:492] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.329557 30212 ts_tablet_manager.cc:1403] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 13:14:13.330623 30209 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:13.330493 30228 raft_consensus.cc:2804] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.334708 30209 ts_tablet_manager.cc:1403] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.000s
I20260709 13:14:13.334942 30207 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:13.335459 30207 ts_tablet_manager.cc:1403] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.000s
I20260709 13:14:13.334813 30228 raft_consensus.cc:697] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:13.336877 30228 consensus_queue.cc:237] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.338538 30207 raft_consensus.cc:359] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.339614 30207 raft_consensus.cc:385] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.339936 30207 raft_consensus.cc:740] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.340910 30207 consensus_queue.cc:260] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.343240 30209 raft_consensus.cc:359] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.344053 30209 raft_consensus.cc:385] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.344386 30209 raft_consensus.cc:740] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.345148 30209 consensus_queue.cc:260] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.332319 30212 raft_consensus.cc:359] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.348361 30212 raft_consensus.cc:385] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.348675 30212 raft_consensus.cc:740] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.322546 30210 leader_election.cc:290] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:13.334111 30206 tablet_bootstrap.cc:654] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.349364 30212 consensus_queue.cc:260] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.351091 30209 ts_tablet_manager.cc:1434] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:14:13.352893 30209 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
W20260709 13:14:13.354166 29904 consensus_peers.cc:597] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:13.354310 30212 ts_tablet_manager.cc:1434] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:14:13.359848 30212 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.360602 30207 ts_tablet_manager.cc:1434] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:14:13.362167 30207 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:13.365576 30212 tablet_bootstrap.cc:654] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.372167 30228 consensus_queue.cc:1048] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.386188 30209 tablet_bootstrap.cc:654] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.387091 30290 consensus_queue.cc:1048] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.409549 30207 tablet_bootstrap.cc:654] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.394817 29833 catalog_manager.cc:5697] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.424841 30228 consensus_queue.cc:1048] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.427320 30228 raft_consensus.cc:493] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.429301 30228 raft_consensus.cc:515] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.433367 30228 leader_election.cc:290] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
W20260709 13:14:13.434383 29904 consensus_peers.cc:597] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:13.440984 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c323dfa54847f1890203bcc0f931c9" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.441383 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c323dfa54847f1890203bcc0f931c9" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:13.442991 29904 leader_election.cc:343] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:13.443837 29904 leader_election.cc:343] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.444234 29904 leader_election.cc:304] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:13.444540 30209 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:13.445147 30209 ts_tablet_manager.cc:1403] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.000s
W20260709 13:14:13.452062 30127 consensus_peers.cc:597] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:13.445516 30228 raft_consensus.cc:2749] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.458582 30209 raft_consensus.cc:359] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.459403 30209 raft_consensus.cc:385] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.462793 30207 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:13.463312 30207 ts_tablet_manager.cc:1403] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.005s
I20260709 13:14:13.466032 30207 raft_consensus.cc:359] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.466681 30207 raft_consensus.cc:385] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.466943 30207 raft_consensus.cc:740] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.459743 30209 raft_consensus.cc:740] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.467406 30206 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:13.468147 30209 consensus_queue.cc:260] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.468132 30206 ts_tablet_manager.cc:1403] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.142s	user 0.026s	sys 0.079s
I20260709 13:14:13.472139 30206 raft_consensus.cc:359] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.472808 30206 raft_consensus.cc:385] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.473064 30206 raft_consensus.cc:740] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.473829 30207 consensus_queue.cc:260] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.475869 30212 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.476153 30207 ts_tablet_manager.cc:1434] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:13.476471 30212 ts_tablet_manager.cc:1403] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.117s	user 0.039s	sys 0.058s
I20260709 13:14:13.477159 30207 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:13.479317 30212 raft_consensus.cc:359] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.479966 30212 raft_consensus.cc:385] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.480261 30212 raft_consensus.cc:740] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.480926 30212 consensus_queue.cc:260] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.481110 30206 consensus_queue.cc:260] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.483050 30212 ts_tablet_manager.cc:1434] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:14:13.483369 30206 ts_tablet_manager.cc:1434] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:14:13.484004 30212 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.484444 30206 tablet_bootstrap.cc:492] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:13.486245 30268 consensus_queue.cc:1048] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.490142 30212 tablet_bootstrap.cc:654] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.490547 30206 tablet_bootstrap.cc:654] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.493954 30268 raft_consensus.cc:493] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.494488 30268 raft_consensus.cc:515] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.496100 30207 tablet_bootstrap.cc:654] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.499959 30268 leader_election.cc:290] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:13.500547 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.504494 30013 raft_consensus.cc:2468] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:13.505508 30207 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:13.506199 30207 ts_tablet_manager.cc:1403] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.005s
I20260709 13:14:13.506247 30127 leader_election.cc:304] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:13.501925 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:13.507926 29937 raft_consensus.cc:2468] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:13.509377 30307 raft_consensus.cc:2804] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.509995 30307 raft_consensus.cc:493] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.509654 30207 raft_consensus.cc:359] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.510526 30307 raft_consensus.cc:3060] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.510747 30207 raft_consensus.cc:385] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.511240 30207 raft_consensus.cc:740] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.512120 30207 consensus_queue.cc:260] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.514925 30207 ts_tablet_manager.cc:1434] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:13.516316 30207 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:13.519927 30212 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.520484 30212 ts_tablet_manager.cc:1403] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.007s
I20260709 13:14:13.522239 30207 tablet_bootstrap.cc:654] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.523262 30212 raft_consensus.cc:359] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.524566 30212 raft_consensus.cc:385] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.524855 30212 raft_consensus.cc:740] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.525794 30212 consensus_queue.cc:260] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.531046 30212 ts_tablet_manager.cc:1434] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:13.532302 30212 tablet_bootstrap.cc:492] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.534031 30207 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:13.534551 30207 ts_tablet_manager.cc:1403] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:14:13.538746 30212 tablet_bootstrap.cc:654] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.552655 30212 tablet_bootstrap.cc:492] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.553160 30212 ts_tablet_manager.cc:1403] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:14:13.556093 30212 raft_consensus.cc:359] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.556882 30212 raft_consensus.cc:385] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.557154 30212 raft_consensus.cc:740] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.557782 30212 consensus_queue.cc:260] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.560465 30212 ts_tablet_manager.cc:1434] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:13.557799 30207 raft_consensus.cc:359] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.561005 30207 raft_consensus.cc:385] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.561326 30207 raft_consensus.cc:740] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.561498 30212 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.562011 30207 consensus_queue.cc:260] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.568496 30212 tablet_bootstrap.cc:654] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.567876 30228 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.569348 30228 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.570688 30207 ts_tablet_manager.cc:1434] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:14:13.571801 30207 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:13.573516 30228 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:13.575750 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:13.577072 30088 raft_consensus.cc:2468] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:13.593756 30268 raft_consensus.cc:493] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.594673 30268 raft_consensus.cc:515] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.602013 30268 leader_election.cc:290] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:13.598642 30212 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.607753 30212 ts_tablet_manager.cc:1403] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.016s
I20260709 13:14:13.606932 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b502d61f804f169b0f20adba55efa5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.625567 30013 raft_consensus.cc:2468] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:13.628398 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b502d61f804f169b0f20adba55efa5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:13.628585 30212 raft_consensus.cc:359] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.629416 29937 raft_consensus.cc:2468] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:13.629652 30212 raft_consensus.cc:385] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.630151 30212 raft_consensus.cc:740] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.631054 30212 consensus_queue.cc:260] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.634312 30263 raft_consensus.cc:493] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.634677 30212 ts_tablet_manager.cc:1434] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:14:13.634974 30263 raft_consensus.cc:515] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.636674 30212 tablet_bootstrap.cc:492] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.644951 30127 leader_election.cc:304] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:13.646396 30268 raft_consensus.cc:2804] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.646934 30268 raft_consensus.cc:493] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.647365 30268 raft_consensus.cc:3060] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.651350 30212 tablet_bootstrap.cc:654] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.662158 30212 tablet_bootstrap.cc:492] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.662684 30228 raft_consensus.cc:493] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.663585 30228 raft_consensus.cc:515] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.666244 30228 leader_election.cc:290] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:13.662814 30212 ts_tablet_manager.cc:1403] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:14:13.669420 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.672474 30263 leader_election.cc:290] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
W20260709 13:14:13.673106 30053 leader_election.cc:343] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.674633 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.674566 30212 raft_consensus.cc:359] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.688598 30212 raft_consensus.cc:385] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.689038 30212 raft_consensus.cc:740] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
W20260709 13:14:13.690338 30052 leader_election.cc:343] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.690001 30212 consensus_queue.cc:260] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.680217 30242 consensus_queue.cc:1048] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.691120 30052 leader_election.cc:304] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:13.692724 30332 raft_consensus.cc:493] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.693495 30332 raft_consensus.cc:515] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.694412 30212 ts_tablet_manager.cc:1434] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:14:13.695773 30212 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.697926 30264 raft_consensus.cc:2749] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.700730 30332 leader_election.cc:290] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:13.706300 30212 tablet_bootstrap.cc:654] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.712589 30014 raft_consensus.cc:3060] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.714447 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65b829ec05f405d8d11888322430664" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:13.720678 30242 consensus_queue.cc:1048] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.722450 30263 raft_consensus.cc:493] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.723026 30263 raft_consensus.cc:515] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.725248 30263 leader_election.cc:290] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:13.727115 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.730145 30212 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.730451 30264 raft_consensus.cc:493] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.730855 30212 ts_tablet_manager.cc:1403] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:14:13.730967 30264 raft_consensus.cc:515] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.733603 30264 leader_election.cc:290] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:13.735111 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.737929 30212 raft_consensus.cc:359] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.738943 30212 raft_consensus.cc:385] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.739283 30212 raft_consensus.cc:740] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.741209 30268 raft_consensus.cc:515] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.741801 30209 ts_tablet_manager.cc:1434] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.296s	user 0.042s	sys 0.057s
W20260709 13:14:13.742558 30052 leader_election.cc:343] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.743192 30209 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:13.744448 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b502d61f804f169b0f20adba55efa5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:13.745071 29937 raft_consensus.cc:3060] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:13.758203 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:13.762575 30268 leader_election.cc:290] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:13.767879 30348 raft_consensus.cc:493] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.768638 30348 raft_consensus.cc:515] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.771562 30348 leader_election.cc:290] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:13.765933 30212 consensus_queue.cc:260] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.765584 30209 tablet_bootstrap.cc:654] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.774610 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b502d61f804f169b0f20adba55efa5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:13.775493 30014 raft_consensus.cc:3060] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.776183 30348 raft_consensus.cc:493] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.777419 30348 raft_consensus.cc:515] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:13.783005 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.784092 30162 raft_consensus.cc:2468] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:13.784192 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.786583 30052 leader_election.cc:304] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:13.793460 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.794261 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.794276 30013 raft_consensus.cc:2468] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:13.797631 30348 leader_election.cc:290] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:13.827232 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:13.827584 30053 leader_election.cc:343] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.830539 30053 leader_election.cc:304] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:13.832010 30263 consensus_queue.cc:1048] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.791931 30264 raft_consensus.cc:2804] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.842435 29937 raft_consensus.cc:2468] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:13.851073 30348 raft_consensus.cc:2804] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:13.851565 30053 leader_election.cc:343] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.854398 30212 ts_tablet_manager.cc:1434] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.123s	user 0.029s	sys 0.006s
I20260709 13:14:13.853130 30264 raft_consensus.cc:493] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.861029 30212 tablet_bootstrap.cc:492] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:13.862376 30209 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:13.864984 30209 ts_tablet_manager.cc:1403] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.122s	user 0.032s	sys 0.001s
I20260709 13:14:13.858238 30207 tablet_bootstrap.cc:654] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.876402 30212 tablet_bootstrap.cc:654] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.860000 30348 raft_consensus.cc:493] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.863160 30264 raft_consensus.cc:3060] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.916955 30349 raft_consensus.cc:493] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.869498 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.866173 30014 raft_consensus.cc:2468] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:13.863976 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:13.873857 30126 leader_election.cc:304] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
W20260709 13:14:13.941563 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 67836us
I20260709 13:14:13.941799 30264 raft_consensus.cc:515] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:13.923513 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 137067us
I20260709 13:14:13.879382 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:13.878065 30307 raft_consensus.cc:515] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.943902 30088 raft_consensus.cc:2468] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:13.914110 30348 raft_consensus.cc:3060] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.928589 30349 raft_consensus.cc:515] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.945875 30307 leader_election.cc:290] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
W20260709 13:14:13.943797 30052 leader_election.cc:343] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.946609 30052 leader_election.cc:304] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:13.947337 30349 leader_election.cc:290] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:13.925241 29904 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:13.948452 30085 raft_consensus.cc:3060] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.949368 29904 leader_election.cc:304] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:13.950572 30209 raft_consensus.cc:359] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.951282 30209 raft_consensus.cc:385] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.951498 30322 raft_consensus.cc:2804] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.952086 30322 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.952416 30322 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.952996 30307 raft_consensus.cc:493] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.952927 30333 consensus_queue.cc:1048] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.954032 30307 raft_consensus.cc:515] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:13.936210 30315 raft_consensus.cc:493] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.955530 30315 raft_consensus.cc:515] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.956216 30307 leader_election.cc:290] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:13.943054 30268 raft_consensus.cc:2804] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.951563 30209 raft_consensus.cc:740] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.948019 30349 raft_consensus.cc:2749] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.958369 30210 raft_consensus.cc:2804] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.959250 30212 tablet_bootstrap.cc:492] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:13.953227 30263 raft_consensus.cc:493] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.956416 30324 consensus_queue.cc:1048] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:14:13.964438 30263 raft_consensus.cc:515] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.965255 30315 leader_election.cc:290] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:13.926358 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:13.937680 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65b829ec05f405d8d11888322430664" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:13.962416 30212 ts_tablet_manager.cc:1403] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.024s
I20260709 13:14:13.960367 30209 consensus_queue.cc:260] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:13.962919 30268 raft_consensus.cc:697] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:13.970899 30268 consensus_queue.cc:237] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:13.973058 30263 leader_election.cc:290] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:13.963301 30210 raft_consensus.cc:493] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.977463 30209 ts_tablet_manager.cc:1434] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.001s
I20260709 13:14:13.979557 30209 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:13.989099 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:13.990137 29936 raft_consensus.cc:3060] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.992257 29937 raft_consensus.cc:2393] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:13.993811 30088 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.994652 30206 tablet_bootstrap.cc:492] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:13.995643 30206 ts_tablet_manager.cc:1403] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.511s	user 0.137s	sys 0.185s
I20260709 13:14:13.988656 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c323dfa54847f1890203bcc0f931c9" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:13.981117 30210 raft_consensus.cc:3060] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.016387 30209 tablet_bootstrap.cc:654] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:14.019714 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 79916.9us
I20260709 13:14:14.024891 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:14.025563 30011 raft_consensus.cc:3060] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.029907 30264 leader_election.cc:290] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:14.032141 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232202ef61084cb1b794c297a13e0a07" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:14.032876 30087 raft_consensus.cc:2468] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:14.033356 30013 raft_consensus.cc:2468] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
W20260709 13:14:14.034236 30053 leader_election.cc:343] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.038302 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:14.039011 30162 raft_consensus.cc:3060] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.040519 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:14.041460 30160 raft_consensus.cc:2468] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:14.040583 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:14.047174 30162 raft_consensus.cc:2468] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:14.048413 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232202ef61084cb1b794c297a13e0a07" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.048442 30052 leader_election.cc:304] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
W20260709 13:14:14.049618 30053 leader_election.cc:343] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.053078 30351 raft_consensus.cc:2804] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.053905 30351 raft_consensus.cc:697] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:14.057621 30127 leader_election.cc:304] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:14.058101 29833 catalog_manager.cc:5697] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:14.059618 30126 leader_election.cc:343] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.059893 30242 raft_consensus.cc:2804] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.060410 30242 raft_consensus.cc:493] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.060788 30242 raft_consensus.cc:3060] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.035387 30212 raft_consensus.cc:359] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.064369 30212 raft_consensus.cc:385] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.064692 30212 raft_consensus.cc:740] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.072255 30207 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:14.072831 30207 ts_tablet_manager.cc:1403] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.501s	user 0.009s	sys 0.014s
I20260709 13:14:14.072772 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.075918 30207 raft_consensus.cc:359] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.076694 30207 raft_consensus.cc:385] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.076982 30207 raft_consensus.cc:740] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.077800 30207 consensus_queue.cc:260] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.079210 30011 raft_consensus.cc:2468] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:14.079952 30207 ts_tablet_manager.cc:1434] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:14.070509 30206 raft_consensus.cc:359] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.081197 30207 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:14.081197 30206 raft_consensus.cc:385] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.081923 30212 consensus_queue.cc:260] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.055239 30351 consensus_queue.cc:237] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.082616 30206 raft_consensus.cc:740] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.088577 30206 consensus_queue.cc:260] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.086284 30212 ts_tablet_manager.cc:1434] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.119s	user 0.004s	sys 0.003s
I20260709 13:14:14.090582 30212 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:14.090633 30210 raft_consensus.cc:515] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.086967 30322 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.092823 30210 leader_election.cc:290] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:14.095419 30322 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:14.079991 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:14.099651 30214 raft_consensus.cc:493] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.101780 30214 raft_consensus.cc:515] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.103910 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c323dfa54847f1890203bcc0f931c9" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.104959 30214 leader_election.cc:290] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:14.105089 29937 raft_consensus.cc:2468] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
W20260709 13:14:14.082067 29903 leader_election.cc:343] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.107019 30206 ts_tablet_manager.cc:1434] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 13:14:14.107776 30206 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:14.089028 30348 raft_consensus.cc:515] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.100903 30127 leader_election.cc:304] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:14.116276 30209 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:14.116564 29903 leader_election.cc:304] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:14.116784 30209 ts_tablet_manager.cc:1403] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.137s	user 0.019s	sys 0.021s
I20260709 13:14:14.117008 30307 raft_consensus.cc:2804] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.118023 30356 raft_consensus.cc:2804] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.118307 30307 raft_consensus.cc:697] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:14.104955 29936 raft_consensus.cc:2468] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:14.123306 30209 raft_consensus.cc:359] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.124109 30209 raft_consensus.cc:385] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.124954 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:14.124352 30209 raft_consensus.cc:740] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
W20260709 13:14:14.115937 29904 consensus_peers.cc:597] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:14.120645 30356 raft_consensus.cc:493] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:14.127429 29903 leader_election.cc:343] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.127573 30307 consensus_queue.cc:237] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.138582 29978 leader_election.cc:304] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:14.139892 30333 raft_consensus.cc:2749] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.141602 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:14.142637 30086 raft_consensus.cc:2393] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:14.143277 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:14.143953 30012 raft_consensus.cc:2468] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:14.145610 30127 leader_election.cc:304] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:14.146415 30268 raft_consensus.cc:2804] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.146788 30268 raft_consensus.cc:493] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.147122 30268 raft_consensus.cc:3060] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.148834 30356 raft_consensus.cc:3060] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.154915 30207 tablet_bootstrap.cc:654] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.127190 30209 consensus_queue.cc:260] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.159482 30209 ts_tablet_manager.cc:1434] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 13:14:14.132051 30242 raft_consensus.cc:515] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.134073 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:14.134850 30052 leader_election.cc:304] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:14.135151 30348 leader_election.cc:290] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:14.138224 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:14.144091 30264 raft_consensus.cc:493] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.162181 30349 raft_consensus.cc:2749] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.132325 30212 tablet_bootstrap.cc:654] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.162361 30264 raft_consensus.cc:515] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.131417 30206 tablet_bootstrap.cc:654] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.168870 30242 leader_election.cc:290] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:14.165385 30209 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:14.173550 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd7f09ce7b043caa93dbd036bf072d2" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:14.163846 30052 leader_election.cc:304] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
W20260709 13:14:14.214856 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 51095.6us
I20260709 13:14:14.216797 30052 leader_election.cc:304] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.170625 30013 raft_consensus.cc:3060] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.184382 30356 raft_consensus.cc:515] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.169322 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:14.187989 30348 raft_consensus.cc:493] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.163641 30349 consensus_queue.cc:1048] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.217165 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:14.178854 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232202ef61084cb1b794c297a13e0a07" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:14.175068 30264 leader_election.cc:290] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:14.217303 30263 raft_consensus.cc:2749] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.170802 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232202ef61084cb1b794c297a13e0a07" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:14.221458 30348 raft_consensus.cc:515] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.188290 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:14.200107 30210 raft_consensus.cc:493] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.220536 30209 tablet_bootstrap.cc:654] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.221812 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:14.222698 30356 leader_election.cc:290] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.221238 30351 raft_consensus.cc:2804] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.219758 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd7f09ce7b043caa93dbd036bf072d2" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:14.224712 30088 raft_consensus.cc:3060] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.225087 30086 raft_consensus.cc:3060] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.232143 30012 raft_consensus.cc:3060] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.234283 30351 raft_consensus.cc:493] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.235869 30085 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:14.236083 30126 leader_election.cc:343] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:14.234190 30053 leader_election.cc:343] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.245895 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:14.246552 30160 raft_consensus.cc:3060] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.233438 30210 raft_consensus.cc:515] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.254210 30210 leader_election.cc:290] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.255062 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:14.256778 29903 leader_election.cc:343] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:14.238561 29904 leader_election.cc:343] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.242951 30351 raft_consensus.cc:3060] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.279546 30348 leader_election.cc:290] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.280799 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43ee291f79741eebbaeff079b730c10" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:14.282320 30053 leader_election.cc:343] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.283970 30268 raft_consensus.cc:515] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.285900 30162 raft_consensus.cc:2393] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 1: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:14.294232 30207 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:14.294938 30207 ts_tablet_manager.cc:1403] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.214s	user 0.012s	sys 0.018s
I20260709 13:14:14.289951 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:14.298871 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:14.298940 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:14.298933 30268 leader_election.cc:290] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:14.302213 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:14.303301 30084 raft_consensus.cc:2393] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:14.292953 30088 raft_consensus.cc:2468] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:14.309072 30333 raft_consensus.cc:493] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.309707 30127 leader_election.cc:304] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
W20260709 13:14:14.310343 29904 leader_election.cc:343] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.309725 30333 raft_consensus.cc:515] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.310902 29904 leader_election.cc:304] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.312366 30356 raft_consensus.cc:2749] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.313023 30333 leader_election.cc:290] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
W20260709 13:14:14.313787 29904 leader_election.cc:343] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:14.297683 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 81012.5us
I20260709 13:14:14.316001 30268 raft_consensus.cc:2749] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:14:14.323411 30052 leader_election.cc:343] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.323961 30052 leader_election.cc:304] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.325184 30012 raft_consensus.cc:2468] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:14.325371 30348 raft_consensus.cc:2749] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.333905 30086 raft_consensus.cc:2468] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:14.335743 30127 leader_election.cc:304] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:14.337025 30160 raft_consensus.cc:2468] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:14.337533 30268 raft_consensus.cc:2804] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.338290 30268 raft_consensus.cc:697] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:14.338430 29903 leader_election.cc:304] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.339566 30356 raft_consensus.cc:2804] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.340114 30356 raft_consensus.cc:697] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:14.340757 30351 raft_consensus.cc:515] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.339330 30268 consensus_queue.cc:237] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.340941 30356 consensus_queue.cc:237] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.336222 30013 raft_consensus.cc:2468] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:14.347998 30053 leader_election.cc:304] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:14.322456 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c323dfa54847f1890203bcc0f931c9" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:14.349509 30348 raft_consensus.cc:2804] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.352231 30348 raft_consensus.cc:697] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:14.346484 30351 leader_election.cc:290] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.328011 30085 raft_consensus.cc:2468] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:14.345418 29904 leader_election.cc:304] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:14.356594 30210 raft_consensus.cc:2804] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.357156 30210 raft_consensus.cc:697] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:14.358116 30210 consensus_queue.cc:237] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.359266 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c323dfa54847f1890203bcc0f931c9" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:14.359910 29939 raft_consensus.cc:3060] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.360272 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43ee291f79741eebbaeff079b730c10" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.361276 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c323dfa54847f1890203bcc0f931c9" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.355931 30348 consensus_queue.cc:237] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.364912 30207 raft_consensus.cc:359] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.365661 30207 raft_consensus.cc:385] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.365922 30207 raft_consensus.cc:740] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.366591 30207 consensus_queue.cc:260] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.369907 30207 ts_tablet_manager.cc:1434] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 13:14:14.377334 30209 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:14.378217 30209 ts_tablet_manager.cc:1403] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.213s	user 0.023s	sys 0.020s
I20260709 13:14:14.376880 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c323dfa54847f1890203bcc0f931c9" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:14.381747 30088 raft_consensus.cc:2393] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:14.387342 30209 raft_consensus.cc:359] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.387982 29979 leader_election.cc:304] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:14.384065 29936 raft_consensus.cc:2468] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:14.385964 30206 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:14.383546 30012 raft_consensus.cc:3060] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.389518 30206 ts_tablet_manager.cc:1403] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.282s	user 0.013s	sys 0.001s
I20260709 13:14:14.390507 29904 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:14.392249 30228 raft_consensus.cc:2804] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.392715 30228 raft_consensus.cc:697] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:14.386427 29939 raft_consensus.cc:2468] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:14.388260 30209 raft_consensus.cc:385] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.392818 30207 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:14.394032 30209 raft_consensus.cc:740] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.395097 30209 consensus_queue.cc:260] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.393607 30228 consensus_queue.cc:237] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.401579 30052 leader_election.cc:304] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.408572 30052 leader_election.cc:304] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:14.412566 30212 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:14.413106 30212 ts_tablet_manager.cc:1403] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.323s	user 0.023s	sys 0.016s
I20260709 13:14:14.417413 30369 raft_consensus.cc:2804] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.418013 30369 raft_consensus.cc:493] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.418792 30369 raft_consensus.cc:3060] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.420786 30348 raft_consensus.cc:2804] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.421912 30348 raft_consensus.cc:697] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:14.415864 30212 raft_consensus.cc:359] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.424849 30212 raft_consensus.cc:385] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.423275 30207 tablet_bootstrap.cc:654] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.425179 30212 raft_consensus.cc:740] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.425925 30212 consensus_queue.cc:260] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.424363 30348 consensus_queue.cc:237] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.427654 30011 raft_consensus.cc:3060] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.428416 30212 ts_tablet_manager.cc:1434] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:14:14.429409 30212 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:14.438740 30209 ts_tablet_manager.cc:1434] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:14:14.440111 30206 raft_consensus.cc:359] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.441077 30206 raft_consensus.cc:385] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.441422 30206 raft_consensus.cc:740] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.442373 30209 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:14.443275 30207 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:14.443748 30207 ts_tablet_manager.cc:1403] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 13:14:14.445195 30012 raft_consensus.cc:2468] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:14.445916 30333 raft_consensus.cc:2749] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.448566 30206 consensus_queue.cc:260] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.451454 30207 raft_consensus.cc:359] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.452250 30207 raft_consensus.cc:385] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.442406 30212 tablet_bootstrap.cc:654] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.451938 30206 ts_tablet_manager.cc:1434] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:14:14.453815 30206 tablet_bootstrap.cc:492] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:14.452549 30207 raft_consensus.cc:740] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.455865 30207 consensus_queue.cc:260] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.460111 30209 tablet_bootstrap.cc:654] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.464180 30207 ts_tablet_manager.cc:1434] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:14:14.462477 29837 catalog_manager.cc:5697] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.465858 29837 catalog_manager.cc:5697] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.471306 29834 catalog_manager.cc:5697] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.480373 30369 raft_consensus.cc:515] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.482756 30369 leader_election.cc:290] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.484408 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43ee291f79741eebbaeff079b730c10" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:14.486526 30053 leader_election.cc:343] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.487350 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43ee291f79741eebbaeff079b730c10" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:14.488173 29939 raft_consensus.cc:3060] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.493618 30207 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:14.499185 30212 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:14.499768 30212 ts_tablet_manager.cc:1403] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.001s
I20260709 13:14:14.519717 30307 consensus_queue.cc:1048] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.530841 30206 tablet_bootstrap.cc:654] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.533869 30242 consensus_queue.cc:1048] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.537458 29939 raft_consensus.cc:2468] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:14.539073 30052 leader_election.cc:304] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.540639 30369 raft_consensus.cc:2804] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.541153 30369 raft_consensus.cc:697] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:14.542320 30369 consensus_queue.cc:237] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.545728 30207 tablet_bootstrap.cc:654] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.546176 30242 consensus_queue.cc:1048] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.552062 29837 catalog_manager.cc:5697] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.554504 29837 catalog_manager.cc:5697] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.557047 29837 catalog_manager.cc:5697] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.571883 30207 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:14.572431 30207 ts_tablet_manager.cc:1403] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.002s
I20260709 13:14:14.583671 30212 raft_consensus.cc:359] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.584484 30212 raft_consensus.cc:385] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.584772 30212 raft_consensus.cc:740] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.591048 30209 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:14.591579 30209 ts_tablet_manager.cc:1403] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.149s	user 0.021s	sys 0.000s
I20260709 13:14:14.593082 30212 consensus_queue.cc:260] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.595520 30268 consensus_queue.cc:1048] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.600601 30212 ts_tablet_manager.cc:1434] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.000s
I20260709 13:14:14.603133 30207 raft_consensus.cc:359] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.603909 30207 raft_consensus.cc:385] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.604228 30207 raft_consensus.cc:740] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.605134 30209 raft_consensus.cc:359] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.607487 30206 tablet_bootstrap.cc:492] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:14.608074 30212 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:14.607939 29833 catalog_manager.cc:5697] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.616617 29833 catalog_manager.cc:5697] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.609592 30206 ts_tablet_manager.cc:1403] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.156s	user 0.019s	sys 0.008s
I20260709 13:14:14.624869 30206 raft_consensus.cc:359] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.625588 30206 raft_consensus.cc:385] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.626652 30206 raft_consensus.cc:740] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.627462 30206 consensus_queue.cc:260] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.629597 30206 ts_tablet_manager.cc:1434] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:14.630617 30206 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:14.609561 30207 consensus_queue.cc:260] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.630865 30369 raft_consensus.cc:493] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.631628 30369 raft_consensus.cc:515] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:14.633477 30207 ts_tablet_manager.cc:1434] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:14:14.609396 30209 raft_consensus.cc:385] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.635167 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.639427 30209 raft_consensus.cc:740] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.636519 30369 leader_election.cc:290] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.621816 30212 tablet_bootstrap.cc:654] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:14.642081 30053 consensus_peers.cc:597] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:14.642978 30209 consensus_queue.cc:260] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.645341 30209 ts_tablet_manager.cc:1434] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:14:14.646317 30209 tablet_bootstrap.cc:492] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:14.648658 30207 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:14.652372 30209 tablet_bootstrap.cc:654] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:14.640661 30052 leader_election.cc:343] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.636741 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:14.638303 30206 tablet_bootstrap.cc:654] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:14.656055 30053 leader_election.cc:343] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.656571 30053 leader_election.cc:304] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:14.653347 30207 tablet_bootstrap.cc:654] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.658355 30348 raft_consensus.cc:2749] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.663779 30214 raft_consensus.cc:493] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.664429 30214 raft_consensus.cc:515] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.666646 30214 leader_election.cc:290] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:14.668473 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:14.669217 30088 raft_consensus.cc:2468] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:14.670573 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:14.672103 30127 leader_election.cc:343] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.672884 30127 leader_election.cc:304] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.673689 30214 raft_consensus.cc:2804] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.674072 30214 raft_consensus.cc:493] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.674425 30214 raft_consensus.cc:3060] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.682721 30214 raft_consensus.cc:515] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.686105 30206 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:14.686721 30206 ts_tablet_manager.cc:1403] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.001s
I20260709 13:14:14.687724 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:14.688370 30088 raft_consensus.cc:3060] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.689538 30206 raft_consensus.cc:359] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.690305 30206 raft_consensus.cc:385] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.690586 30206 raft_consensus.cc:740] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.686175 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:14.692559 30127 leader_election.cc:343] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.693953 30206 consensus_queue.cc:260] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.695477 30088 raft_consensus.cc:2468] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:14.695850 30206 ts_tablet_manager.cc:1434] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:14:14.696679 30127 leader_election.cc:304] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.697501 30307 raft_consensus.cc:2804] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.697988 30307 raft_consensus.cc:697] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:14.698783 30307 consensus_queue.cc:237] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.704224 30214 leader_election.cc:290] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:14.696933 30206 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:14.710872 30206 tablet_bootstrap.cc:654] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.713941 30307 raft_consensus.cc:493] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.714483 30307 raft_consensus.cc:515] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.719373 30369 consensus_queue.cc:1048] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.724784 30307 leader_election.cc:290] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.724157 29834 catalog_manager.cc:5697] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.730371 30207 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:14.730909 30207 ts_tablet_manager.cc:1403] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.019s
I20260709 13:14:14.731550 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:14.733273 30127 leader_election.cc:343] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.733677 30207 raft_consensus.cc:359] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.734381 30207 raft_consensus.cc:385] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.734654 30207 raft_consensus.cc:740] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.734578 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.735343 29939 raft_consensus.cc:2468] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:14.736318 30207 consensus_queue.cc:260] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.748216 30207 ts_tablet_manager.cc:1434] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:14:14.748447 30212 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:14.749032 30212 ts_tablet_manager.cc:1403] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.147s	user 0.008s	sys 0.004s
I20260709 13:14:14.749513 30207 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:14.747916 30126 leader_election.cc:304] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:14.752678 30307 raft_consensus.cc:2804] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.753060 30307 raft_consensus.cc:493] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.753414 30307 raft_consensus.cc:3060] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.746968 30369 raft_consensus.cc:493] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.754624 30369 raft_consensus.cc:515] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.756165 30206 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:14.756062 30212 raft_consensus.cc:359] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.756788 30206 ts_tablet_manager.cc:1403] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.004s
I20260709 13:14:14.756948 30212 raft_consensus.cc:385] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.757506 30212 raft_consensus.cc:740] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.758360 30212 consensus_queue.cc:260] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.756875 30207 tablet_bootstrap.cc:654] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.759433 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d3f73348f4deca6026b42f4e83fab" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:14.760591 30212 ts_tablet_manager.cc:1434] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:14:14.761281 30206 raft_consensus.cc:359] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.761606 30212 tablet_bootstrap.cc:492] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:14.762259 30206 raft_consensus.cc:385] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.762712 30206 raft_consensus.cc:740] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.764518 30206 consensus_queue.cc:260] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.757558 30369 leader_election.cc:290] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:14.767944 30206 ts_tablet_manager.cc:1434] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
W20260709 13:14:14.761660 30052 leader_election.cc:343] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.768890 30212 tablet_bootstrap.cc:654] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.769907 30214 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.770624 30214 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.769486 30206 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:14.775385 30214 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:14.776139 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:14.777351 30086 raft_consensus.cc:2393] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in current term 1: Already voted for candidate b9712e59a1774be08aa8e368566dcfed in this term.
I20260709 13:14:14.782199 30212 tablet_bootstrap.cc:492] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:14.782872 30212 ts_tablet_manager.cc:1403] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:14:14.782680 30307 raft_consensus.cc:515] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.784144 30206 tablet_bootstrap.cc:654] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.786373 30209 tablet_bootstrap.cc:492] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:14.786252 30212 raft_consensus.cc:359] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.786959 30307 leader_election.cc:290] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.787238 30212 raft_consensus.cc:385] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.787642 30212 raft_consensus.cc:740] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.788383 30212 consensus_queue.cc:260] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.789824 30212 ts_tablet_manager.cc:1434] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:14.790211 30206 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:14.790578 30212 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:14.790717 30206 ts_tablet_manager.cc:1403] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 13:14:14.786959 30209 ts_tablet_manager.cc:1403] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.141s	user 0.018s	sys 0.024s
I20260709 13:14:14.793536 30206 raft_consensus.cc:359] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.794232 30206 raft_consensus.cc:385] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.794513 30206 raft_consensus.cc:740] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.795389 30206 consensus_queue.cc:260] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.796015 30212 tablet_bootstrap.cc:654] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.796890 30209 raft_consensus.cc:359] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.797595 30209 raft_consensus.cc:385] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.797902 30206 ts_tablet_manager.cc:1434] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:14.797863 30209 raft_consensus.cc:740] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.798653 30209 consensus_queue.cc:260] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:14.846505 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.849051 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:14.852083 29937 raft_consensus.cc:3060] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.854509 30209 ts_tablet_manager.cc:1434] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:14:14.860729 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:14.867113 30210 raft_consensus.cc:493] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.872432 30210 raft_consensus.cc:515] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.878520 30214 raft_consensus.cc:493] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.879094 29836 catalog_manager.cc:5697] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.890515 30369 consensus_queue.cc:1048] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.891958 30307 raft_consensus.cc:493] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.893210 30209 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:14.892925 30307 raft_consensus.cc:515] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.896730 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d3f73348f4deca6026b42f4e83fab" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.898456 30206 tablet_bootstrap.cc:492] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:14.901934 30210 leader_election.cc:290] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
W20260709 13:14:14.902369 30052 leader_election.cc:343] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.902633 30307 leader_election.cc:290] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:14.903023 30052 leader_election.cc:304] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:14.905230 30351 raft_consensus.cc:2749] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.903944 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232202ef61084cb1b794c297a13e0a07" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:14.906541 30381 raft_consensus.cc:493] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.879683 30214 raft_consensus.cc:515] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.914366 30214 leader_election.cc:290] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.863407 30126 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
W20260709 13:14:14.916674 30127 leader_election.cc:343] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.907436 30381 raft_consensus.cc:515] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.920269 30307 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.920218 30210 consensus_queue.cc:1048] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.920862 30381 leader_election.cc:290] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:14.925411 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232202ef61084cb1b794c297a13e0a07" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:14.907447 30088 raft_consensus.cc:2393] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 1: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:14.932642 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d3f73348f4deca6026b42f4e83fab" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:14.936292 30348 consensus_queue.cc:1048] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:14.947803 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 45650.9us
I20260709 13:14:14.937378 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:14.938669 30207 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
W20260709 13:14:14.932693 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 69827.6us
I20260709 13:14:14.944643 30214 consensus_queue.cc:1048] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.954620 30348 consensus_queue.cc:1048] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.962832 30355 raft_consensus.cc:493] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.964020 30355 raft_consensus.cc:515] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:14.967244 30086 raft_consensus.cc:2468] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:14.969314 30212 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:14.970320 30212 ts_tablet_manager.cc:1403] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.180s	user 0.012s	sys 0.000s
I20260709 13:14:14.972524 30207 ts_tablet_manager.cc:1403] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.223s	user 0.023s	sys 0.014s
I20260709 13:14:14.971752 30355 leader_election.cc:290] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:14.970373 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:14.972553 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:14.980718 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196c8778ba948e3a8684b5b06a20876" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:14.975394 30348 raft_consensus.cc:493] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.983059 30369 raft_consensus.cc:493] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.983762 30369 raft_consensus.cc:515] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:14.984687 29903 leader_election.cc:343] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.987576 30369 leader_election.cc:290] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:14.988521 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:14.990335 30053 leader_election.cc:343] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.996635 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d3f73348f4deca6026b42f4e83fab" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:15.003436 30355 consensus_queue.cc:1048] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:14:15.009506 29978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 44609.4us
I20260709 13:14:14.983155 30348 raft_consensus.cc:515] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.013375 30348 leader_election.cc:290] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:15.014782 30209 tablet_bootstrap.cc:654] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.017656 29904 leader_election.cc:304] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:15.019824 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196c8778ba948e3a8684b5b06a20876" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:15.026472 29936 raft_consensus.cc:2468] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:15.026686 29939 raft_consensus.cc:3060] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.022868 30212 raft_consensus.cc:359] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.032342 30212 raft_consensus.cc:385] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.034286 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:15.034474 30212 raft_consensus.cc:740] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.034727 29978 leader_election.cc:304] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:15.032522 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:15.033666 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:15.035403 30212 consensus_queue.cc:260] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:14.999265 30127 leader_election.cc:304] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:15.075510 30307 raft_consensus.cc:2749] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.088655 30307 raft_consensus.cc:2804] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:15.088807 30126 leader_election.cc:343] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.089269 30307 raft_consensus.cc:493] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.089727 30307 raft_consensus.cc:3060] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.090108 30207 raft_consensus.cc:359] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.091387 30207 raft_consensus.cc:385] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.076072 30381 raft_consensus.cc:2749] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.091748 30207 raft_consensus.cc:740] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.092149 30355 raft_consensus.cc:2749] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.077111 30338 raft_consensus.cc:493] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:15.079981 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:15.086144 29937 raft_consensus.cc:2468] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:15.092978 30010 raft_consensus.cc:3060] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:15.091583 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 60608.4us
I20260709 13:14:15.106947 30212 ts_tablet_manager.cc:1434] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 13:14:15.097954 30338 raft_consensus.cc:515] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.098884 30206 tablet_bootstrap.cc:654] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.093187 30207 consensus_queue.cc:260] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.107612 30126 leader_election.cc:304] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:15.108767 30356 consensus_queue.cc:1048] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:15.112670 30212 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:15.113214 30338 leader_election.cc:290] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:15.114548 30011 raft_consensus.cc:3060] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:15.088580 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 90513.3us
I20260709 13:14:15.116401 30307 raft_consensus.cc:515] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.119263 30307 leader_election.cc:290] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:15.121206 30207 ts_tablet_manager.cc:1434] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.001s
I20260709 13:14:15.125161 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:15.127395 30053 consensus_peers.cc:597] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.129431 30214 raft_consensus.cc:2804] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.128521 30207 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
W20260709 13:14:15.133174 30052 leader_election.cc:343] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.133285 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
W20260709 13:14:15.134122 30052 leader_election.cc:343] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.134595 30052 leader_election.cc:304] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.135511 30263 consensus_queue.cc:1048] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.131628 30214 raft_consensus.cc:493] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.136663 30355 consensus_queue.cc:1048] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
W20260709 13:14:15.137955 29904 leader_election.cc:343] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.184235 29904 leader_election.cc:304] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.155547 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3533d54b9a67432bb09ec05957de7241" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:15.157317 30307 consensus_queue.cc:1048] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:14:15.186095 30212 tablet_bootstrap.cc:654] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.157100 30126 leader_election.cc:304] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.187744 30307 raft_consensus.cc:2804] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.188357 30207 tablet_bootstrap.cc:654] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.135850 30348 raft_consensus.cc:2749] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:15.164746 30127 leader_election.cc:343] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.140728 30214 raft_consensus.cc:3060] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:15.189495 29904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 51581.7us
I20260709 13:14:15.157141 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d3f73348f4deca6026b42f4e83fab" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:15.190076 30355 raft_consensus.cc:2749] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.192972 29978 leader_election.cc:304] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:15.195072 30307 raft_consensus.cc:697] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:15.198722 29939 raft_consensus.cc:3060] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.203660 30307 consensus_queue.cc:237] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.204548 30209 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:15.205231 30209 ts_tablet_manager.cc:1403] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.312s	user 0.016s	sys 0.000s
W20260709 13:14:15.201006 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 68791.2us
I20260709 13:14:15.227098 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d3f73348f4deca6026b42f4e83fab" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:15.227782 30086 raft_consensus.cc:3060] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.229064 30338 raft_consensus.cc:2749] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.230794 30209 raft_consensus.cc:359] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.239060 30209 raft_consensus.cc:385] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.239349 30209 raft_consensus.cc:740] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.231088 29939 raft_consensus.cc:2468] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:15.258425 30209 consensus_queue.cc:260] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.269562 30355 consensus_queue.cc:1048] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:14:15.303406 30212 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:15.303464 30206 tablet_bootstrap.cc:492] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:15.304177 30212 ts_tablet_manager.cc:1403] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.009s
I20260709 13:14:15.304299 30206 ts_tablet_manager.cc:1403] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.407s	user 0.035s	sys 0.053s
W20260709 13:14:15.308228 30052 leader_election.cc:343] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.308799 30052 leader_election.cc:304] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:15.309623 30351 raft_consensus.cc:2749] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.299145 30126 leader_election.cc:304] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:15.317018 30207 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:15.317621 30207 ts_tablet_manager.cc:1403] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.005s
I20260709 13:14:15.319720 30209 ts_tablet_manager.cc:1434] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.000s
I20260709 13:14:15.321101 30209 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:15.321053 30214 raft_consensus.cc:515] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.322337 30348 consensus_queue.cc:1048] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.323647 30214 leader_election.cc:290] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:15.324570 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196c8778ba948e3a8684b5b06a20876" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:15.325224 29938 raft_consensus.cc:3060] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:15.300628 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 53612.2us
I20260709 13:14:15.317210 30307 raft_consensus.cc:2804] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.340130 30322 consensus_queue.cc:1048] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.343415 30086 raft_consensus.cc:2468] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:15.343829 30206 raft_consensus.cc:359] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.344700 30206 raft_consensus.cc:385] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.345343 30207 raft_consensus.cc:359] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.345975 30206 raft_consensus.cc:740] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.346094 30207 raft_consensus.cc:385] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.346530 30207 raft_consensus.cc:740] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.347515 30207 consensus_queue.cc:260] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.347853 30212 raft_consensus.cc:359] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.348776 30212 raft_consensus.cc:385] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.349089 30212 raft_consensus.cc:740] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.332883 30348 raft_consensus.cc:493] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.349684 30207 ts_tablet_manager.cc:1434] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:14:15.349761 30348 raft_consensus.cc:515] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.349982 30212 consensus_queue.cc:260] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.352296 30207 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:15.353297 30348 leader_election.cc:290] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:15.352855 30212 ts_tablet_manager.cc:1434] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:14:15.367394 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:15.365347 30209 tablet_bootstrap.cc:654] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.335465 30307 raft_consensus.cc:697] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:15.356274 30206 consensus_queue.cc:260] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.353483 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:15.387732 30207 tablet_bootstrap.cc:654] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:15.398316 30053 leader_election.cc:343] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.394462 30159 raft_consensus.cc:2468] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:15.407503 30307 consensus_queue.cc:237] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.414824 30206 ts_tablet_manager.cc:1434] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.007s
I20260709 13:14:15.423848 30212 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:15.428653 30419 consensus_queue.cc:1048] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:15.434064 30052 leader_election.cc:304] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.442027 30348 raft_consensus.cc:2804] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.442479 30348 raft_consensus.cc:493] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.442847 30348 raft_consensus.cc:3060] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.443084 30212 tablet_bootstrap.cc:654] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.454542 30206 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:15.459167 30369 raft_consensus.cc:493] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.451691 30348 raft_consensus.cc:515] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.473919 30348 leader_election.cc:290] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:15.474697 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:15.475082 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196c8778ba948e3a8684b5b06a20876" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:15.459910 30369 raft_consensus.cc:515] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.477176 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:15.477743 30369 leader_election.cc:290] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:15.479198 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2aff9b036d42d98af552cbecc893a5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:15.459889 29938 raft_consensus.cc:2468] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
W20260709 13:14:15.482401 30053 leader_election.cc:343] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.483466 30126 leader_election.cc:304] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:15.484779 30396 raft_consensus.cc:2804] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.485234 30396 raft_consensus.cc:697] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:15.486176 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2aff9b036d42d98af552cbecc893a5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:15.486903 30396 consensus_queue.cc:237] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
W20260709 13:14:15.492430 30052 leader_election.cc:343] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:15.493256 30052 leader_election.cc:343] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.502172 30052 leader_election.cc:304] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:15.493458 30162 raft_consensus.cc:3060] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.505065 30351 raft_consensus.cc:2749] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.515471 30228 raft_consensus.cc:493] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.525071 30207 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:15.525578 30207 ts_tablet_manager.cc:1403] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.000s
W20260709 13:14:15.529042 30127 consensus_peers.cc:597] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:15.530783 30127 leader_election.cc:343] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.524690 30348 raft_consensus.cc:493] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.533123 30348 raft_consensus.cc:515] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.538154 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:15.523548 30228 raft_consensus.cc:515] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
W20260709 13:14:15.540233 30053 leader_election.cc:343] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.541383 30228 leader_election.cc:290] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:15.542618 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d8796d68924971b6214133c03fef63" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:15.542878 30348 leader_election.cc:290] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:15.546231 30209 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:15.546868 30209 ts_tablet_manager.cc:1403] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.226s	user 0.023s	sys 0.003s
I20260709 13:14:15.547953 30212 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:15.548519 30212 ts_tablet_manager.cc:1403] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.015s
I20260709 13:14:15.550392 30209 raft_consensus.cc:359] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.551463 30209 raft_consensus.cc:385] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.551833 30209 raft_consensus.cc:740] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
W20260709 13:14:15.551993 29903 leader_election.cc:343] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.553828 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:15.552960 30206 tablet_bootstrap.cc:654] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.556118 30209 consensus_queue.cc:260] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.552944 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d8796d68924971b6214133c03fef63" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:15.558756 30052 leader_election.cc:343] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:15.559615 29904 leader_election.cc:343] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.562469 30052 leader_election.cc:304] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:15.562587 29904 leader_election.cc:304] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:15.563824 30369 raft_consensus.cc:2749] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.564121 30228 raft_consensus.cc:2749] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.560868 30212 raft_consensus.cc:359] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.565378 30212 raft_consensus.cc:385] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.565675 30212 raft_consensus.cc:740] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.561635 30209 ts_tablet_manager.cc:1434] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:15.563812 30162 raft_consensus.cc:2468] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:15.567428 30209 tablet_bootstrap.cc:492] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:15.567075 30212 consensus_queue.cc:260] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.572260 30212 ts_tablet_manager.cc:1434] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:14:15.575028 30212 tablet_bootstrap.cc:492] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:15.588140 30207 raft_consensus.cc:359] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.588886 30207 raft_consensus.cc:385] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.589160 30207 raft_consensus.cc:740] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.584831 30209 tablet_bootstrap.cc:654] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.586041 30052 leader_election.cc:304] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.590963 30348 raft_consensus.cc:2804] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.591583 30348 raft_consensus.cc:697] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:15.592818 30348 consensus_queue.cc:237] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.595537 30212 tablet_bootstrap.cc:654] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.595579 30206 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:15.596313 30206 ts_tablet_manager.cc:1403] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.001s
I20260709 13:14:15.600572 30206 raft_consensus.cc:359] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.601465 30206 raft_consensus.cc:385] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.601764 30206 raft_consensus.cc:740] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.602676 30206 consensus_queue.cc:260] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.602676 30207 consensus_queue.cc:260] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.605662 30206 ts_tablet_manager.cc:1434] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:15.606915 30206 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:15.607599 30207 ts_tablet_manager.cc:1434] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:14:15.614406 30207 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:15.619619 30011 raft_consensus.cc:3060] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.620882 30206 tablet_bootstrap.cc:654] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.623481 30209 tablet_bootstrap.cc:492] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:15.624119 30209 ts_tablet_manager.cc:1403] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.005s
I20260709 13:14:15.630355 30209 raft_consensus.cc:359] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.631109 30209 raft_consensus.cc:385] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.632576 30207 tablet_bootstrap.cc:654] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.633908 29833 catalog_manager.cc:5697] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.635129 30206 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:15.631373 30209 raft_consensus.cc:740] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.635728 30206 ts_tablet_manager.cc:1403] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.005s
I20260709 13:14:15.636152 30209 consensus_queue.cc:260] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.637176 30307 consensus_queue.cc:1048] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.638634 30209 ts_tablet_manager.cc:1434] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:15.638634 30206 raft_consensus.cc:359] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.639524 30206 raft_consensus.cc:385] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.639801 30206 raft_consensus.cc:740] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.639972 30209 tablet_bootstrap.cc:492] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:15.640643 30206 consensus_queue.cc:260] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.643113 30206 ts_tablet_manager.cc:1434] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:14:15.643512 30013 raft_consensus.cc:3060] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.644781 30206 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:15.644963 29833 catalog_manager.cc:5697] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.647220 30207 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:15.647691 30207 ts_tablet_manager.cc:1403] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:14:15.648619 30010 raft_consensus.cc:3060] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.656873 30206 tablet_bootstrap.cc:654] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.659227 30307 raft_consensus.cc:493] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.659768 30307 raft_consensus.cc:515] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.663587 30307 leader_election.cc:290] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:15.651189 30207 raft_consensus.cc:359] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.664837 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2aff9b036d42d98af552cbecc893a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:15.666172 30207 raft_consensus.cc:385] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.666534 30207 raft_consensus.cc:740] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.670184 30209 tablet_bootstrap.cc:654] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:15.670854 30126 leader_election.cc:343] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.672087 30207 consensus_queue.cc:260] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.675079 30207 ts_tablet_manager.cc:1434] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:14:15.676301 30207 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:15.680611 30206 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:15.681156 30206 ts_tablet_manager.cc:1403] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.009s
I20260709 13:14:15.682108 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2aff9b036d42d98af552cbecc893a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:15.682951 30207 tablet_bootstrap.cc:654] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.682827 30087 raft_consensus.cc:2468] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:15.684696 30127 leader_election.cc:304] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:15.685722 30436 raft_consensus.cc:2804] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.686105 30436 raft_consensus.cc:493] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.686452 30436 raft_consensus.cc:3060] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.687259 30206 raft_consensus.cc:359] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.687981 30206 raft_consensus.cc:385] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.688273 30206 raft_consensus.cc:740] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.688948 30206 consensus_queue.cc:260] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.690582 30206 ts_tablet_manager.cc:1434] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:15.691622 30206 tablet_bootstrap.cc:492] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:15.696372 30207 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:15.697124 30207 ts_tablet_manager.cc:1403] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:14:15.699134 30228 raft_consensus.cc:493] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.699595 30228 raft_consensus.cc:515] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.701808 30228 leader_election.cc:290] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:15.696777 30436 raft_consensus.cc:515] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.704769 30206 tablet_bootstrap.cc:654] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.705291 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:15.703912 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:15.706350 30162 raft_consensus.cc:2468] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:15.703941 30207 raft_consensus.cc:359] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:15.706727 29904 leader_election.cc:343] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.706918 30207 raft_consensus.cc:385] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.707310 30207 raft_consensus.cc:740] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.707928 29903 leader_election.cc:304] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.708091 30207 consensus_queue.cc:260] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.709548 30355 raft_consensus.cc:2804] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.710050 30355 raft_consensus.cc:493] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.710487 30355 raft_consensus.cc:3060] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.710659 29833 catalog_manager.cc:5697] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.713487 30207 ts_tablet_manager.cc:1434] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:14:15.715204 30207 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:15.717190 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2aff9b036d42d98af552cbecc893a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:15.713918 30436 leader_election.cc:290] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:15.717845 30087 raft_consensus.cc:3060] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.721912 30207 tablet_bootstrap.cc:654] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.723672 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2aff9b036d42d98af552cbecc893a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:15.724644 30436 consensus_queue.cc:1048] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:15.726316 30126 leader_election.cc:343] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.726747 30087 raft_consensus.cc:2468] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:15.731546 30212 tablet_bootstrap.cc:492] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:15.737740 30127 leader_election.cc:304] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:15.741797 30436 raft_consensus.cc:2804] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.742326 30436 raft_consensus.cc:697] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:15.739694 30212 ts_tablet_manager.cc:1403] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.165s	user 0.018s	sys 0.011s
I20260709 13:14:15.743177 30436 consensus_queue.cc:237] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.745550 30212 raft_consensus.cc:359] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.746287 30212 raft_consensus.cc:385] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.746574 30212 raft_consensus.cc:740] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.750128 30381 raft_consensus.cc:493] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c8ac4f0fa334a16b65c6a52a89b8d49)
I20260709 13:14:15.750820 30381 raft_consensus.cc:515] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.757040 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:15.758562 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:15.755888 30381 leader_election.cc:290] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:15.760800 29979 leader_election.cc:304] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:15.761641 30338 raft_consensus.cc:2749] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:15.764637 30351 raft_consensus.cc:493] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.765390 30351 raft_consensus.cc:515] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.769385 30351 leader_election.cc:290] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:15.770421 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4b15c88c1748e9b84a6fbe8dcfb073" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:15.770844 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4b15c88c1748e9b84a6fbe8dcfb073" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:15.771220 29936 raft_consensus.cc:2468] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
W20260709 13:14:15.772302 30053 leader_election.cc:343] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.773412 30052 leader_election.cc:304] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.773417 30207 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:15.776165 30351 raft_consensus.cc:2804] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.776490 30207 ts_tablet_manager.cc:1403] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.007s
I20260709 13:14:15.779891 30212 consensus_queue.cc:260] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.798826 30212 ts_tablet_manager.cc:1434] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:14:15.797919 30355 raft_consensus.cc:515] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.800279 30212 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:15.776643 30351 raft_consensus.cc:493] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.802459 30351 raft_consensus.cc:3060] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.802714 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:15.803650 30162 raft_consensus.cc:3060] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.814229 30209 tablet_bootstrap.cc:492] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:15.813740 29834 catalog_manager.cc:5697] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.814764 30209 ts_tablet_manager.cc:1403] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.175s	user 0.012s	sys 0.000s
I20260709 13:14:15.818145 30209 raft_consensus.cc:359] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.818833 30209 raft_consensus.cc:385] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.819101 30209 raft_consensus.cc:740] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.820297 30207 raft_consensus.cc:359] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.821095 30207 raft_consensus.cc:385] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.821370 30207 raft_consensus.cc:740] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.823506 30162 raft_consensus.cc:2468] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:15.825166 29903 leader_election.cc:304] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:15.826220 30210 raft_consensus.cc:2804] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.826742 30210 raft_consensus.cc:697] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:15.827576 30210 consensus_queue.cc:237] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.829262 30351 raft_consensus.cc:515] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.833271 30355 leader_election.cc:290] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:15.834239 30212 tablet_bootstrap.cc:654] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.834357 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4b15c88c1748e9b84a6fbe8dcfb073" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:15.835427 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:15.840446 29936 raft_consensus.cc:3060] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.837071 30209 consensus_queue.cc:260] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:15.841876 29904 leader_election.cc:343] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.837987 30207 consensus_queue.cc:260] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:15.844244 30207 ts_tablet_manager.cc:1434] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 13:14:15.846100 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4b15c88c1748e9b84a6fbe8dcfb073" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:15.847666 30053 leader_election.cc:343] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.848245 30209 ts_tablet_manager.cc:1434] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:14:15.849380 30209 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:15.849905 30351 leader_election.cc:290] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:15.853068 30207 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:15.858525 29936 raft_consensus.cc:2468] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:15.864861 30209 tablet_bootstrap.cc:654] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.874450 30212 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:15.875216 30212 ts_tablet_manager.cc:1403] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.002s
I20260709 13:14:15.868482 30052 leader_election.cc:304] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.879112 30351 raft_consensus.cc:2804] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.879601 30351 raft_consensus.cc:697] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:15.880276 30207 tablet_bootstrap.cc:654] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.880427 30351 consensus_queue.cc:237] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.882270 29834 catalog_manager.cc:5697] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.901846 30206 tablet_bootstrap.cc:492] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:15.902611 30206 ts_tablet_manager.cc:1403] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.211s	user 0.041s	sys 0.059s
I20260709 13:14:15.906737 30206 raft_consensus.cc:359] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.917963 30436 consensus_queue.cc:1048] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.907891 30206 raft_consensus.cc:385] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.925365 30206 raft_consensus.cc:740] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.929176 30206 consensus_queue.cc:260] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:15.929905 30322 raft_consensus.cc:493] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.930446 30322 raft_consensus.cc:515] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.930954 30207 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:15.931455 30207 ts_tablet_manager.cc:1403] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.018s
I20260709 13:14:15.932066 30206 ts_tablet_manager.cc:1434] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:14:15.933247 30206 tablet_bootstrap.cc:492] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:15.934450 30207 raft_consensus.cc:359] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.935149 30207 raft_consensus.cc:385] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.935413 30207 raft_consensus.cc:740] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.936122 30207 consensus_queue.cc:260] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:15.937682 30322 leader_election.cc:290] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:15.938374 30207 ts_tablet_manager.cc:1434] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:15.939085 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:15.939747 30207 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:15.941100 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:15.941978 30087 raft_consensus.cc:2468] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
W20260709 13:14:15.943238 29904 leader_election.cc:343] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.944015 29904 leader_election.cc:304] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:15.941334 30209 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:15.944830 30210 raft_consensus.cc:2804] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.946620 30210 raft_consensus.cc:493] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.947021 30210 raft_consensus.cc:3060] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.947642 30209 ts_tablet_manager.cc:1403] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.099s	user 0.017s	sys 0.020s
I20260709 13:14:15.945696 30212 raft_consensus.cc:359] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.951042 30212 raft_consensus.cc:385] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.951810 30212 raft_consensus.cc:740] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.955614 30210 raft_consensus.cc:515] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.955281 30212 consensus_queue.cc:260] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.958695 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:15.953586 30209 raft_consensus.cc:359] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.959467 30209 raft_consensus.cc:385] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.960141 30209 raft_consensus.cc:740] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
W20260709 13:14:15.960397 29904 leader_election.cc:343] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.946985 30207 tablet_bootstrap.cc:654] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.961616 30209 consensus_queue.cc:260] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:15.958695 30212 ts_tablet_manager.cc:1434] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.001s
I20260709 13:14:15.964793 30212 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:15.966310 30436 consensus_queue.cc:1048] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.960659 29833 catalog_manager.cc:5697] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.972105 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:15.972716 30087 raft_consensus.cc:3060] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.966769 30209 ts_tablet_manager.cc:1434] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:14:15.966869 30011 raft_consensus.cc:3060] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.984535 30087 raft_consensus.cc:2468] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:15.955847 29834 catalog_manager.cc:5697] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.987149 30210 leader_election.cc:290] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:16.000676 29904 leader_election.cc:304] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:16.001955 30210 raft_consensus.cc:2804] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.012229 30206 tablet_bootstrap.cc:654] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.014031 30207 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:16.014883 30207 ts_tablet_manager.cc:1403] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.008s
I20260709 13:14:16.017298 30212 tablet_bootstrap.cc:654] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.003000 30210 raft_consensus.cc:697] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:16.022755 30338 raft_consensus.cc:493] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.023351 30338 raft_consensus.cc:515] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.023551 30210 consensus_queue.cc:237] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:16.026324 30127 consensus_peers.cc:597] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.026539 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.026969 30436 consensus_queue.cc:1048] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:16.027622 30162 raft_consensus.cc:2393] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:16.026512 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:16.030016 30338 leader_election.cc:290] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:16.022908 30209 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:16.032447 29979 leader_election.cc:304] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:16.020182 30207 raft_consensus.cc:359] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.035346 30207 raft_consensus.cc:385] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.035173 30338 raft_consensus.cc:3060] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.059569 30206 tablet_bootstrap.cc:492] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:16.060179 30206 ts_tablet_manager.cc:1403] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.127s	user 0.009s	sys 0.007s
I20260709 13:14:16.060470 30369 raft_consensus.cc:493] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.061090 30369 raft_consensus.cc:515] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.063220 30206 raft_consensus.cc:359] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.063832 30369 leader_election.cc:290] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:16.063956 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd7f09ce7b043caa93dbd036bf072d2" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:16.064724 30206 raft_consensus.cc:385] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.065127 30206 raft_consensus.cc:740] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
W20260709 13:14:16.065667 30053 leader_election.cc:343] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.065806 30206 consensus_queue.cc:260] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.066373 30212 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:16.066967 30212 ts_tablet_manager.cc:1403] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.004s
I20260709 13:14:16.067004 30338 raft_consensus.cc:2749] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.067775 30207 raft_consensus.cc:740] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.068634 30207 consensus_queue.cc:260] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.069159 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd7f09ce7b043caa93dbd036bf072d2" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.069890 30162 raft_consensus.cc:2468] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:16.070160 30212 raft_consensus.cc:359] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.071025 30212 raft_consensus.cc:385] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.071065 30052 leader_election.cc:304] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:16.071460 30212 raft_consensus.cc:740] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.072615 30369 raft_consensus.cc:2804] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.072412 30212 consensus_queue.cc:260] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.073042 30369 raft_consensus.cc:493] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.073540 30369 raft_consensus.cc:3060] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.072449 30206 ts_tablet_manager.cc:1434] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:14:16.077029 30206 tablet_bootstrap.cc:492] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:16.081795 30369 raft_consensus.cc:515] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.085794 30369 leader_election.cc:290] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:16.083877 30212 ts_tablet_manager.cc:1434] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:14:16.083335 30209 tablet_bootstrap.cc:654] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.085922 30207 ts_tablet_manager.cc:1434] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:14:16.087702 30207 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:16.088187 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd7f09ce7b043caa93dbd036bf072d2" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:16.088912 30162 raft_consensus.cc:3060] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.092387 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd7f09ce7b043caa93dbd036bf072d2" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:16.093979 30053 leader_election.cc:343] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.093983 30206 tablet_bootstrap.cc:654] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.102165 30207 tablet_bootstrap.cc:654] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.104143 30212 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:16.112963 30212 tablet_bootstrap.cc:654] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.124732 30436 raft_consensus.cc:493] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.125322 30436 raft_consensus.cc:515] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.133486 30436 leader_election.cc:290] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:16.134959 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:16.136379 29935 raft_consensus.cc:2468] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:16.135546 29834 catalog_manager.cc:5697] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.137015 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:16.137562 30126 leader_election.cc:304] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:16.138222 30209 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
W20260709 13:14:16.138407 30127 leader_election.cc:343] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.138789 30209 ts_tablet_manager.cc:1403] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.136s	user 0.005s	sys 0.014s
I20260709 13:14:16.138808 30423 raft_consensus.cc:2804] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.143199 30423 raft_consensus.cc:493] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.143579 30423 raft_consensus.cc:3060] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.139036 30162 raft_consensus.cc:2468] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:16.150389 30206 tablet_bootstrap.cc:492] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:16.150899 30206 ts_tablet_manager.cc:1403] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.000s
I20260709 13:14:16.153731 30355 raft_consensus.cc:493] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.157068 30052 leader_election.cc:304] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:16.158061 30369 raft_consensus.cc:2804] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.158385 30355 raft_consensus.cc:515] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.158550 30206 raft_consensus.cc:359] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.158558 30369 raft_consensus.cc:697] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:16.159456 30206 raft_consensus.cc:385] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.160233 30369 consensus_queue.cc:237] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.161228 30355 leader_election.cc:290] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:16.161882 30207 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:16.162395 30207 ts_tablet_manager.cc:1403] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.075s	user 0.007s	sys 0.005s
I20260709 13:14:16.162505 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.162921 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:16.163683 30087 raft_consensus.cc:2468] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
W20260709 13:14:16.164060 29903 leader_election.cc:343] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.165316 30207 raft_consensus.cc:359] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.165619 29904 leader_election.cc:304] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:16.166039 30207 raft_consensus.cc:385] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.166325 30207 raft_consensus.cc:740] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.159785 30206 raft_consensus.cc:740] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.167449 30206 consensus_queue.cc:260] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.169507 30206 ts_tablet_manager.cc:1434] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.005s
I20260709 13:14:16.170544 30206 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:16.172765 30355 raft_consensus.cc:2804] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.175027 30355 raft_consensus.cc:493] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.175518 30355 raft_consensus.cc:3060] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.178350 30206 tablet_bootstrap.cc:654] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.179579 30207 consensus_queue.cc:260] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.185261 30351 raft_consensus.cc:493] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.185808 30351 raft_consensus.cc:515] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.186995 30423 raft_consensus.cc:515] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.197983 30212 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:16.198520 30212 ts_tablet_manager.cc:1403] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.005s
I20260709 13:14:16.192742 30351 leader_election.cc:290] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:16.200318 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a958826a704e629d021a83d965c74e" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:16.200623 30207 ts_tablet_manager.cc:1434] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:14:16.204185 30423 leader_election.cc:290] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:16.205031 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:16.206077 30207 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:16.207127 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a958826a704e629d021a83d965c74e" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.211884 30210 raft_consensus.cc:493] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.212494 30210 raft_consensus.cc:515] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
W20260709 13:14:16.213645 30053 leader_election.cc:343] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.214607 30210 leader_election.cc:290] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:16.215389 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:16.216002 29935 raft_consensus.cc:3060] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.216486 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960d9fe4dcc48798391f67ce47e9f24" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.217952 30209 raft_consensus.cc:359] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.218611 30209 raft_consensus.cc:385] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.218865 30209 raft_consensus.cc:740] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
W20260709 13:14:16.221014 29903 leader_election.cc:343] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.220831 30355 raft_consensus.cc:515] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.223065 30355 leader_election.cc:290] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
W20260709 13:14:16.223320 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:14:16.223670 30127 leader_election.cc:343] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.225667 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960d9fe4dcc48798391f67ce47e9f24" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:16.229820 30209 consensus_queue.cc:260] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.243665 30207 tablet_bootstrap.cc:654] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.226395 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
W20260709 13:14:16.226423 30052 leader_election.cc:343] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.253212 29936 raft_consensus.cc:3060] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.253477 30052 leader_election.cc:304] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:16.254837 30348 raft_consensus.cc:2749] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:16.257536 29904 leader_election.cc:343] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.258237 29904 leader_election.cc:304] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:16.235360 29935 raft_consensus.cc:2468] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:16.260080 30322 raft_consensus.cc:2749] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.260645 30126 leader_election.cc:304] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:16.262020 30423 raft_consensus.cc:2804] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.262661 30423 raft_consensus.cc:697] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:16.263366 30209 ts_tablet_manager.cc:1434] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.001s
I20260709 13:14:16.264833 30209 tablet_bootstrap.cc:492] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
W20260709 13:14:16.265651 29903 leader_election.cc:343] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.263789 30423 consensus_queue.cc:237] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.235955 30351 consensus_queue.cc:1048] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
W20260709 13:14:16.290683 29904 consensus_peers.cc:597] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.233517 30369 raft_consensus.cc:493] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.315632 30209 tablet_bootstrap.cc:654] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.320134 30351 consensus_queue.cc:1048] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:16.357031 30212 raft_consensus.cc:359] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.357971 30212 raft_consensus.cc:385] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.358335 30212 raft_consensus.cc:740] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.358765 30355 raft_consensus.cc:493] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.359182 30212 consensus_queue.cc:260] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.359524 30355 raft_consensus.cc:515] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.350876 30369 raft_consensus.cc:515] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:16.380167 30212 ts_tablet_manager.cc:1434] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.181s	user 0.006s	sys 0.004s
I20260709 13:14:16.382753 30355 leader_election.cc:290] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:16.384315 30210 raft_consensus.cc:493] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.389609 30209 tablet_bootstrap.cc:492] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:16.390164 30209 ts_tablet_manager.cc:1403] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.001s
I20260709 13:14:16.384541 30436 consensus_queue.cc:1048] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:16.391148 29833 catalog_manager.cc:5697] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.394702 30209 raft_consensus.cc:359] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.398816 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:16.400741 30209 raft_consensus.cc:385] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.386391 30210 raft_consensus.cc:515] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.401072 30209 raft_consensus.cc:740] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.403242 30209 consensus_queue.cc:260] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.390601 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:16.406224 30085 raft_consensus.cc:2468] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:16.413578 30209 ts_tablet_manager.cc:1434] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 13:14:16.415794 30212 tablet_bootstrap.cc:492] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:16.416908 30207 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:16.411707 30351 raft_consensus.cc:493] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.418224 30207 ts_tablet_manager.cc:1403] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.212s	user 0.054s	sys 0.085s
I20260709 13:14:16.414655 30087 raft_consensus.cc:3060] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.421252 30209 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:16.415131 30419 raft_consensus.cc:493] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.418679 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.412176 30423 consensus_queue.cc:1048] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:14:16.436448 30206 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:16.437510 30206 ts_tablet_manager.cc:1403] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.267s	user 0.017s	sys 0.015s
W20260709 13:14:16.445050 29903 leader_election.cc:343] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.425308 30419 raft_consensus.cc:515] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.447600 30419 leader_election.cc:290] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:16.420382 30351 raft_consensus.cc:515] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.453521 30369 leader_election.cc:290] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:16.454967 30210 leader_election.cc:290] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:16.456951 30436 raft_consensus.cc:493] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.457473 30436 raft_consensus.cc:515] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.458437 30207 raft_consensus.cc:359] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:16.464152 30207 raft_consensus.cc:385] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.464565 30207 raft_consensus.cc:740] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.465368 30207 consensus_queue.cc:260] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:16.471273 29834 catalog_manager.cc:5697] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.478411 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2aff9b036d42d98af552cbecc893a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.481002 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:16.481938 30351 leader_election.cc:290] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:16.482829 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:16.484467 30053 leader_election.cc:343] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.487743 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:16.491578 30127 leader_election.cc:343] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.491690 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a5ee0643f24ee996670cdf22181c76" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:16.492929 30127 leader_election.cc:343] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.499709 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a5ee0643f24ee996670cdf22181c76" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:16.502419 30206 raft_consensus.cc:359] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.503135 30206 raft_consensus.cc:385] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.503381 30206 raft_consensus.cc:740] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.503484 30212 tablet_bootstrap.cc:654] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.504261 30207 ts_tablet_manager.cc:1434] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.001s
I20260709 13:14:16.505339 30207 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:16.506019 30209 tablet_bootstrap.cc:654] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:16.506968 30053 consensus_peers.cc:597] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:16.507691 29904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 85665.6us
I20260709 13:14:16.508687 29904 leader_election.cc:304] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:16.509637 30206 consensus_queue.cc:260] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.507958 30436 leader_election.cc:290] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:16.507596 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d8796d68924971b6214133c03fef63" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.519552 30355 raft_consensus.cc:2804] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.482009 30085 raft_consensus.cc:2468] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:16.532416 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d8796d68924971b6214133c03fef63" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:16.533068 29939 raft_consensus.cc:2468] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:16.535758 30206 ts_tablet_manager.cc:1434] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.098s	user 0.005s	sys 0.003s
I20260709 13:14:16.531592 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:16.538589 29938 raft_consensus.cc:2468] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:16.552233 30087 raft_consensus.cc:2468] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:16.554092 30482 consensus_queue.cc:1048] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:16.529603 30355 raft_consensus.cc:493] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.571483 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2aff9b036d42d98af552cbecc893a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:16.579044 29904 leader_election.cc:304] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:16.580358 29904 leader_election.cc:304] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:16.560119 30355 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.604558 30206 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:16.590354 30210 raft_consensus.cc:2804] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.590647 30482 raft_consensus.cc:2749] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:16.561463 30052 leader_election.cc:304] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:16.594131 30423 raft_consensus.cc:493] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.593422 30481 consensus_queue.cc:1048] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:14:16.611626 30338 raft_consensus.cc:493] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:16.618667 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 61730.9us
I20260709 13:14:16.622315 30348 raft_consensus.cc:2804] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.637282 30207 tablet_bootstrap.cc:654] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.642973 30210 raft_consensus.cc:697] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:16.648483 30210 consensus_queue.cc:237] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.617030 30423 raft_consensus.cc:515] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.671541 30014 raft_consensus.cc:3060] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.636828 30338 raft_consensus.cc:515] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.670719 30206 tablet_bootstrap.cc:654] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.675678 30338 leader_election.cc:290] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:16.656302 30348 raft_consensus.cc:493] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.653957 30423 leader_election.cc:290] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:16.651993 30369 consensus_queue.cc:1048] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:14:16.688014 30212 tablet_bootstrap.cc:492] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:16.688742 30212 ts_tablet_manager.cc:1403] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.283s	user 0.027s	sys 0.013s
I20260709 13:14:16.690587 30209 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:16.691289 30209 ts_tablet_manager.cc:1403] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.270s	user 0.027s	sys 0.022s
I20260709 13:14:16.684451 30348 raft_consensus.cc:3060] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.708633 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196c8778ba948e3a8684b5b06a20876" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
W20260709 13:14:16.712872 30484 log.cc:927] Time spent T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Append to log took a long time: real 0.133s	user 0.005s	sys 0.000s
I20260709 13:14:16.720006 30212 raft_consensus.cc:359] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.723140 30212 raft_consensus.cc:385] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.723687 30212 raft_consensus.cc:740] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.732870 30212 consensus_queue.cc:260] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.679105 30052 leader_election.cc:304] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:16.734798 30486 raft_consensus.cc:2804] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.735286 30486 raft_consensus.cc:493] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.735674 30486 raft_consensus.cc:3060] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:16.722294 29904 consensus_peers.cc:597] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.740854 30369 consensus_queue.cc:1048] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.749064 30212 ts_tablet_manager.cc:1434] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:14:16.763042 30212 tablet_bootstrap.cc:492] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
W20260709 13:14:16.756515 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 89372.2us
I20260709 13:14:16.770514 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196c8778ba948e3a8684b5b06a20876" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:16.771692 30052 leader_election.cc:343] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.773223 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:16.776602 29978 leader_election.cc:304] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
W20260709 13:14:16.756917 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 139863us
I20260709 13:14:16.791188 30338 raft_consensus.cc:2749] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.797396 30206 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:16.797991 30206 ts_tablet_manager.cc:1403] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.234s	user 0.015s	sys 0.002s
I20260709 13:14:16.801630 30209 raft_consensus.cc:359] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.802215 30209 raft_consensus.cc:385] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.802472 30209 raft_consensus.cc:740] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.805447 30209 consensus_queue.cc:260] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.806974 29833 catalog_manager.cc:5697] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:16.799790 30127 leader_election.cc:343] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.827289 30127 leader_election.cc:304] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:16.818447 30206 raft_consensus.cc:359] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.828691 30496 raft_consensus.cc:2749] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.829017 30206 raft_consensus.cc:385] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.829340 30206 raft_consensus.cc:740] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.830102 30206 consensus_queue.cc:260] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.832515 30206 ts_tablet_manager.cc:1434] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 13:14:16.833480 30206 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:16.824980 30348 raft_consensus.cc:515] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.842118 30209 ts_tablet_manager.cc:1434] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.150s	user 0.007s	sys 0.000s
I20260709 13:14:16.805820 30355 raft_consensus.cc:515] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:16.862876 30209 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:16.867731 30207 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:16.868487 30207 ts_tablet_manager.cc:1403] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.363s	user 0.016s	sys 0.012s
I20260709 13:14:16.871016 30338 raft_consensus.cc:493] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.879187 30338 raft_consensus.cc:515] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:16.881489 30338 leader_election.cc:290] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:16.881784 30486 raft_consensus.cc:515] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:16.883975 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:16.885054 29937 raft_consensus.cc:2393] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in current term 1: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:16.885380 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:16.853924 30127 leader_election.cc:304] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:16.885749 30369 consensus_queue.cc:1048] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:16.899217 30495 raft_consensus.cc:2804] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.899904 30495 raft_consensus.cc:493] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.900377 30495 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:16.912793 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 71789.4us
I20260709 13:14:16.915915 30423 consensus_queue.cc:1048] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.917160 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:16.918322 30087 raft_consensus.cc:2393] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in current term 1: Already voted for candidate b9712e59a1774be08aa8e368566dcfed in this term.
I20260709 13:14:16.900516 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:16.922173 30013 raft_consensus.cc:3060] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.923977 29978 leader_election.cc:304] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:16.924954 30338 raft_consensus.cc:3060] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:16.935642 30053 leader_election.cc:343] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.918349 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:16.938884 29937 raft_consensus.cc:3060] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.949783 30207 raft_consensus.cc:359] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:16.950881 30207 raft_consensus.cc:385] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.951213 30207 raft_consensus.cc:740] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.953614 30355 leader_election.cc:290] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:16.954025 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d8796d68924971b6214133c03fef63" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
W20260709 13:14:16.955544 30052 leader_election.cc:343] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.957144 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:16.957463 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:16.958305 30086 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:16.958839 29903 leader_election.cc:343] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.896885 30486 leader_election.cc:290] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:16.962116 30207 consensus_queue.cc:260] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:16.959748 30495 raft_consensus.cc:515] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:16.989250 30207 ts_tablet_manager.cc:1434] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.000s
I20260709 13:14:17.001672 30348 leader_election.cc:290] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:17.024605 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d8796d68924971b6214133c03fef63" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:17.025241 29939 raft_consensus.cc:3060] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.026028 30209 tablet_bootstrap.cc:654] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.031003 30212 tablet_bootstrap.cc:654] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.055583 30206 tablet_bootstrap.cc:654] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.041406 30495 leader_election.cc:290] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.039989 30086 raft_consensus.cc:2468] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:17.065934 30127 leader_election.cc:304] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:17.066859 30214 raft_consensus.cc:3060] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.073045 30207 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:17.048238 29939 raft_consensus.cc:2468] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:17.074802 30052 leader_election.cc:304] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:17.052325 29937 raft_consensus.cc:2468] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:17.077235 29904 leader_election.cc:304] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:17.056612 30436 raft_consensus.cc:493] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.080891 30348 raft_consensus.cc:2804] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.082453 30210 raft_consensus.cc:2804] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.089938 30210 raft_consensus.cc:697] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:17.090528 30210 consensus_queue.cc:237] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.096648 30348 raft_consensus.cc:697] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:17.100317 30052 leader_election.cc:304] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.100224 30348 consensus_queue.cc:237] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.102003 30474 raft_consensus.cc:2804] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.102571 30474 raft_consensus.cc:697] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:17.104209 30214 raft_consensus.cc:2749] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.105737 30212 tablet_bootstrap.cc:492] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.106345 30212 ts_tablet_manager.cc:1403] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.344s	user 0.008s	sys 0.014s
I20260709 13:14:17.103518 30474 consensus_queue.cc:237] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.110733 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:17.092422 30436 raft_consensus.cc:515] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.116787 30338 raft_consensus.cc:2749] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.119928 30436 leader_election.cc:290] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:17.122085 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:17.122786 30085 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.122076 30207 tablet_bootstrap.cc:654] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.122974 30212 raft_consensus.cc:359] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.127308 30212 raft_consensus.cc:385] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.127614 30212 raft_consensus.cc:740] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.130384 30212 consensus_queue.cc:260] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.132995 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960d9fe4dcc48798391f67ce47e9f24" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:17.135720 30212 ts_tablet_manager.cc:1434] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:14:17.136881 30212 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.145941 30355 consensus_queue.cc:1048] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.148224 30212 tablet_bootstrap.cc:654] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.161185 30483 consensus_queue.cc:1048] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.161675 30085 raft_consensus.cc:2468] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
W20260709 13:14:17.165714 30127 leader_election.cc:343] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.173439 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960d9fe4dcc48798391f67ce47e9f24" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:17.188905 30209 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:17.191538 30209 ts_tablet_manager.cc:1403] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.337s	user 0.016s	sys 0.011s
I20260709 13:14:17.198200 30486 raft_consensus.cc:493] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.198763 30486 raft_consensus.cc:515] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.200795 30486 leader_election.cc:290] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:17.203317 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a5ee0643f24ee996670cdf22181c76" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:17.204854 30053 leader_election.cc:343] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.205749 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a5ee0643f24ee996670cdf22181c76" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:17.206422 30161 raft_consensus.cc:2468] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:17.208432 30206 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:17.208897 30052 leader_election.cc:304] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.209472 30206 ts_tablet_manager.cc:1403] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.376s	user 0.023s	sys 0.004s
I20260709 13:14:17.210494 30486 raft_consensus.cc:2804] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.210909 30486 raft_consensus.cc:493] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.211247 30486 raft_consensus.cc:3060] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:17.212350 30127 leader_election.cc:343] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.213619 30206 raft_consensus.cc:359] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.214036 30419 consensus_queue.cc:1048] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.215826 30127 leader_election.cc:304] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.217291 30496 raft_consensus.cc:2804] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.217782 30496 raft_consensus.cc:697] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:17.218340 30206 raft_consensus.cc:385] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.196280 29939 raft_consensus.cc:2468] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:17.218597 30496 consensus_queue.cc:237] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.219978 30206 raft_consensus.cc:740] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.220678 29833 catalog_manager.cc:5697] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.221118 30206 consensus_queue.cc:260] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.224763 30126 leader_election.cc:304] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.225808 30206 ts_tablet_manager.cc:1434] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:14:17.225992 30495 raft_consensus.cc:2804] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.226434 30495 raft_consensus.cc:493] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.226758 30495 raft_consensus.cc:3060] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.227180 30206 tablet_bootstrap.cc:492] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:17.250284 30206 tablet_bootstrap.cc:654] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.256925 29837 catalog_manager.cc:5697] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.258960 29837 catalog_manager.cc:5697] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.264459 30485 raft_consensus.cc:493] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.265024 30485 raft_consensus.cc:515] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.267145 30485 leader_election.cc:290] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.269796 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:17.271399 30209 raft_consensus.cc:359] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.272215 30209 raft_consensus.cc:385] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.272486 30209 raft_consensus.cc:740] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.254169 30495 raft_consensus.cc:515] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.273149 30209 consensus_queue.cc:260] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:17.274539 29904 leader_election.cc:343] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.275135 30495 leader_election.cc:290] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:17.276589 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960d9fe4dcc48798391f67ce47e9f24" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:17.277423 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:17.296420 29938 raft_consensus.cc:3060] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.279241 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960d9fe4dcc48798391f67ce47e9f24" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:17.298664 29904 leader_election.cc:343] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.299090 29904 leader_election.cc:304] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:17.299893 30355 raft_consensus.cc:2749] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.283906 30209 ts_tablet_manager.cc:1434] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260709 13:14:17.287806 30486 raft_consensus.cc:515] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.294937 30207 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:17.304200 30207 ts_tablet_manager.cc:1403] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.232s	user 0.019s	sys 0.057s
I20260709 13:14:17.307096 30209 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:17.309250 30207 raft_consensus.cc:359] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.309994 30207 raft_consensus.cc:385] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.310276 30207 raft_consensus.cc:740] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.310911 30207 consensus_queue.cc:260] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.318092 29938 raft_consensus.cc:2468] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:17.319600 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a5ee0643f24ee996670cdf22181c76" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:17.325129 30053 leader_election.cc:343] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.320797 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a5ee0643f24ee996670cdf22181c76" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:17.326028 30161 raft_consensus.cc:3060] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.328665 30486 leader_election.cc:290] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
W20260709 13:14:17.322144 30127 leader_election.cc:343] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.330689 30209 tablet_bootstrap.cc:654] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.335739 30126 leader_election.cc:304] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.338027 30207 ts_tablet_manager.cc:1434] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:14:17.342983 30206 tablet_bootstrap.cc:492] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:17.343575 30206 ts_tablet_manager.cc:1403] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.008s
I20260709 13:14:17.343112 29837 catalog_manager.cc:5697] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.344041 30338 raft_consensus.cc:493] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.346984 30338 raft_consensus.cc:515] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.349092 30338 leader_election.cc:290] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.350178 30212 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.350685 30212 ts_tablet_manager.cc:1403] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.214s	user 0.011s	sys 0.011s
I20260709 13:14:17.351378 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:17.351881 30207 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:17.352069 30084 raft_consensus.cc:2468] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 0.
I20260709 13:14:17.353510 30212 raft_consensus.cc:359] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.353899 30485 raft_consensus.cc:493] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.354233 30212 raft_consensus.cc:385] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.354599 30212 raft_consensus.cc:740] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.354451 30485 raft_consensus.cc:515] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.355059 29979 leader_election.cc:304] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:17.355363 30212 consensus_queue.cc:260] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.367205 30207 tablet_bootstrap.cc:654] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.368594 30212 ts_tablet_manager.cc:1434] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:14:17.369573 30212 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.356469 30338 raft_consensus.cc:2804] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.372855 30338 raft_consensus.cc:493] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.373629 30338 raft_consensus.cc:3060] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.358466 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:17.359299 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:17.380985 30083 raft_consensus.cc:2468] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:17.346331 30495 raft_consensus.cc:2804] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.382483 30495 raft_consensus.cc:697] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:17.382640 29904 leader_election.cc:304] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:17.383556 30355 raft_consensus.cc:2804] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.384124 30355 raft_consensus.cc:493] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.384588 30355 raft_consensus.cc:3060] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.364809 30161 raft_consensus.cc:2468] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:17.356935 30485 leader_election.cc:290] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.357650 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:17.388917 30348 raft_consensus.cc:493] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.389611 30348 raft_consensus.cc:515] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.394210 30355 raft_consensus.cc:515] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.395447 29938 raft_consensus.cc:2393] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in current term 1: Already voted for candidate b9712e59a1774be08aa8e368566dcfed in this term.
W20260709 13:14:17.396709 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:17.360445 30206 raft_consensus.cc:359] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.398217 30212 tablet_bootstrap.cc:654] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.397994 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:17.402822 30206 raft_consensus.cc:385] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.403179 30206 raft_consensus.cc:740] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.403343 30338 raft_consensus.cc:515] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.403883 30206 consensus_queue.cc:260] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.405279 30355 leader_election.cc:290] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.406216 30206 ts_tablet_manager.cc:1434] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 13:14:17.407395 30206 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:17.408342 30338 leader_election.cc:290] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.398931 30052 leader_election.cc:304] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.409385 30011 raft_consensus.cc:2393] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 1: Already voted for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in this term.
I20260709 13:14:17.409718 30486 raft_consensus.cc:2804] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.410287 30486 raft_consensus.cc:697] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
W20260709 13:14:17.410704 30052 leader_election.cc:343] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.412585 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:17.413210 30084 raft_consensus.cc:3060] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.413069 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:17.416500 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:17.417215 30206 tablet_bootstrap.cc:654] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.417322 29939 raft_consensus.cc:2393] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in current term 1: Already voted for candidate b9712e59a1774be08aa8e368566dcfed in this term.
I20260709 13:14:17.417063 30011 raft_consensus.cc:2393] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 1: Already voted for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in this term.
I20260709 13:14:17.383695 30495 consensus_queue.cc:237] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.416254 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:17.420013 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:17.420279 30474 raft_consensus.cc:493] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.420965 30474 raft_consensus.cc:515] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.411137 30486 consensus_queue.cc:237] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.422068 30207 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:17.422575 30207 ts_tablet_manager.cc:1403] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.023s
I20260709 13:14:17.423734 30474 leader_election.cc:290] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:17.425138 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:17.425338 30207 raft_consensus.cc:359] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.400885 30348 leader_election.cc:290] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:17.426047 30207 raft_consensus.cc:385] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.426438 30207 raft_consensus.cc:740] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
W20260709 13:14:17.426544 30052 leader_election.cc:343] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.427119 30207 consensus_queue.cc:260] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.429556 30207 ts_tablet_manager.cc:1434] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:17.430635 30207 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
W20260709 13:14:17.434108 30052 leader_election.cc:343] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.434741 30052 leader_election.cc:304] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:17.436161 30348 raft_consensus.cc:2749] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.436455 30207 tablet_bootstrap.cc:654] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.439234 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:17.445403 30053 leader_election.cc:343] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.446029 30053 leader_election.cc:304] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.447773 30348 raft_consensus.cc:2749] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.493290 30209 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:17.449071 29904 leader_election.cc:304] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:17.503222 30209 ts_tablet_manager.cc:1403] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.196s	user 0.030s	sys 0.003s
I20260709 13:14:17.503419 30355 raft_consensus.cc:2749] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.506108 30209 raft_consensus.cc:359] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.502558 30206 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:17.502735 30084 raft_consensus.cc:2468] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:17.506850 30212 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.507246 30206 ts_tablet_manager.cc:1403] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.100s	user 0.022s	sys 0.022s
I20260709 13:14:17.507591 30212 ts_tablet_manager.cc:1403] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.138s	user 0.023s	sys 0.036s
I20260709 13:14:17.507882 29979 leader_election.cc:304] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:17.508872 30508 raft_consensus.cc:2804] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.509367 30508 raft_consensus.cc:697] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:17.506892 30209 raft_consensus.cc:385] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.510648 30209 raft_consensus.cc:740] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.510159 30508 consensus_queue.cc:237] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.511664 30212 raft_consensus.cc:359] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.512430 30212 raft_consensus.cc:385] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.513015 30212 raft_consensus.cc:740] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.510183 30206 raft_consensus.cc:359] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.513746 30206 raft_consensus.cc:385] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.514032 30206 raft_consensus.cc:740] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.514156 30212 consensus_queue.cc:260] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.515887 30212 ts_tablet_manager.cc:1434] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:17.517210 30212 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.516810 29834 catalog_manager.cc:5697] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.512753 30207 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
W20260709 13:14:17.524511 29904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 71514.4us
I20260709 13:14:17.526304 30212 tablet_bootstrap.cc:654] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:17.526480 30053 consensus_peers.cc:597] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:17.529045 30209 consensus_queue.cc:260] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.530385 30206 consensus_queue.cc:260] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.533073 30209 ts_tablet_manager.cc:1434] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:14:17.537101 30209 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:17.537448 30207 ts_tablet_manager.cc:1403] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.013s
I20260709 13:14:17.539072 30206 ts_tablet_manager.cc:1434] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:14:17.545027 30206 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:17.543808 29837 catalog_manager.cc:5697] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.549918 30355 raft_consensus.cc:493] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.550482 30355 raft_consensus.cc:515] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.551641 30206 tablet_bootstrap.cc:654] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.541047 30207 raft_consensus.cc:359] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.555022 30207 raft_consensus.cc:385] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.555253 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:17.543737 30212 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.556097 30161 raft_consensus.cc:2468] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:17.556396 30212 ts_tablet_manager.cc:1403] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.003s
I20260709 13:14:17.557197 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:17.557528 29903 leader_election.cc:304] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:17.558395 30485 raft_consensus.cc:2804] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.558874 30485 raft_consensus.cc:493] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.559185 30485 raft_consensus.cc:3060] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.555449 30207 raft_consensus.cc:740] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.560520 30207 consensus_queue.cc:260] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.562701 30207 ts_tablet_manager.cc:1434] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
W20260709 13:14:17.563309 29904 leader_election.cc:343] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.542979 30209 tablet_bootstrap.cc:654] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.565896 30207 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:17.552702 30355 leader_election.cc:290] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:17.573776 29833 catalog_manager.cc:5697] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.576135 30496 raft_consensus.cc:493] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.576715 30496 raft_consensus.cc:515] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.579094 30496 leader_election.cc:290] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.579286 30207 tablet_bootstrap.cc:654] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.593030 30212 raft_consensus.cc:359] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.593871 30212 raft_consensus.cc:385] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.594194 30212 raft_consensus.cc:740] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.594905 30212 consensus_queue.cc:260] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.597452 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a958826a704e629d021a83d965c74e" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:17.597471 30212 ts_tablet_manager.cc:1434] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:14:17.599674 30161 raft_consensus.cc:3060] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.601393 30485 raft_consensus.cc:515] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.604049 30485 leader_election.cc:290] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
W20260709 13:14:17.604583 30127 leader_election.cc:343] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.604924 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:17.605512 30159 raft_consensus.cc:3060] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.607630 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a958826a704e629d021a83d965c74e" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:17.608333 30084 raft_consensus.cc:2468] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:17.609934 30212 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.613999 30159 raft_consensus.cc:2468] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:17.617079 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:17.625101 30209 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:17.625690 30486 consensus_queue.cc:1048] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.625663 30209 ts_tablet_manager.cc:1403] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.000s
I20260709 13:14:17.626802 30127 leader_election.cc:304] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.627315 29903 leader_election.cc:304] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:17.634138 30355 raft_consensus.cc:2804] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.635792 30209 raft_consensus.cc:359] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.636775 30209 raft_consensus.cc:385] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.636821 30355 raft_consensus.cc:697] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:17.637138 30209 raft_consensus.cc:740] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.638001 30209 consensus_queue.cc:260] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.638164 30355 consensus_queue.cc:237] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.638600 30212 tablet_bootstrap.cc:654] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.640724 30209 ts_tablet_manager.cc:1434] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:17.642889 30494 raft_consensus.cc:2804] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.643347 30494 raft_consensus.cc:493] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.643680 30494 raft_consensus.cc:3060] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.647758 30209 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:17.651742 30212 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.652920 30486 raft_consensus.cc:493] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.653467 30212 ts_tablet_manager.cc:1403] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.001s
I20260709 13:14:17.653447 30486 raft_consensus.cc:515] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:17.641764 29904 leader_election.cc:343] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.658347 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:17.659981 30053 leader_election.cc:343] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.655736 30486 leader_election.cc:290] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:17.665241 30209 tablet_bootstrap.cc:654] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.667168 30207 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:17.667654 30207 ts_tablet_manager.cc:1403] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.102s	user 0.008s	sys 0.014s
I20260709 13:14:17.668541 30206 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:17.669240 30206 ts_tablet_manager.cc:1403] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.011s
I20260709 13:14:17.656533 30212 raft_consensus.cc:359] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.673630 30212 raft_consensus.cc:385] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.674044 30212 raft_consensus.cc:740] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.673799 30207 raft_consensus.cc:359] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.674675 30207 raft_consensus.cc:385] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.674975 30207 raft_consensus.cc:740] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.655671 30494 raft_consensus.cc:515] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.675756 30207 consensus_queue.cc:260] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.677809 30494 leader_election.cc:290] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.678201 30206 raft_consensus.cc:359] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.679169 30206 raft_consensus.cc:385] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.679419 30206 raft_consensus.cc:740] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.679651 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a958826a704e629d021a83d965c74e" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:17.680292 30084 raft_consensus.cc:3060] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.681339 30212 consensus_queue.cc:260] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.684269 30212 ts_tablet_manager.cc:1434] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:14:17.684408 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a958826a704e629d021a83d965c74e" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:17.684845 30206 consensus_queue.cc:260] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
W20260709 13:14:17.685873 30127 leader_election.cc:343] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.686599 30212 tablet_bootstrap.cc:492] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.690857 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:17.700382 30206 ts_tablet_manager.cc:1434] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:14:17.698348 30084 raft_consensus.cc:2468] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:17.701538 30206 tablet_bootstrap.cc:492] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:17.702595 30207 ts_tablet_manager.cc:1434] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:14:17.702370 30127 leader_election.cc:304] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:17.703715 30207 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:17.703750 30496 raft_consensus.cc:2804] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.704406 30496 raft_consensus.cc:697] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:17.704787 30212 tablet_bootstrap.cc:654] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.705226 30496 consensus_queue.cc:237] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.711669 30207 tablet_bootstrap.cc:654] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.713348 30206 tablet_bootstrap.cc:654] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.723309 30348 consensus_queue.cc:1048] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.725064 30212 tablet_bootstrap.cc:492] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
W20260709 13:14:17.726287 30052 leader_election.cc:343] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.725615 30212 ts_tablet_manager.cc:1403] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:14:17.727053 30052 leader_election.cc:304] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:17.728348 30348 raft_consensus.cc:2749] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.728861 30207 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:17.725541 29834 catalog_manager.cc:5697] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.729533 30206 tablet_bootstrap.cc:492] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:17.729373 30207 ts_tablet_manager.cc:1403] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:14:17.729987 30206 ts_tablet_manager.cc:1403] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.003s
I20260709 13:14:17.730147 30212 raft_consensus.cc:359] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.730857 30212 raft_consensus.cc:385] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.731133 30212 raft_consensus.cc:740] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.731211 30209 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:17.731745 30209 ts_tablet_manager.cc:1403] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.010s
I20260709 13:14:17.732892 30207 raft_consensus.cc:359] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.733582 30207 raft_consensus.cc:385] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.733868 30207 raft_consensus.cc:740] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.734251 30209 raft_consensus.cc:359] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.734733 30209 raft_consensus.cc:385] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.734930 30209 raft_consensus.cc:740] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.734514 30207 consensus_queue.cc:260] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.735525 30209 consensus_queue.cc:260] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.736912 30207 ts_tablet_manager.cc:1434] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:17.738001 30207 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:17.738459 30206 raft_consensus.cc:359] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.740118 30206 raft_consensus.cc:385] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.742326 30348 consensus_queue.cc:1048] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:17.743887 30127 consensus_peers.cc:597] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:17.744176 30508 raft_consensus.cc:493] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.744423 30212 consensus_queue.cc:260] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.744685 30508 raft_consensus.cc:515] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.745042 30207 tablet_bootstrap.cc:654] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.746783 30508 leader_election.cc:290] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.746886 30212 ts_tablet_manager.cc:1434] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:14:17.748066 30212 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.751119 30490 raft_consensus.cc:493] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.751647 30490 raft_consensus.cc:515] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.752868 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:17.753829 30490 leader_election.cc:290] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.754287 30212 tablet_bootstrap.cc:654] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.739993 29835 catalog_manager.cc:5697] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.756505 30159 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.757503 30209 ts_tablet_manager.cc:1434] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:14:17.758553 30209 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:17.764371 30209 tablet_bootstrap.cc:654] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.766223 30490 consensus_queue.cc:1048] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.786826 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb1d96bc2a74b3096fcedd6db889969" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:17.787755 30212 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.788321 30212 ts_tablet_manager.cc:1403] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.007s
I20260709 13:14:17.789098 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb1d96bc2a74b3096fcedd6db889969" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:17.789644 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:17.790678 29937 raft_consensus.cc:2393] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:17.791119 30212 raft_consensus.cc:359] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.791858 30212 raft_consensus.cc:385] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.792155 30212 raft_consensus.cc:740] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.792400 30419 consensus_queue.cc:1048] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.792999 30212 consensus_queue.cc:260] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.795431 30212 ts_tablet_manager.cc:1434] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:17.796736 30212 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.800433 30206 raft_consensus.cc:740] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.801960 30206 consensus_queue.cc:260] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.802624 30212 tablet_bootstrap.cc:654] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.812966 30508 raft_consensus.cc:493] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.813606 30508 raft_consensus.cc:515] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.815128 30212 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.815150 30207 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:17.815835 30207 ts_tablet_manager.cc:1403] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.004s
I20260709 13:14:17.815718 30508 leader_election.cc:290] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:17.815706 30212 ts_tablet_manager.cc:1403] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 13:14:17.817145 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:17.820863 30212 raft_consensus.cc:359] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.821563 30212 raft_consensus.cc:385] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.821832 30212 raft_consensus.cc:740] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.822693 30212 consensus_queue.cc:260] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.824524 30212 ts_tablet_manager.cc:1434] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:17.824676 30206 ts_tablet_manager.cc:1434] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.001s
I20260709 13:14:17.825508 30212 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.825740 30206 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:17.826431 30207 raft_consensus.cc:359] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:17.827363 30207 raft_consensus.cc:385] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.827610 30207 raft_consensus.cc:740] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.828434 30207 consensus_queue.cc:260] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:17.829577 30127 consensus_peers.cc:597] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:17.830475 30207 ts_tablet_manager.cc:1434] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:14:17.831530 30207 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:17.832235 30212 tablet_bootstrap.cc:654] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.838110 30483 consensus_queue.cc:1048] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.841600 30207 tablet_bootstrap.cc:654] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:17.843466 30053 consensus_peers.cc:597] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:17.852766 30212 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.853395 30212 ts_tablet_manager.cc:1403] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.003s
I20260709 13:14:17.856405 30212 raft_consensus.cc:359] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.857131 30212 raft_consensus.cc:385] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.857431 30212 raft_consensus.cc:740] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.858443 30212 consensus_queue.cc:260] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.860477 30212 ts_tablet_manager.cc:1434] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:14:17.861529 30212 tablet_bootstrap.cc:492] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.867777 30212 tablet_bootstrap.cc:654] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:17.876434 29904 leader_election.cc:343] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.878809 30011 raft_consensus.cc:3060] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.881207 30212 tablet_bootstrap.cc:492] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.881814 30212 ts_tablet_manager.cc:1403] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:14:17.884364 30483 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.884588 30212 raft_consensus.cc:359] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.884935 30483 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.885329 30212 raft_consensus.cc:385] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.885746 30212 raft_consensus.cc:740] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.886566 30212 consensus_queue.cc:260] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:17.887121 30483 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:17.889273 30212 ts_tablet_manager.cc:1434] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:17.890403 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:17.890388 30212 tablet_bootstrap.cc:492] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:17.890599 29978 leader_election.cc:304] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:17.891631 30508 raft_consensus.cc:3060] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:17.892169 29903 leader_election.cc:343] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.895658 30355 raft_consensus.cc:493] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.896232 30355 raft_consensus.cc:515] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.897389 30212 tablet_bootstrap.cc:654] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.898247 30355 leader_election.cc:290] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
W20260709 13:14:17.899024 29904 leader_election.cc:343] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.899428 29904 leader_election.cc:304] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:17.899580 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:17.901057 29903 leader_election.cc:343] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.902472 30483 raft_consensus.cc:2749] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.911600 30348 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.912433 30348 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:17.916302 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:17.916564 30348 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
W20260709 13:14:17.920368 30052 leader_election.cc:343] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.948786 30508 raft_consensus.cc:2749] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.950609 30209 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:17.992697 30209 ts_tablet_manager.cc:1403] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.234s	user 0.019s	sys 0.019s
I20260709 13:14:17.995546 30209 raft_consensus.cc:359] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.996306 30209 raft_consensus.cc:385] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.996585 30209 raft_consensus.cc:740] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.997330 30209 consensus_queue.cc:260] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:17.950732 30207 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:17.951350 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:17.998404 30207 ts_tablet_manager.cc:1403] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.167s	user 0.046s	sys 0.040s
I20260709 13:14:17.999444 30212 tablet_bootstrap.cc:492] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:17.999955 30212 ts_tablet_manager.cc:1403] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.110s	user 0.041s	sys 0.031s
I20260709 13:14:18.000116 30209 ts_tablet_manager.cc:1434] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:17.952122 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:17.952862 30206 tablet_bootstrap.cc:654] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.955294 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:17.960739 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:17.971304 30348 consensus_queue.cc:1048] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.972959 30496 raft_consensus.cc:493] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.981005 30014 raft_consensus.cc:3060] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.001524 30087 raft_consensus.cc:2468] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
W20260709 13:14:18.002686 29904 leader_election.cc:343] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.006289 29904 leader_election.cc:304] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.001185 30207 raft_consensus.cc:359] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.007318 30207 raft_consensus.cc:385] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.002985 29938 raft_consensus.cc:2468] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:18.007417 30355 raft_consensus.cc:2749] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.012895 29904 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:18.014153 30052 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:18.014948 30348 raft_consensus.cc:2804] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.015329 30348 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.015740 30348 raft_consensus.cc:3060] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.016363 30355 raft_consensus.cc:2804] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.016783 30355 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.017136 30355 raft_consensus.cc:3060] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.002002 29978 leader_election.cc:304] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:18.004941 30496 raft_consensus.cc:515] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.021916 30496 leader_election.cc:290] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:18.007658 30207 raft_consensus.cc:740] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.001077 30209 tablet_bootstrap.cc:492] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:18.004354 30212 raft_consensus.cc:359] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.023073 30212 raft_consensus.cc:385] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.023382 30212 raft_consensus.cc:740] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.024097 30212 consensus_queue.cc:260] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.022809 30207 consensus_queue.cc:260] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.026180 30212 ts_tablet_manager.cc:1434] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:14:18.028090 30212 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63: Bootstrap starting.
I20260709 13:14:18.033880 30212 tablet_bootstrap.cc:654] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.034188 30209 tablet_bootstrap.cc:654] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.035494 30207 ts_tablet_manager.cc:1434] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 13:14:18.037348 30207 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:18.037899 30348 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.041726 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:18.045892 30348 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:18.049463 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:18.050395 30087 raft_consensus.cc:2468] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:18.059237 30338 consensus_queue.cc:1048] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.064275 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:18.066105 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:18.070061 30493 raft_consensus.cc:493] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.070756 30493 raft_consensus.cc:515] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.074262 30207 tablet_bootstrap.cc:654] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.074116 30493 leader_election.cc:290] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:18.074765 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789ef1eb3f346e480405a1544cd57d5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:18.076113 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789ef1eb3f346e480405a1544cd57d5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:18.076454 30053 leader_election.cc:343] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.077662 30355 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
W20260709 13:14:18.078374 30052 leader_election.cc:343] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.080390 30355 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:18.081213 29938 raft_consensus.cc:2393] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 1: Already voted for candidate b9712e59a1774be08aa8e368566dcfed in this term.
I20260709 13:14:18.087934 30209 tablet_bootstrap.cc:492] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:18.092303 30209 ts_tablet_manager.cc:1403] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.001s
I20260709 13:14:18.097287 30212 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63: No bootstrap required, opened a new log
I20260709 13:14:18.098950 30212 ts_tablet_manager.cc:1403] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.013s
I20260709 13:14:18.102865 30127 leader_election.cc:304] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
W20260709 13:14:18.103790 30127 leader_election.cc:343] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.080621 30052 leader_election.cc:343] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.082093 30508 raft_consensus.cc:2749] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.107764 30351 raft_consensus.cc:493] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.081669 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:18.108359 30351 raft_consensus.cc:515] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.083777 30493 raft_consensus.cc:493] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:18.109977 29903 leader_election.cc:343] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.110244 30493 raft_consensus.cc:515] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.103799 30494 raft_consensus.cc:2804] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.111164 30494 raft_consensus.cc:493] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.111563 30494 raft_consensus.cc:3060] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.085942 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:18.112869 30084 raft_consensus.cc:2393] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:18.114305 30493 leader_election.cc:290] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:18.116905 30496 consensus_queue.cc:1048] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.119539 30351 leader_election.cc:290] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:18.119632 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:18.122223 30053 leader_election.cc:343] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.123410 30212 raft_consensus.cc:359] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.125121 30212 raft_consensus.cc:385] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.125521 30212 raft_consensus.cc:740] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.126502 30212 consensus_queue.cc:260] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.127228 30490 consensus_queue.cc:1048] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.135247 30052 leader_election.cc:304] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.141245 30493 raft_consensus.cc:2749] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:18.141489 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 60916.8us
I20260709 13:14:18.123409 30209 raft_consensus.cc:359] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.136457 29904 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:18.145084 30209 raft_consensus.cc:385] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.145558 30209 raft_consensus.cc:740] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.135308 30212 ts_tablet_manager.cc:1434] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.003s
I20260709 13:14:18.147127 30490 raft_consensus.cc:2749] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.146665 30209 consensus_queue.cc:260] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.168797 30052 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:18.111850 30206 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:18.201180 30206 ts_tablet_manager.cc:1403] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.376s	user 0.017s	sys 0.009s
I20260709 13:14:18.202008 30355 raft_consensus.cc:493] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.202620 30355 raft_consensus.cc:515] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.170795 30494 raft_consensus.cc:515] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.158411 30369 raft_consensus.cc:493] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.165316 30573 consensus_queue.cc:1048] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.179503 30209 ts_tablet_manager.cc:1434] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.003s
I20260709 13:14:18.208783 30355 leader_election.cc:290] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
W20260709 13:14:18.185461 29904 consensus_peers.cc:597] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.205879 30494 leader_election.cc:290] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:18.206257 30369 raft_consensus.cc:515] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.211706 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:18.212380 30369 leader_election.cc:290] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:18.148813 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244205f3a8df4e07b6dd48c47779e712" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:18.207973 30209 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
W20260709 13:14:18.213600 29904 leader_election.cc:343] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.204020 30206 raft_consensus.cc:359] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.212263 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:18.154721 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244205f3a8df4e07b6dd48c47779e712" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:18.216420 30084 raft_consensus.cc:2468] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:18.216533 29937 raft_consensus.cc:2468] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:18.217391 30206 raft_consensus.cc:385] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.217722 30206 raft_consensus.cc:740] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.218397 29904 leader_election.cc:304] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.218434 30206 consensus_queue.cc:260] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.220198 30355 raft_consensus.cc:2804] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.220649 30355 raft_consensus.cc:493] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.221030 30355 raft_consensus.cc:3060] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.221684 30209 tablet_bootstrap.cc:654] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.222147 30206 ts_tablet_manager.cc:1434] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:14:18.223248 30206 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:18.150813 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:18.224242 29935 raft_consensus.cc:2468] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:18.224380 30369 raft_consensus.cc:493] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.183313 30207 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:18.225386 30207 ts_tablet_manager.cc:1403] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.188s	user 0.023s	sys 0.054s
I20260709 13:14:18.225242 30369 raft_consensus.cc:515] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.227403 30486 raft_consensus.cc:2749] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:14:18.229570 30127 consensus_peers.cc:597] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.242493 30369 leader_election.cc:290] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:18.243443 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:18.244902 30053 leader_election.cc:343] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.246740 30207 raft_consensus.cc:359] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.247486 30207 raft_consensus.cc:385] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.247756 30207 raft_consensus.cc:740] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.248435 30207 consensus_queue.cc:260] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
W20260709 13:14:18.241672 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 72961.4us
I20260709 13:14:18.251690 30052 leader_election.cc:304] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:18.252411 30486 raft_consensus.cc:2804] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.252774 30486 raft_consensus.cc:493] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.253077 30486 raft_consensus.cc:3060] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.264951 30486 raft_consensus.cc:515] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.267076 30486 leader_election.cc:290] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:18.267722 30052 leader_election.cc:304] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.269227 30206 tablet_bootstrap.cc:654] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.272637 30486 raft_consensus.cc:2804] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.273571 30486 raft_consensus.cc:493] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.277279 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:18.279026 30486 raft_consensus.cc:3060] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.279302 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:18.280486 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:18.280692 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:18.285168 30084 raft_consensus.cc:3060] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.289829 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:18.292414 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244205f3a8df4e07b6dd48c47779e712" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:18.292951 30084 raft_consensus.cc:2468] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:18.295073 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244205f3a8df4e07b6dd48c47779e712" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:18.295701 29939 raft_consensus.cc:3060] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.269738 30355 raft_consensus.cc:515] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.298278 30355 leader_election.cc:290] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:18.299239 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:18.299779 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:18.320408 30087 raft_consensus.cc:3060] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:18.325320 29904 leader_election.cc:343] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.305199 29939 raft_consensus.cc:2468] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:18.308163 30573 raft_consensus.cc:493] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.328589 30573 raft_consensus.cc:515] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.330856 30573 leader_election.cc:290] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:18.332728 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960d9fe4dcc48798391f67ce47e9f24" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:18.332437 30013 raft_consensus.cc:3060] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.332849 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960d9fe4dcc48798391f67ce47e9f24" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:18.336402 29978 leader_election.cc:304] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:18.341008 30338 raft_consensus.cc:493] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.341538 30338 raft_consensus.cc:515] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.343595 30338 leader_election.cc:290] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:18.345533 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a958826a704e629d021a83d965c74e" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:18.346357 30083 raft_consensus.cc:2393] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in current term 1: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:18.346602 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a958826a704e629d021a83d965c74e" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:18.348287 29978 leader_election.cc:304] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:18.349610 30338 raft_consensus.cc:3060] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.349793 30087 raft_consensus.cc:2468] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:18.313301 30581 raft_consensus.cc:493] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.351945 29904 leader_election.cc:304] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.351855 30581 raft_consensus.cc:515] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.352840 30322 raft_consensus.cc:2804] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.353047 30206 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:18.353358 30322 raft_consensus.cc:697] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:18.353569 30206 ts_tablet_manager.cc:1403] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.131s	user 0.033s	sys 0.028s
I20260709 13:14:18.354275 30322 consensus_queue.cc:237] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.356436 30206 raft_consensus.cc:359] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.357154 30206 raft_consensus.cc:385] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.357431 30206 raft_consensus.cc:740] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.357908 30581 leader_election.cc:290] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:18.358130 30206 consensus_queue.cc:260] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.359054 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:18.360524 30053 leader_election.cc:343] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.360711 30206 ts_tablet_manager.cc:1434] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:18.361829 30206 tablet_bootstrap.cc:492] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:18.363234 30338 raft_consensus.cc:2749] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.364576 30573 raft_consensus.cc:2749] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:18.367929 30127 leader_election.cc:343] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.368357 30206 tablet_bootstrap.cc:654] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.281332 30207 ts_tablet_manager.cc:1434] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260709 13:14:18.362040 30486 raft_consensus.cc:515] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.374985 30207 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:18.376103 30206 tablet_bootstrap.cc:492] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:18.376641 30206 ts_tablet_manager.cc:1403] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
W20260709 13:14:18.317709 30052 leader_election.cc:343] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.377784 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 60113.7us
I20260709 13:14:18.378027 30209 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:18.378527 30209 ts_tablet_manager.cc:1403] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.171s	user 0.021s	sys 0.025s
I20260709 13:14:18.382246 30209 raft_consensus.cc:359] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.383008 30209 raft_consensus.cc:385] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.383312 30209 raft_consensus.cc:740] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
W20260709 13:14:18.383841 30052 leader_election.cc:343] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.384618 30052 leader_election.cc:343] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.385010 30052 leader_election.cc:304] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.384145 30209 consensus_queue.cc:260] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.388077 30209 ts_tablet_manager.cc:1434] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:18.388024 30206 raft_consensus.cc:359] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.389004 30206 raft_consensus.cc:385] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.389321 30206 raft_consensus.cc:740] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.389528 30209 tablet_bootstrap.cc:492] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:18.391659 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:18.394925 30053 leader_election.cc:343] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.389976 30206 consensus_queue.cc:260] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.397228 30486 leader_election.cc:290] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:18.397907 30206 ts_tablet_manager.cc:1434] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:14:18.398983 30127 leader_election.cc:304] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.399686 30581 raft_consensus.cc:2749] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.399719 30419 consensus_queue.cc:1048] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:18.399449 30052 leader_election.cc:343] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.409090 30052 leader_election.cc:343] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.409804 30206 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:18.419345 30206 tablet_bootstrap.cc:654] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.421032 30209 tablet_bootstrap.cc:654] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.418936 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:18.423166 30496 raft_consensus.cc:2804] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.423692 30496 raft_consensus.cc:697] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:18.412519 30207 tablet_bootstrap.cc:654] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.419776 30052 leader_election.cc:304] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:18.432243 30052 leader_election.cc:304] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
W20260709 13:14:18.434449 30052 leader_election.cc:343] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.434865 30052 leader_election.cc:304] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.431912 30496 consensus_queue.cc:237] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.448117 30369 raft_consensus.cc:2749] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.441506 30348 raft_consensus.cc:2749] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.444255 30486 raft_consensus.cc:2804] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.469699 30486 raft_consensus.cc:697] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:18.485215 30486 consensus_queue.cc:237] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.481364 29833 catalog_manager.cc:5697] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:18.490533 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:14:18.514762 29904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 115929us
I20260709 13:14:18.513520 29834 catalog_manager.cc:5697] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.527415 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:18.532994 29935 raft_consensus.cc:3060] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.536767 30586 raft_consensus.cc:493] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.539343 30206 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:18.539880 30206 ts_tablet_manager.cc:1403] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.130s	user 0.027s	sys 0.041s
I20260709 13:14:18.541136 30207 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:18.541616 30207 ts_tablet_manager.cc:1403] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.011s
I20260709 13:14:18.546321 30206 raft_consensus.cc:359] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.547051 30206 raft_consensus.cc:385] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.547333 30206 raft_consensus.cc:740] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.547993 30206 consensus_queue.cc:260] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.550092 30206 ts_tablet_manager.cc:1434] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:14:18.551139 30206 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:18.556737 30348 raft_consensus.cc:493] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.557327 30209 tablet_bootstrap.cc:492] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:18.557327 30206 tablet_bootstrap.cc:654] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.558056 30209 ts_tablet_manager.cc:1403] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.169s	user 0.018s	sys 0.004s
I20260709 13:14:18.557415 30348 raft_consensus.cc:515] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.561944 30348 leader_election.cc:290] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:18.563618 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb1d96bc2a74b3096fcedd6db889969" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:18.565264 30209 raft_consensus.cc:359] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:18.565441 30053 leader_election.cc:343] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.566087 30209 raft_consensus.cc:385] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.566421 30209 raft_consensus.cc:740] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.539012 30586 raft_consensus.cc:515] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.570228 30209 consensus_queue.cc:260] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.570791 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:18.571880 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb1d96bc2a74b3096fcedd6db889969" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:18.582401 30158 raft_consensus.cc:2468] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
I20260709 13:14:18.582495 29937 raft_consensus.cc:2468] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:18.583760 29903 leader_election.cc:304] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:18.585526 30052 leader_election.cc:304] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.586982 30209 ts_tablet_manager.cc:1434] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:14:18.589169 30582 raft_consensus.cc:2804] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.589745 30582 raft_consensus.cc:493] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.590162 30582 raft_consensus.cc:3060] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.590955 30206 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:18.591423 30206 ts_tablet_manager.cc:1403] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.007s
I20260709 13:14:18.593519 30206 raft_consensus.cc:359] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.594206 30206 raft_consensus.cc:385] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.594470 30206 raft_consensus.cc:740] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.595149 30206 consensus_queue.cc:260] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.585115 30586 leader_election.cc:290] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:18.597371 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:18.599442 30209 tablet_bootstrap.cc:492] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:18.586784 30322 raft_consensus.cc:2804] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.561595 29935 raft_consensus.cc:2468] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:18.601066 30206 ts_tablet_manager.cc:1434] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:14:18.601634 29837 catalog_manager.cc:5697] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.602481 30322 raft_consensus.cc:493] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.606411 30322 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.614966 30582 raft_consensus.cc:515] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.621992 30206 tablet_bootstrap.cc:492] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:18.626026 30207 raft_consensus.cc:359] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.627108 30207 raft_consensus.cc:385] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.627562 30207 raft_consensus.cc:740] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.629366 30052 leader_election.cc:304] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.629153 30207 consensus_queue.cc:260] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.631099 30348 raft_consensus.cc:2804] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.631641 30348 raft_consensus.cc:697] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:18.632485 30348 consensus_queue.cc:237] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:18.630789 29904 leader_election.cc:343] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.641474 30322 raft_consensus.cc:515] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.645246 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:18.645871 30159 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.652952 30207 ts_tablet_manager.cc:1434] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.111s	user 0.004s	sys 0.004s
I20260709 13:14:18.653002 30206 tablet_bootstrap.cc:654] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.643829 30322 leader_election.cc:290] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:18.660481 30207 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:18.661679 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:18.663359 29904 leader_election.cc:343] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.663786 30209 tablet_bootstrap.cc:654] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.661075 30495 raft_consensus.cc:493] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.664805 30573 raft_consensus.cc:493] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.659046 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb1d96bc2a74b3096fcedd6db889969" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:18.672890 30573 raft_consensus.cc:515] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.673013 30495 raft_consensus.cc:515] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.676211 30573 leader_election.cc:290] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:18.676636 29937 raft_consensus.cc:3060] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.677817 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4b15c88c1748e9b84a6fbe8dcfb073" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:18.678203 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb1d96bc2a74b3096fcedd6db889969" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:18.679718 30053 leader_election.cc:343] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.683238 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4b15c88c1748e9b84a6fbe8dcfb073" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:18.682557 30582 leader_election.cc:290] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:18.686923 29978 leader_election.cc:304] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:18.688397 30495 leader_election.cc:290] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:18.682108 30159 raft_consensus.cc:2468] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:18.696923 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37416d89f4674706a02df9a84c7f3ae3" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:18.697793 30207 tablet_bootstrap.cc:654] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:18.698316 30127 leader_election.cc:343] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.697772 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37416d89f4674706a02df9a84c7f3ae3" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
W20260709 13:14:18.705914 30126 leader_election.cc:343] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.706528 30126 leader_election.cc:304] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:18.712718 30496 raft_consensus.cc:2749] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.690018 30573 raft_consensus.cc:2749] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.720657 29903 leader_election.cc:304] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.720944 29937 raft_consensus.cc:2468] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:18.723188 30052 leader_election.cc:304] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:18.727545 30322 raft_consensus.cc:2804] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.732218 30322 raft_consensus.cc:697] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:18.733088 30322 consensus_queue.cc:237] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:18.729008 30486 raft_consensus.cc:2804] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.745128 30486 raft_consensus.cc:697] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:18.746060 30486 consensus_queue.cc:237] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.746713 30209 tablet_bootstrap.cc:492] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:18.747263 30209 ts_tablet_manager.cc:1403] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.148s	user 0.023s	sys 0.011s
I20260709 13:14:18.747586 29837 catalog_manager.cc:5697] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.752982 30209 raft_consensus.cc:359] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.753755 30209 raft_consensus.cc:385] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.753996 30209 raft_consensus.cc:740] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.754750 30206 tablet_bootstrap.cc:492] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:18.755240 30206 ts_tablet_manager.cc:1403] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.005s
I20260709 13:14:18.754980 30209 consensus_queue.cc:260] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.758134 30206 raft_consensus.cc:359] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.759073 30206 raft_consensus.cc:385] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.757879 30209 ts_tablet_manager.cc:1434] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:14:18.759423 30206 raft_consensus.cc:740] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.760265 30495 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.762145 30495 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:18.765893 30209 tablet_bootstrap.cc:492] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:18.768741 30496 raft_consensus.cc:493] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.769294 30496 raft_consensus.cc:515] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.769492 30490 consensus_queue.cc:1048] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.771451 30496 leader_election.cc:290] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:18.773356 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789ef1eb3f346e480405a1544cd57d5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:18.774041 30087 raft_consensus.cc:2468] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:18.775184 30011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789ef1eb3f346e480405a1544cd57d5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:18.777453 30209 tablet_bootstrap.cc:654] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.778204 30127 leader_election.cc:304] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
W20260709 13:14:18.779134 30127 leader_election.cc:343] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.779976 30495 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:18.781654 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:18.785646 30011 raft_consensus.cc:3060] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.786909 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:18.788159 29935 raft_consensus.cc:2393] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in current term 1: Already voted for candidate b9712e59a1774be08aa8e368566dcfed in this term.
I20260709 13:14:18.785677 30083 raft_consensus.cc:2393] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:18.780649 30496 raft_consensus.cc:2804] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.790711 30496 raft_consensus.cc:493] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.791082 30496 raft_consensus.cc:3060] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.796619 30127 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:18.800328 30577 raft_consensus.cc:3060] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.809689 30496 raft_consensus.cc:515] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.817112 30577 raft_consensus.cc:2749] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.818645 30009 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.820789 30496 leader_election.cc:290] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:18.833047 30206 consensus_queue.cc:260] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:18.838136 30014 raft_consensus.cc:3060] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.844128 29834 catalog_manager.cc:5697] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.856988 30206 ts_tablet_manager.cc:1434] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.002s
I20260709 13:14:18.867226 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789ef1eb3f346e480405a1544cd57d5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:18.870648 30127 leader_election.cc:343] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.882026 30207 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:18.882694 30207 ts_tablet_manager.cc:1403] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.223s	user 0.009s	sys 0.002s
W20260709 13:14:18.887816 30127 consensus_peers.cc:597] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.890714 30206 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:18.889848 30582 consensus_queue.cc:1048] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:14:18.904500 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789ef1eb3f346e480405a1544cd57d5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:18.905220 30083 raft_consensus.cc:3060] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:18.908051 29904 consensus_peers.cc:597] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.911769 30577 consensus_queue.cc:1048] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.903395 29837 catalog_manager.cc:5697] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.917960 30207 raft_consensus.cc:359] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.918944 30207 raft_consensus.cc:385] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.919286 30207 raft_consensus.cc:740] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.922385 30207 consensus_queue.cc:260] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:18.944145 30419 raft_consensus.cc:493] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.944751 30419 raft_consensus.cc:515] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
W20260709 13:14:18.950760 30605 log.cc:927] Time spent T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:18.962390 30207 ts_tablet_manager.cc:1434] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.003s
I20260709 13:14:18.975224 30207 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:19.072436 30598 raft_consensus.cc:493] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.073168 30598 raft_consensus.cc:515] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.123802 30496 raft_consensus.cc:493] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.124562 30496 raft_consensus.cc:515] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:19.156018 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:19.156790 30086 raft_consensus.cc:2468] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:19.158093 30127 leader_election.cc:304] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:19.158506 30206 tablet_bootstrap.cc:654] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.160465 30577 raft_consensus.cc:2804] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.160945 30577 raft_consensus.cc:493] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.161298 30577 raft_consensus.cc:3060] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.196751 30209 tablet_bootstrap.cc:492] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:19.197326 30209 ts_tablet_manager.cc:1403] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.432s	user 0.081s	sys 0.112s
I20260709 13:14:19.190601 30496 leader_election.cc:290] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:19.203819 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:19.208865 30209 raft_consensus.cc:359] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:19.209645 30209 raft_consensus.cc:385] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.209910 30209 raft_consensus.cc:740] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.210533 30209 consensus_queue.cc:260] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:19.212909 30053 consensus_peers.cc:597] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.217571 30083 raft_consensus.cc:2468] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
W20260709 13:14:19.220216 30053 consensus_peers.cc:597] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:19.223253 30612 log.cc:927] Time spent T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:14:19.220732 30419 leader_election.cc:290] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:19.231961 30209 ts_tablet_manager.cc:1434] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:14:19.233104 30598 leader_election.cc:290] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:19.235828 30207 tablet_bootstrap.cc:654] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.242959 30209 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
W20260709 13:14:19.302925 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 119893us
W20260709 13:14:19.301362 29903 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 114973us
I20260709 13:14:19.325668 30127 leader_election.cc:304] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:19.324051 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39528ca9ed34510aabaa30ddbf33da1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:19.337051 30618 raft_consensus.cc:2804] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.337606 30618 raft_consensus.cc:697] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:19.338433 30618 consensus_queue.cc:237] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:19.340608 30127 leader_election.cc:343] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.346364 30206 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:19.346877 30206 ts_tablet_manager.cc:1403] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.458s	user 0.032s	sys 0.024s
I20260709 13:14:19.356168 30322 raft_consensus.cc:493] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.356784 30322 raft_consensus.cc:515] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:19.357295 30206 raft_consensus.cc:359] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.358022 30206 raft_consensus.cc:385] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.358180 30209 tablet_bootstrap.cc:654] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.358306 30206 raft_consensus.cc:740] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.358803 30322 leader_election.cc:290] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:19.359100 30206 consensus_queue.cc:260] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.361155 30206 ts_tablet_manager.cc:1434] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:14:19.360785 30577 raft_consensus.cc:515] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.370374 30206 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:19.373667 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39528ca9ed34510aabaa30ddbf33da1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:19.376675 30159 raft_consensus.cc:3060] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.377103 30577 leader_election.cc:290] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:19.379649 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:19.384960 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:19.385793 30087 raft_consensus.cc:2468] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
W20260709 13:14:19.387874 29904 leader_election.cc:343] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.389977 30207 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:19.390481 30207 ts_tablet_manager.cc:1403] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.416s	user 0.011s	sys 0.011s
I20260709 13:14:19.392349 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:19.395810 30493 consensus_queue.cc:1048] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:19.397293 30493 consensus_queue.cc:1048] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:19.398727 30207 raft_consensus.cc:359] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.399431 30207 raft_consensus.cc:385] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.399678 30207 raft_consensus.cc:740] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.400336 30207 consensus_queue.cc:260] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.400625 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:19.402670 30207 ts_tablet_manager.cc:1434] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:14:19.403645 30207 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:19.404182 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:19.404884 30087 raft_consensus.cc:2468] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 0.
W20260709 13:14:19.411201 29903 leader_election.cc:343] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.412817 30207 tablet_bootstrap.cc:654] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.415606 30206 tablet_bootstrap.cc:654] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:19.422977 30126 leader_election.cc:343] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:19.425107 30126 leader_election.cc:343] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.427452 29904 leader_election.cc:304] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:19.431766 30127 leader_election.cc:304] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:19.434387 30207 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:19.434916 30207 ts_tablet_manager.cc:1403] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:14:19.421581 29903 leader_election.cc:304] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:19.437829 30207 raft_consensus.cc:359] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.438512 30207 raft_consensus.cc:385] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.438755 30207 raft_consensus.cc:740] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.439160 30617 raft_consensus.cc:2749] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.448578 30207 consensus_queue.cc:260] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.440743 30623 raft_consensus.cc:2804] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.477463 30348 raft_consensus.cc:493] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:19.483583 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 87700.5us
I20260709 13:14:19.478233 30348 raft_consensus.cc:515] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.467954 30629 raft_consensus.cc:2804] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.492328 30209 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:19.493070 30209 ts_tablet_manager.cc:1403] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.253s	user 0.013s	sys 0.007s
I20260709 13:14:19.494374 30010 raft_consensus.cc:3060] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.497121 30348 leader_election.cc:290] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:19.459858 30485 consensus_queue.cc:1048] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:14:19.487232 30629 raft_consensus.cc:493] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.500679 30629 raft_consensus.cc:3060] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.476369 30623 raft_consensus.cc:493] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.520581 30620 raft_consensus.cc:493] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.521130 30620 raft_consensus.cc:515] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.521708 30209 raft_consensus.cc:359] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.522392 30209 raft_consensus.cc:385] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.522648 30209 raft_consensus.cc:740] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.523227 30209 consensus_queue.cc:260] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.536017 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:19.536726 30087 raft_consensus.cc:3060] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.539058 29833 catalog_manager.cc:5697] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.540695 30620 leader_election.cc:290] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:19.506865 30623 raft_consensus.cc:3060] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:19.542479 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 70023.7us
W20260709 13:14:19.543190 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 53045.6us
I20260709 13:14:19.554072 30087 raft_consensus.cc:2468] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
W20260709 13:14:19.556905 29904 leader_election.cc:343] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:19.557951 29904 consensus_peers.cc:597] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.558291 30207 ts_tablet_manager.cc:1434] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.123s	user 0.013s	sys 0.004s
I20260709 13:14:19.565635 30206 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:19.566372 30206 ts_tablet_manager.cc:1403] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.198s	user 0.006s	sys 0.014s
I20260709 13:14:19.557924 30209 ts_tablet_manager.cc:1434] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.002s
I20260709 13:14:19.574007 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:19.574868 29939 raft_consensus.cc:2468] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 0.
I20260709 13:14:19.579752 30207 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:19.531034 30629 raft_consensus.cc:515] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:19.586187 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:19.575464 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:19.570007 30582 consensus_queue.cc:1048] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:14:19.610816 30629 leader_election.cc:290] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:19.614367 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244205f3a8df4e07b6dd48c47779e712" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:19.617376 29934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244205f3a8df4e07b6dd48c47779e712" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:19.579479 30490 raft_consensus.cc:493] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.619145 30490 raft_consensus.cc:515] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.620548 30209 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:19.621248 30490 leader_election.cc:290] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:19.630455 30206 raft_consensus.cc:359] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.631182 30206 raft_consensus.cc:385] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.631438 30206 raft_consensus.cc:740] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
W20260709 13:14:19.631639 30052 leader_election.cc:343] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.647246 30207 tablet_bootstrap.cc:654] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:19.650012 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 83032.8us
I20260709 13:14:19.653745 30206 consensus_queue.cc:260] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.656688 30206 ts_tablet_manager.cc:1434] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 13:14:19.658391 30206 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:19.666002 30623 raft_consensus.cc:515] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:19.665087 30209 tablet_bootstrap.cc:654] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.674156 30127 leader_election.cc:304] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:19.678121 30127 leader_election.cc:304] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
W20260709 13:14:19.686844 29904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 109746us
I20260709 13:14:19.702597 30052 leader_election.cc:304] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:19.707393 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:19.669157 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
W20260709 13:14:19.721967 29904 leader_election.cc:343] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.726485 30493 raft_consensus.cc:2804] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:19.584179 29903 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 144791us
I20260709 13:14:19.730751 30493 raft_consensus.cc:493] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.734720 30493 raft_consensus.cc:3060] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.737491 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:19.738106 30087 raft_consensus.cc:3060] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.733021 30508 raft_consensus.cc:493] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c8ac4f0fa334a16b65c6a52a89b8d49)
I20260709 13:14:19.740463 30508 raft_consensus.cc:515] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:19.743031 30508 leader_election.cc:290] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:19.743641 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:19.743916 30495 raft_consensus.cc:2749] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:19.732198 30619 raft_consensus.cc:2804] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.749884 30619 raft_consensus.cc:697] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:19.750703 30619 consensus_queue.cc:237] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.753093 30087 raft_consensus.cc:2468] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:19.754383 30127 leader_election.cc:304] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:19.755180 30577 raft_consensus.cc:2804] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.755652 30577 raft_consensus.cc:697] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:19.756094 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:19.756523 30577 consensus_queue.cc:237] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:19.733855 30206 tablet_bootstrap.cc:654] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.728637 30623 leader_election.cc:290] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
W20260709 13:14:19.787462 30127 leader_election.cc:343] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.791700 30207 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: No bootstrap required, opened a new log
I20260709 13:14:19.792274 30207 ts_tablet_manager.cc:1403] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.216s	user 0.026s	sys 0.023s
I20260709 13:14:19.795156 30207 raft_consensus.cc:359] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.795868 30207 raft_consensus.cc:385] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.796157 30207 raft_consensus.cc:740] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.800791 30207 consensus_queue.cc:260] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.821373 30207 ts_tablet_manager.cc:1434] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:14:19.885073 30209 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:19.886184 30209 ts_tablet_manager.cc:1403] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.266s	user 0.021s	sys 0.004s
I20260709 13:14:19.888412 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:19.889163 30087 raft_consensus.cc:3060] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.893563 30573 raft_consensus.cc:493] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.894105 30573 raft_consensus.cc:515] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.901293 30087 raft_consensus.cc:2468] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
I20260709 13:14:19.873381 30617 raft_consensus.cc:493] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.920208 29904 leader_election.cc:304] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:19.922210 30485 raft_consensus.cc:2804] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.919430 30209 raft_consensus.cc:359] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.926126 30209 raft_consensus.cc:385] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.926582 30209 raft_consensus.cc:740] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.927328 30209 consensus_queue.cc:260] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.920634 30573 leader_election.cc:290] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:19.943277 30209 ts_tablet_manager.cc:1434] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 13:14:19.930716 30485 raft_consensus.cc:697] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:19.908631 30617 raft_consensus.cc:515] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.949728 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37416d89f4674706a02df9a84c7f3ae3" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:19.970309 29936 raft_consensus.cc:2468] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 0.
I20260709 13:14:19.957882 30419 raft_consensus.cc:493] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.971374 30419 raft_consensus.cc:515] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.973619 30419 leader_election.cc:290] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:19.961525 30206 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:19.973848 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:19.965478 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37416d89f4674706a02df9a84c7f3ae3" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:19.975015 30161 raft_consensus.cc:2468] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 0.
I20260709 13:14:19.976244 30206 ts_tablet_manager.cc:1403] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.318s	user 0.012s	sys 0.004s
I20260709 13:14:19.976737 29978 leader_election.cc:304] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:19.977861 30485 consensus_queue.cc:237] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:19.979103 30206 raft_consensus.cc:359] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.979808 30206 raft_consensus.cc:385] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.980086 30206 raft_consensus.cc:740] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.980718 30206 consensus_queue.cc:260] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:19.981803 30657 raft_consensus.cc:2804] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.982205 30657 raft_consensus.cc:493] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.982527 30657 raft_consensus.cc:3060] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.963397 30493 raft_consensus.cc:515] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:19.986503 30206 ts_tablet_manager.cc:1434] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:19.987160 30083 raft_consensus.cc:2393] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:19.988112 30493 leader_election.cc:290] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
W20260709 13:14:19.990996 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 219012us
I20260709 13:14:19.994234 29939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:19.994874 29939 raft_consensus.cc:2468] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:20.003245 30126 leader_election.cc:304] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:20.004366 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:20.004487 30495 raft_consensus.cc:2804] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.005106 30495 raft_consensus.cc:493] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.005545 30495 raft_consensus.cc:3060] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.005743 30080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:20.006834 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:20.007656 29935 raft_consensus.cc:3060] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:20.013051 30651 log.cc:927] Time spent T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:20.022208 30495 raft_consensus.cc:515] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:20.035511 30419 consensus_queue.cc:1048] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.038839 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:20.053880 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:20.054070 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:19.984956 30617 leader_election.cc:290] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:20.059599 30084 raft_consensus.cc:2393] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 1: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:20.060245 29978 leader_election.cc:304] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:20.069273 30209 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:20.077032 30159 raft_consensus.cc:2393] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 1: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:20.084312 30657 raft_consensus.cc:515] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.086880 30206 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:20.089726 30657 leader_election.cc:290] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:20.090590 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37416d89f4674706a02df9a84c7f3ae3" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:20.091599 30159 raft_consensus.cc:3060] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.098608 30159 raft_consensus.cc:2468] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:20.124330 30209 tablet_bootstrap.cc:654] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.124747 30508 raft_consensus.cc:2749] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:20.126019 29904 leader_election.cc:304] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:20.127136 30322 raft_consensus.cc:3060] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.129285 29904 leader_election.cc:304] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:20.134723 30322 raft_consensus.cc:2749] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.135196 30495 leader_election.cc:290] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:20.136952 29935 raft_consensus.cc:2468] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:20.138080 29978 leader_election.cc:304] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:20.139386 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37416d89f4674706a02df9a84c7f3ae3" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:20.142339 30082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:20.142659 30206 tablet_bootstrap.cc:654] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.142493 30638 raft_consensus.cc:2749] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:20.143299 30127 consensus_peers.cc:597] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:20.144917 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d7a42309c748f0a0ee3236a7e019a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:20.145731 29936 raft_consensus.cc:2393] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:20.141258 29937 raft_consensus.cc:3060] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.143266 30082 raft_consensus.cc:2393] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in current term 1: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:20.140266 30508 raft_consensus.cc:2804] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.154520 30508 raft_consensus.cc:697] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:20.155368 30508 consensus_queue.cc:237] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.161330 29837 catalog_manager.cc:5697] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.163069 29837 catalog_manager.cc:5697] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.174503 29937 raft_consensus.cc:2468] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:20.177234 30638 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.180722 30638 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:20.186877 30348 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.187608 30348 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:20.190255 30348 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:20.192747 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:20.192876 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:20.193517 29937 raft_consensus.cc:2468] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:20.193960 30157 raft_consensus.cc:2468] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:20.194689 30322 raft_consensus.cc:493] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.194926 30052 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:20.195184 30322 raft_consensus.cc:515] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.195719 30348 raft_consensus.cc:2804] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:20.196122 30348 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.196462 30348 raft_consensus.cc:3060] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:20.197333 30322 leader_election.cc:290] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:20.199230 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:20.199493 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:20.199647 30082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:20.200172 30159 raft_consensus.cc:2468] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 1.
W20260709 13:14:20.200819 29903 leader_election.cc:343] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.201704 29903 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:20.202190 30127 leader_election.cc:304] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:20.202569 30322 raft_consensus.cc:2804] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:20.203023 30322 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.203354 30322 raft_consensus.cc:3060] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:20.199273 30638 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:20.209021 30348 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:20.210206 30082 raft_consensus.cc:2393] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 2: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:20.210954 30348 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:20.211424 30322 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:20.213212 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:20.214092 30157 raft_consensus.cc:3060] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:20.215054 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:20.218336 30322 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:20.218521 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:20.219597 29936 raft_consensus.cc:2393] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 2: Already voted for candidate b9712e59a1774be08aa8e368566dcfed in this term.
I20260709 13:14:20.248459 30082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:20.249607 30082 raft_consensus.cc:2393] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 2: Already voted for candidate fca91c8e2c1d4caaaada7f47eb447d63 in this term.
I20260709 13:14:20.253350 29904 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:20.254417 30322 raft_consensus.cc:2749] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:20.277288 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:20.290439 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 88332.1us
I20260709 13:14:20.291095 30629 raft_consensus.cc:2749] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.307193 30052 leader_election.cc:304] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:20.307387 30014 raft_consensus.cc:3060] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.308549 30660 raft_consensus.cc:2804] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.309254 30660 raft_consensus.cc:697] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:20.310349 30660 consensus_queue.cc:237] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:20.316581 30209 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:20.317166 30209 ts_tablet_manager.cc:1403] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.248s	user 0.031s	sys 0.022s
I20260709 13:14:20.319478 30157 raft_consensus.cc:2468] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 2.
I20260709 13:14:20.320444 30209 raft_consensus.cc:359] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:20.335373 30209 raft_consensus.cc:385] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.335690 30209 raft_consensus.cc:740] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.336419 30209 consensus_queue.cc:260] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:20.336767 30052 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
W20260709 13:14:20.321955 29904 leader_election.cc:343] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.323038 30625 raft_consensus.cc:493] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.338122 30348 raft_consensus.cc:2804] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:20.338116 30625 raft_consensus.cc:515] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:20.338838 30348 raft_consensus.cc:697] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:20.339694 30348 consensus_queue.cc:237] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:20.343264 30642 raft_consensus.cc:493] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.343506 30625 leader_election.cc:290] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:20.343905 30642 raft_consensus.cc:515] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.346347 30642 leader_election.cc:290] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:20.346645 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:20.347643 29904 leader_election.cc:304] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:20.348451 30617 raft_consensus.cc:2749] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:20.351953 30053 leader_election.cc:343] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.355120 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39528ca9ed34510aabaa30ddbf33da1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:20.355921 29937 raft_consensus.cc:2468] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:20.357601 30126 leader_election.cc:304] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:20.358676 30629 raft_consensus.cc:2804] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.359064 30629 raft_consensus.cc:493] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.359424 30629 raft_consensus.cc:3060] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.367504 29833 catalog_manager.cc:5697] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 0 to 1, leader changed from <none> to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 1 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.368535 30419 consensus_queue.cc:1048] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:20.334208 30206 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:20.371093 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:20.389230 30052 leader_election.cc:343] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.389359 30206 ts_tablet_manager.cc:1403] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.303s	user 0.062s	sys 0.072s
I20260709 13:14:20.389732 30052 leader_election.cc:304] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:20.390843 30625 raft_consensus.cc:2749] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.392771 30206 raft_consensus.cc:359] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.393965 30206 raft_consensus.cc:385] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.394315 30206 raft_consensus.cc:740] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.395116 30206 consensus_queue.cc:260] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.397531 30206 ts_tablet_manager.cc:1434] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:14:20.375185 30629 raft_consensus.cc:515] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.370375 30209 ts_tablet_manager.cc:1434] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:14:20.400336 29937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39528ca9ed34510aabaa30ddbf33da1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:20.401047 29937 raft_consensus.cc:3060] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.401268 30209 tablet_bootstrap.cc:492] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:20.408489 29835 catalog_manager.cc:5697] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.415160 30209 tablet_bootstrap.cc:654] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.418256 29937 raft_consensus.cc:2468] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:20.420090 30126 leader_election.cc:304] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:20.421092 30419 raft_consensus.cc:2804] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:20.423312 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 82371us
I20260709 13:14:20.425132 30577 consensus_queue.cc:1048] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:20.426817 30209 tablet_bootstrap.cc:492] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:20.427361 30209 ts_tablet_manager.cc:1403] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.003s
I20260709 13:14:20.427397 30419 raft_consensus.cc:697] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:20.428785 30419 consensus_queue.cc:237] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.431104 30209 raft_consensus.cc:359] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:20.432113 30209 raft_consensus.cc:385] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.432425 30209 raft_consensus.cc:740] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.433115 30209 consensus_queue.cc:260] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:20.435698 30209 ts_tablet_manager.cc:1434] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:14:20.436821 30209 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:20.439321 30206 tablet_bootstrap.cc:492] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49: Bootstrap starting.
I20260709 13:14:20.445191 30209 tablet_bootstrap.cc:654] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.444902 30648 consensus_queue.cc:1048] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:20.452450 29837 catalog_manager.cc:5697] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:20.457346 29904 consensus_peers.cc:597] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:20.459022 29837 catalog_manager.cc:5697] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 0 to 2, leader changed from <none> to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.400060 30629 leader_election.cc:290] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:20.464286 30008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39528ca9ed34510aabaa30ddbf33da1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:20.454869 30508 raft_consensus.cc:493] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
W20260709 13:14:20.496141 30127 consensus_peers.cc:597] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:20.497143 30127 leader_election.cc:343] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.482868 30508 raft_consensus.cc:515] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.533241 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39528ca9ed34510aabaa30ddbf33da1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:20.536170 30419 raft_consensus.cc:493] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.536669 30206 tablet_bootstrap.cc:654] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.536733 30419 raft_consensus.cc:515] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.539083 30419 leader_election.cc:290] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:20.542230 30508 leader_election.cc:290] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:20.545565 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:20.548058 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:20.557289 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 58802.7us
I20260709 13:14:20.568009 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:20.568869 29935 raft_consensus.cc:2468] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:20.574720 29978 leader_election.cc:304] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:20.582500 30126 leader_election.cc:304] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
W20260709 13:14:20.586386 29979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 53077.6us
I20260709 13:14:20.570161 29833 catalog_manager.cc:5697] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.561827 30508 raft_consensus.cc:493] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.608958 30657 consensus_queue.cc:1048] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.633163 30657 raft_consensus.cc:2749] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:20.610527 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:20.612214 30009 raft_consensus.cc:3060] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.612977 30642 raft_consensus.cc:2804] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.641536 30642 raft_consensus.cc:493] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.642032 30642 raft_consensus.cc:3060] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:20.630714 29978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 56080.8us
W20260709 13:14:20.661550 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 82473.4us
W20260709 13:14:20.676313 30127 leader_election.cc:343] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.672592 30678 consensus_queue.cc:1048] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:14:20.687851 29979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 72841.8us
I20260709 13:14:20.663242 30508 raft_consensus.cc:515] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:20.699682 30209 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:20.700348 30209 ts_tablet_manager.cc:1403] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.264s	user 0.029s	sys 0.038s
W20260709 13:14:20.713479 29885 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:20.719493 30508 leader_election.cc:290] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:20.723640 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:20.724956 30206 tablet_bootstrap.cc:492] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49: No bootstrap required, opened a new log
I20260709 13:14:20.725503 30206 ts_tablet_manager.cc:1403] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent bootstrapping tablet: real 0.286s	user 0.022s	sys 0.013s
I20260709 13:14:20.725330 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:20.730087 29979 leader_election.cc:304] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:20.733093 30209 raft_consensus.cc:359] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:20.733791 30209 raft_consensus.cc:385] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.734040 30209 raft_consensus.cc:740] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.734699 30508 raft_consensus.cc:2749] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.737519 30642 raft_consensus.cc:515] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.739228 30209 consensus_queue.cc:260] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:20.739977 30206 raft_consensus.cc:359] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:20.742605 30206 raft_consensus.cc:385] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.742901 30206 raft_consensus.cc:740] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.744040 30206 consensus_queue.cc:260] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:20.763135 30642 leader_election.cc:290] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:20.764293 30206 ts_tablet_manager.cc:1434] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 13:14:20.765548 30010 raft_consensus.cc:3060] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.777105 30209 ts_tablet_manager.cc:1434] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:14:20.778060 30679 consensus_queue.cc:1048] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:20.780144 30657 raft_consensus.cc:493] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c8ac4f0fa334a16b65c6a52a89b8d49)
I20260709 13:14:20.780700 30657 raft_consensus.cc:515] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:20.782562 30127 leader_election.cc:343] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.783344 30657 leader_election.cc:290] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:20.784652 29938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:20.785318 29938 raft_consensus.cc:3060] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.790799 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:20.792941 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789ef1eb3f346e480405a1544cd57d5" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:20.793720 30127 leader_election.cc:343] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.796577 30209 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:20.807515 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789ef1eb3f346e480405a1544cd57d5" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:20.810930 29978 leader_election.cc:304] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:20.811535 30348 consensus_queue.cc:1048] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:20.812327 30657 raft_consensus.cc:2749] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:20.815207 30209 tablet_bootstrap.cc:654] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.841042 29938 raft_consensus.cc:2468] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:20.897809 30126 leader_election.cc:304] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:20.907069 30495 raft_consensus.cc:2804] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.910543 30657 raft_consensus.cc:493] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.911108 30657 raft_consensus.cc:515] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:20.913282 30657 leader_election.cc:290] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:20.916916 30495 raft_consensus.cc:697] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:20.917999 30495 consensus_queue.cc:237] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.926261 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:20.937307 30127 consensus_peers.cc:597] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:20.957885 30209 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:20.958451 30209 ts_tablet_manager.cc:1403] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.162s	user 0.010s	sys 0.026s
I20260709 13:14:20.962855 30209 raft_consensus.cc:359] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.963562 30209 raft_consensus.cc:385] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.963838 30209 raft_consensus.cc:740] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.965178 30209 consensus_queue.cc:260] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:20.974620 29935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:20.978981 30209 ts_tablet_manager.cc:1434] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:14:20.980139 30209 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:20.983278 29978 leader_election.cc:304] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:20.985783 30657 raft_consensus.cc:2749] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.992621 30209 tablet_bootstrap.cc:654] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.995523 30495 consensus_queue.cc:1048] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.004290 29834 catalog_manager.cc:5697] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.006841 30660 consensus_queue.cc:1048] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:21.020010 30209 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:21.020573 30209 ts_tablet_manager.cc:1403] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.006s
I20260709 13:14:21.023859 29935 raft_consensus.cc:1275] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Refusing update from remote peer fca91c8e2c1d4caaaada7f47eb447d63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:21.024287 30209 raft_consensus.cc:359] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:21.024956 30209 raft_consensus.cc:385] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.025197 30209 raft_consensus.cc:740] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.025892 30209 consensus_queue.cc:260] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:21.035897 30209 ts_tablet_manager.cc:1434] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:14:21.036954 30209 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:21.040971 30348 consensus_queue.cc:1048] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.046350 30156 raft_consensus.cc:1275] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer fca91c8e2c1d4caaaada7f47eb447d63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:21.047928 30348 consensus_queue.cc:1048] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.061606 30209 tablet_bootstrap.cc:654] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.089103 30007 raft_consensus.cc:3060] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.106271 30209 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:21.106825 30209 ts_tablet_manager.cc:1403] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.002s
I20260709 13:14:21.111737 30209 raft_consensus.cc:359] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:21.112448 30209 raft_consensus.cc:385] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.112705 30209 raft_consensus.cc:740] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.113333 30209 consensus_queue.cc:260] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:21.114805 30209 ts_tablet_manager.cc:1434] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 13:14:21.115778 30209 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:21.123739 30209 tablet_bootstrap.cc:654] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.160899 30209 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:21.161520 30209 ts_tablet_manager.cc:1403] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.015s
I20260709 13:14:21.164448 30209 raft_consensus.cc:359] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:21.165509 30209 raft_consensus.cc:385] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.165803 30209 raft_consensus.cc:740] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.166533 30209 consensus_queue.cc:260] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:21.170372 30209 ts_tablet_manager.cc:1434] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:21.171417 30209 tablet_bootstrap.cc:492] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:21.177388 30209 tablet_bootstrap.cc:654] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.195312 30209 tablet_bootstrap.cc:492] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:21.195814 30209 ts_tablet_manager.cc:1403] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
I20260709 13:14:21.197896 30209 raft_consensus.cc:359] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:21.198351 30209 raft_consensus.cc:385] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.198503 30209 raft_consensus.cc:740] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.199033 30209 consensus_queue.cc:260] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:21.201838 30209 ts_tablet_manager.cc:1434] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:21.203548 30209 tablet_bootstrap.cc:492] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:21.209327 30209 tablet_bootstrap.cc:654] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.213280 30495 raft_consensus.cc:493] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.213910 30495 raft_consensus.cc:515] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:21.216343 30495 leader_election.cc:290] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:21.219379 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:21.220220 30088 raft_consensus.cc:2468] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 0.
I20260709 13:14:21.222164 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:21.224205 30127 leader_election.cc:343] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:21.225111 30127 leader_election.cc:304] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:21.229311 30577 raft_consensus.cc:2804] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:21.229699 30577 raft_consensus.cc:493] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.230021 30577 raft_consensus.cc:3060] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.234553 30209 tablet_bootstrap.cc:492] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:21.235146 30209 ts_tablet_manager.cc:1403] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 13:14:21.237267 30657 raft_consensus.cc:493] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.237819 30657 raft_consensus.cc:515] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:21.239874 30657 leader_election.cc:290] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:21.240453 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:21.241367 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:21.243428 29979 leader_election.cc:304] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:21.244117 30209 raft_consensus.cc:359] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:21.244864 30209 raft_consensus.cc:385] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.245139 30209 raft_consensus.cc:740] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.245852 30209 consensus_queue.cc:260] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:21.247081 30007 raft_consensus.cc:3060] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.247959 30209 ts_tablet_manager.cc:1434] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:14:21.249735 30209 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36: Bootstrap starting.
I20260709 13:14:21.246227 30657 raft_consensus.cc:2749] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:21.255791 30209 tablet_bootstrap.cc:654] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.257639 30577 raft_consensus.cc:515] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:21.261133 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:21.261735 30009 raft_consensus.cc:3060] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.269009 30009 raft_consensus.cc:2468] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:21.269742 30209 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36: No bootstrap required, opened a new log
I20260709 13:14:21.269697 30577 leader_election.cc:290] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:21.270640 30209 ts_tablet_manager.cc:1403] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:14:21.270767 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:21.271216 30127 leader_election.cc:304] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:21.271409 30088 raft_consensus.cc:3060] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.273732 30577 raft_consensus.cc:2804] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:21.274109 30209 raft_consensus.cc:359] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:21.275801 30209 raft_consensus.cc:385] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.278348 30209 raft_consensus.cc:740] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.274228 30577 raft_consensus.cc:697] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:21.279556 30577 consensus_queue.cc:237] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:21.281298 30209 consensus_queue.cc:260] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:21.283825 30209 ts_tablet_manager.cc:1434] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:14:21.286043 30088 raft_consensus.cc:2468] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:21.326294 29833 catalog_manager.cc:5697] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 1 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.332449 30007 raft_consensus.cc:3060] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.358865 30009 raft_consensus.cc:3060] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.404822 30577 consensus_queue.cc:1048] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.416411 30009 raft_consensus.cc:3060] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.422359 30508 raft_consensus.cc:493] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.422945 30508 raft_consensus.cc:515] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:21.425264 30508 leader_election.cc:290] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:21.425874 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:21.427851 29936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:21.429389 29978 leader_election.cc:304] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:21.431033 30508 raft_consensus.cc:2749] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:21.431653 30419 consensus_queue.cc:1048] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.437618 30007 raft_consensus.cc:3060] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.440426 30009 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.730751 30419 consensus_queue.cc:1048] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.750504 30618 consensus_queue.cc:1048] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:22.844442 20199 tablet_server.cc:179] TabletServer@127.19.185.193:0 shutting down...
W20260709 13:14:22.851984 30126 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 322 similar messages]
W20260709 13:14:22.862215 30126 consensus_peers.cc:597] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:22.865912 30126 consensus_peers.cc:597] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.899389 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:22.902185 20199 tablet_replica.cc:333] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.902964 20199 raft_consensus.cc:2243] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.903620 20199 raft_consensus.cc:2272] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.905305 30126 consensus_peers.cc:597] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.906302 20199 tablet_replica.cc:333] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.907420 20199 raft_consensus.cc:2243] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.908104 20199 raft_consensus.cc:2272] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.907588 30126 consensus_peers.cc:597] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:22.910225 30052 consensus_peers.cc:597] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.910879 20199 tablet_replica.cc:333] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.911641 20199 raft_consensus.cc:2243] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.912176 20199 raft_consensus.cc:2272] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.914899 20199 tablet_replica.cc:333] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.916014 20199 raft_consensus.cc:2243] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.917204 20199 raft_consensus.cc:2272] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.917793 30052 consensus_peers.cc:597] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.919608 20199 tablet_replica.cc:333] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.920593 20199 raft_consensus.cc:2243] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.921031 20199 raft_consensus.cc:2272] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.923007 20199 tablet_replica.cc:333] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.923599 20199 raft_consensus.cc:2243] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.924404 20199 raft_consensus.cc:2272] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.926424 20199 tablet_replica.cc:333] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.927109 20199 raft_consensus.cc:2243] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.927660 20199 raft_consensus.cc:2272] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.929679 29978 consensus_peers.cc:597] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.930099 20199 tablet_replica.cc:333] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.930760 20199 raft_consensus.cc:2243] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.931264 20199 raft_consensus.cc:2272] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.933238 20199 tablet_replica.cc:333] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.933933 20199 raft_consensus.cc:2243] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.934298 20199 raft_consensus.cc:2272] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.936002 20199 tablet_replica.cc:333] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.936646 20199 raft_consensus.cc:2243] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.937463 20199 raft_consensus.cc:2272] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.939451 20199 tablet_replica.cc:333] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.940099 20199 raft_consensus.cc:2243] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:22.940120 30052 consensus_peers.cc:597] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.940608 20199 raft_consensus.cc:2272] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.942371 20199 tablet_replica.cc:333] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.942981 20199 raft_consensus.cc:2243] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.943650 20199 raft_consensus.cc:2272] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.945426 20199 tablet_replica.cc:333] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.946055 20199 raft_consensus.cc:2243] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.946491 20199 raft_consensus.cc:2272] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.948458 20199 tablet_replica.cc:333] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.949031 20199 raft_consensus.cc:2243] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.949928 20199 raft_consensus.cc:2272] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.951858 20199 tablet_replica.cc:333] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.952545 20199 raft_consensus.cc:2243] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.952962 20199 raft_consensus.cc:2272] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.954679 20199 tablet_replica.cc:333] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.955252 20199 raft_consensus.cc:2243] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.955986 20199 raft_consensus.cc:2272] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.957669 20199 tablet_replica.cc:333] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.958247 20199 raft_consensus.cc:2243] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.958910 20199 raft_consensus.cc:2272] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.960645 20199 tablet_replica.cc:333] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.961148 20199 raft_consensus.cc:2243] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.961575 20199 raft_consensus.cc:2272] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.963927 20199 tablet_replica.cc:333] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.964578 20199 raft_consensus.cc:2243] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.965035 20199 raft_consensus.cc:2272] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.965525 29978 consensus_peers.cc:597] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.967070 20199 tablet_replica.cc:333] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.967702 20199 raft_consensus.cc:2243] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.968152 20199 raft_consensus.cc:2272] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.970057 20199 tablet_replica.cc:333] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.970609 20199 raft_consensus.cc:2243] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.971009 20199 raft_consensus.cc:2272] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.973022 20199 tablet_replica.cc:333] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.973752 20199 raft_consensus.cc:2243] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.974687 20199 raft_consensus.cc:2272] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.976931 29978 consensus_peers.cc:597] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.977088 20199 tablet_replica.cc:333] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.978195 20199 raft_consensus.cc:2243] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.978718 20199 raft_consensus.cc:2272] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.978832 30126 consensus_peers.cc:597] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.981133 20199 tablet_replica.cc:333] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.982102 20199 raft_consensus.cc:2243] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.982672 20199 raft_consensus.cc:2272] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.985416 20199 tablet_replica.cc:333] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.986222 20199 raft_consensus.cc:2243] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.986721 20199 raft_consensus.cc:2272] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.989182 20199 tablet_replica.cc:333] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.989965 20199 raft_consensus.cc:2243] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.990463 20199 raft_consensus.cc:2272] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.992724 20199 tablet_replica.cc:333] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.993548 20199 raft_consensus.cc:2243] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.994093 20199 raft_consensus.cc:2272] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.996876 20199 tablet_replica.cc:333] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:22.997603 20199 raft_consensus.cc:2243] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.998133 20199 raft_consensus.cc:2272] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.000839 20199 tablet_replica.cc:333] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.001602 20199 raft_consensus.cc:2243] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.002153 20199 raft_consensus.cc:2272] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:23.004627 30126 consensus_peers.cc:597] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.005589 20199 tablet_replica.cc:333] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.006577 20199 raft_consensus.cc:2243] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.007586 20199 raft_consensus.cc:2272] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.010630 20199 tablet_replica.cc:333] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.011442 20199 raft_consensus.cc:2243] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.011801 20199 raft_consensus.cc:2272] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.013473 20199 tablet_replica.cc:333] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.013958 20199 raft_consensus.cc:2243] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.014287 20199 raft_consensus.cc:2272] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.015985 20199 tablet_replica.cc:333] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.016559 20199 raft_consensus.cc:2243] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.017834 20199 raft_consensus.cc:2272] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.022045 20199 tablet_replica.cc:333] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.022778 20199 raft_consensus.cc:2243] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.023329 20199 raft_consensus.cc:2272] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.025859 20199 tablet_replica.cc:333] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.026448 20199 raft_consensus.cc:2243] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.027177 20199 raft_consensus.cc:2272] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.029340 20199 tablet_replica.cc:333] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.030076 20199 raft_consensus.cc:2243] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.030920 20199 raft_consensus.cc:2272] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.033214 20199 tablet_replica.cc:333] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.033775 20199 raft_consensus.cc:2243] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.034185 20199 raft_consensus.cc:2272] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.036361 20199 tablet_replica.cc:333] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.037109 20199 raft_consensus.cc:2243] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.037969 20199 raft_consensus.cc:2272] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.040349 20199 tablet_replica.cc:333] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.041083 20199 raft_consensus.cc:2243] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.042001 20199 raft_consensus.cc:2272] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.044637 20199 tablet_replica.cc:333] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
W20260709 13:14:23.045075 30052 consensus_peers.cc:597] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.045421 20199 raft_consensus.cc:2243] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.046305 20199 raft_consensus.cc:2272] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.048350 20199 tablet_replica.cc:333] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.048899 20199 raft_consensus.cc:2243] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.049310 20199 raft_consensus.cc:2272] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.051358 20199 tablet_replica.cc:333] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.051877 20199 raft_consensus.cc:2243] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.052372 20199 raft_consensus.cc:2272] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.054517 20199 tablet_replica.cc:333] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.055022 20199 raft_consensus.cc:2243] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.055423 20199 raft_consensus.cc:2272] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.057320 20199 tablet_replica.cc:333] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.057821 20199 raft_consensus.cc:2243] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.058229 20199 raft_consensus.cc:2272] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.060145 20199 tablet_replica.cc:333] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: stopping tablet replica
I20260709 13:14:23.060608 20199 raft_consensus.cc:2243] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.061357 20199 raft_consensus.cc:2272] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:23.067188 30126 consensus_peers.cc:597] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.082072 30052 consensus_peers.cc:597] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.119131 30126 consensus_peers.cc:597] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.136837 30126 consensus_peers.cc:597] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.137223 30126 consensus_peers.cc:597] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.142560 20199 tablet_server.cc:196] TabletServer@127.19.185.193:0 shutdown complete.
W20260709 13:14:23.148200 30052 consensus_peers.cc:597] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.174713 30052 consensus_peers.cc:597] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.180447 30052 consensus_peers.cc:597] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.188192 30052 consensus_peers.cc:597] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.193015 30126 consensus_peers.cc:597] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.209774 30052 consensus_peers.cc:597] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.217778 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:23.225914 30731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:23.226001 30729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:23.226460 30728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:23.229322 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:23.234198 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:23.234529 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:23.234773 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602863234746 us; error 0 us; skew 500 ppm
I20260709 13:14:23.235507 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:23.240310 20199 webserver.cc:533] Webserver started at http://127.19.185.193:33811/ using document root <none> and password file <none>
I20260709 13:14:23.240967 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:23.241214 20199 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:14:23.245885 20199 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:23.255396 30736 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.257450 20199 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:14:23.257838 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "b9712e59a1774be08aa8e368566dcfed"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-rrf3"
I20260709 13:14:23.258415 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:23.275877 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:23.277241 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:23.278884 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:23.284387 30743 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:14:23.294835 30126 consensus_peers.cc:597] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.321069 30126 consensus_peers.cc:597] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.352324 30126 consensus_peers.cc:597] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.377372 30052 consensus_peers.cc:597] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:23.404976 30052 consensus_peers.cc:597] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.563952 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:14:23.564465 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.281s	user 0.010s	sys 0.000s
I20260709 13:14:23.564790 20199 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:14:23.570415 30743 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.583737 30743 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.584508 30743 tablet_bootstrap.cc:492] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.585001 30743 ts_tablet_manager.cc:1403] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:14:23.587247 30743 raft_consensus.cc:359] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.587918 30743 raft_consensus.cc:740] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.588649 30743 consensus_queue.cc:260] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.596910 30743 ts_tablet_manager.cc:1434] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.004s
I20260709 13:14:23.597764 30743 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.612540 30743 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.613428 30743 tablet_bootstrap.cc:492] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.614025 30743 ts_tablet_manager.cc:1403] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:14:23.616691 30743 raft_consensus.cc:359] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.617347 30743 raft_consensus.cc:740] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.618062 30743 consensus_queue.cc:260] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.619899 30743 ts_tablet_manager.cc:1434] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:14:23.620663 30743 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.641007 30743 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.641942 30743 tablet_bootstrap.cc:492] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.642545 30743 ts_tablet_manager.cc:1403] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:14:23.644929 30743 raft_consensus.cc:359] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.645601 30743 raft_consensus.cc:740] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.646350 30743 consensus_queue.cc:260] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.648244 30743 ts_tablet_manager.cc:1434] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:14:23.648990 30743 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.676503 30743 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.677435 30743 tablet_bootstrap.cc:492] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.678061 30743 ts_tablet_manager.cc:1403] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.012s
I20260709 13:14:23.680558 30743 raft_consensus.cc:359] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.681257 30743 raft_consensus.cc:740] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.681933 30743 consensus_queue.cc:260] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.683812 30743 ts_tablet_manager.cc:1434] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:23.684616 30743 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.705744 30743 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.706694 30743 tablet_bootstrap.cc:492] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.707310 30743 ts_tablet_manager.cc:1403] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 13:14:23.709882 30743 raft_consensus.cc:359] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:23.710561 30743 raft_consensus.cc:740] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.711169 30743 consensus_queue.cc:260] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:23.712987 30743 ts_tablet_manager.cc:1434] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:14:23.713761 30743 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.728262 30743 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.729183 30743 tablet_bootstrap.cc:492] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.729803 30743 ts_tablet_manager.cc:1403] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:14:23.732232 30743 raft_consensus.cc:359] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:23.732892 30743 raft_consensus.cc:740] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.733542 30743 consensus_queue.cc:260] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:23.735366 30743 ts_tablet_manager.cc:1434] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:23.736194 30743 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.753908 30743 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.754980 30743 tablet_bootstrap.cc:492] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.755643 30743 ts_tablet_manager.cc:1403] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:14:23.757989 30743 raft_consensus.cc:359] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.758644 30743 raft_consensus.cc:740] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.759295 30743 consensus_queue.cc:260] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.761315 30743 ts_tablet_manager.cc:1434] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:14:23.762073 30743 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.775974 30743 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.776897 30743 tablet_bootstrap.cc:492] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.777539 30743 ts_tablet_manager.cc:1403] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:14:23.779947 30743 raft_consensus.cc:359] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.780651 30743 raft_consensus.cc:740] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.781344 30743 consensus_queue.cc:260] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.783453 30743 ts_tablet_manager.cc:1434] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:23.784274 30743 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.799330 30743 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.800359 30743 tablet_bootstrap.cc:492] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.801370 30743 ts_tablet_manager.cc:1403] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:14:23.804060 30743 raft_consensus.cc:359] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.804797 30743 raft_consensus.cc:740] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.805640 30743 consensus_queue.cc:260] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.809757 30743 ts_tablet_manager.cc:1434] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:23.810595 30743 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.830725 30743 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.831665 30743 tablet_bootstrap.cc:492] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.832326 30743 ts_tablet_manager.cc:1403] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:14:23.835309 30743 raft_consensus.cc:359] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.836001 30743 raft_consensus.cc:740] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.841166 30743 consensus_queue.cc:260] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.843360 30743 ts_tablet_manager.cc:1434] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.004s
I20260709 13:14:23.844139 30743 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.866587 30743 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.867403 30743 tablet_bootstrap.cc:492] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.868144 30743 ts_tablet_manager.cc:1403] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:14:23.870318 30743 raft_consensus.cc:359] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.870852 30743 raft_consensus.cc:740] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.871500 30743 consensus_queue.cc:260] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.873544 30743 ts_tablet_manager.cc:1434] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:23.874482 30743 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.877424 20199 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:14:23.877847 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.313s	user 0.270s	sys 0.000s
I20260709 13:14:23.896899 30743 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.897838 30743 tablet_bootstrap.cc:492] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.898456 30743 ts_tablet_manager.cc:1403] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 13:14:23.901353 30743 raft_consensus.cc:359] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.902034 30743 raft_consensus.cc:740] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.902706 30743 consensus_queue.cc:260] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.905694 30743 ts_tablet_manager.cc:1434] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:23.906497 30743 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.932399 30508 raft_consensus.cc:493] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:23.933058 30508 raft_consensus.cc:515] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:23.935268 30508 leader_election.cc:290] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:23.936719 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ad95d8d5e43d9888dc66173bdae9c" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:23.940061 29978 leader_election.cc:336] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:23.940531 29978 leader_election.cc:304] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:23.941506 30743 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.941859 30508 raft_consensus.cc:2749] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:23.942487 30743 tablet_bootstrap.cc:492] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.943192 30743 ts_tablet_manager.cc:1403] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.008s
I20260709 13:14:23.945891 30743 raft_consensus.cc:359] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.946573 30743 raft_consensus.cc:740] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.947363 30743 consensus_queue.cc:260] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:23.949465 30743 ts_tablet_manager.cc:1434] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:23.950259 30743 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:23.958285 30660 raft_consensus.cc:493] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:23.959121 30660 raft_consensus.cc:515] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:23.963407 30660 leader_election.cc:290] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:23.970360 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:23.971601 30743 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.972688 30743 tablet_bootstrap.cc:492] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:23.973379 30743 ts_tablet_manager.cc:1403] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:14:23.975986 30743 raft_consensus.cc:359] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.976797 30743 raft_consensus.cc:740] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.977676 30743 consensus_queue.cc:260] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:23.979852 30743 ts_tablet_manager.cc:1434] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:14:23.980959 30743 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
W20260709 13:14:23.986027 30052 leader_election.cc:336] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:23.995527 30052 leader_election.cc:304] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:23.996415 30660 raft_consensus.cc:2749] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.117515 30743 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:24.123375 30743 tablet_bootstrap.cc:492] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:24.124406 30743 ts_tablet_manager.cc:1403] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.029s
I20260709 13:14:24.121536 30746 raft_consensus.cc:493] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.129374 30746 raft_consensus.cc:515] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:24.129768 30508 raft_consensus.cc:493] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.130333 30508 raft_consensus.cc:515] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.131512 30746 leader_election.cc:290] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.134560 30508 leader_election.cc:290] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:24.145867 30419 raft_consensus.cc:493] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.145586 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.146440 30419 raft_consensus.cc:515] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
W20260709 13:14:24.153824 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 140653us
I20260709 13:14:24.157292 30743 raft_consensus.cc:359] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.165597 30743 raft_consensus.cc:740] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.146382 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.166970 30743 consensus_queue.cc:260] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
W20260709 13:14:24.169893 29978 leader_election.cc:336] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.170428 29978 leader_election.cc:304] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.170603 30743 ts_tablet_manager.cc:1434] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:14:24.155736 30785 raft_consensus.cc:493] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.171286 30785 raft_consensus.cc:515] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.171708 30743 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
W20260709 13:14:24.171610 29978 leader_election.cc:336] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.172271 29978 leader_election.cc:304] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:24.173480 30785 leader_election.cc:290] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.173626 30746 raft_consensus.cc:2749] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.174408 30746 raft_consensus.cc:2749] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.176820 30419 leader_election.cc:290] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.177163 30782 raft_consensus.cc:493] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.177716 30782 raft_consensus.cc:515] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.179869 30782 leader_election.cc:290] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.181443 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
W20260709 13:14:24.189746 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 43524.2us
I20260709 13:14:24.194121 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.194849 30083 raft_consensus.cc:2468] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
W20260709 13:14:24.205771 30126 leader_election.cc:336] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
W20260709 13:14:24.206403 30126 leader_election.cc:336] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.212687 30419 raft_consensus.cc:493] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.213229 30419 raft_consensus.cc:515] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.204438 30660 raft_consensus.cc:493] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.216279 30127 leader_election.cc:304] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.208431 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:24.218515 30618 raft_consensus.cc:2804] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.218874 30618 raft_consensus.cc:493] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.219149 30618 raft_consensus.cc:3060] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.221071 30781 raft_consensus.cc:493] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
W20260709 13:14:24.221921 30052 leader_election.cc:336] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.221696 30781 raft_consensus.cc:515] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:24.222398 30052 leader_election.cc:304] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.228063 30786 raft_consensus.cc:493] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.228892 30419 leader_election.cc:290] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.231060 30127 leader_election.cc:304] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.228621 30786 raft_consensus.cc:515] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.232331 30419 raft_consensus.cc:2749] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.232978 30746 raft_consensus.cc:493] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.228916 30781 leader_election.cc:290] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.244269 30784 raft_consensus.cc:493] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.243701 30746 raft_consensus.cc:515] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:24.244861 30784 raft_consensus.cc:515] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.247485 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.229849 30785 raft_consensus.cc:2749] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.217929 30660 raft_consensus.cc:515] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.254729 30746 leader_election.cc:290] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.251292 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:24.256608 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.257347 30156 raft_consensus.cc:2468] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:24.258630 30786 leader_election.cc:290] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:24.259294 30660 leader_election.cc:290] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
W20260709 13:14:24.264464 30126 leader_election.cc:336] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
W20260709 13:14:24.266084 29978 leader_election.cc:336] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.265386 30126 leader_election.cc:304] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.267776 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:24.268018 30126 leader_election.cc:336] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.268460 30083 raft_consensus.cc:2468] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:24.268548 30126 leader_election.cc:304] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:24.269878 29979 leader_election.cc:304] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.270917 30780 raft_consensus.cc:2749] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.271433 30786 raft_consensus.cc:493] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.271981 30780 raft_consensus.cc:2749] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.271904 30746 raft_consensus.cc:2804] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.272647 30746 raft_consensus.cc:493] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.274217 30746 raft_consensus.cc:3060] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.272069 30786 raft_consensus.cc:515] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:24.276825 30743 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:24.277155 30786 leader_election.cc:290] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.276886 30784 leader_election.cc:290] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.277817 29978 leader_election.cc:304] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:24.277850 30743 tablet_bootstrap.cc:492] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:24.279261 30743 ts_tablet_manager.cc:1403] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.008s
I20260709 13:14:24.280392 30786 raft_consensus.cc:2804] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.280685 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.269359 30660 raft_consensus.cc:493] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.281517 30660 raft_consensus.cc:515] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.280821 30786 raft_consensus.cc:493] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.282500 30786 raft_consensus.cc:3060] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.282725 30618 raft_consensus.cc:515] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.284940 30618 leader_election.cc:290] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
W20260709 13:14:24.286324 29978 leader_election.cc:336] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
W20260709 13:14:24.288636 30052 leader_election.cc:336] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
W20260709 13:14:24.290931 29978 leader_election.cc:336] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.291567 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:24.288830 30660 leader_election.cc:290] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.281834 30743 raft_consensus.cc:359] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.293093 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:24.294389 30088 raft_consensus.cc:3060] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.295409 30743 raft_consensus.cc:740] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.297816 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.298134 30743 consensus_queue.cc:260] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.298584 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381657a3006a4f52b1268ecae19b2922" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.299683 30156 raft_consensus.cc:2393] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 2: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:24.291494 29978 leader_election.cc:304] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.297821 30618 raft_consensus.cc:493] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.303934 30743 ts_tablet_manager.cc:1434] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:14:24.301595 30618 raft_consensus.cc:515] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.304908 30743 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:24.306484 30618 leader_election.cc:290] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.307542 30793 raft_consensus.cc:2749] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.307534 30660 raft_consensus.cc:493] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.309944 30660 raft_consensus.cc:515] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.313844 30660 leader_election.cc:290] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.301728 30746 raft_consensus.cc:515] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.314311 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
W20260709 13:14:24.315332 30126 leader_election.cc:336] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.316463 30746 leader_election.cc:290] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:24.315382 30007 raft_consensus.cc:2393] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 2: Already voted for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in this term.
I20260709 13:14:24.317518 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.333269 30083 raft_consensus.cc:2468] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:24.318887 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1860b4022529422197e01c32e02598f4" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:24.334190 30084 raft_consensus.cc:3060] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.335948 30088 raft_consensus.cc:2468] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:24.319891 30782 raft_consensus.cc:493] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.321831 30720 raft_consensus.cc:493] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.337626 30720 raft_consensus.cc:515] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
W20260709 13:14:24.335991 30126 leader_election.cc:336] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.339327 30127 leader_election.cc:304] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.339840 30720 leader_election.cc:290] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
W20260709 13:14:24.322340 30052 leader_election.cc:336] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.340269 30618 raft_consensus.cc:2804] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:24.340574 30052 leader_election.cc:336] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.341069 30052 leader_election.cc:304] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.341508 30127 leader_election.cc:304] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.324950 30793 raft_consensus.cc:493] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.342824 30793 raft_consensus.cc:515] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.345028 30793 leader_election.cc:290] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:24.345785 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:24.346681 30787 raft_consensus.cc:2804] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.346693 30007 raft_consensus.cc:2468] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:24.347270 30787 raft_consensus.cc:697] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:24.347774 30720 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.348223 30787 consensus_queue.cc:237] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.348719 30720 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.349762 30052 leader_election.cc:304] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.353490 30720 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.337579 30782 raft_consensus.cc:515] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.340651 30618 raft_consensus.cc:493] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.360738 30618 raft_consensus.cc:3060] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.362659 30782 leader_election.cc:290] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.356307 30660 raft_consensus.cc:2749] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.357733 30052 leader_election.cc:304] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.363821 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:24.327000 29978 leader_election.cc:336] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.366816 30660 raft_consensus.cc:2749] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.368475 30746 raft_consensus.cc:493] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.369063 30746 raft_consensus.cc:515] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.371116 30746 leader_election.cc:290] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:24.371588 30746 raft_consensus.cc:493] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.372014 30746 raft_consensus.cc:515] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.372781 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.373718 30088 raft_consensus.cc:2468] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:24.375267 29979 leader_election.cc:304] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.376047 30793 raft_consensus.cc:2804] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.376135 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.327054 30784 raft_consensus.cc:493] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.376497 30793 raft_consensus.cc:493] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.399070 30719 raft_consensus.cc:493] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.403178 30793 raft_consensus.cc:3060] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.403447 30719 raft_consensus.cc:515] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.402364 30508 raft_consensus.cc:493] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.404588 30508 raft_consensus.cc:515] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:24.405721 30719 leader_election.cc:290] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.406697 30508 leader_election.cc:290] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.406855 30792 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.407433 30792 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
W20260709 13:14:24.408002 30052 leader_election.cc:336] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.408540 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:24.409248 30010 raft_consensus.cc:2468] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:24.409524 30792 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.410764 30053 leader_election.cc:304] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.410995 30618 raft_consensus.cc:515] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.376935 30088 raft_consensus.cc:2468] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:24.359452 30743 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:24.412676 29979 leader_election.cc:304] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.356196 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.413719 30083 raft_consensus.cc:2468] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:24.414578 30508 raft_consensus.cc:2804] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.415069 30508 raft_consensus.cc:493] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.415521 30508 raft_consensus.cc:3060] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.406422 30784 raft_consensus.cc:515] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.359481 30084 raft_consensus.cc:2468] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:24.417434 30785 raft_consensus.cc:2749] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.412897 30743 tablet_bootstrap.cc:492] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:24.418941 30743 ts_tablet_manager.cc:1403] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.114s	user 0.020s	sys 0.000s
I20260709 13:14:24.421384 30743 raft_consensus.cc:359] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.427645 30743 raft_consensus.cc:740] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.429561 30784 leader_election.cc:290] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
W20260709 13:14:24.391852 29978 leader_election.cc:336] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.411515 30792 raft_consensus.cc:2804] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.421537 29979 leader_election.cc:304] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.412098 30052 leader_election.cc:304] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed
W20260709 13:14:24.612838 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 204851us
I20260709 13:14:24.489770 29978 leader_election.cc:304] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:24.358681 30127 leader_election.cc:304] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
W20260709 13:14:24.719736 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 361109us
W20260709 13:14:24.721071 30126 leader_election.cc:336] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
W20260709 13:14:24.722762 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 361301us
I20260709 13:14:24.541358 30820 raft_consensus.cc:493] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.447016 30508 raft_consensus.cc:515] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.428580 30743 consensus_queue.cc:260] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.376065 30746 leader_election.cc:290] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:24.322461 30786 raft_consensus.cc:515] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:24.746686 30786 leader_election.cc:290] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.444123 30793 raft_consensus.cc:515] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.750324 30793 leader_election.cc:290] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:24.435120 30618 leader_election.cc:290] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.372615 30660 raft_consensus.cc:493] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.755432 30660 raft_consensus.cc:515] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.758065 30660 leader_election.cc:290] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.489792 30792 raft_consensus.cc:493] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.619170 30828 raft_consensus.cc:2804] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:14:24.619047 29979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 197580us
I20260709 13:14:24.657572 30832 raft_consensus.cc:2749] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.763067 30828 raft_consensus.cc:697] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:24.670495 30831 raft_consensus.cc:493] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.670907 29835 catalog_manager.cc:5697] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.764017 30828 consensus_queue.cc:237] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.764343 30831 raft_consensus.cc:515] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.762579 30127 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.675019 30830 raft_consensus.cc:2749] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.723836 30820 raft_consensus.cc:515] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.726111 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.726886 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:24.771327 30083 raft_consensus.cc:3060] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.731472 30783 raft_consensus.cc:2804] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.735335 30743 ts_tablet_manager.cc:1434] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.316s	user 0.009s	sys 0.000s
I20260709 13:14:24.777541 30783 raft_consensus.cc:493] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.778038 30783 raft_consensus.cc:3060] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.778656 30743 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:24.780381 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:24.736737 30781 raft_consensus.cc:493] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.738117 30780 raft_consensus.cc:493] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.739090 30508 leader_election.cc:290] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
W20260709 13:14:24.741199 30052 leader_election.cc:336] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.790066 30084 raft_consensus.cc:2468] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
W20260709 13:14:24.793596 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 52454.7us
W20260709 13:14:24.794044 30052 leader_election.cc:336] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
W20260709 13:14:24.794487 30052 leader_election.cc:336] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.794565 30781 raft_consensus.cc:515] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.796916 30781 leader_election.cc:290] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.799170 30780 raft_consensus.cc:515] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
W20260709 13:14:24.800566 30052 leader_election.cc:336] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.788245 30085 raft_consensus.cc:3060] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:24.801182 30052 leader_election.cc:336] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
I20260709 13:14:24.801589 30780 leader_election.cc:290] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.803340 30820 leader_election.cc:290] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.758607 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.759646 30792 raft_consensus.cc:3060] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:24.667901 29978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 276283us
I20260709 13:14:24.766659 30618 raft_consensus.cc:2804] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.811326 30618 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.811769 30618 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.814461 30792 raft_consensus.cc:515] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.815471 30085 raft_consensus.cc:2468] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:24.767961 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:24.817519 30088 raft_consensus.cc:3060] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.772858 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ad95d8d5e43d9888dc66173bdae9c" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:24.825441 30618 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.818732 30007 raft_consensus.cc:2468] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
W20260709 13:14:24.771725 30126 leader_election.cc:336] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111)
W20260709 13:14:24.828560 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 56871.7us
I20260709 13:14:24.836490 30083 raft_consensus.cc:2468] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:24.804193 30831 leader_election.cc:290] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.842268 30618 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.849496 30088 raft_consensus.cc:2468] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:24.844224 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:38129
I20260709 13:14:24.853865 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:24.854928 30157 raft_consensus.cc:3060] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.845095 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.856715 30162 raft_consensus.cc:2468] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
I20260709 13:14:24.861966 29978 leader_election.cc:304] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:24.863478 30127 leader_election.cc:304] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.864578 30419 raft_consensus.cc:2804] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.864877 30792 leader_election.cc:290] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.864952 30419 raft_consensus.cc:493] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.865537 30419 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.865738 30508 raft_consensus.cc:2804] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.866156 30508 raft_consensus.cc:493] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.866515 30508 raft_consensus.cc:3060] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.867091 30127 leader_election.cc:304] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.868019 30156 raft_consensus.cc:2393] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 2: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:24.869138 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:24.869813 30007 raft_consensus.cc:2468] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:24.872870 30781 raft_consensus.cc:2804] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.873817 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:24.874442 30088 raft_consensus.cc:2468] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:24.878487 30080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:24.879174 30080 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.883118 30012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:24.883827 30012 raft_consensus.cc:2468] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:24.887562 30781 raft_consensus.cc:697] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:24.888219 30053 leader_election.cc:304] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.888583 30781 consensus_queue.cc:237] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.890586 30834 raft_consensus.cc:2804] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.890980 30834 raft_consensus.cc:493] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.891331 30834 raft_consensus.cc:3060] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.895306 30008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:24.895985 30008 raft_consensus.cc:3060] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.899001 30127 leader_election.cc:304] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.899885 30780 raft_consensus.cc:2804] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.900321 30780 raft_consensus.cc:493] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.900671 30780 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.894202 30053 leader_election.cc:304] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.904757 30419 raft_consensus.cc:515] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.907048 30419 leader_election.cc:290] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.909067 30832 raft_consensus.cc:2804] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.910841 30832 raft_consensus.cc:493] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.911193 30832 raft_consensus.cc:3060] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.907266 29833 catalog_manager.cc:5697] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.910207 30080 raft_consensus.cc:2468] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:24.913239 30508 raft_consensus.cc:515] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:24.915535 30508 leader_election.cc:290] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.910427 30008 raft_consensus.cc:2468] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 2.
I20260709 13:14:24.917830 30157 raft_consensus.cc:2468] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:24.917752 30783 raft_consensus.cc:515] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:24.919234 30832 raft_consensus.cc:515] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.916457 29979 leader_election.cc:304] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.921365 30053 leader_election.cc:304] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.921782 29979 leader_election.cc:304] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.922760 30793 raft_consensus.cc:2804] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.922976 30785 raft_consensus.cc:2804] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.923394 30793 raft_consensus.cc:697] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:24.924232 30785 raft_consensus.cc:697] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:24.924731 30793 consensus_queue.cc:237] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.925256 30785 consensus_queue.cc:237] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.926030 30508 raft_consensus.cc:2804] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.932160 30508 raft_consensus.cc:697] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:24.938695 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.940645 30783 leader_election.cc:290] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.936889 30844 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:38129 every 8 connection(s)
I20260709 13:14:24.939558 30162 raft_consensus.cc:2468] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 1.
I20260709 13:14:24.942904 30052 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:24.951161 30660 raft_consensus.cc:2749] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.952286 30052 leader_election.cc:304] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.953478 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:24.953998 30745 raft_consensus.cc:2804] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:24.954314 30007 raft_consensus.cc:3060] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.954465 30745 raft_consensus.cc:493] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:24.955014 30745 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.955124 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:24.942167 30832 leader_election.cc:290] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:24.973230 30007 raft_consensus.cc:2468] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 2.
I20260709 13:14:24.975394 30053 leader_election.cc:304] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:24.933424 30508 consensus_queue.cc:237] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.963547 30745 raft_consensus.cc:515] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:24.938901 30834 raft_consensus.cc:515] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:24.996237 30745 leader_election.cc:290] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:24.980147 30719 raft_consensus.cc:2804] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.003491 30743 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:25.009202 30743 tablet_bootstrap.cc:492] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:25.010231 30743 ts_tablet_manager.cc:1403] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.232s	user 0.021s	sys 0.000s
I20260709 13:14:24.997787 30834 leader_election.cc:290] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:25.000502 30719 raft_consensus.cc:697] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:25.012085 30719 consensus_queue.cc:237] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:25.014936 30846 log.cc:927] Time spent T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:14:25.021073 30743 raft_consensus.cc:359] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.021915 30743 raft_consensus.cc:740] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.022727 30743 consensus_queue.cc:260] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.024837 30743 ts_tablet_manager.cc:1434] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:25.025687 30743 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:25.025713 30780 raft_consensus.cc:515] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.028053 30780 leader_election.cc:290] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:25.075076 29978 leader_election.cc:304] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
W20260709 13:14:25.077597 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 151902us
I20260709 13:14:25.078208 30007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ad95d8d5e43d9888dc66173bdae9c" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:25.093242 30007 raft_consensus.cc:3060] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.093281 30127 leader_election.cc:304] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:25.094687 30751 raft_consensus.cc:493] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.095932 30751 raft_consensus.cc:515] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.081372 30156 raft_consensus.cc:2393] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fca91c8e2c1d4caaaada7f47eb447d63 in current term 2: Already voted for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in this term.
I20260709 13:14:25.096731 30508 raft_consensus.cc:2804] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.087811 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:25.111392 30781 raft_consensus.cc:2804] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:25.112054 30781 raft_consensus.cc:493] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9712e59a1774be08aa8e368566dcfed)
I20260709 13:14:25.112527 30781 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.129037 30751 leader_election.cc:290] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:25.131147 30127 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:25.131574 30157 raft_consensus.cc:3060] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.133214 30849 raft_consensus.cc:2804] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.133956 30849 raft_consensus.cc:697] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:25.139896 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:25.141099 30162 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.141693 30849 consensus_queue.cc:237] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.143337 30508 raft_consensus.cc:697] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:25.145062 30508 consensus_queue.cc:237] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.149209 30008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:25.150382 30008 raft_consensus.cc:3060] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.186796 30083 raft_consensus.cc:1275] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.190336 30082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:25.191327 30082 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.192800 30080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:25.193833 30080 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.259584 30419 consensus_queue.cc:1048] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:25.268646 30751 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.275476 30751 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.279110 30751 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:25.272611 30162 raft_consensus.cc:2468] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 2.
I20260709 13:14:25.332439 30007 raft_consensus.cc:2468] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 2.
I20260709 13:14:25.291775 30751 raft_consensus.cc:493] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.319758 30080 raft_consensus.cc:2468] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:25.346267 30082 raft_consensus.cc:2468] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:25.348969 30052 leader_election.cc:304] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca91c8e2c1d4caaaada7f47eb447d63; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:25.353322 30820 raft_consensus.cc:2749] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:25.354732 30781 raft_consensus.cc:515] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.356216 30052 leader_election.cc:304] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:25.362413 30820 raft_consensus.cc:2804] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.363166 30820 raft_consensus.cc:697] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:25.365173 30008 raft_consensus.cc:2468] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:25.367080 30781 leader_election.cc:290] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Requested vote from peers b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:25.366532 29834 catalog_manager.cc:5697] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.371541 30751 raft_consensus.cc:515] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.374270 30751 leader_election.cc:290] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:25.374850 30751 raft_consensus.cc:493] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.387192 30157 raft_consensus.cc:2468] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:25.364598 30820 consensus_queue.cc:237] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.375435 30751 raft_consensus.cc:515] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.405695 29978 leader_election.cc:304] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:25.407269 30508 raft_consensus.cc:2804] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.408665 30508 raft_consensus.cc:697] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:25.411080 30508 consensus_queue.cc:237] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.420280 30751 leader_election.cc:290] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:25.421898 30869 raft_consensus.cc:493] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.422394 30751 raft_consensus.cc:493] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.422801 30869 raft_consensus.cc:515] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.423094 30751 raft_consensus.cc:515] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.437058 30869 leader_election.cc:290] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:25.439836 30751 leader_election.cc:290] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:25.443424 30743 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:25.444876 30743 tablet_bootstrap.cc:492] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:25.445405 30810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93319818a15f4d37a35a004c1f533803" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.445858 30743 ts_tablet_manager.cc:1403] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.420s	user 0.021s	sys 0.029s
I20260709 13:14:25.471347 29834 catalog_manager.cc:5697] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.472389 30085 raft_consensus.cc:1275] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.474885 30751 raft_consensus.cc:493] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.482577 30127 leader_election.cc:304] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:25.476300 30010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:25.487221 29834 catalog_manager.cc:5697] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.498313 30873 raft_consensus.cc:493] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.498755 30874 raft_consensus.cc:493] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.538837 30010 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.543167 30127 leader_election.cc:304] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:25.545121 30849 raft_consensus.cc:2804] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.545722 30849 raft_consensus.cc:697] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:25.546731 30873 raft_consensus.cc:515] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:25.546854 30849 consensus_queue.cc:237] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.549602 30873 leader_election.cc:290] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:25.547813 30618 consensus_queue.cc:1048] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:14:25.551386 30751 raft_consensus.cc:515] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.554637 30751 leader_election.cc:290] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:25.558495 30869 raft_consensus.cc:493] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.566119 30419 raft_consensus.cc:2804] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.573650 30419 raft_consensus.cc:697] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:25.577046 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13ad599db1d42519e573887087d5a0f" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.577924 30811 raft_consensus.cc:3060] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.579917 30053 leader_election.cc:304] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:25.580127 30809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:25.561836 30873 raft_consensus.cc:493] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:25.602468 30053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 123422us
W20260709 13:14:25.603801 30183 debug-util.cc:398] Leaking SignalData structure 0x7b0800131800 after lost signal to thread 20202
I20260709 13:14:25.571372 30869 raft_consensus.cc:515] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.606702 30869 leader_election.cc:290] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:25.606369 30873 raft_consensus.cc:515] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.607329 30869 raft_consensus.cc:493] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.582188 30751 raft_consensus.cc:493] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.616118 30719 raft_consensus.cc:2804] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.611182 30419 consensus_queue.cc:237] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.582736 30874 raft_consensus.cc:515] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.621217 30080 raft_consensus.cc:1275] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.622377 30082 raft_consensus.cc:1275] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.624454 30874 leader_election.cc:290] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:25.624672 30807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.607908 30869 raft_consensus.cc:515] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.627005 30719 raft_consensus.cc:697] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Becoming Leader. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:25.639765 30719 consensus_queue.cc:237] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:25.640703 30869 leader_election.cc:290] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:25.619115 30743 raft_consensus.cc:359] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.645197 30743 raft_consensus.cc:740] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.646190 30743 consensus_queue.cc:260] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.634600 30751 raft_consensus.cc:515] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:25.654198 30160 raft_consensus.cc:1275] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.654585 30809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5ad95d8d5e43d9888dc66173bdae9c" candidate_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.655414 30082 raft_consensus.cc:1275] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.656524 30793 consensus_queue.cc:1048] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.666011 30857 heartbeater.cc:344] Connected to a master server at 127.19.185.254:34975
I20260709 13:14:25.651933 30873 leader_election.cc:290] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:25.650933 30010 raft_consensus.cc:2468] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:25.669111 30508 consensus_queue.cc:1048] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:14:25.690912 30810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.691565 30810 raft_consensus.cc:3060] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.675335 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196c8778ba948e3a8684b5b06a20876" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.685931 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.693264 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.693365 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.676082 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.676275 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.677038 30161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.679684 30793 consensus_queue.cc:1048] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:14:25.696144 30161 raft_consensus.cc:2393] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9712e59a1774be08aa8e368566dcfed in current term 2: Already voted for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in this term.
I20260709 13:14:25.677201 30159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.678228 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.668279 30014 raft_consensus.cc:1275] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer fca91c8e2c1d4caaaada7f47eb447d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.682005 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.686957 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.687358 30809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:25.688818 30807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:25.690127 30808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.689956 30828 consensus_queue.cc:1048] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:25.691664 30857 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:25.659834 30811 raft_consensus.cc:2468] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca91c8e2c1d4caaaada7f47eb447d63 in term 2.
I20260709 13:14:25.732091 30857 heartbeater.cc:507] Master 127.19.185.254:34975 requested a full tablet report, sending...
I20260709 13:14:25.733346 30810 raft_consensus.cc:2468] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
W20260709 13:14:25.735442 30875 log.cc:927] Time spent T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:14:25.673302 30743 ts_tablet_manager.cc:1434] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.227s	user 0.006s	sys 0.003s
I20260709 13:14:25.739733 30127 leader_election.cc:304] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:25.743705 30751 leader_election.cc:290] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:25.736732 30807 raft_consensus.cc:2468] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 1.
W20260709 13:14:25.760403 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 79372.2us
I20260709 13:14:25.760499 30618 raft_consensus.cc:2804] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.766302 30618 raft_consensus.cc:697] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:25.767237 30618 consensus_queue.cc:237] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:25.762142 30784 consensus_queue.cc:1048] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:25.771689 30808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.769927 30751 raft_consensus.cc:493] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.772410 30808 raft_consensus.cc:3060] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.772526 30751 raft_consensus.cc:515] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:25.774844 30751 leader_election.cc:290] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:25.775563 30807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7459878da0fd4511bdb65ad263c4697e" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.777648 30809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:25.780309 30014 raft_consensus.cc:1275] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer fca91c8e2c1d4caaaada7f47eb447d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.782650 30803 raft_consensus.cc:1275] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Refusing update from remote peer fca91c8e2c1d4caaaada7f47eb447d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.799398 30801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:25.804738 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d3f73348f4deca6026b42f4e83fab" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:25.808274 30803 raft_consensus.cc:3060] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.809134 30809 raft_consensus.cc:1275] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.813989 30085 raft_consensus.cc:1275] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:25.824361 29979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:42729, user_credentials={real_user=slave}} blocked reactor thread for 57028.2us
I20260709 13:14:25.827913 30809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
W20260709 13:14:25.822001 30052 leader_election.cc:343] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.832475 30801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:25.833523 30801 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:25.855149 30053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 47536.1us
I20260709 13:14:25.865737 30743 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
W20260709 13:14:25.866739 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 44821.6us
I20260709 13:14:25.868284 30153 raft_consensus.cc:1275] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.866156 30781 consensus_queue.cc:1048] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:14:25.994735 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 124397us
I20260709 13:14:26.014362 30508 consensus_queue.cc:1048] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.014707 29834 catalog_manager.cc:5697] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.010310 30127 leader_election.cc:304] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
W20260709 13:14:26.029474 30052 leader_election.cc:343] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:26.031769 30052 leader_election.cc:343] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:26.033035 30052 leader_election.cc:343] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.040597 29834 catalog_manager.cc:5697] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.999979 30801 raft_consensus.cc:2468] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
W20260709 13:14:26.038003 30052 consensus_peers.cc:597] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:26.015118 30808 raft_consensus.cc:2468] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:26.055578 30834 consensus_queue.cc:1048] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:14:26.043646 30849 raft_consensus.cc:2804] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:26.058127 30849 raft_consensus.cc:697] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:26.059141 30849 consensus_queue.cc:237] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:26.074681 30820 consensus_queue.cc:1048] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:26.074527 30052 consensus_peers.cc:597] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:26.077553 30888 log.cc:927] Time spent T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:14:26.050738 29834 catalog_manager.cc:5697] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.145495 30005 raft_consensus.cc:1275] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer fca91c8e2c1d4caaaada7f47eb447d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.130993 30155 raft_consensus.cc:1275] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer fca91c8e2c1d4caaaada7f47eb447d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.162355 30803 raft_consensus.cc:1275] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:26.197907 30053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 98849.9us
I20260709 13:14:26.195654 30820 consensus_queue.cc:1048] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:14:26.232342 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 76865.6us
W20260709 13:14:26.247174 30052 consensus_peers.cc:597] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:26.248234 30052 consensus_peers.cc:597] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.266299 30010 raft_consensus.cc:1275] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:26.267709 30893 log.cc:927] Time spent T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:14:26.269196 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:26.269946 30811 raft_consensus.cc:2468] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 1.
I20260709 13:14:26.289402 30803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e23d4c3c2b4b57b9e83c088db43d8c" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:26.290270 30895 consensus_queue.cc:1048] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:14:26.313866 30052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.196:46305, user_credentials={real_user=slave}} blocked reactor thread for 64539.1us
I20260709 13:14:26.323449 30801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:26.323879 30804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:26.325069 30806 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.323561 30808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
W20260709 13:14:26.337652 29978 leader_election.cc:343] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.325338 30803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
I20260709 13:14:26.343345 30806 raft_consensus.cc:1275] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:26.344937 29978 consensus_peers.cc:597] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.332170 30811 raft_consensus.cc:1275] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.332383 29833 catalog_manager.cc:5697] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.354733 29833 catalog_manager.cc:5697] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:26.356257 29978 consensus_peers.cc:597] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:26.374400 29978 leader_election.cc:343] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.372133 29833 catalog_manager.cc:5697] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:26.397228 30053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 140409us
I20260709 13:14:26.381273 29833 catalog_manager.cc:5697] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.415714 30086 raft_consensus.cc:1275] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.418805 30088 raft_consensus.cc:1275] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.434561 30419 consensus_queue.cc:1048] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:26.456341 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 48516.7us
I20260709 13:14:26.456952 30911 consensus_queue.cc:1048] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.457190 30618 consensus_queue.cc:1048] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:26.457700 30126 leader_election.cc:343] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:26.470904 29978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 96527.6us
W20260709 13:14:26.477288 30052 consensus_peers.cc:597] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:26.539891 30052 consensus_peers.cc:597] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:26.570734 30743 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:26.580547 29835 ts_manager.cc:194] Re-registered known tserver with Master: b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129)
I20260709 13:14:26.602610 30743 tablet_bootstrap.cc:492] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:26.603466 30743 ts_tablet_manager.cc:1403] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.774s	user 0.046s	sys 0.043s
W20260709 13:14:26.618688 29978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 76527.6us
W20260709 13:14:26.623188 30126 leader_election.cc:343] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.624688 30902 consensus_queue.cc:1048] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:26.631542 30904 consensus_queue.cc:1048] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:14:26.645308 30126 consensus_peers.cc:597] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:26.646497 30126 consensus_peers.cc:597] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:26.653499 30126 consensus_peers.cc:597] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:26.654067 30126 leader_election.cc:343] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.659035 30743 raft_consensus.cc:359] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:26.660528 30743 raft_consensus.cc:740] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.661193 30743 consensus_queue.cc:260] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
W20260709 13:14:26.672070 30126 leader_election.cc:343] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.665974 30809 raft_consensus.cc:1275] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.681309 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:26.682070 30788 consensus_queue.cc:1048] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:26.682775 30781 consensus_queue.cc:1048] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.680335 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196c8778ba948e3a8684b5b06a20876" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:26.698823 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7c6f3de6904607952cb2b6c95d45a5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:26.700129 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449e14ef64d34e178c4b2a56e512e761" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:26.702721 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:26.704066 30006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6438e7353ed64f82b4991b777c290e39" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:26.706847 30006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:26.707867 30809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed" is_pre_election: true
I20260709 13:14:26.708194 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" is_pre_election: true
I20260709 13:14:26.713173 30811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a07a99809b452d97abd212707856e4" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
W20260709 13:14:26.810161 30126 consensus_peers.cc:597] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:26.812059 30126 consensus_peers.cc:597] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:26.812654 30126 leader_election.cc:343] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.820909 30739 leader_election.cc:304] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:26.822263 30739 leader_election.cc:304] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
W20260709 13:14:26.822502 30126 leader_election.cc:343] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.823541 30739 leader_election.cc:304] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:26.875072 29834 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38220 (request call id 100) took 1092 ms. Trace:
I20260709 13:14:26.872004 30869 raft_consensus.cc:2749] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:26.881261 30743 ts_tablet_manager.cc:1434] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.278s	user 0.021s	sys 0.022s
I20260709 13:14:26.887128 30743 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:26.812917 30908 consensus_queue.cc:1048] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:14:26.894098 30948 log.cc:927] Time spent T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:14:26.963646 30949 raft_consensus.cc:2749] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:26.931308 30869 raft_consensus.cc:2749] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:26.882040 29834 rpcz_store.cc:276] 0709 13:14:25.780496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.811023 (+ 30527us) service_pool.cc:224] Handling call
0709 13:14:26.824251 (+1013228us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:26.184921 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:26.185715 (+   794us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:26.185762 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:14:26.185790 (+    28us) tablet.cc:662] Decoding operations
0709 13:14:26.186539 (+   749us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:26.186640 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:26.186681 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:14:26.187104 (+   423us) tablet.cc:701] Row locks acquired
0709 13:14:26.187129 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:14:26.187313 (+   184us) write_op.cc:270] Start()
0709 13:14:26.187448 (+   135us) write_op.cc:276] Timestamp: P: 1783602866187254 usec, L: 0
0709 13:14:26.187477 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:14:26.199114 (+ 11637us) log.cc:844] Serialized 1325 byte log entry
0709 13:14:26.325025 (+125911us) op_driver.cc:464] REPLICATION: finished
0709 13:14:26.474553 (+149528us) write_op.cc:301] APPLY: starting
0709 13:14:26.478743 (+  4190us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:26.483582 (+  4839us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:26.555815 (+ 72233us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:26.582088 (+ 26273us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:26.582276 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:14:26.582325 (+    49us) write_op.cc:312] APPLY: finished
0709 13:14:26.582535 (+   210us) log.cc:844] Serialized 34 byte log entry
0709 13:14:26.582688 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:26.582770 (+    82us) write_op.cc:454] Released schema lock
0709 13:14:26.582807 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:26.597621 (+ 14814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:26.599953 (+  2332us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":182777,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":124283,"apply.run_cpu_time_us":7896,"apply.run_wall_time_us":114013,"mutex_wait_us":6747,"num_ops":3,"prepare.queue_time_us":66923,"prepare.run_cpu_time_us":3956,"prepare.run_wall_time_us":28857,"replication_time_us":124834,"thread_start_us":133139,"threads_started":2}]]}
I20260709 13:14:27.004017 30869 raft_consensus.cc:493] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fca91c8e2c1d4caaaada7f47eb447d63)
I20260709 13:14:27.012714 30869 raft_consensus.cc:515] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.015141 30869 leader_election.cc:290] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:27.086973 30011 raft_consensus.cc:1275] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:27.087114 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d8796d68924971b6214133c03fef63" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" is_pre_election: true
I20260709 13:14:27.088629 30082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:27.009960 30739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 186497us
I20260709 13:14:27.133859 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3677eacee9c41669b921c2143570547" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:27.137343 30087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340f6e2bf07e464a9f0c78041367953d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:27.142584 30080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f4bfb894ab1b6890463f034478b" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:27.147418 30942 log.cc:927] Time spent T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63: Append to log took a long time: real 0.185s	user 0.002s	sys 0.002s
I20260709 13:14:27.148660 30080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d3f73348f4deca6026b42f4e83fab" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:27.149255 30052 consensus_peers.cc:597] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:27.150025 30052 consensus_peers.cc:597] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:27.151147 30052 consensus_peers.cc:597] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:27.161194 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:27.132356 30739 leader_election.cc:304] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:27.187644 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
W20260709 13:14:27.208854 30946 log.cc:927] Time spent T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260709 13:14:27.219523 30958 raft_consensus.cc:2749] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:27.220717 30739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 102401us
I20260709 13:14:27.243121 30739 leader_election.cc:304] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:27.244300 30958 raft_consensus.cc:2749] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.235741 30082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b95bfcf7cd48e5aa9e14f40f7b9118" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:27.271021 30739 leader_election.cc:304] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:27.275348 30958 raft_consensus.cc:2749] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.281419 30783 consensus_queue.cc:1048] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:27.289005 29837 catalog_manager.cc:5697] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.307475 29837 catalog_manager.cc:5697] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.312834 29837 catalog_manager.cc:5697] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:27.327606 30052 consensus_peers.cc:597] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:27.319489 29837 catalog_manager.cc:5697] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 1 to 2, leader changed from b9712e59a1774be08aa8e368566dcfed (127.19.185.193) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:27.372104 29978 consensus_peers.cc:597] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:27.373843 30743 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:14:27.375829 30126 consensus_peers.cc:597] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:27.378037 30743 tablet_bootstrap.cc:492] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.379051 30743 ts_tablet_manager.cc:1403] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.496s	user 0.015s	sys 0.009s
W20260709 13:14:27.380004 30126 consensus_peers.cc:597] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.385485 30739 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.387972 30958 raft_consensus.cc:2749] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:27.386075 30126 consensus_peers.cc:597] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:27.385947 30743 raft_consensus.cc:359] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.388481 30739 leader_election.cc:304] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.376821 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d8796d68924971b6214133c03fef63" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" is_pre_election: true
I20260709 13:14:27.391613 30739 leader_election.cc:304] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.392557 30869 raft_consensus.cc:2749] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.393276 30869 raft_consensus.cc:2749] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.394598 30739 leader_election.cc:304] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.395444 30869 raft_consensus.cc:2749] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:27.389371 30743 raft_consensus.cc:740] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.398236 30743 consensus_queue.cc:260] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.409953 30805 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.416432 30739 leader_election.cc:304] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.417394 30958 raft_consensus.cc:2749] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.418951 30739 leader_election.cc:304] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.410511 30743 ts_tablet_manager.cc:1434] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:14:27.419689 30958 raft_consensus.cc:2749] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.420825 30739 leader_election.cc:304] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.421712 30958 raft_consensus.cc:2749] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.422215 30739 leader_election.cc:304] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.423066 30958 raft_consensus.cc:2749] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.423601 30739 leader_election.cc:304] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed; no voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, fca91c8e2c1d4caaaada7f47eb447d63
I20260709 13:14:27.424453 30958 raft_consensus.cc:2749] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.428550 30743 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
W20260709 13:14:27.434511 30126 consensus_peers.cc:597] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:27.452956 30743 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.454159 30743 tablet_bootstrap.cc:492] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.454972 30743 ts_tablet_manager.cc:1403] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.009s
I20260709 13:14:27.457901 30743 raft_consensus.cc:359] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:27.458834 30743 raft_consensus.cc:740] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.460165 30743 consensus_queue.cc:260] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:27.462916 30743 ts_tablet_manager.cc:1434] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:27.463891 30743 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:27.492199 29837 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38222 (request call id 121) took 1099 ms. Trace:
I20260709 13:14:27.492726 29837 rpcz_store.cc:276] 0709 13:14:26.393228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.394773 (+  1545us) service_pool.cc:224] Handling call
0709 13:14:26.480167 (+ 85394us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54009d7bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf182090 00007fc2bf220f3a 00007fc2c4fd71cc 00007fc2c50d537e 00007fc2c35962a4 00007fc2c3596232 00007fc2c3596161 00007fc2c35960dc 00007fc2c3595392 00007fc2bd55348c 00007fc2bd5528c6
0709 13:14:27.492115 (+1011948us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:27.398472 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:27.425133 (+ 26661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:27.425188 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:14:27.425211 (+    23us) tablet.cc:662] Decoding operations
0709 13:14:27.425917 (+   706us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:27.425984 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:27.426017 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:14:27.426440 (+   423us) tablet.cc:701] Row locks acquired
0709 13:14:27.426460 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:14:27.426623 (+   163us) write_op.cc:270] Start()
0709 13:14:27.426750 (+   127us) write_op.cc:276] Timestamp: P: 1783602867426579 usec, L: 0
0709 13:14:27.426778 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:14:27.427468 (+   690us) log.cc:844] Serialized 1717 byte log entry
0709 13:14:27.444365 (+ 16897us) op_driver.cc:464] REPLICATION: finished
0709 13:14:27.454184 (+  9819us) write_op.cc:301] APPLY: starting
0709 13:14:27.454283 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:27.454457 (+   174us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:27.454593 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:27.455164 (+   571us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:27.455363 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:14:27.455416 (+    53us) write_op.cc:312] APPLY: finished
0709 13:14:27.455644 (+   228us) log.cc:844] Serialized 40 byte log entry
0709 13:14:27.472244 (+ 16600us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:27.472407 (+   163us) write_op.cc:454] Released schema lock
0709 13:14:27.472466 (+    59us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":11,"spinlock_wait_cycles":45817600,"child_traces":[["op",{"apply.queue_time_us":9531,"num_ops":4,"prepare.queue_time_us":37716,"prepare.run_cpu_time_us":4243,"prepare.run_wall_time_us":42363,"replication_time_us":17399,"thread_start_us":34855,"threads_started":2}]]}
I20260709 13:14:27.498706 30743 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.499745 30743 tablet_bootstrap.cc:492] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.500407 30743 ts_tablet_manager.cc:1403] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.008s
I20260709 13:14:27.502974 30743 raft_consensus.cc:359] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:27.503765 30743 raft_consensus.cc:740] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.504630 30743 consensus_queue.cc:260] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:27.508669 30743 ts_tablet_manager.cc:1434] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:14:27.510068 30743 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:27.538126 30743 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.539080 30743 tablet_bootstrap.cc:492] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.539857 30743 ts_tablet_manager.cc:1403] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.003s
I20260709 13:14:27.542632 30743 raft_consensus.cc:359] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:27.543321 30743 raft_consensus.cc:740] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.544152 30743 consensus_queue.cc:260] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:27.546769 30743 ts_tablet_manager.cc:1434] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:14:27.547556 30743 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:27.649956 30743 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.655740 30805 raft_consensus.cc:3060] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.657924 30743 tablet_bootstrap.cc:492] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.659307 30743 ts_tablet_manager.cc:1403] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.112s	user 0.022s	sys 0.023s
I20260709 13:14:27.662202 30743 raft_consensus.cc:359] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:27.653015 29835 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38498
I20260709 13:14:27.663798 29835 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38498 (request call id 1) took 1322 ms. Trace:
I20260709 13:14:27.664199 29835 rpcz_store.cc:276] 0709 13:14:26.341818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.342007 (+   189us) service_pool.cc:224] Handling call
0709 13:14:26.469205 (+127198us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b54009d7bd4. stack: 00007fc2bc0f9343 00007fc2bc0f9240 00007fc2bba881d4 00007fc2c57c6304 00007fc2c57c6299 00007fc2bf182090 00007fc2bf220f3a 00007fc2c4fd71cc 00007fc2c50d537e 00007fc2c35962a4 00007fc2c3596232 00007fc2c3596161 00007fc2c35960dc 00007fc2c3595392 00007fc2bd55348c 00007fc2bd5528c6
0709 13:14:27.663733 (+1194528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188627,"reported_tablets":45,"spinlock_wait_cycles":187507584}
I20260709 13:14:27.665949 30743 raft_consensus.cc:740] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.666791 30743 consensus_queue.cc:260] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:27.668689 30857 heartbeater.cc:499] Master 127.19.185.254:34975 was elected leader, sending a full tablet report...
I20260709 13:14:27.669628 30743 ts_tablet_manager.cc:1434] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:14:27.671020 30743 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
W20260709 13:14:27.685353 29978 consensus_peers.cc:597] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:27.705004 30811 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:27.767113 30126 consensus_peers.cc:597] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:27.770234 30743 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.771284 30743 tablet_bootstrap.cc:492] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.771906 30743 ts_tablet_manager.cc:1403] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.101s	user 0.031s	sys 0.012s
I20260709 13:14:27.774569 30743 raft_consensus.cc:359] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.775332 30743 raft_consensus.cc:740] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.775997 30743 consensus_queue.cc:260] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.778092 30743 ts_tablet_manager.cc:1434] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:14:27.778879 30743 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:27.806519 30743 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.807585 30743 tablet_bootstrap.cc:492] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.808334 30743 ts_tablet_manager.cc:1403] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.012s
I20260709 13:14:27.815366 30743 raft_consensus.cc:359] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:27.816643 30743 raft_consensus.cc:740] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.817329 30743 consensus_queue.cc:260] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:27.819438 30743 ts_tablet_manager.cc:1434] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.001s
I20260709 13:14:27.820320 30743 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:27.868194 30743 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.869215 30743 tablet_bootstrap.cc:492] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.869843 30743 ts_tablet_manager.cc:1403] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.050s	user 0.024s	sys 0.012s
I20260709 13:14:27.872817 30743 raft_consensus.cc:359] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.873564 30743 raft_consensus.cc:740] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.874341 30743 consensus_queue.cc:260] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.876490 30743 ts_tablet_manager.cc:1434] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:27.877808 30743 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:27.896291 30743 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.897408 30743 tablet_bootstrap.cc:492] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.898145 30743 ts_tablet_manager.cc:1403] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:14:27.901566 30743 raft_consensus.cc:359] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:27.902926 30743 raft_consensus.cc:740] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.903719 30743 consensus_queue.cc:260] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:27.906061 30743 ts_tablet_manager.cc:1434] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:27.906996 30743 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:27.931499 30743 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.932744 30743 tablet_bootstrap.cc:492] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.933380 30743 ts_tablet_manager.cc:1403] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 13:14:27.936086 30743 raft_consensus.cc:359] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:27.936810 30743 raft_consensus.cc:740] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.937548 30743 consensus_queue.cc:260] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:27.939692 30743 ts_tablet_manager.cc:1434] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:27.942279 30743 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:27.965803 30743 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.966745 30743 tablet_bootstrap.cc:492] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:27.967725 30743 ts_tablet_manager.cc:1403] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.010s
I20260709 13:14:27.970189 30743 raft_consensus.cc:359] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.970803 30743 raft_consensus.cc:740] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:27.971481 30743 consensus_queue.cc:260] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:27.973635 30743 ts_tablet_manager.cc:1434] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:27.974951 30743 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.008930 30743 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.009979 30743 tablet_bootstrap.cc:492] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.010701 30743 ts_tablet_manager.cc:1403] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.014s
I20260709 13:14:28.013458 30743 raft_consensus.cc:359] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:28.014225 30743 raft_consensus.cc:740] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.014971 30743 consensus_queue.cc:260] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:28.017416 30743 ts_tablet_manager.cc:1434] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:28.018922 30743 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.036278 30743 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.037302 30743 tablet_bootstrap.cc:492] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.038015 30743 ts_tablet_manager.cc:1403] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:14:28.041251 30743 raft_consensus.cc:359] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.042155 30743 raft_consensus.cc:740] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.042906 30743 consensus_queue.cc:260] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.045377 30743 ts_tablet_manager.cc:1434] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:14:28.046481 30743 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.069854 30743 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.070837 30743 tablet_bootstrap.cc:492] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.071542 30743 ts_tablet_manager.cc:1403] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 13:14:28.074326 30743 raft_consensus.cc:359] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:28.075078 30743 raft_consensus.cc:740] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.076049 30743 consensus_queue.cc:260] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:28.079546 30743 ts_tablet_manager.cc:1434] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:14:28.080452 30743 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.096845 30743 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.099459 30743 tablet_bootstrap.cc:492] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.100242 30743 ts_tablet_manager.cc:1403] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:14:28.102730 30743 raft_consensus.cc:359] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.103452 30743 raft_consensus.cc:740] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.104298 30743 consensus_queue.cc:260] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.105754 30743 ts_tablet_manager.cc:1434] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:14:28.106738 30743 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.151429 30805 raft_consensus.cc:3060] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.267663 30809 raft_consensus.cc:3060] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.276988 30801 raft_consensus.cc:3060] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.281405 30811 raft_consensus.cc:3060] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.298317 30743 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.299824 30743 tablet_bootstrap.cc:492] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.300951 30743 ts_tablet_manager.cc:1403] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.194s	user 0.081s	sys 0.101s
I20260709 13:14:28.315496 30743 raft_consensus.cc:359] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:28.316280 30743 raft_consensus.cc:740] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.316907 30804 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.316934 30743 consensus_queue.cc:260] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:28.347559 30743 ts_tablet_manager.cc:1434] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.000s
I20260709 13:14:28.348436 30743 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.386906 30811 raft_consensus.cc:3060] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.401166 30743 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.402280 30743 tablet_bootstrap.cc:492] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.403333 30743 ts_tablet_manager.cc:1403] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.014s
I20260709 13:14:28.406810 30743 raft_consensus.cc:359] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:28.407887 30743 raft_consensus.cc:740] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.408978 30743 consensus_queue.cc:260] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:28.411885 30743 ts_tablet_manager.cc:1434] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:14:28.413102 30743 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.454150 30743 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.455299 30743 tablet_bootstrap.cc:492] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.456118 30743 ts_tablet_manager.cc:1403] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.021s
I20260709 13:14:28.468011 30743 raft_consensus.cc:359] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:28.468864 30743 raft_consensus.cc:740] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.469667 30743 consensus_queue.cc:260] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:28.472153 30743 ts_tablet_manager.cc:1434] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:28.472997 30743 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.499648 30743 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.500648 30743 tablet_bootstrap.cc:492] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.501343 30743 ts_tablet_manager.cc:1403] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.003s
I20260709 13:14:28.505513 30743 raft_consensus.cc:359] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:28.506376 30743 raft_consensus.cc:740] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.507254 30743 consensus_queue.cc:260] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:28.509517 30743 ts_tablet_manager.cc:1434] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:14:28.510422 30743 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.527629 30743 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.528821 30743 tablet_bootstrap.cc:492] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.535967 30743 ts_tablet_manager.cc:1403] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 13:14:28.543133 30743 raft_consensus.cc:359] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.543944 30743 raft_consensus.cc:740] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.544624 30743 consensus_queue.cc:260] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.547267 30743 ts_tablet_manager.cc:1434] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:28.548228 30743 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.613576 30743 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.614763 30743 tablet_bootstrap.cc:492] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.615602 30743 ts_tablet_manager.cc:1403] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.068s	user 0.028s	sys 0.016s
I20260709 13:14:28.618789 30743 raft_consensus.cc:359] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.619695 30743 raft_consensus.cc:740] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.620741 30743 consensus_queue.cc:260] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.624660 30743 ts_tablet_manager.cc:1434] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:14:28.625600 30743 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.675177 30743 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.676333 30743 tablet_bootstrap.cc:492] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.677151 30743 ts_tablet_manager.cc:1403] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.025s
I20260709 13:14:28.679811 30743 raft_consensus.cc:359] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:28.680595 30743 raft_consensus.cc:740] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.681293 30743 consensus_queue.cc:260] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:28.683619 30743 ts_tablet_manager.cc:1434] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:14:28.684916 30743 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.733935 30743 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.734907 30743 tablet_bootstrap.cc:492] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.735576 30743 ts_tablet_manager.cc:1403] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.009s
I20260709 13:14:28.737927 30743 raft_consensus.cc:359] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:28.743975 30743 raft_consensus.cc:740] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.746325 30743 consensus_queue.cc:260] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:28.748454 30743 ts_tablet_manager.cc:1434] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:14:28.751829 30743 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.766371 30743 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.767319 30743 tablet_bootstrap.cc:492] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.768010 30743 ts_tablet_manager.cc:1403] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 13:14:28.770726 30743 raft_consensus.cc:359] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.771430 30743 raft_consensus.cc:740] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.772241 30743 consensus_queue.cc:260] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.776548 30743 ts_tablet_manager.cc:1434] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:14:28.780472 30743 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Bootstrap starting.
I20260709 13:14:28.810179 30743 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.811685 30743 tablet_bootstrap.cc:492] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Bootstrap complete.
I20260709 13:14:28.812448 30743 ts_tablet_manager.cc:1403] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.013s
I20260709 13:14:28.814896 30743 raft_consensus.cc:359] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.815608 30743 raft_consensus.cc:740] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:28.816316 30743 consensus_queue.cc:260] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:28.818653 30743 ts_tablet_manager.cc:1434] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:29.127429 30804 raft_consensus.cc:3060] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.110150 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:35.354987 30126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.193:38129, user_credentials={real_user=slave}} blocked reactor thread for 44134.5us
I20260709 13:14:35.364910 30155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:35.366317 30155 raft_consensus.cc:606] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:35.370290 30155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:35.371011 30155 raft_consensus.cc:606] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:35.375015 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:35.375820 30160 raft_consensus.cc:606] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:35.382421 30155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8320902d3532452e843e170bb7405f44"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:35.383419 30155 raft_consensus.cc:606] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:35.439159 31034 raft_consensus.cc:993] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:35.439874 31034 raft_consensus.cc:1081] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:35.442492 30009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8320902d3532452e843e170bb7405f44"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:37144
I20260709 13:14:35.444053 30009 raft_consensus.cc:493] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.444517 30009 raft_consensus.cc:3060] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.445786 30084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d65b829ec05f405d8d11888322430664"
dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:43774
I20260709 13:14:35.446427 30084 raft_consensus.cc:606] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:35.496160 30155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f80e36941c78483ebd0edba43ec63b83"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:35.497996 30155 raft_consensus.cc:606] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:35.499640 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:35.504688 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:35.508005 30009 raft_consensus.cc:515] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.509877 31039 raft_consensus.cc:993] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:35.510593 31026 raft_consensus.cc:1081] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:35.512141 30009 leader_election.cc:290] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:35.512429 30005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f80e36941c78483ebd0edba43ec63b83"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:37144
I20260709 13:14:35.513051 30005 raft_consensus.cc:493] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.512866 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:35.513552 30005 raft_consensus.cc:3060] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.513718 30084 raft_consensus.cc:3060] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.516646 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8320902d3532452e843e170bb7405f44" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:35.517261 30155 raft_consensus.cc:3055] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:35.522323 30005 raft_consensus.cc:515] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.517532 30155 raft_consensus.cc:740] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:35.525100 30155 consensus_queue.cc:260] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.526831 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80e36941c78483ebd0edba43ec63b83" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:35.527751 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80e36941c78483ebd0edba43ec63b83" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:35.528091 30160 raft_consensus.cc:3055] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:35.528421 30085 raft_consensus.cc:3060] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.528527 30160 raft_consensus.cc:740] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:35.529706 30160 consensus_queue.cc:260] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.530964 30160 raft_consensus.cc:3060] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.525727 30005 leader_election.cc:290] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:35.534602 30085 raft_consensus.cc:2468] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:35.535812 30084 raft_consensus.cc:2468] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:35.536002 29979 leader_election.cc:304] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:35.528514 30155 raft_consensus.cc:3060] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.537001 31030 raft_consensus.cc:2804] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:35.537537 31030 raft_consensus.cc:697] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:35.538326 30160 raft_consensus.cc:2468] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:35.538589 31030 consensus_queue.cc:237] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.541168 29979 leader_election.cc:304] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:35.542129 31031 raft_consensus.cc:2804] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:35.542676 31031 raft_consensus.cc:697] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:35.542980 30155 raft_consensus.cc:2468] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:35.543968 31031 consensus_queue.cc:237] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.555294 29835 catalog_manager.cc:5697] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.578164 29835 catalog_manager.cc:5697] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.618978 31034 raft_consensus.cc:993] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:35.619472 31034 raft_consensus.cc:1081] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:35.621127 30005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:37144
I20260709 13:14:35.621698 30005 raft_consensus.cc:493] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.622077 30005 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.627737 30005 raft_consensus.cc:515] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.629525 30005 leader_election.cc:290] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:35.630729 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:35.631119 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:35.631405 30155 raft_consensus.cc:3055] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:35.631696 30085 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.631716 30155 raft_consensus.cc:740] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:35.633452 30155 consensus_queue.cc:260] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.634657 30155 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.639561 30085 raft_consensus.cc:2468] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:35.640738 29979 leader_election.cc:304] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:35.641440 31030 raft_consensus.cc:2804] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:35.641866 31030 raft_consensus.cc:697] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:35.642622 30155 raft_consensus.cc:2468] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:35.642728 31030 consensus_queue.cc:237] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:35.654052 29835 catalog_manager.cc:5697] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.657266 31034 raft_consensus.cc:993] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:35.658066 31037 raft_consensus.cc:1081] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:35.659876 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:35.660468 30801 raft_consensus.cc:493] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.660898 30801 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.671700 30801 raft_consensus.cc:515] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:35.673451 30801 leader_election.cc:290] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:35.674954 30005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:35.675031 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27287279f1d34d898c530c2e961f1ea1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:35.675557 30005 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.675817 30155 raft_consensus.cc:3055] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:35.676210 30155 raft_consensus.cc:740] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:35.677068 30155 consensus_queue.cc:260] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:35.678361 30155 raft_consensus.cc:3060] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.681164 30005 raft_consensus.cc:2468] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:35.682607 30739 leader_election.cc:304] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:35.686375 30155 raft_consensus.cc:2468] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:35.688275 31051 raft_consensus.cc:2804] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:35.689666 31051 raft_consensus.cc:697] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:35.690719 31051 consensus_queue.cc:237] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:35.701567 29835 catalog_manager.cc:5697] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 2 to 3, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 3 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.854136 31037 raft_consensus.cc:993] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:35.854776 31034 raft_consensus.cc:1081] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:35.857314 30804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:35.857846 30804 raft_consensus.cc:493] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.858175 30804 raft_consensus.cc:3060] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.865940 30804 raft_consensus.cc:515] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:35.867434 30804 leader_election.cc:290] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:35.868297 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:35.868721 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1609495998e14d48914fd9d7dce5a3d1" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:35.868959 30085 raft_consensus.cc:3060] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.869231 30155 raft_consensus.cc:3055] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:35.869491 30155 raft_consensus.cc:740] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:35.870182 30155 consensus_queue.cc:260] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:35.871204 30155 raft_consensus.cc:3060] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.874756 30085 raft_consensus.cc:2468] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:35.876070 30739 leader_election.cc:304] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:35.877048 31051 raft_consensus.cc:2804] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:35.877799 31051 raft_consensus.cc:697] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:35.877884 30155 raft_consensus.cc:2468] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:35.880100 31051 consensus_queue.cc:237] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:35.892302 29835 catalog_manager.cc:5697] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.896842 31028 raft_consensus.cc:993] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:35.897562 31041 raft_consensus.cc:1081] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:35.902034 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d65b829ec05f405d8d11888322430664"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:14:35.902822 30801 raft_consensus.cc:493] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.903223 30801 raft_consensus.cc:3060] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.910156 30801 raft_consensus.cc:515] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:35.911738 30801 leader_election.cc:290] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:35.912503 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65b829ec05f405d8d11888322430664" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:35.912603 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65b829ec05f405d8d11888322430664" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:35.913348 30009 raft_consensus.cc:3060] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.913416 30085 raft_consensus.cc:3055] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:35.913792 30085 raft_consensus.cc:740] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:35.914399 30085 consensus_queue.cc:260] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:35.915419 30085 raft_consensus.cc:3060] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.918874 30009 raft_consensus.cc:2468] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:35.920488 30739 leader_election.cc:304] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:35.921578 30085 raft_consensus.cc:2468] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:35.922784 31051 raft_consensus.cc:2804] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:35.923306 31051 raft_consensus.cc:697] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:35.924149 31051 consensus_queue.cc:237] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:35.933622 29835 catalog_manager.cc:5697] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.984743 30155 raft_consensus.cc:1275] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:35.985921 31031 consensus_queue.cc:1048] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:35.999799 30085 raft_consensus.cc:1275] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.001482 31030 consensus_queue.cc:1048] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.050801 30160 raft_consensus.cc:1275] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.051934 31030 consensus_queue.cc:1048] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.063763 30085 raft_consensus.cc:1275] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.065275 31030 consensus_queue.cc:1048] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.113713 30085 raft_consensus.cc:1275] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.114975 31030 consensus_queue.cc:1048] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.126739 30160 raft_consensus.cc:1275] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.128154 31031 consensus_queue.cc:1048] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.132520 30160 raft_consensus.cc:1275] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:36.134490 31051 consensus_queue.cc:1048] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.156956 30013 raft_consensus.cc:1275] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:36.158769 31052 consensus_queue.cc:1048] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.328397 30013 raft_consensus.cc:1275] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.329784 31067 consensus_queue.cc:1048] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.339978 30085 raft_consensus.cc:1275] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.350065 31052 consensus_queue.cc:1048] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.435622 30085 raft_consensus.cc:1275] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.436988 31067 consensus_queue.cc:1048] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.447083 30160 raft_consensus.cc:1275] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.448618 31051 consensus_queue.cc:1048] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.506035 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:36.575716 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:36.612709 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13b502d61f804f169b0f20adba55efa5"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:36.613281 30160 raft_consensus.cc:606] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:36.617244 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:36.618407 30160 raft_consensus.cc:606] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:36.621002 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:36.621505 30160 raft_consensus.cc:606] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:36.624420 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:36.625099 30160 raft_consensus.cc:606] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:36.627934 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:36.628700 30160 raft_consensus.cc:606] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:36.631310 30084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85"
dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:43774
I20260709 13:14:36.631966 30084 raft_consensus.cc:606] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:36.633296 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:36.634837 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:36.713780 31034 raft_consensus.cc:993] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:36.714316 31037 raft_consensus.cc:1081] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:36.715857 30804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:36.716466 30804 raft_consensus.cc:493] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.716747 30804 raft_consensus.cc:3060] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.723255 30804 raft_consensus.cc:515] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:36.725143 30804 leader_election.cc:290] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:36.725883 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:36.726014 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae95e4a365df4e69b385a8da4f7d0357" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:36.726632 30160 raft_consensus.cc:3055] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:36.726665 30013 raft_consensus.cc:3060] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.726999 30160 raft_consensus.cc:740] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:36.727842 30160 consensus_queue.cc:260] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:36.729091 30160 raft_consensus.cc:3060] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.733673 30013 raft_consensus.cc:2468] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:36.734675 30160 raft_consensus.cc:2468] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:36.735126 30739 leader_election.cc:304] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:36.736153 31067 raft_consensus.cc:2804] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:36.736675 31067 raft_consensus.cc:697] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:36.737620 31067 consensus_queue.cc:237] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:36.747792 29835 catalog_manager.cc:5697] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.787954 31034 raft_consensus.cc:993] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:36.788482 31037 raft_consensus.cc:1081] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:36.789778 30804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:36.790434 30804 raft_consensus.cc:493] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.790771 30804 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.795969 30804 raft_consensus.cc:515] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:36.797917 30804 leader_election.cc:290] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:36.798257 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:36.798473 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c481032d44545c1bfcdb474fab199ac" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:36.798956 30084 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.798993 30160 raft_consensus.cc:3055] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:36.799583 30160 raft_consensus.cc:740] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:36.800457 30160 consensus_queue.cc:260] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:36.801801 30160 raft_consensus.cc:3060] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.806838 30084 raft_consensus.cc:2468] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:36.808336 30739 leader_election.cc:304] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:36.809101 30160 raft_consensus.cc:2468] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:36.809101 31067 raft_consensus.cc:2804] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:36.810129 31067 raft_consensus.cc:697] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:36.811178 31067 consensus_queue.cc:237] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:36.815994 31037 raft_consensus.cc:993] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:36.816696 31034 raft_consensus.cc:1081] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:36.818513 30005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:37144
I20260709 13:14:36.819087 30005 raft_consensus.cc:493] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.819506 30005 raft_consensus.cc:3060] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.827732 29835 catalog_manager.cc:5697] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 2 to 3, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 3 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.831573 30005 raft_consensus.cc:515] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:36.833822 30005 leader_election.cc:290] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:36.836901 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:36.837551 30160 raft_consensus.cc:3055] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:36.837826 30160 raft_consensus.cc:740] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:36.838665 30160 consensus_queue.cc:260] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
W20260709 13:14:36.840135 31034 consensus_queue.cc:1175] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:14:36.841919 30160 raft_consensus.cc:3060] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.838678 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e8c3cdaf33402dbdedf5ac7b0d5f69" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:36.846033 30084 raft_consensus.cc:3060] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.850688 30160 raft_consensus.cc:2468] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:36.851810 29978 leader_election.cc:304] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:36.852837 30902 raft_consensus.cc:2804] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:36.853247 30902 raft_consensus.cc:697] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:36.853685 30084 raft_consensus.cc:2468] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:36.854053 30902 consensus_queue.cc:237] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:36.865154 29835 catalog_manager.cc:5697] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.931749 31034 raft_consensus.cc:993] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:36.932394 31026 raft_consensus.cc:1081] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:36.934196 30804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13b502d61f804f169b0f20adba55efa5"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:36.934688 30804 raft_consensus.cc:493] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.934978 30804 raft_consensus.cc:3060] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.942693 30804 raft_consensus.cc:515] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:36.946065 30804 leader_election.cc:290] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:36.946666 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b502d61f804f169b0f20adba55efa5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:36.947916 30160 raft_consensus.cc:3055] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:36.950290 30160 raft_consensus.cc:740] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:36.950634 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b502d61f804f169b0f20adba55efa5" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:36.951225 30160 consensus_queue.cc:260] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:36.951272 30013 raft_consensus.cc:3060] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.952863 30160 raft_consensus.cc:3060] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.959522 30013 raft_consensus.cc:2468] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:36.960577 30160 raft_consensus.cc:2468] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:36.960811 30739 leader_election.cc:304] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:36.961701 31067 raft_consensus.cc:2804] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:36.962131 31067 raft_consensus.cc:697] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:36.962915 31067 consensus_queue.cc:237] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:36.973781 29835 catalog_manager.cc:5697] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.980556 31028 raft_consensus.cc:993] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:36.981074 31028 raft_consensus.cc:1081] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:36.981889 31034 raft_consensus.cc:993] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:36.982445 31034 raft_consensus.cc:1081] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:36.983217 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:14:36.983816 30801 raft_consensus.cc:493] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.984208 30801 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.984177 30013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:37144
I20260709 13:14:36.988366 30013 raft_consensus.cc:493] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.988755 30013 raft_consensus.cc:3060] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.991488 30801 raft_consensus.cc:515] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:36.993624 30801 leader_election.cc:290] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:36.993860 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:36.994531 30084 raft_consensus.cc:3055] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:36.994140 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c039a4adb4a94b4983b0bd4ba5936b85" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:36.995240 30084 raft_consensus.cc:740] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:36.994302 30013 raft_consensus.cc:515] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:36.995574 30160 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.996205 30084 consensus_queue.cc:260] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:36.997115 30013 leader_election.cc:290] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:36.998072 30085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:36.998224 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c97b9de751e4869a4675dfa47486840" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:36.998627 30085 raft_consensus.cc:3060] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.998857 30153 raft_consensus.cc:3055] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:36.999089 30084 raft_consensus.cc:3060] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.999267 30153 raft_consensus.cc:740] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:37.000451 30153 consensus_queue.cc:260] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:37.001716 30153 raft_consensus.cc:3060] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.003947 30160 raft_consensus.cc:2468] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:37.005342 30738 leader_election.cc:304] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:37.006475 30084 raft_consensus.cc:2468] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:37.007005 30085 raft_consensus.cc:2468] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:37.008846 29979 leader_election.cc:304] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:37.009750 30902 raft_consensus.cc:2804] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:37.010226 30902 raft_consensus.cc:697] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:37.010977 30902 consensus_queue.cc:237] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:37.013569 31067 raft_consensus.cc:2804] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:37.014196 31067 raft_consensus.cc:697] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:37.015218 31067 consensus_queue.cc:237] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:37.023644 30153 raft_consensus.cc:2468] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:37.030395 29835 catalog_manager.cc:5697] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.035238 29837 catalog_manager.cc:5697] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 2 to 3, leader changed from fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 3 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.236800 30005 raft_consensus.cc:1275] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.238067 31067 consensus_queue.cc:1048] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:37.249881 30153 raft_consensus.cc:1275] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.252751 31067 consensus_queue.cc:1048] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:37.272670 30085 raft_consensus.cc:1275] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.274073 31031 consensus_queue.cc:1048] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:37.296159 30160 raft_consensus.cc:1275] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:37.296272 30153 raft_consensus.cc:1275] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.297629 30084 raft_consensus.cc:1275] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:37.297958 31031 consensus_queue.cc:1048] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:37.301084 31051 consensus_queue.cc:1048] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.302510 31051 consensus_queue.cc:1048] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.474013 30013 raft_consensus.cc:1275] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.475456 31067 consensus_queue.cc:1048] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:37.485853 30084 raft_consensus.cc:1275] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.488646 30160 raft_consensus.cc:1275] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.492110 31052 consensus_queue.cc:1048] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:37.492607 31031 consensus_queue.cc:1048] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:37.495723 30084 raft_consensus.cc:1275] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:37.497400 31067 consensus_queue.cc:1048] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.508903 30160 raft_consensus.cc:1275] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.510490 31031 consensus_queue.cc:1048] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:37.526723 30153 raft_consensus.cc:1275] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:37.530541 31098 consensus_queue.cc:1048] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:37.635982 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:37.681584 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:37.721416 30153 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:37.722020 30153 raft_consensus.cc:606] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:37.726619 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91006ce206784668a848904ea662f60d"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:37.727180 30160 raft_consensus.cc:606] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:37.729787 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:37.730206 30160 raft_consensus.cc:606] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:37.732522 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:37.732928 30160 raft_consensus.cc:606] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:37.735219 30084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa"
dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:43774
I20260709 13:14:37.735718 30084 raft_consensus.cc:606] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:37.738392 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:37.738931 30160 raft_consensus.cc:606] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Received request to transfer leadership to TS 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:37.739965 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:37.741497 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:37.816102 31034 raft_consensus.cc:993] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:37.816794 31026 raft_consensus.cc:1081] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:37.818437 30005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:37144
I20260709 13:14:37.819016 30005 raft_consensus.cc:493] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:37.819391 30005 raft_consensus.cc:3060] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.825413 30005 raft_consensus.cc:515] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:37.827850 30005 leader_election.cc:290] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:37.829319 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:37.829766 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986e5222b0a848fe998624fedd70c7a9" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:37.829895 30160 raft_consensus.cc:3055] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:37.830260 30084 raft_consensus.cc:3060] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.830312 30160 raft_consensus.cc:740] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:37.831246 30160 consensus_queue.cc:260] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:37.832355 30160 raft_consensus.cc:3060] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.837067 30084 raft_consensus.cc:2468] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:37.838264 29979 leader_election.cc:304] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:37.838955 31034 raft_consensus.cc:993] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:37.839104 31030 raft_consensus.cc:2804] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:37.839325 30160 raft_consensus.cc:2468] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:37.839465 31034 raft_consensus.cc:1081] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:37.839804 31030 raft_consensus.cc:697] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:37.840940 31030 consensus_queue.cc:237] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:37.841445 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:37.842049 30801 raft_consensus.cc:493] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:37.842341 30801 raft_consensus.cc:3060] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.848773 30801 raft_consensus.cc:515] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:37.851051 30801 leader_election.cc:290] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:37.851387 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:37.850965 29833 catalog_manager.cc:5697] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.852020 30160 raft_consensus.cc:3055] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:37.852469 30160 raft_consensus.cc:740] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:37.853170 30160 consensus_queue.cc:260] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:37.855159 30005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ddfecc18142ca96ca46730679e15d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:37.855191 30160 raft_consensus.cc:3060] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.855846 30005 raft_consensus.cc:3060] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.863253 30160 raft_consensus.cc:2468] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:37.863658 30005 raft_consensus.cc:2468] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:37.867841 30738 leader_election.cc:304] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:37.868853 31098 raft_consensus.cc:2804] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:37.869503 31098 raft_consensus.cc:697] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:37.870546 31098 consensus_queue.cc:237] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:37.885278 29833 catalog_manager.cc:5697] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.102677 31037 raft_consensus.cc:993] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:38.103205 31034 raft_consensus.cc:1081] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:38.104887 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91006ce206784668a848904ea662f60d"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:38.105492 30801 raft_consensus.cc:493] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.105865 30801 raft_consensus.cc:3060] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.111255 30801 raft_consensus.cc:515] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:38.113324 30801 leader_election.cc:290] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:38.114030 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:38.114710 30160 raft_consensus.cc:3055] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.115049 30160 raft_consensus.cc:740] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:38.115942 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91006ce206784668a848904ea662f60d" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:38.115962 30160 consensus_queue.cc:260] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:38.116758 31041 raft_consensus.cc:993] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:38.116770 30013 raft_consensus.cc:3060] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.117475 31041 raft_consensus.cc:1081] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:38.117755 30160 raft_consensus.cc:3060] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.119165 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:14:38.119722 30801 raft_consensus.cc:493] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.120146 30801 raft_consensus.cc:3060] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.124428 30160 raft_consensus.cc:2468] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:38.124342 30013 raft_consensus.cc:2468] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:38.125746 30738 leader_election.cc:304] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:38.126232 30801 raft_consensus.cc:515] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:38.126658 31067 raft_consensus.cc:2804] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.127197 31067 raft_consensus.cc:697] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:38.128378 30801 leader_election.cc:290] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:38.128086 31067 consensus_queue.cc:237] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:38.129019 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:38.129627 30013 raft_consensus.cc:3060] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.131458 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ff06a319654c8b81ee03263d338afa" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:38.132133 30084 raft_consensus.cc:3055] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.132375 30084 raft_consensus.cc:740] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:38.139792 30084 consensus_queue.cc:260] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:38.142536 30084 raft_consensus.cc:3060] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.144135 30013 raft_consensus.cc:2468] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:38.145484 30739 leader_election.cc:304] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:38.146430 31067 raft_consensus.cc:2804] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.147002 31067 raft_consensus.cc:697] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:38.146608 29833 catalog_manager.cc:5697] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.149314 31067 consensus_queue.cc:237] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:38.165542 30084 raft_consensus.cc:2468] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:38.168109 29833 catalog_manager.cc:5697] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.172387 31034 raft_consensus.cc:993] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:38.172941 31037 raft_consensus.cc:1081] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:38.174636 30013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:37144
I20260709 13:14:38.175144 30013 raft_consensus.cc:493] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.175490 30013 raft_consensus.cc:3060] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.181274 30013 raft_consensus.cc:515] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:38.182879 30013 leader_election.cc:290] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:38.183465 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:38.183933 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c319af3352cf463fa873785b1acfb5bd" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:38.184145 30084 raft_consensus.cc:3060] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.184722 30153 raft_consensus.cc:3055] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.185200 30153 raft_consensus.cc:740] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:38.186084 30153 consensus_queue.cc:260] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:38.187397 30153 raft_consensus.cc:3060] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.191649 30084 raft_consensus.cc:2468] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:38.193035 29979 leader_election.cc:304] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:38.193774 31088 raft_consensus.cc:2804] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.194192 31088 raft_consensus.cc:697] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:38.195024 31088 consensus_queue.cc:237] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:38.196218 30153 raft_consensus.cc:2468] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:38.207772 29833 catalog_manager.cc:5697] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.233431 31034 raft_consensus.cc:993] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:38.233918 31037 raft_consensus.cc:1081] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:38.235481 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:38.235989 30801 raft_consensus.cc:493] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.236330 30801 raft_consensus.cc:3060] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.242977 30801 raft_consensus.cc:515] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:38.245442 30801 leader_election.cc:290] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305), 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209)
I20260709 13:14:38.245486 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:38.246317 30153 raft_consensus.cc:3055] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.246423 30005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9869b01845b944d8b60d71f7ab3e1934" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:38.246708 30153 raft_consensus.cc:740] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:38.247079 30005 raft_consensus.cc:3060] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.247570 30153 consensus_queue.cc:260] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:38.248890 30153 raft_consensus.cc:3060] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.252316 30005 raft_consensus.cc:2468] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:38.253444 30739 leader_election.cc:304] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c83cd09fc554bf48cc07b2d9aa63e36, b9712e59a1774be08aa8e368566dcfed; no voters: 
I20260709 13:14:38.254222 31067 raft_consensus.cc:2804] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.254382 30153 raft_consensus.cc:2468] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:38.254680 31067 raft_consensus.cc:697] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:38.255641 31067 consensus_queue.cc:237] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } }
I20260709 13:14:38.265203 30153 raft_consensus.cc:1275] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.265883 29833 catalog_manager.cc:5697] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.266870 31031 consensus_queue.cc:1048] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.290077 30084 raft_consensus.cc:1275] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.291790 31030 consensus_queue.cc:1048] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.341574 30160 raft_consensus.cc:1275] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.343248 31067 consensus_queue.cc:1048] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.361905 30005 raft_consensus.cc:1275] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.363361 31052 consensus_queue.cc:1048] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.533924 30013 raft_consensus.cc:1275] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.535027 31067 consensus_queue.cc:1048] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.542313 30005 raft_consensus.cc:1275] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.543857 31098 consensus_queue.cc:1048] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.548959 30084 raft_consensus.cc:1275] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.551409 31052 consensus_queue.cc:1048] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.574339 30153 raft_consensus.cc:1275] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.578392 31067 consensus_queue.cc:1048] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.606474 30153 raft_consensus.cc:1275] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.607904 31031 consensus_queue.cc:1048] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.623792 30084 raft_consensus.cc:1275] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.628197 31088 consensus_queue.cc:1048] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.738137 30013 raft_consensus.cc:1275] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.739355 31120 consensus_queue.cc:1048] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.742424 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:38.758201 30153 raft_consensus.cc:1275] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.760216 31120 consensus_queue.cc:1048] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.812561 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:38.847627 30084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87"
dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
mode: GRACEFUL
new_leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:43774
I20260709 13:14:38.848237 30084 raft_consensus.cc:606] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Received request to transfer leadership to TS 5c83cd09fc554bf48cc07b2d9aa63e36
I20260709 13:14:38.851233 30084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044"
dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
mode: GRACEFUL
new_leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
 from {username='slave'} at 127.0.0.1:43774
I20260709 13:14:38.851753 30084 raft_consensus.cc:606] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Received request to transfer leadership to TS 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:38.854377 30084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "affbd9c95c834993a100eeadb412d208"
dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:43774
I20260709 13:14:38.855000 30084 raft_consensus.cc:606] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:38.856329 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:38.857992 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:38.869549 31041 raft_consensus.cc:993] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:38.870255 31118 raft_consensus.cc:1081] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:38.871989 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "affbd9c95c834993a100eeadb412d208"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:14:38.872570 30801 raft_consensus.cc:493] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.872896 30801 raft_consensus.cc:3060] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.879531 30801 raft_consensus.cc:515] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:38.881968 30801 leader_election.cc:290] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:38.882469 30005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:38.883170 30005 raft_consensus.cc:3060] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.883121 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affbd9c95c834993a100eeadb412d208" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:38.884056 31041 raft_consensus.cc:993] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63: : Instructing follower 0c8ac4f0fa334a16b65c6a52a89b8d49 to start an election
I20260709 13:14:38.884358 30084 raft_consensus.cc:3055] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.884545 31041 raft_consensus.cc:1081] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Signalling peer 0c8ac4f0fa334a16b65c6a52a89b8d49 to start an election
I20260709 13:14:38.884733 30084 raft_consensus.cc:740] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:38.885643 30084 consensus_queue.cc:260] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:38.887091 30084 raft_consensus.cc:3060] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.887174 30153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
 from {username='slave'} at 127.0.0.1:59668
I20260709 13:14:38.887841 30153 raft_consensus.cc:493] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.888273 30153 raft_consensus.cc:3060] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.893798 30084 raft_consensus.cc:2468] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:38.893857 30005 raft_consensus.cc:2468] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 2.
I20260709 13:14:38.894857 30739 leader_election.cc:304] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:38.895496 31120 raft_consensus.cc:2804] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.895985 31120 raft_consensus.cc:697] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:38.896569 30153 raft_consensus.cc:515] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:38.896837 31120 consensus_queue.cc:237] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } }
I20260709 13:14:38.899273 30153 leader_election.cc:290] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:38.902469 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:38.902729 30005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e24eb550644b86a27b84105bfbc044" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:38.903280 30084 raft_consensus.cc:3055] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.903280 30005 raft_consensus.cc:3060] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.903796 30084 raft_consensus.cc:740] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:38.904590 30084 consensus_queue.cc:260] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:38.905824 30084 raft_consensus.cc:3060] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.907191 29833 catalog_manager.cc:5697] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 1 to 2, leader changed from fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 2 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.910462 30005 raft_consensus.cc:2468] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:38.911777 30127 leader_election.cc:304] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:38.912690 31034 raft_consensus.cc:2804] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.913237 31034 raft_consensus.cc:697] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:38.912568 30084 raft_consensus.cc:2468] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 2.
I20260709 13:14:38.914108 31034 consensus_queue.cc:237] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:38.936723 29833 catalog_manager.cc:5697] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 1 to 2, leader changed from fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 2 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:39.229774 31114 raft_consensus.cc:993] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63: : Instructing follower 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:39.230372 31118 raft_consensus.cc:1081] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Signalling peer 5c83cd09fc554bf48cc07b2d9aa63e36 to start an election
I20260709 13:14:39.231863 30005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
 from {username='slave'} at 127.0.0.1:37164
I20260709 13:14:39.232390 30005 raft_consensus.cc:493] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:39.232713 30005 raft_consensus.cc:3060] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:39.237972 30005 raft_consensus.cc:515] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:39.239418 30005 leader_election.cc:290] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:39.240270 30084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:39.240712 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d37e8e23ef4f4fa7507c9f20cdda87" candidate_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:39.241585 30084 raft_consensus.cc:3055] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:39.241675 30154 raft_consensus.cc:3060] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:39.241966 30084 raft_consensus.cc:740] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca91c8e2c1d4caaaada7f47eb447d63, State: Running, Role: LEADER
I20260709 13:14:39.242884 30084 consensus_queue.cc:260] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:39.244692 30084 raft_consensus.cc:3060] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:39.249583 30154 raft_consensus.cc:2468] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:39.251307 29978 leader_election.cc:304] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:39.251484 30084 raft_consensus.cc:2468] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c83cd09fc554bf48cc07b2d9aa63e36 in term 2.
I20260709 13:14:39.252199 31088 raft_consensus.cc:2804] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:39.252704 31088 raft_consensus.cc:697] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Leader. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:39.253763 31088 consensus_queue.cc:237] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:39.264755 29833 catalog_manager.cc:5697] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 reported cstate change: term changed from 1 to 2, leader changed from fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195) to 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.398939 30009 raft_consensus.cc:1275] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:39.400269 31130 consensus_queue.cc:1048] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:39.415552 30084 raft_consensus.cc:1275] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:39.452716 31098 consensus_queue.cc:1048] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:39.465396 30084 raft_consensus.cc:1275] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:39.466439 30005 raft_consensus.cc:1275] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:39.468520 31130 consensus_queue.cc:1048] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:39.475965 31120 consensus_queue.cc:1048] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:39.519739 30127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:34209, user_credentials={real_user=slave}} blocked reactor thread for 51780.4us
I20260709 13:14:39.634895 30085 raft_consensus.cc:1275] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:39.636147 31030 consensus_queue.cc:1048] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:39.647656 30154 raft_consensus.cc:1275] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Refusing update from remote peer 5c83cd09fc554bf48cc07b2d9aa63e36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:39.649380 31031 consensus_queue.cc:1048] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:39.858924 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:39.909830 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:39.963544 30005 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09"
dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
mode: GRACEFUL
new_leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
 from {username='slave'} at 127.0.0.1:55368
I20260709 13:14:39.964184 30005 raft_consensus.cc:606] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Received request to transfer leadership to TS 0c8ac4f0fa334a16b65c6a52a89b8d49
I20260709 13:14:39.966612 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:39.967079 30160 raft_consensus.cc:606] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:39.968190 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:39.969689 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:40.333250 31034 raft_consensus.cc:993] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:40.333868 31139 raft_consensus.cc:1081] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:40.335498 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:40.336018 30801 raft_consensus.cc:493] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:40.336282 30801 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.341002 30801 raft_consensus.cc:515] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:40.342715 30801 leader_election.cc:290] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:40.343647 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:40.343811 30160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b267e53446f24bfab5e48e060d0250d0" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:40.344390 30083 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.344455 30160 raft_consensus.cc:3055] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:40.344915 30160 raft_consensus.cc:740] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:40.345554 30160 consensus_queue.cc:260] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:40.346611 30160 raft_consensus.cc:3060] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.350916 30083 raft_consensus.cc:2468] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:40.351060 30160 raft_consensus.cc:2468] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:40.352244 30739 leader_election.cc:304] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:40.353322 31052 raft_consensus.cc:2804] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:40.353835 31052 raft_consensus.cc:697] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:40.354743 31052 consensus_queue.cc:237] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:40.373766 29837 catalog_manager.cc:5697] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 2 to 3, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 3 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.429486 31150 raft_consensus.cc:993] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36: : Instructing follower 0c8ac4f0fa334a16b65c6a52a89b8d49 to start an election
I20260709 13:14:40.430181 31137 raft_consensus.cc:1081] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Signalling peer 0c8ac4f0fa334a16b65c6a52a89b8d49 to start an election
I20260709 13:14:40.431998 30160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
 from {username='slave'} at 127.0.0.1:59678
I20260709 13:14:40.432549 30160 raft_consensus.cc:493] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:40.432835 30160 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.439522 30160 raft_consensus.cc:515] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:40.442409 30009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36"
I20260709 13:14:40.442649 30160 leader_election.cc:290] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 3 election: Requested vote from peers 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209), fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729)
I20260709 13:14:40.443053 30009 raft_consensus.cc:3055] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:40.443362 30009 raft_consensus.cc:740] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c83cd09fc554bf48cc07b2d9aa63e36, State: Running, Role: LEADER
I20260709 13:14:40.444010 30009 consensus_queue.cc:260] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:40.446254 30009 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.448889 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887ffedd97e42cf858676b10f32bd09" candidate_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:40.451936 30083 raft_consensus.cc:3060] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.453162 30009 raft_consensus.cc:2468] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 3.
I20260709 13:14:40.456702 30083 raft_consensus.cc:2468] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c8ac4f0fa334a16b65c6a52a89b8d49 in term 3.
I20260709 13:14:40.456693 30127 leader_election.cc:304] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c8ac4f0fa334a16b65c6a52a89b8d49, 5c83cd09fc554bf48cc07b2d9aa63e36; no voters: 
I20260709 13:14:40.457600 31034 raft_consensus.cc:2804] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:40.458079 31034 raft_consensus.cc:697] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 LEADER]: Becoming Leader. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:40.458859 31034 consensus_queue.cc:237] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } }
I20260709 13:14:40.470011 29837 catalog_manager.cc:5697] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 reported cstate change: term changed from 2 to 3, leader changed from 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194) to 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196). New cstate: current_term: 3 leader_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.736125 30160 raft_consensus.cc:1275] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:40.737625 31052 consensus_queue.cc:1048] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.758554 30083 raft_consensus.cc:1275] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:40.761957 31160 consensus_queue.cc:1048] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.850009 30085 raft_consensus.cc:1275] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:40.851773 31034 consensus_queue.cc:1048] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:40.884402 30009 raft_consensus.cc:1275] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 3 FOLLOWER]: Refusing update from remote peer 0c8ac4f0fa334a16b65c6a52a89b8d49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:40.889663 31139 consensus_queue.cc:1048] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c83cd09fc554bf48cc07b2d9aa63e36" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.970556 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:41.032742 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:41.070597 30160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427"
dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
mode: GRACEFUL
new_leader_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:46616
I20260709 13:14:41.071273 30160 raft_consensus.cc:606] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Received request to transfer leadership to TS b9712e59a1774be08aa8e368566dcfed
I20260709 13:14:41.072956 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:14:41.074548 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:41.425513 31169 raft_consensus.cc:993] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49: : Instructing follower b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:41.426134 31139 raft_consensus.cc:1081] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Signalling peer b9712e59a1774be08aa8e368566dcfed to start an election
I20260709 13:14:41.428138 30801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427"
dest_uuid: "b9712e59a1774be08aa8e368566dcfed"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:14:41.428660 30801 raft_consensus.cc:493] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:41.429011 30801 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.434909 30801 raft_consensus.cc:515] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:41.438524 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49"
I20260709 13:14:41.439242 30155 raft_consensus.cc:3055] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:41.439323 30083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af3771620b0455ba5105bfb4d256427" candidate_uuid: "b9712e59a1774be08aa8e368566dcfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fca91c8e2c1d4caaaada7f47eb447d63"
I20260709 13:14:41.439610 30155 raft_consensus.cc:740] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c8ac4f0fa334a16b65c6a52a89b8d49, State: Running, Role: LEADER
I20260709 13:14:41.440011 30083 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.440711 30155 consensus_queue.cc:260] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:41.441969 30155 raft_consensus.cc:3060] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.443495 30801 leader_election.cc:290] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Requested vote from peers fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729), 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196:46305)
I20260709 13:14:41.447050 30083 raft_consensus.cc:2468] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:41.448974 30739 leader_election.cc:304] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9712e59a1774be08aa8e368566dcfed, fca91c8e2c1d4caaaada7f47eb447d63; no voters: 
I20260709 13:14:41.449774 31160 raft_consensus.cc:2804] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:41.450531 31160 raft_consensus.cc:697] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Becoming Leader. State: Replica: b9712e59a1774be08aa8e368566dcfed, State: Running, Role: LEADER
I20260709 13:14:41.450567 30155 raft_consensus.cc:2468] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9712e59a1774be08aa8e368566dcfed in term 3.
I20260709 13:14:41.452396 31160 consensus_queue.cc:237] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } }
I20260709 13:14:41.462829 29835 catalog_manager.cc:5697] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed reported cstate change: term changed from 2 to 3, leader changed from 0c8ac4f0fa334a16b65c6a52a89b8d49 (127.19.185.196) to b9712e59a1774be08aa8e368566dcfed (127.19.185.193). New cstate: current_term: 3 leader_uuid: "b9712e59a1774be08aa8e368566dcfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9712e59a1774be08aa8e368566dcfed" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 38129 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.986081 30155 raft_consensus.cc:1275] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:41.987690 31160 consensus_queue.cc:1048] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c8ac4f0fa334a16b65c6a52a89b8d49" member_type: VOTER last_known_addr { host: "127.19.185.196" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:42.005023 30083 raft_consensus.cc:1275] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Refusing update from remote peer b9712e59a1774be08aa8e368566dcfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:42.006744 31120 consensus_queue.cc:1048] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca91c8e2c1d4caaaada7f47eb447d63" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 42729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:42.075589 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:42.113535 20199 tablet_server.cc:179] TabletServer@127.19.185.193:38129 shutting down...
W20260709 13:14:42.126250 30126 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 147 similar messages]
W20260709 13:14:42.132212 30126 consensus_peers.cc:597] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.150460 30052 consensus_peers.cc:597] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.157708 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:42.158793 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.159919 20199 raft_consensus.cc:2243] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.160531 20199 raft_consensus.cc:2272] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.163808 20199 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:42.164269 30126 consensus_peers.cc:597] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.164690 20199 raft_consensus.cc:2243] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.165262 20199 raft_consensus.cc:2272] T 0f5ad95d8d5e43d9888dc66173bdae9c P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.167452 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.168327 20199 raft_consensus.cc:2243] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.168825 20199 raft_consensus.cc:2272] T 90d7a42309c748f0a0ee3236a7e019a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.171893 20199 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:42.171787 30052 consensus_peers.cc:597] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.172915 30052 consensus_peers.cc:597] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.172961 20199 raft_consensus.cc:2243] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.173766 20199 raft_consensus.cc:2272] T 8960d9fe4dcc48798391f67ce47e9f24 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.176730 20199 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:42.176579 30126 consensus_peers.cc:597] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.177525 20199 raft_consensus.cc:2243] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.178038 20199 raft_consensus.cc:2272] T e8c323dfa54847f1890203bcc0f931c9 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.180877 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.181667 20199 raft_consensus.cc:2243] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.182665 20199 raft_consensus.cc:2272] T d65b829ec05f405d8d11888322430664 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.184965 29978 consensus_peers.cc:597] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.185613 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.186564 20199 raft_consensus.cc:2243] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.187134 20199 raft_consensus.cc:2272] T b5a07a99809b452d97abd212707856e4 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.190274 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.191082 20199 raft_consensus.cc:2243] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.191625 20199 raft_consensus.cc:2272] T 1860b4022529422197e01c32e02598f4 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.194799 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.195670 20199 raft_consensus.cc:2243] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.196269 20199 raft_consensus.cc:2272] T 7459878da0fd4511bdb65ad263c4697e P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.198472 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.199044 20199 raft_consensus.cc:2243] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.199507 20199 raft_consensus.cc:2272] T 381657a3006a4f52b1268ecae19b2922 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.201793 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.202894 20199 raft_consensus.cc:2243] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.203509 20199 raft_consensus.cc:2272] T c39528ca9ed34510aabaa30ddbf33da1 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.205113 29978 consensus_peers.cc:597] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.206341 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.207096 20199 raft_consensus.cc:2243] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.207645 20199 raft_consensus.cc:2272] T 93319818a15f4d37a35a004c1f533803 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.211043 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.212023 20199 raft_consensus.cc:2243] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.212584 20199 raft_consensus.cc:2272] T 1e9f8efa2d564711b2d5c65c4f7de9cd P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.215914 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.216782 20199 raft_consensus.cc:2243] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.217689 20199 raft_consensus.cc:2272] T c039a4adb4a94b4983b0bd4ba5936b85 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.220199 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.220778 20199 raft_consensus.cc:2243] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.221127 20199 raft_consensus.cc:2272] T 244205f3a8df4e07b6dd48c47779e712 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.223570 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.224447 20199 raft_consensus.cc:2243] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.224983 20199 raft_consensus.cc:2272] T 1cb1d96bc2a74b3096fcedd6db889969 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.228159 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.228791 20199 raft_consensus.cc:2243] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.229562 20199 raft_consensus.cc:2272] T affbd9c95c834993a100eeadb412d208 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.231864 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.232460 20199 raft_consensus.cc:2243] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.233312 20199 raft_consensus.cc:2272] T 8c481032d44545c1bfcdb474fab199ac P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.236099 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.236666 20199 raft_consensus.cc:2243] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.237421 20199 raft_consensus.cc:2272] T 91006ce206784668a848904ea662f60d P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.239465 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.240022 20199 raft_consensus.cc:2243] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.241106 20199 raft_consensus.cc:2272] T 9869b01845b944d8b60d71f7ab3e1934 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.243161 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.243752 20199 raft_consensus.cc:2243] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.244204 20199 raft_consensus.cc:2272] T 8c2aff9b036d42d98af552cbecc893a5 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.246838 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.247644 20199 raft_consensus.cc:2243] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.248106 20199 raft_consensus.cc:2272] T c43ee291f79741eebbaeff079b730c10 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.250517 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.251156 20199 raft_consensus.cc:2243] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.251852 20199 raft_consensus.cc:2272] T b2ff06a319654c8b81ee03263d338afa P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.253847 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.254411 20199 raft_consensus.cc:2243] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.254843 20199 raft_consensus.cc:2272] T 37416d89f4674706a02df9a84c7f3ae3 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.256996 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.257566 20199 raft_consensus.cc:2243] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.258033 20199 raft_consensus.cc:2272] T d13ad599db1d42519e573887087d5a0f P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.260358 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.261075 20199 raft_consensus.cc:2243] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.261511 20199 raft_consensus.cc:2272] T c3677eacee9c41669b921c2143570547 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.264328 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.264911 20199 raft_consensus.cc:2243] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.265297 20199 raft_consensus.cc:2272] T c3925f4bfb894ab1b6890463f034478b P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.268172 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.268783 20199 raft_consensus.cc:2243] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.269224 20199 raft_consensus.cc:2272] T 232202ef61084cb1b794c297a13e0a07 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.271943 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.272574 20199 raft_consensus.cc:2243] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.273080 20199 raft_consensus.cc:2272] T 04d8796d68924971b6214133c03fef63 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.275321 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.275826 20199 raft_consensus.cc:2243] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.276614 20199 raft_consensus.cc:2272] T 27287279f1d34d898c530c2e961f1ea1 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.278680 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.279474 20199 raft_consensus.cc:2243] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.279968 20199 raft_consensus.cc:2272] T b196c8778ba948e3a8684b5b06a20876 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.282815 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.283378 20199 raft_consensus.cc:2243] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.284289 20199 raft_consensus.cc:2272] T b267e53446f24bfab5e48e060d0250d0 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.286715 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.287230 20199 raft_consensus.cc:2243] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.287956 20199 raft_consensus.cc:2272] T 3af3771620b0455ba5105bfb4d256427 P b9712e59a1774be08aa8e368566dcfed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.290364 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.290925 20199 raft_consensus.cc:2243] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.291630 20199 raft_consensus.cc:2272] T 8b3ddfecc18142ca96ca46730679e15d P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.293670 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.294229 20199 raft_consensus.cc:2243] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.294924 20199 raft_consensus.cc:2272] T 1609495998e14d48914fd9d7dce5a3d1 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.297399 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.298108 20199 raft_consensus.cc:2243] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.298581 20199 raft_consensus.cc:2272] T 6438e7353ed64f82b4991b777c290e39 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.301251 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.301970 20199 raft_consensus.cc:2243] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.302827 20199 raft_consensus.cc:2272] T ae95e4a365df4e69b385a8da4f7d0357 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.304291 30126 consensus_peers.cc:597] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.305236 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.305894 20199 raft_consensus.cc:2243] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.306331 20199 raft_consensus.cc:2272] T d64e98dbb807428aaa77b766013b2d3e P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.308554 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.309111 20199 raft_consensus.cc:2243] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.309620 20199 raft_consensus.cc:2272] T 1a7c6f3de6904607952cb2b6c95d45a5 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.312369 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.313098 20199 raft_consensus.cc:2243] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.313506 20199 raft_consensus.cc:2272] T 340f6e2bf07e464a9f0c78041367953d P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.315778 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.316656 20199 raft_consensus.cc:2243] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.317258 20199 raft_consensus.cc:2272] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.320431 20199 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:42.321110 30126 consensus_peers.cc:597] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.321213 20199 raft_consensus.cc:2243] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:14:42.321786 30052 consensus_peers.cc:597] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.322587 20199 raft_consensus.cc:2272] T 13b502d61f804f169b0f20adba55efa5 P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.325421 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.326231 20199 raft_consensus.cc:2243] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.326817 20199 raft_consensus.cc:2272] T e0e23d4c3c2b4b57b9e83c088db43d8c P b9712e59a1774be08aa8e368566dcfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.329547 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.330216 20199 raft_consensus.cc:2243] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.330672 20199 raft_consensus.cc:2272] T e01d3f73348f4deca6026b42f4e83fab P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.333178 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:42.333599 20199 raft_consensus.cc:2243] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.333925 20199 raft_consensus.cc:2272] T 449e14ef64d34e178c4b2a56e512e761 P b9712e59a1774be08aa8e368566dcfed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.340166 30052 consensus_peers.cc:597] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.383123 30052 consensus_peers.cc:597] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.395188 30052 consensus_peers.cc:597] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.398857 29978 consensus_peers.cc:597] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.408766 29978 consensus_peers.cc:597] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.412281 29978 consensus_peers.cc:597] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.416011 30052 consensus_peers.cc:597] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.417407 20199 tablet_server.cc:196] TabletServer@127.19.185.193:38129 shutdown complete.
W20260709 13:14:42.430401 30126 consensus_peers.cc:597] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.438969 29978 consensus_peers.cc:597] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.482949 30126 consensus_peers.cc:597] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.483539 30126 consensus_peers.cc:597] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.509083 29978 consensus_peers.cc:597] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.510862 30126 consensus_peers.cc:597] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.516695 20199 tablet_server.cc:179] TabletServer@127.19.185.194:0 shutting down...
W20260709 13:14:42.516534 29978 consensus_peers.cc:597] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.526476 30052 consensus_peers.cc:597] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.527145 30052 consensus_peers.cc:597] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.561652 30127 consensus_peers.cc:597] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.564352 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:42.565256 20199 tablet_replica.cc:333] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.566148 20199 raft_consensus.cc:2243] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.566624 20199 raft_consensus.cc:2272] T c39528ca9ed34510aabaa30ddbf33da1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.568897 20199 tablet_replica.cc:333] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.569479 20199 raft_consensus.cc:2243] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.569998 20199 raft_consensus.cc:2272] T 27287279f1d34d898c530c2e961f1ea1 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.572474 20199 tablet_replica.cc:333] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.573197 20199 raft_consensus.cc:2243] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.574041 20199 raft_consensus.cc:2272] T c3677eacee9c41669b921c2143570547 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.576210 20199 tablet_replica.cc:333] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.576771 20199 raft_consensus.cc:2243] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.577224 20199 raft_consensus.cc:2272] T 8789ef1eb3f346e480405a1544cd57d5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.579218 20199 tablet_replica.cc:333] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.579771 20199 raft_consensus.cc:2243] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.580268 20199 raft_consensus.cc:2272] T 91006ce206784668a848904ea662f60d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.582254 20199 tablet_replica.cc:333] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.582808 20199 raft_consensus.cc:2243] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.583204 20199 raft_consensus.cc:2272] T affbd9c95c834993a100eeadb412d208 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.585100 20199 tablet_replica.cc:333] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.585626 20199 raft_consensus.cc:2243] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.586372 20199 raft_consensus.cc:2272] T 6438e7353ed64f82b4991b777c290e39 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.589143 20199 tablet_replica.cc:333] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.589869 20199 raft_consensus.cc:2243] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.590412 20199 raft_consensus.cc:2272] T d13ad599db1d42519e573887087d5a0f P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.592600 20199 tablet_replica.cc:333] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.593174 20199 raft_consensus.cc:2243] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.593984 20199 raft_consensus.cc:2272] T 37416d89f4674706a02df9a84c7f3ae3 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.595728 20199 tablet_replica.cc:333] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.596272 20199 raft_consensus.cc:2243] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.596622 20199 raft_consensus.cc:2272] T 1cb1d96bc2a74b3096fcedd6db889969 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.598495 20199 tablet_replica.cc:333] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.599009 20199 raft_consensus.cc:2243] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.599824 20199 raft_consensus.cc:2272] T 8320902d3532452e843e170bb7405f44 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.602257 20199 tablet_replica.cc:333] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.603040 20199 raft_consensus.cc:2243] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.603600 20199 raft_consensus.cc:2272] T 34a5ee0643f24ee996670cdf22181c76 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.605965 20199 tablet_replica.cc:333] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.606564 20199 raft_consensus.cc:2243] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.607141 20199 raft_consensus.cc:2272] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.609696 20199 tablet_replica.cc:333] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.610324 20199 raft_consensus.cc:2243] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.610837 20199 raft_consensus.cc:2272] T 8960d9fe4dcc48798391f67ce47e9f24 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.613406 20199 tablet_replica.cc:333] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.614069 20199 raft_consensus.cc:2243] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.614987 20199 raft_consensus.cc:2272] T 1a7c6f3de6904607952cb2b6c95d45a5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.617513 20199 tablet_replica.cc:333] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.618283 20199 raft_consensus.cc:2243] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.618983 20199 raft_consensus.cc:2272] T 93319818a15f4d37a35a004c1f533803 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.621958 20199 tablet_replica.cc:333] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.622756 20199 raft_consensus.cc:2243] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:14:42.623366 30052 consensus_peers.cc:597] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.623605 20199 raft_consensus.cc:2272] T c319af3352cf463fa873785b1acfb5bd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.624099 30126 consensus_peers.cc:597] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.626457 20199 tablet_replica.cc:333] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.627040 20199 raft_consensus.cc:2243] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.627427 20199 raft_consensus.cc:2272] T 3533d54b9a67432bb09ec05957de7241 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.629845 20199 tablet_replica.cc:333] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.630582 20199 raft_consensus.cc:2243] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.631065 20199 raft_consensus.cc:2272] T 449e14ef64d34e178c4b2a56e512e761 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.634152 20199 tablet_replica.cc:333] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.634809 20199 raft_consensus.cc:2243] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.635242 20199 raft_consensus.cc:2272] T b196c8778ba948e3a8684b5b06a20876 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.637121 30053 consensus_peers.cc:597] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.638087 20199 tablet_replica.cc:333] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.638746 20199 raft_consensus.cc:2243] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.639195 20199 raft_consensus.cc:2272] T b2ff06a319654c8b81ee03263d338afa P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.641292 20199 tablet_replica.cc:333] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.641916 20199 raft_consensus.cc:2243] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.642323 20199 raft_consensus.cc:2272] T 9869b01845b944d8b60d71f7ab3e1934 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.644477 20199 tablet_replica.cc:333] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.645237 20199 raft_consensus.cc:2243] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.645764 20199 raft_consensus.cc:2272] T c43ee291f79741eebbaeff079b730c10 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.649896 20199 tablet_replica.cc:333] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.650871 20199 raft_consensus.cc:2243] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.651386 20199 raft_consensus.cc:2272] T 4887ffedd97e42cf858676b10f32bd09 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.653887 20199 tablet_replica.cc:333] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.654392 20199 raft_consensus.cc:2243] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.655247 20199 raft_consensus.cc:2272] T 340f6e2bf07e464a9f0c78041367953d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.657747 20199 tablet_replica.cc:333] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.658517 20199 raft_consensus.cc:2243] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.659096 20199 raft_consensus.cc:2272] T 0f5ad95d8d5e43d9888dc66173bdae9c P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.661633 20199 tablet_replica.cc:333] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.662348 20199 raft_consensus.cc:2243] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.662904 20199 raft_consensus.cc:2272] T e8c323dfa54847f1890203bcc0f931c9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.664109 30126 consensus_peers.cc:597] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.665285 20199 tablet_replica.cc:333] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.665908 20199 raft_consensus.cc:2243] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.666320 20199 raft_consensus.cc:2272] T d65b829ec05f405d8d11888322430664 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.668578 20199 tablet_replica.cc:333] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.669332 20199 raft_consensus.cc:2243] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.670329 20199 raft_consensus.cc:2272] T 1860b4022529422197e01c32e02598f4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.671193 30053 consensus_peers.cc:597] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.672734 20199 tablet_replica.cc:333] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.673393 20199 raft_consensus.cc:2243] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.674132 20199 raft_consensus.cc:2272] T 986e5222b0a848fe998624fedd70c7a9 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.676303 20199 tablet_replica.cc:333] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.676852 20199 raft_consensus.cc:2243] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.677271 20199 raft_consensus.cc:2272] T bfd7f09ce7b043caa93dbd036bf072d2 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.679327 20199 tablet_replica.cc:333] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.680176 20199 raft_consensus.cc:2243] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.681061 20199 raft_consensus.cc:2272] T 9c97b9de751e4869a4675dfa47486840 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.683495 20199 tablet_replica.cc:333] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.684367 20199 raft_consensus.cc:2243] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:42.684798 30052 consensus_peers.cc:597] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer b9712e59a1774be08aa8e368566dcfed (127.19.185.193:38129): Couldn't send request to peer b9712e59a1774be08aa8e368566dcfed. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:38129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.684892 20199 raft_consensus.cc:2272] T ae95e4a365df4e69b385a8da4f7d0357 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.686971 20199 tablet_replica.cc:333] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.687502 20199 raft_consensus.cc:2243] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.687927 20199 raft_consensus.cc:2272] T d64e98dbb807428aaa77b766013b2d3e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.689976 20199 tablet_replica.cc:333] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.690522 20199 raft_consensus.cc:2243] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.691304 20199 raft_consensus.cc:2272] T f80e36941c78483ebd0edba43ec63b83 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.693295 20199 tablet_replica.cc:333] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.693830 20199 raft_consensus.cc:2243] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.694244 20199 raft_consensus.cc:2272] T 13b502d61f804f169b0f20adba55efa5 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.696203 20199 tablet_replica.cc:333] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.696724 20199 raft_consensus.cc:2243] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.697176 20199 raft_consensus.cc:2272] T b5a07a99809b452d97abd212707856e4 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.699054 20199 tablet_replica.cc:333] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.699604 20199 raft_consensus.cc:2243] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.700428 20199 raft_consensus.cc:2272] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.702386 20199 tablet_replica.cc:333] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.703078 20199 raft_consensus.cc:2243] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.703641 20199 raft_consensus.cc:2272] T 8b3ddfecc18142ca96ca46730679e15d P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.706297 20199 tablet_replica.cc:333] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.707036 20199 raft_consensus.cc:2243] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.708133 20199 raft_consensus.cc:2272] T 7459878da0fd4511bdb65ad263c4697e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.710949 20199 tablet_replica.cc:333] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.711640 20199 raft_consensus.cc:2243] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.712301 20199 raft_consensus.cc:2272] T 53a958826a704e629d021a83d965c74e P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.714917 20199 tablet_replica.cc:333] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.715584 20199 raft_consensus.cc:2243] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.716615 20199 raft_consensus.cc:2272] T 1e9f8efa2d564711b2d5c65c4f7de9cd P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.719483 20199 tablet_replica.cc:333] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.720197 20199 raft_consensus.cc:2243] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.720732 20199 raft_consensus.cc:2272] T 07e24eb550644b86a27b84105bfbc044 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.723297 20199 tablet_replica.cc:333] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36: stopping tablet replica
I20260709 13:14:42.724058 20199 raft_consensus.cc:2243] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.725008 20199 raft_consensus.cc:2272] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 5c83cd09fc554bf48cc07b2d9aa63e36 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.742828 30127 consensus_peers.cc:597] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.754561 30127 consensus_peers.cc:597] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.804112 20199 tablet_server.cc:196] TabletServer@127.19.185.194:0 shutdown complete.
W20260709 13:14:42.824208 30053 consensus_peers.cc:597] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.827059 30053 consensus_peers.cc:597] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.827248 30127 consensus_peers.cc:597] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.834987 30127 consensus_peers.cc:597] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.843070 30127 consensus_peers.cc:597] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.853366 30053 consensus_peers.cc:597] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.893007 20199 tablet_server.cc:179] TabletServer@127.19.185.195:0 shutting down...
W20260709 13:14:42.902032 30127 consensus_peers.cc:597] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.902684 30127 consensus_peers.cc:597] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.908800 30127 consensus_peers.cc:597] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.922238 30053 consensus_peers.cc:597] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.922928 30053 consensus_peers.cc:597] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.944458 30053 consensus_peers.cc:597] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.964300 30127 consensus_peers.cc:597] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.965029 30127 consensus_peers.cc:597] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:42.966152 30127 consensus_peers.cc:597] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.966728 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:42.968607 30053 consensus_peers.cc:597] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.968842 20199 tablet_replica.cc:333] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:42.969903 20199 raft_consensus.cc:2243] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.970566 20199 raft_consensus.cc:2272] T c3677eacee9c41669b921c2143570547 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.973234 20199 tablet_replica.cc:333] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:42.974068 20199 raft_consensus.cc:2243] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.975013 20199 raft_consensus.cc:2272] T c3925f4bfb894ab1b6890463f034478b P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.977609 20199 tablet_replica.cc:333] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:42.978428 20199 raft_consensus.cc:2243] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.978916 20199 raft_consensus.cc:2272] T 8789ef1eb3f346e480405a1544cd57d5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.981729 20199 tablet_replica.cc:333] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:42.982551 20199 raft_consensus.cc:2243] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.983474 20199 raft_consensus.cc:2272] T d13ad599db1d42519e573887087d5a0f P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.986478 20199 tablet_replica.cc:333] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:42.987264 20199 raft_consensus.cc:2243] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.988288 20199 raft_consensus.cc:2272] T 1cb1d96bc2a74b3096fcedd6db889969 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.991055 20199 tablet_replica.cc:333] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:42.991804 20199 raft_consensus.cc:2243] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.992794 20199 raft_consensus.cc:2272] T 244205f3a8df4e07b6dd48c47779e712 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.995805 20199 tablet_replica.cc:333] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:42.996630 20199 raft_consensus.cc:2243] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.997112 20199 raft_consensus.cc:2272] T 8320902d3532452e843e170bb7405f44 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.999984 20199 tablet_replica.cc:333] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.000604 20199 raft_consensus.cc:2243] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.001029 20199 raft_consensus.cc:2272] T b267e53446f24bfab5e48e060d0250d0 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.002863 20199 tablet_replica.cc:333] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.003445 20199 raft_consensus.cc:2243] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.004379 20199 raft_consensus.cc:2272] T 34a5ee0643f24ee996670cdf22181c76 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.006644 20199 tablet_replica.cc:333] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.007242 20199 raft_consensus.cc:2243] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.008018 20199 raft_consensus.cc:2272] T 0e4b15c88c1748e9b84a6fbe8dcfb073 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.010682 20199 tablet_replica.cc:333] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.011456 20199 raft_consensus.cc:2243] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.012001 20199 raft_consensus.cc:2272] T 340f6e2bf07e464a9f0c78041367953d P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.014511 20199 tablet_replica.cc:333] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.015272 20199 raft_consensus.cc:2243] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.015861 20199 raft_consensus.cc:2272] T 4887ffedd97e42cf858676b10f32bd09 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.018087 20199 tablet_replica.cc:333] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.018746 20199 raft_consensus.cc:2243] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.019203 20199 raft_consensus.cc:2272] T b2ff06a319654c8b81ee03263d338afa P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.021574 20199 tablet_replica.cc:333] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.022112 20199 raft_consensus.cc:2243] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.022521 20199 raft_consensus.cc:2272] T 8c2aff9b036d42d98af552cbecc893a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.024945 30053 consensus_peers.cc:597] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 -> Peer 5c83cd09fc554bf48cc07b2d9aa63e36 (127.19.185.194:34209): Couldn't send request to peer 5c83cd09fc554bf48cc07b2d9aa63e36. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.025173 20199 tablet_replica.cc:333] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.025930 20199 raft_consensus.cc:2243] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.026705 20199 raft_consensus.cc:2272] T c43ee291f79741eebbaeff079b730c10 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.029279 20199 tablet_replica.cc:333] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.029820 20199 raft_consensus.cc:2243] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.030227 20199 raft_consensus.cc:2272] T affbd9c95c834993a100eeadb412d208 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.032519 20199 tablet_replica.cc:333] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.033200 20199 raft_consensus.cc:2243] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.033622 20199 raft_consensus.cc:2272] T 8c481032d44545c1bfcdb474fab199ac P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.035991 20199 tablet_replica.cc:333] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.036724 20199 raft_consensus.cc:2243] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.037488 20199 raft_consensus.cc:2272] T 986e5222b0a848fe998624fedd70c7a9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.039527 20199 tablet_replica.cc:333] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.040191 20199 raft_consensus.cc:2243] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.040956 20199 raft_consensus.cc:2272] T bfd7f09ce7b043caa93dbd036bf072d2 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.043035 20199 tablet_replica.cc:333] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.043587 20199 raft_consensus.cc:2243] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.043990 20199 raft_consensus.cc:2272] T 1609495998e14d48914fd9d7dce5a3d1 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.045964 20199 tablet_replica.cc:333] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.046499 20199 raft_consensus.cc:2243] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.046909 20199 raft_consensus.cc:2272] T 9c97b9de751e4869a4675dfa47486840 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.048740 20199 tablet_replica.cc:333] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.049274 20199 raft_consensus.cc:2243] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.049676 20199 raft_consensus.cc:2272] T d65b829ec05f405d8d11888322430664 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.051538 20199 tablet_replica.cc:333] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.052157 20199 raft_consensus.cc:2243] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.052886 20199 raft_consensus.cc:2272] T e8c323dfa54847f1890203bcc0f931c9 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.055126 20199 tablet_replica.cc:333] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.055853 20199 raft_consensus.cc:2243] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.056388 20199 raft_consensus.cc:2272] T e0e23d4c3c2b4b57b9e83c088db43d8c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.058370 20199 tablet_replica.cc:333] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
W20260709 13:14:43.058419 30127 consensus_peers.cc:597] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.059018 20199 raft_consensus.cc:2243] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.059455 20199 raft_consensus.cc:2272] T f80e36941c78483ebd0edba43ec63b83 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.061374 20199 tablet_replica.cc:333] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.062007 20199 raft_consensus.cc:2243] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.062412 20199 raft_consensus.cc:2272] T e01d3f73348f4deca6026b42f4e83fab P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.064339 20199 tablet_replica.cc:333] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.064877 20199 raft_consensus.cc:2243] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.065284 20199 raft_consensus.cc:2272] T 01d37e8e23ef4f4fa7507c9f20cdda87 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.067099 20199 tablet_replica.cc:333] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.067627 20199 raft_consensus.cc:2243] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.068378 20199 raft_consensus.cc:2272] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.070263 20199 tablet_replica.cc:333] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.070806 20199 raft_consensus.cc:2243] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.071547 20199 raft_consensus.cc:2272] T 0f5ad95d8d5e43d9888dc66173bdae9c P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.074236 20199 tablet_replica.cc:333] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.074813 20199 raft_consensus.cc:2243] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.075253 20199 raft_consensus.cc:2272] T c319af3352cf463fa873785b1acfb5bd P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.077195 20199 tablet_replica.cc:333] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.077752 20199 raft_consensus.cc:2243] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.078531 20199 raft_consensus.cc:2272] T 3533d54b9a67432bb09ec05957de7241 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.080569 20199 tablet_replica.cc:333] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.081076 20199 raft_consensus.cc:2243] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.081806 20199 raft_consensus.cc:2272] T 04d8796d68924971b6214133c03fef63 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.083698 20199 tablet_replica.cc:333] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.084329 20199 raft_consensus.cc:2243] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.084748 20199 raft_consensus.cc:2272] T 232202ef61084cb1b794c297a13e0a07 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.086648 20199 tablet_replica.cc:333] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.087182 20199 raft_consensus.cc:2243] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.087607 20199 raft_consensus.cc:2272] T 53a958826a704e629d021a83d965c74e P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.089530 20199 tablet_replica.cc:333] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.090071 20199 raft_consensus.cc:2243] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.090472 20199 raft_consensus.cc:2272] T 1e9f8efa2d564711b2d5c65c4f7de9cd P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.092352 20199 tablet_replica.cc:333] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.092878 20199 raft_consensus.cc:2243] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.093289 20199 raft_consensus.cc:2272] T c039a4adb4a94b4983b0bd4ba5936b85 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.095072 20199 tablet_replica.cc:333] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.095616 20199 raft_consensus.cc:2243] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.096019 20199 raft_consensus.cc:2272] T 3af3771620b0455ba5105bfb4d256427 P fca91c8e2c1d4caaaada7f47eb447d63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.097820 20199 tablet_replica.cc:333] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.098344 20199 raft_consensus.cc:2243] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.098752 20199 raft_consensus.cc:2272] T 07e24eb550644b86a27b84105bfbc044 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.100620 20199 tablet_replica.cc:333] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.101117 20199 raft_consensus.cc:2243] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.101877 20199 raft_consensus.cc:2272] T 90d7a42309c748f0a0ee3236a7e019a5 P fca91c8e2c1d4caaaada7f47eb447d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.103771 20199 tablet_replica.cc:333] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.104295 20199 raft_consensus.cc:2243] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.104707 20199 raft_consensus.cc:2272] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.106551 20199 tablet_replica.cc:333] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.107224 20199 raft_consensus.cc:2243] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.107717 20199 raft_consensus.cc:2272] T 381657a3006a4f52b1268ecae19b2922 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.110270 20199 tablet_replica.cc:333] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.110844 20199 raft_consensus.cc:2243] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.111346 20199 raft_consensus.cc:2272] T 7459878da0fd4511bdb65ad263c4697e P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.113547 20199 tablet_replica.cc:333] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.114027 20199 raft_consensus.cc:2243] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.115068 20199 raft_consensus.cc:2272] T 93319818a15f4d37a35a004c1f533803 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.116999 20199 tablet_replica.cc:333] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63: stopping tablet replica
I20260709 13:14:43.117435 20199 raft_consensus.cc:2243] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.117847 20199 raft_consensus.cc:2272] T 1860b4022529422197e01c32e02598f4 P fca91c8e2c1d4caaaada7f47eb447d63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.186108 20199 tablet_server.cc:196] TabletServer@127.19.185.195:0 shutdown complete.
W20260709 13:14:43.201085 30127 consensus_peers.cc:597] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:42729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.201730 30127 consensus_peers.cc:597] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:42729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.241791 30127 consensus_peers.cc:597] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:42729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.260969 20199 tablet_server.cc:179] TabletServer@127.19.185.196:0 shutting down...
W20260709 13:14:43.284998 30127 consensus_peers.cc:597] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:42729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.318205 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:43.319026 20199 tablet_replica.cc:333] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.319649 20199 raft_consensus.cc:2243] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.320509 20199 raft_consensus.cc:2272] T c39528ca9ed34510aabaa30ddbf33da1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.322753 20199 tablet_replica.cc:333] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.323529 20199 raft_consensus.cc:2243] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.324096 20199 raft_consensus.cc:2272] T c3925f4bfb894ab1b6890463f034478b P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.326333 20199 tablet_replica.cc:333] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.327155 20199 raft_consensus.cc:2243] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.328171 20199 raft_consensus.cc:2272] T 8789ef1eb3f346e480405a1544cd57d5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.330905 20199 tablet_replica.cc:333] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
W20260709 13:14:43.331355 30127 consensus_peers.cc:597] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:42729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.331547 20199 raft_consensus.cc:2243] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.332213 20199 raft_consensus.cc:2272] T 37416d89f4674706a02df9a84c7f3ae3 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.334260 20199 tablet_replica.cc:333] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.334854 20199 raft_consensus.cc:2243] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.335294 20199 raft_consensus.cc:2272] T 244205f3a8df4e07b6dd48c47779e712 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.337265 20199 tablet_replica.cc:333] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.337836 20199 raft_consensus.cc:2243] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.338249 20199 raft_consensus.cc:2272] T 8320902d3532452e843e170bb7405f44 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.340252 20199 tablet_replica.cc:333] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.340824 20199 raft_consensus.cc:2243] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.341233 20199 raft_consensus.cc:2272] T b267e53446f24bfab5e48e060d0250d0 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.343171 20199 tablet_replica.cc:333] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.343734 20199 raft_consensus.cc:2243] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.344189 20199 raft_consensus.cc:2272] T 6438e7353ed64f82b4991b777c290e39 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.346273 20199 tablet_replica.cc:333] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.346830 20199 raft_consensus.cc:2243] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.347581 20199 raft_consensus.cc:2272] T 8960d9fe4dcc48798391f67ce47e9f24 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.349845 20199 tablet_replica.cc:333] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.350458 20199 raft_consensus.cc:2243] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.351321 20199 raft_consensus.cc:2272] T 4887ffedd97e42cf858676b10f32bd09 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.352885 30127 consensus_peers.cc:597] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 -> Peer fca91c8e2c1d4caaaada7f47eb447d63 (127.19.185.195:42729): Couldn't send request to peer fca91c8e2c1d4caaaada7f47eb447d63. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.195:42729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.353678 20199 tablet_replica.cc:333] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.354246 20199 raft_consensus.cc:2243] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.354779 20199 raft_consensus.cc:2272] T 34a5ee0643f24ee996670cdf22181c76 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.357204 20199 tablet_replica.cc:333] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.357843 20199 raft_consensus.cc:2243] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.358320 20199 raft_consensus.cc:2272] T 986e5222b0a848fe998624fedd70c7a9 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.360208 20199 tablet_replica.cc:333] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.360687 20199 raft_consensus.cc:2243] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.361029 20199 raft_consensus.cc:2272] T bfd7f09ce7b043caa93dbd036bf072d2 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.362854 20199 tablet_replica.cc:333] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.363322 20199 raft_consensus.cc:2243] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.363669 20199 raft_consensus.cc:2272] T c319af3352cf463fa873785b1acfb5bd P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.365484 20199 tablet_replica.cc:333] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.365958 20199 raft_consensus.cc:2243] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.366308 20199 raft_consensus.cc:2272] T 3533d54b9a67432bb09ec05957de7241 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.368140 20199 tablet_replica.cc:333] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.368713 20199 raft_consensus.cc:2243] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.369396 20199 raft_consensus.cc:2272] T 449e14ef64d34e178c4b2a56e512e761 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.371162 20199 tablet_replica.cc:333] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.371639 20199 raft_consensus.cc:2243] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.372104 20199 raft_consensus.cc:2272] T 1a7c6f3de6904607952cb2b6c95d45a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.373961 20199 tablet_replica.cc:333] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.374430 20199 raft_consensus.cc:2243] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.375124 20199 raft_consensus.cc:2272] T b196c8778ba948e3a8684b5b06a20876 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.377542 20199 tablet_replica.cc:333] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.378213 20199 raft_consensus.cc:2243] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.378576 20199 raft_consensus.cc:2272] T 8b3ddfecc18142ca96ca46730679e15d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.380914 20199 tablet_replica.cc:333] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.381516 20199 raft_consensus.cc:2243] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.381971 20199 raft_consensus.cc:2272] T 3af3771620b0455ba5105bfb4d256427 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.384543 20199 tablet_replica.cc:333] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.385351 20199 raft_consensus.cc:2243] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.386240 20199 raft_consensus.cc:2272] T e0e23d4c3c2b4b57b9e83c088db43d8c P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.388216 20199 tablet_replica.cc:333] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.388751 20199 raft_consensus.cc:2243] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.389154 20199 raft_consensus.cc:2272] T f80e36941c78483ebd0edba43ec63b83 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.390879 20199 tablet_replica.cc:333] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.391470 20199 raft_consensus.cc:2243] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.391867 20199 raft_consensus.cc:2272] T 13b502d61f804f169b0f20adba55efa5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.393738 20199 tablet_replica.cc:333] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.394246 20199 raft_consensus.cc:2243] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.395099 20199 raft_consensus.cc:2272] T e01d3f73348f4deca6026b42f4e83fab P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.397082 20199 tablet_replica.cc:333] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.397639 20199 raft_consensus.cc:2243] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.398063 20199 raft_consensus.cc:2272] T 01d37e8e23ef4f4fa7507c9f20cdda87 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.399789 20199 tablet_replica.cc:333] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.400382 20199 raft_consensus.cc:2243] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.401172 20199 raft_consensus.cc:2272] T 53a958826a704e629d021a83d965c74e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.403079 20199 tablet_replica.cc:333] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.403628 20199 raft_consensus.cc:2243] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.404109 20199 raft_consensus.cc:2272] T c039a4adb4a94b4983b0bd4ba5936b85 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.406119 20199 tablet_replica.cc:333] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.406749 20199 raft_consensus.cc:2243] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.407609 20199 raft_consensus.cc:2272] T b5a07a99809b452d97abd212707856e4 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.409711 20199 tablet_replica.cc:333] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.410274 20199 raft_consensus.cc:2243] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.410686 20199 raft_consensus.cc:2272] T 9869b01845b944d8b60d71f7ab3e1934 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.412595 20199 tablet_replica.cc:333] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.413132 20199 raft_consensus.cc:2243] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.413847 20199 raft_consensus.cc:2272] T 8c2aff9b036d42d98af552cbecc893a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.415702 20199 tablet_replica.cc:333] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.416250 20199 raft_consensus.cc:2243] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.416643 20199 raft_consensus.cc:2272] T b7b95bfcf7cd48e5aa9e14f40f7b9118 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.418463 20199 tablet_replica.cc:333] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.418996 20199 raft_consensus.cc:2243] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.419759 20199 raft_consensus.cc:2272] T 381657a3006a4f52b1268ecae19b2922 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.421612 20199 tablet_replica.cc:333] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.422134 20199 raft_consensus.cc:2243] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.422531 20199 raft_consensus.cc:2272] T 91006ce206784668a848904ea662f60d P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.424412 20199 tablet_replica.cc:333] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.424947 20199 raft_consensus.cc:2243] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.425344 20199 raft_consensus.cc:2272] T 8c481032d44545c1bfcdb474fab199ac P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.427181 20199 tablet_replica.cc:333] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.427693 20199 raft_consensus.cc:2243] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.428150 20199 raft_consensus.cc:2272] T ae95e4a365df4e69b385a8da4f7d0357 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.430089 20199 tablet_replica.cc:333] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.430663 20199 raft_consensus.cc:2243] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.431068 20199 raft_consensus.cc:2272] T 1609495998e14d48914fd9d7dce5a3d1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.432945 20199 tablet_replica.cc:333] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.433388 20199 raft_consensus.cc:2243] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.433722 20199 raft_consensus.cc:2272] T 9c97b9de751e4869a4675dfa47486840 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.435580 20199 tablet_replica.cc:333] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.436010 20199 raft_consensus.cc:2243] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.436734 20199 raft_consensus.cc:2272] T d64e98dbb807428aaa77b766013b2d3e P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.438684 20199 tablet_replica.cc:333] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.439193 20199 raft_consensus.cc:2243] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.439939 20199 raft_consensus.cc:2272] T 07e24eb550644b86a27b84105bfbc044 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.441780 20199 tablet_replica.cc:333] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.442288 20199 raft_consensus.cc:2243] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.442708 20199 raft_consensus.cc:2272] T 90d7a42309c748f0a0ee3236a7e019a5 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.444474 20199 tablet_replica.cc:333] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.444921 20199 raft_consensus.cc:2243] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.445258 20199 raft_consensus.cc:2272] T 29e8c3cdaf33402dbdedf5ac7b0d5f69 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.447053 20199 tablet_replica.cc:333] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.447497 20199 raft_consensus.cc:2243] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.447834 20199 raft_consensus.cc:2272] T 27287279f1d34d898c530c2e961f1ea1 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.449514 20199 tablet_replica.cc:333] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.449966 20199 raft_consensus.cc:2243] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.450325 20199 raft_consensus.cc:2272] T 04d8796d68924971b6214133c03fef63 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.452075 20199 tablet_replica.cc:333] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49: stopping tablet replica
I20260709 13:14:43.452483 20199 raft_consensus.cc:2243] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.453184 20199 raft_consensus.cc:2272] T 232202ef61084cb1b794c297a13e0a07 P 0c8ac4f0fa334a16b65c6a52a89b8d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.535058 20199 tablet_server.cc:196] TabletServer@127.19.185.196:0 shutdown complete.
I20260709 13:14:43.597010 20199 master.cc:562] Master@127.19.185.254:34975 shutting down...
I20260709 13:14:43.626260 20199 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.626879 20199 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.627190 20199 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7050905dc68b4287b91cfda87917dfd8: stopping tablet replica
I20260709 13:14:43.649482 20199 master.cc:584] Master@127.19.185.254:34975 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34141 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:14:43.741066 20199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.185.254:39787
I20260709 13:14:43.742286 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:43.748816 31197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:43.749163 31198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:43.749737 31200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:43.750483 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:43.751613 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:43.751792 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:43.751991 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602883751948 us; error 0 us; skew 500 ppm
I20260709 13:14:43.752593 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:43.759845 20199 webserver.cc:533] Webserver started at http://127.19.185.254:46595/ using document root <none> and password file <none>
I20260709 13:14:43.760423 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:43.760650 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:43.760924 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:43.762053 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/master-0-root/instance:
uuid: "958003602e9045528f5c1310d82f834a"
format_stamp: "Formatted at 2026-07-09 13:14:43 on dist-test-slave-rrf3"
I20260709 13:14:43.766537 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:14:43.769912 31205 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:43.770645 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:14:43.770943 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/master-0-root
uuid: "958003602e9045528f5c1310d82f834a"
format_stamp: "Formatted at 2026-07-09 13:14:43 on dist-test-slave-rrf3"
I20260709 13:14:43.771219 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:43.789158 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:43.790382 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:43.829310 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.254:39787
I20260709 13:14:43.829416 31256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.254:39787 every 8 connection(s)
I20260709 13:14:43.833412 31257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:43.846246 31257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a: Bootstrap starting.
I20260709 13:14:43.851560 31257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:43.856422 31257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a: No bootstrap required, opened a new log
I20260709 13:14:43.858681 31257 raft_consensus.cc:359] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958003602e9045528f5c1310d82f834a" member_type: VOTER }
I20260709 13:14:43.859182 31257 raft_consensus.cc:385] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:43.859467 31257 raft_consensus.cc:740] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958003602e9045528f5c1310d82f834a, State: Initialized, Role: FOLLOWER
I20260709 13:14:43.860258 31257 consensus_queue.cc:260] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958003602e9045528f5c1310d82f834a" member_type: VOTER }
I20260709 13:14:43.860705 31257 raft_consensus.cc:399] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:43.860905 31257 raft_consensus.cc:493] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:43.861115 31257 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.865954 31257 raft_consensus.cc:515] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958003602e9045528f5c1310d82f834a" member_type: VOTER }
I20260709 13:14:43.866457 31257 leader_election.cc:304] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 958003602e9045528f5c1310d82f834a; no voters: 
I20260709 13:14:43.867617 31257 leader_election.cc:290] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:43.867978 31260 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:43.869438 31260 raft_consensus.cc:697] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 1 LEADER]: Becoming Leader. State: Replica: 958003602e9045528f5c1310d82f834a, State: Running, Role: LEADER
I20260709 13:14:43.870118 31260 consensus_queue.cc:237] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958003602e9045528f5c1310d82f834a" member_type: VOTER }
I20260709 13:14:43.870924 31257 sys_catalog.cc:565] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:43.874374 31261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "958003602e9045528f5c1310d82f834a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958003602e9045528f5c1310d82f834a" member_type: VOTER } }
I20260709 13:14:43.875025 31261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:43.875005 31262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 958003602e9045528f5c1310d82f834a. Latest consensus state: current_term: 1 leader_uuid: "958003602e9045528f5c1310d82f834a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958003602e9045528f5c1310d82f834a" member_type: VOTER } }
I20260709 13:14:43.875932 31262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:43.879565 31266 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:43.884788 31266 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:43.889637 20199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:43.894227 31266 catalog_manager.cc:1383] Generated new cluster ID: d76408812cb1461aa07afbc1a71e7c21
I20260709 13:14:43.894541 31266 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:43.909236 31266 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:43.910569 31266 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:43.931341 31266 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a: Generated new TSK 0
I20260709 13:14:43.932011 31266 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:43.957448 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:43.966137 31278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:43.966845 31279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:43.969517 31281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:43.970582 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:43.971822 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:43.972118 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:43.972323 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602883972305 us; error 0 us; skew 500 ppm
I20260709 13:14:43.973215 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:43.976465 20199 webserver.cc:533] Webserver started at http://127.19.185.193:43989/ using document root <none> and password file <none>
I20260709 13:14:43.977131 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:43.977375 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:43.977767 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:43.979470 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root/instance:
uuid: "fef85a27379d47749867ecb8d725b327"
format_stamp: "Formatted at 2026-07-09 13:14:43 on dist-test-slave-rrf3"
I20260709 13:14:43.984987 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:14:43.990465 31286 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:43.991536 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:14:43.992012 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "fef85a27379d47749867ecb8d725b327"
format_stamp: "Formatted at 2026-07-09 13:14:43 on dist-test-slave-rrf3"
I20260709 13:14:43.992483 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:44.018127 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:44.019362 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:44.020884 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:44.023185 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:44.023357 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:44.023659 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:44.023829 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:44.065248 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:35519
I20260709 13:14:44.065367 31348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:35519 every 8 connection(s)
I20260709 13:14:44.070478 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:44.079236 31353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:44.082854 31354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:44.083113 20199 server_base.cc:1061] running on GCE node
W20260709 13:14:44.084206 31356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:44.085382 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:44.085685 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:44.085878 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602884085863 us; error 0 us; skew 500 ppm
I20260709 13:14:44.085891 31349 heartbeater.cc:344] Connected to a master server at 127.19.185.254:39787
I20260709 13:14:44.086309 31349 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:44.086634 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:44.087009 31349 heartbeater.cc:507] Master 127.19.185.254:39787 requested a full tablet report, sending...
I20260709 13:14:44.089424 20199 webserver.cc:533] Webserver started at http://127.19.185.194:45129/ using document root <none> and password file <none>
I20260709 13:14:44.089629 31222 ts_manager.cc:194] Registered new tserver with Master: fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519)
I20260709 13:14:44.090168 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:44.090440 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:44.090767 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:44.092118 31222 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33960
I20260709 13:14:44.092231 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-1-root/instance:
uuid: "6e6d613befde4e62b5352c1c14bcaf29"
format_stamp: "Formatted at 2026-07-09 13:14:44 on dist-test-slave-rrf3"
I20260709 13:14:44.097527 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:44.101241 31361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:44.102082 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:14:44.102335 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-1-root
uuid: "6e6d613befde4e62b5352c1c14bcaf29"
format_stamp: "Formatted at 2026-07-09 13:14:44 on dist-test-slave-rrf3"
I20260709 13:14:44.102576 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:44.112468 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:44.113606 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:44.114977 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:44.117285 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:44.117466 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:44.117754 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:44.117918 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:44.159209 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.194:42315
I20260709 13:14:44.159336 31423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.194:42315 every 8 connection(s)
I20260709 13:14:44.163986 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:44.170786 31427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:44.171448 31428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:44.174608 31430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:44.175150 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:44.176849 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:44.177109 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:44.177201 31424 heartbeater.cc:344] Connected to a master server at 127.19.185.254:39787
I20260709 13:14:44.177345 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602884177323 us; error 0 us; skew 500 ppm
I20260709 13:14:44.177675 31424 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:44.178145 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:44.178574 31424 heartbeater.cc:507] Master 127.19.185.254:39787 requested a full tablet report, sending...
I20260709 13:14:44.180907 31222 ts_manager.cc:194] Registered new tserver with Master: 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:44.182252 31222 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33976
I20260709 13:14:44.183512 20199 webserver.cc:533] Webserver started at http://127.19.185.195:33991/ using document root <none> and password file <none>
I20260709 13:14:44.184262 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:44.184497 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:44.184775 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:44.185946 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-2-root/instance:
uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
format_stamp: "Formatted at 2026-07-09 13:14:44 on dist-test-slave-rrf3"
I20260709 13:14:44.190579 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:44.194033 31435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:44.194839 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:44.195232 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-2-root
uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
format_stamp: "Formatted at 2026-07-09 13:14:44 on dist-test-slave-rrf3"
I20260709 13:14:44.195518 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:44.240160 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:44.241328 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:44.242764 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:44.245208 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:44.245440 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:44.245689 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:44.245864 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:44.288867 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.195:45617
I20260709 13:14:44.288981 31497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.195:45617 every 8 connection(s)
I20260709 13:14:44.302896 31498 heartbeater.cc:344] Connected to a master server at 127.19.185.254:39787
I20260709 13:14:44.303297 31498 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:44.304155 31498 heartbeater.cc:507] Master 127.19.185.254:39787 requested a full tablet report, sending...
I20260709 13:14:44.306048 31222 ts_manager.cc:194] Registered new tserver with Master: 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:44.306829 20199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014624129s
I20260709 13:14:44.307528 31222 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33988
I20260709 13:14:44.333232 31222 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34004:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:44.336280 31222 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:44.413020 31314 tablet_service.cc:1511] Processing CreateTablet for tablet 254ef3d5e8254dec95e15895bed25d44 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:44.418239 31314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ef3d5e8254dec95e15895bed25d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.417999 31313 tablet_service.cc:1511] Processing CreateTablet for tablet d028789819df4b7aa36ef622c6221c4b (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:44.420490 31313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d028789819df4b7aa36ef622c6221c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.437340 31312 tablet_service.cc:1511] Processing CreateTablet for tablet a874a108a1b74919bb600d7ae61d8f58 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:44.439020 31312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a874a108a1b74919bb600d7ae61d8f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.439947 31463 tablet_service.cc:1511] Processing CreateTablet for tablet 254ef3d5e8254dec95e15895bed25d44 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:44.440336 31462 tablet_service.cc:1511] Processing CreateTablet for tablet d028789819df4b7aa36ef622c6221c4b (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:44.441531 31463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ef3d5e8254dec95e15895bed25d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.442205 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d028789819df4b7aa36ef622c6221c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.443114 31461 tablet_service.cc:1511] Processing CreateTablet for tablet a874a108a1b74919bb600d7ae61d8f58 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:44.444591 31461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a874a108a1b74919bb600d7ae61d8f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.460918 31311 tablet_service.cc:1511] Processing CreateTablet for tablet 144dffcbe8c14cb28cfcf976a4067b1d (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:44.462488 31311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144dffcbe8c14cb28cfcf976a4067b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.466171 31513 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:44.466723 31389 tablet_service.cc:1511] Processing CreateTablet for tablet 254ef3d5e8254dec95e15895bed25d44 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:44.467411 31387 tablet_service.cc:1511] Processing CreateTablet for tablet a874a108a1b74919bb600d7ae61d8f58 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:44.468288 31389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ef3d5e8254dec95e15895bed25d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.469055 31387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a874a108a1b74919bb600d7ae61d8f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.470640 31388 tablet_service.cc:1511] Processing CreateTablet for tablet d028789819df4b7aa36ef622c6221c4b (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:44.472198 31388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d028789819df4b7aa36ef622c6221c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.475219 31513 tablet_bootstrap.cc:654] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.493750 31515 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:44.511584 31386 tablet_service.cc:1511] Processing CreateTablet for tablet 144dffcbe8c14cb28cfcf976a4067b1d (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:44.513162 31386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144dffcbe8c14cb28cfcf976a4067b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.517066 31515 tablet_bootstrap.cc:654] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.521035 31513 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:44.521581 31513 ts_tablet_manager.cc:1403] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.023s
I20260709 13:14:44.522972 31461 tablet_service.cc:1511] Processing CreateTablet for tablet 144dffcbe8c14cb28cfcf976a4067b1d (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:44.524415 31461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144dffcbe8c14cb28cfcf976a4067b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.524616 31513 raft_consensus.cc:359] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.525403 31513 raft_consensus.cc:385] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.525712 31513 raft_consensus.cc:740] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.526630 31513 consensus_queue.cc:260] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.529260 31516 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:44.532208 31462 tablet_service.cc:1511] Processing CreateTablet for tablet f86b42ff1b1d46159b7d833a795d6f50 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:44.532943 31311 tablet_service.cc:1511] Processing CreateTablet for tablet 41046b8af00d481e96309be0d7fe4946 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:44.533842 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86b42ff1b1d46159b7d833a795d6f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.534303 31311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41046b8af00d481e96309be0d7fe4946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.537190 31312 tablet_service.cc:1511] Processing CreateTablet for tablet f86b42ff1b1d46159b7d833a795d6f50 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:44.538973 31312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86b42ff1b1d46159b7d833a795d6f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.543819 31513 ts_tablet_manager.cc:1434] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 13:14:44.547483 31516 tablet_bootstrap.cc:654] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.554047 31463 tablet_service.cc:1511] Processing CreateTablet for tablet 41046b8af00d481e96309be0d7fe4946 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:44.555527 31463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41046b8af00d481e96309be0d7fe4946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.555958 31515 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:44.556551 31515 ts_tablet_manager.cc:1403] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
I20260709 13:14:44.556995 31389 tablet_service.cc:1511] Processing CreateTablet for tablet 827baed22a1947539e3a5fc6de4b7bbc (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:44.558180 31313 tablet_service.cc:1511] Processing CreateTablet for tablet 827baed22a1947539e3a5fc6de4b7bbc (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:44.559698 31313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827baed22a1947539e3a5fc6de4b7bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.561213 31513 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:44.570421 31387 tablet_service.cc:1511] Processing CreateTablet for tablet 41046b8af00d481e96309be0d7fe4946 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:44.571384 31459 tablet_service.cc:1511] Processing CreateTablet for tablet f0ae6ae390464869ba10803a2245a6cb (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:44.561360 31460 tablet_service.cc:1511] Processing CreateTablet for tablet 827baed22a1947539e3a5fc6de4b7bbc (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:44.559986 31515 raft_consensus.cc:359] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:44.565892 31385 tablet_service.cc:1511] Processing CreateTablet for tablet f0ae6ae390464869ba10803a2245a6cb (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:44.566645 31389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827baed22a1947539e3a5fc6de4b7bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.572811 31459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ae6ae390464869ba10803a2245a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.560436 31498 heartbeater.cc:499] Master 127.19.185.254:39787 was elected leader, sending a full tablet report...
I20260709 13:14:44.577515 31310 tablet_service.cc:1511] Processing CreateTablet for tablet c75b9ed11f644d5bb5e9595f198ace0e (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:44.579419 31310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75b9ed11f644d5bb5e9595f198ace0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.573765 31515 raft_consensus.cc:385] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.580289 31387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41046b8af00d481e96309be0d7fe4946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.580472 31515 raft_consensus.cc:740] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.581285 31515 consensus_queue.cc:260] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:44.584525 31385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ae6ae390464869ba10803a2245a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.563624 31314 tablet_service.cc:1511] Processing CreateTablet for tablet f0ae6ae390464869ba10803a2245a6cb (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:44.569197 31388 tablet_service.cc:1511] Processing CreateTablet for tablet f86b42ff1b1d46159b7d833a795d6f50 (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:44.592715 31314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ae6ae390464869ba10803a2245a6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.592463 31386 tablet_service.cc:1511] Processing CreateTablet for tablet c75b9ed11f644d5bb5e9595f198ace0e (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:44.596436 31388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86b42ff1b1d46159b7d833a795d6f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.597085 31460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827baed22a1947539e3a5fc6de4b7bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.602218 31386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75b9ed11f644d5bb5e9595f198ace0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.607422 31462 tablet_service.cc:1511] Processing CreateTablet for tablet c75b9ed11f644d5bb5e9595f198ace0e (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:44.608858 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75b9ed11f644d5bb5e9595f198ace0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.613906 31515 ts_tablet_manager.cc:1434] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.057s	user 0.002s	sys 0.022s
I20260709 13:14:44.614773 31349 heartbeater.cc:499] Master 127.19.185.254:39787 was elected leader, sending a full tablet report...
I20260709 13:14:44.615113 31515 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:44.621479 31515 tablet_bootstrap.cc:654] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.635217 31517 raft_consensus.cc:493] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.636109 31517 raft_consensus.cc:515] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.644518 31513 tablet_bootstrap.cc:654] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.645296 31384 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea7637b7c9b4fc0bac88ebab10a530d (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:44.646770 31384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea7637b7c9b4fc0bac88ebab10a530d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.649119 31463 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea7637b7c9b4fc0bac88ebab10a530d (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:44.649394 31313 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea7637b7c9b4fc0bac88ebab10a530d (DEFAULT_TABLE table=test-workload [id=77a2b1d5391143b6949523c1c90d7b01]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:44.650471 31463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea7637b7c9b4fc0bac88ebab10a530d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.650702 31313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea7637b7c9b4fc0bac88ebab10a530d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:44.654090 31517 leader_election.cc:290] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:44.670897 31516 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:44.671685 31516 ts_tablet_manager.cc:1403] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.030s
I20260709 13:14:44.675295 31516 raft_consensus.cc:359] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:44.677775 31516 raft_consensus.cc:385] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.695616 31516 raft_consensus.cc:740] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.696489 31516 consensus_queue.cc:260] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:44.697502 31324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
W20260709 13:14:44.699739 31439 leader_election.cc:343] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:44.725868 31516 ts_tablet_manager.cc:1434] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.001s
I20260709 13:14:44.726768 31424 heartbeater.cc:499] Master 127.19.185.254:39787 was elected leader, sending a full tablet report...
I20260709 13:14:44.728668 31516 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:44.744148 31515 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:44.744746 31515 ts_tablet_manager.cc:1403] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.130s	user 0.029s	sys 0.022s
I20260709 13:14:44.747695 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:44.748680 31515 raft_consensus.cc:359] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
W20260709 13:14:44.749395 31437 leader_election.cc:343] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:44.749572 31515 raft_consensus.cc:385] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.750025 31515 raft_consensus.cc:740] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.749977 31437 leader_election.cc:304] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818; no voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327
I20260709 13:14:44.750972 31517 raft_consensus.cc:2749] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:44.751067 31515 consensus_queue.cc:260] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.753541 31515 ts_tablet_manager.cc:1434] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:44.754563 31515 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:44.754611 31520 raft_consensus.cc:493] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.755162 31520 raft_consensus.cc:515] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:44.757918 31520 leader_election.cc:290] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:44.764835 31515 tablet_bootstrap.cc:654] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.775146 31516 tablet_bootstrap.cc:654] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.780588 31513 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:44.781342 31513 ts_tablet_manager.cc:1403] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.220s	user 0.011s	sys 0.011s
I20260709 13:14:44.789827 31515 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:44.790735 31515 ts_tablet_manager.cc:1403] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.006s
I20260709 13:14:44.792547 31513 raft_consensus.cc:359] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
W20260709 13:14:44.793155 31499 tablet.cc:2406] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:44.793407 31513 raft_consensus.cc:385] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.793857 31513 raft_consensus.cc:740] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.795691 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ef3d5e8254dec95e15895bed25d44" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:44.796700 31399 raft_consensus.cc:2468] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:44.797468 31515 raft_consensus.cc:359] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.798009 31288 leader_election.cc:304] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:44.798219 31515 raft_consensus.cc:385] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.798687 31515 raft_consensus.cc:740] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.798935 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ef3d5e8254dec95e15895bed25d44" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:44.799764 31520 raft_consensus.cc:2804] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:44.799554 31515 consensus_queue.cc:260] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.800221 31520 raft_consensus.cc:493] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.800716 31520 raft_consensus.cc:3060] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.795948 31513 consensus_queue.cc:260] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:44.801239 31516 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:44.801443 31473 raft_consensus.cc:2468] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:44.801786 31516 ts_tablet_manager.cc:1403] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.017s
I20260709 13:14:44.805174 31516 raft_consensus.cc:359] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.805876 31516 raft_consensus.cc:385] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.806155 31516 raft_consensus.cc:740] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.806875 31516 consensus_queue.cc:260] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.809013 31516 ts_tablet_manager.cc:1434] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:44.809617 31515 ts_tablet_manager.cc:1434] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:14:44.810024 31516 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:44.809583 31520 raft_consensus.cc:515] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:44.814445 31513 ts_tablet_manager.cc:1434] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:14:44.815284 31515 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:44.816606 31516 tablet_bootstrap.cc:654] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.817607 31513 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:44.823688 31515 tablet_bootstrap.cc:654] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.830150 31520 leader_election.cc:290] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Requested vote from peers 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:44.831382 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ef3d5e8254dec95e15895bed25d44" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:44.828411 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ef3d5e8254dec95e15895bed25d44" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:44.832283 31399 raft_consensus.cc:3060] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.832458 31473 raft_consensus.cc:3060] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.837231 31513 tablet_bootstrap.cc:654] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.840348 31399 raft_consensus.cc:2468] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:44.841533 31288 leader_election.cc:304] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:44.842229 31520 raft_consensus.cc:2804] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:44.842692 31520 raft_consensus.cc:697] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Becoming Leader. State: Replica: fef85a27379d47749867ecb8d725b327, State: Running, Role: LEADER
I20260709 13:14:44.843535 31520 consensus_queue.cc:237] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:44.847904 31515 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:44.848346 31516 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:44.848508 31515 ts_tablet_manager.cc:1403] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.015s
I20260709 13:14:44.848917 31516 ts_tablet_manager.cc:1403] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.007s
I20260709 13:14:44.851508 31515 raft_consensus.cc:359] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.851706 31516 raft_consensus.cc:359] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.852324 31515 raft_consensus.cc:385] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.852398 31516 raft_consensus.cc:385] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.852697 31515 raft_consensus.cc:740] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.852768 31516 raft_consensus.cc:740] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.853114 31220 catalog_manager.cc:5697] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 reported cstate change: term changed from 0 to 1, leader changed from <none> to fef85a27379d47749867ecb8d725b327 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "fef85a27379d47749867ecb8d725b327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.853559 31516 consensus_queue.cc:260] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.853559 31515 consensus_queue.cc:260] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.855944 31515 ts_tablet_manager.cc:1434] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:44.857005 31515 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:44.859722 31473 raft_consensus.cc:2468] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:44.855943 31516 ts_tablet_manager.cc:1434] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:44.861840 31516 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:44.864220 31513 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:44.864766 31513 ts_tablet_manager.cc:1403] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.001s
I20260709 13:14:44.864988 31515 tablet_bootstrap.cc:654] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.868475 31516 tablet_bootstrap.cc:654] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.872284 31523 raft_consensus.cc:493] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.872859 31523 raft_consensus.cc:515] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.873303 31515 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:44.874090 31515 ts_tablet_manager.cc:1403] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:14:44.867818 31513 raft_consensus.cc:359] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.875422 31513 raft_consensus.cc:385] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.876173 31513 raft_consensus.cc:740] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.877157 31513 consensus_queue.cc:260] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.878108 31515 raft_consensus.cc:359] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.879146 31515 raft_consensus.cc:385] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.879561 31515 raft_consensus.cc:740] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.879727 31513 ts_tablet_manager.cc:1434] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:14:44.881007 31513 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:44.880786 31515 consensus_queue.cc:260] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.884438 31515 ts_tablet_manager.cc:1434] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
W20260709 13:14:44.885872 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:44.885852 31515 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:44.875648 31523 leader_election.cc:290] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:44.895347 31515 tablet_bootstrap.cc:654] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.898164 31516 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:44.898833 31516 ts_tablet_manager.cc:1403] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.020s
I20260709 13:14:44.901901 31516 raft_consensus.cc:359] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.902806 31516 raft_consensus.cc:385] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.903216 31516 raft_consensus.cc:740] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.902367 31513 tablet_bootstrap.cc:654] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.904382 31516 consensus_queue.cc:260] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.906984 31516 ts_tablet_manager.cc:1434] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:44.908138 31516 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:44.915472 31516 tablet_bootstrap.cc:654] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.920126 31513 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:44.920850 31513 ts_tablet_manager.cc:1403] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.001s
I20260709 13:14:44.925709 31324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a874a108a1b74919bb600d7ae61d8f58" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
I20260709 13:14:44.926797 31324 raft_consensus.cc:2468] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 0.
I20260709 13:14:44.929157 31365 leader_election.cc:304] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:44.930409 31523 raft_consensus.cc:2804] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:44.930791 31523 raft_consensus.cc:493] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.931145 31523 raft_consensus.cc:3060] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.931517 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a874a108a1b74919bb600d7ae61d8f58" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:44.932170 31473 raft_consensus.cc:2468] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 0.
I20260709 13:14:44.931152 31513 raft_consensus.cc:359] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.934561 31515 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:44.934551 31516 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:44.934906 31513 raft_consensus.cc:385] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.935386 31515 ts_tablet_manager.cc:1403] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.012s
I20260709 13:14:44.935431 31513 raft_consensus.cc:740] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.935642 31516 ts_tablet_manager.cc:1403] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 13:14:44.937058 31513 consensus_queue.cc:260] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.938674 31515 raft_consensus.cc:359] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.939450 31515 raft_consensus.cc:385] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.939859 31515 raft_consensus.cc:740] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.939487 31516 raft_consensus.cc:359] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.940585 31516 raft_consensus.cc:385] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.940953 31516 raft_consensus.cc:740] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.940795 31515 consensus_queue.cc:260] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.941821 31513 ts_tablet_manager.cc:1434] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:14:44.942045 31516 consensus_queue.cc:260] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.942888 31513 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:44.946347 31515 ts_tablet_manager.cc:1434] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:14:44.947513 31515 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:44.950114 31513 tablet_bootstrap.cc:654] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.953959 31515 tablet_bootstrap.cc:654] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.954908 31516 ts_tablet_manager.cc:1434] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:14:44.956090 31516 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:44.964602 31513 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:44.965452 31513 ts_tablet_manager.cc:1403] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 13:14:44.970052 31520 raft_consensus.cc:493] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.970638 31520 raft_consensus.cc:515] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.972306 31516 tablet_bootstrap.cc:654] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:44.973058 31515 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:44.973577 31515 ts_tablet_manager.cc:1403] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.016s
I20260709 13:14:44.974336 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:44.975025 31399 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:44.976603 31288 leader_election.cc:304] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:44.976814 31515 raft_consensus.cc:359] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.977638 31515 raft_consensus.cc:385] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.976997 31523 raft_consensus.cc:515] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.977960 31515 raft_consensus.cc:740] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.978825 31515 consensus_queue.cc:260] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.979904 31529 raft_consensus.cc:2804] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:44.980357 31529 raft_consensus.cc:493] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.980713 31529 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.982110 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:44.983233 31520 leader_election.cc:290] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:44.970568 31513 raft_consensus.cc:359] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.984099 31513 raft_consensus.cc:385] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.984547 31513 raft_consensus.cc:740] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.985543 31513 consensus_queue.cc:260] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.986557 31473 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:44.988653 31529 raft_consensus.cc:515] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:44.990553 31324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a874a108a1b74919bb600d7ae61d8f58" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:44.991377 31324 raft_consensus.cc:3060] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.991478 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:44.992151 31399 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.993355 31513 ts_tablet_manager.cc:1434] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 13:14:44.994429 31513 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:45.001463 31513 tablet_bootstrap.cc:654] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.002455 31515 ts_tablet_manager.cc:1434] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:14:45.003633 31515 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:45.004997 31529 leader_election.cc:290] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.000358 31399 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:45.006268 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:45.006418 31288 leader_election.cc:304] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.006914 31473 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.010383 31529 raft_consensus.cc:2804] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.014580 31473 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:45.016880 31515 tablet_bootstrap.cc:654] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.020201 31529 raft_consensus.cc:697] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Becoming Leader. State: Replica: fef85a27379d47749867ecb8d725b327, State: Running, Role: LEADER
I20260709 13:14:45.021245 31529 consensus_queue.cc:237] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.026175 31513 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:45.027036 31513 ts_tablet_manager.cc:1403] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.005s
I20260709 13:14:45.033188 31513 raft_consensus.cc:359] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.034047 31513 raft_consensus.cc:385] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.034364 31513 raft_consensus.cc:740] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.035295 31513 consensus_queue.cc:260] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.036458 31515 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:45.036983 31515 ts_tablet_manager.cc:1403] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.002s
I20260709 13:14:45.035915 31218 catalog_manager.cc:5697] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 reported cstate change: term changed from 0 to 1, leader changed from <none> to fef85a27379d47749867ecb8d725b327 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "fef85a27379d47749867ecb8d725b327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.037853 31513 ts_tablet_manager.cc:1434] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:45.038966 31513 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:45.039731 31515 raft_consensus.cc:359] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.040475 31515 raft_consensus.cc:385] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.040740 31515 raft_consensus.cc:740] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.041543 31515 consensus_queue.cc:260] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.044067 31515 ts_tablet_manager.cc:1434] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:45.045071 31515 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:45.046288 31513 tablet_bootstrap.cc:654] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.051182 31515 tablet_bootstrap.cc:654] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.059006 31513 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:45.059701 31513 ts_tablet_manager.cc:1403] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.012s
I20260709 13:14:45.063496 31515 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:45.063490 31513 raft_consensus.cc:359] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.064173 31515 ts_tablet_manager.cc:1403] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 13:14:45.064309 31513 raft_consensus.cc:385] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.064642 31513 raft_consensus.cc:740] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.065630 31513 consensus_queue.cc:260] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.066879 31515 raft_consensus.cc:359] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.067632 31515 raft_consensus.cc:385] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.067902 31515 raft_consensus.cc:740] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.068277 31513 ts_tablet_manager.cc:1434] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:45.068711 31515 consensus_queue.cc:260] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.069361 31513 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:45.071024 31515 ts_tablet_manager.cc:1434] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:45.071997 31515 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:45.076249 31513 tablet_bootstrap.cc:654] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.077522 31515 tablet_bootstrap.cc:654] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.078167 31324 raft_consensus.cc:2468] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:45.079525 31365 leader_election.cc:304] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.082057 31541 raft_consensus.cc:2804] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.083796 31541 raft_consensus.cc:697] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:45.084806 31541 consensus_queue.cc:237] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.088249 31513 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:45.088815 31513 ts_tablet_manager.cc:1403] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.013s
I20260709 13:14:45.089339 31515 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: No bootstrap required, opened a new log
I20260709 13:14:45.089830 31515 ts_tablet_manager.cc:1403] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:14:45.091533 31513 raft_consensus.cc:359] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.092685 31513 raft_consensus.cc:385] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.092491 31515 raft_consensus.cc:359] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.092998 31513 raft_consensus.cc:740] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.093228 31515 raft_consensus.cc:385] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.093536 31515 raft_consensus.cc:740] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.093926 31513 consensus_queue.cc:260] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.094365 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a874a108a1b74919bb600d7ae61d8f58" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:45.094481 31515 consensus_queue.cc:260] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.095350 31473 raft_consensus.cc:3060] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.096292 31513 ts_tablet_manager.cc:1434] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:14:45.096982 31515 ts_tablet_manager.cc:1434] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:45.097590 31513 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:45.100786 31523 leader_election.cc:290] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.107863 31513 tablet_bootstrap.cc:654] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.111614 31516 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:45.112232 31516 ts_tablet_manager.cc:1403] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.156s	user 0.073s	sys 0.055s
I20260709 13:14:45.115635 31513 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:45.115509 31473 raft_consensus.cc:2468] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:45.115413 31516 raft_consensus.cc:359] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.116266 31513 ts_tablet_manager.cc:1403] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 13:14:45.116394 31516 raft_consensus.cc:385] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.116890 31516 raft_consensus.cc:740] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.117753 31516 consensus_queue.cc:260] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.117950 31222 catalog_manager.cc:5697] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.119072 31513 raft_consensus.cc:359] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.119763 31513 raft_consensus.cc:385] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.120060 31513 raft_consensus.cc:740] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.120615 31516 ts_tablet_manager.cc:1434] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:45.120756 31513 consensus_queue.cc:260] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.121718 31516 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:45.122538 31513 ts_tablet_manager.cc:1434] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:45.124541 31513 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818: Bootstrap starting.
I20260709 13:14:45.128815 31516 tablet_bootstrap.cc:654] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.131979 31513 tablet_bootstrap.cc:654] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.139526 31516 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:45.139739 31513 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818: No bootstrap required, opened a new log
I20260709 13:14:45.140002 31516 ts_tablet_manager.cc:1403] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:14:45.140466 31513 ts_tablet_manager.cc:1403] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:14:45.140614 31529 raft_consensus.cc:493] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.141160 31529 raft_consensus.cc:515] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.142597 31513 raft_consensus.cc:359] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.143155 31513 raft_consensus.cc:385] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.143410 31513 raft_consensus.cc:740] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.143214 31516 raft_consensus.cc:359] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.144106 31516 raft_consensus.cc:385] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.144435 31516 raft_consensus.cc:740] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.144234 31513 consensus_queue.cc:260] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.145023 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:45.145227 31516 consensus_queue.cc:260] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.146183 31513 ts_tablet_manager.cc:1434] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:45.147523 31516 ts_tablet_manager.cc:1434] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:45.148639 31516 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:45.143376 31529 leader_election.cc:290] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.149924 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:45.150656 31473 raft_consensus.cc:2468] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:45.151949 31290 leader_election.cc:304] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.152922 31529 raft_consensus.cc:2804] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:45.153271 31529 raft_consensus.cc:493] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.153599 31529 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.155046 31516 tablet_bootstrap.cc:654] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.155438 31541 raft_consensus.cc:493] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.155938 31541 raft_consensus.cc:515] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.158296 31541 leader_election.cc:290] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.161370 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
W20260709 13:14:45.161831 31288 leader_election.cc:343] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:45.161388 31529 raft_consensus.cc:515] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.162283 31473 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 0.
I20260709 13:14:45.162961 31516 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:45.163471 31516 ts_tablet_manager.cc:1403] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:14:45.161373 31324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
I20260709 13:14:45.164362 31324 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 0.
I20260709 13:14:45.165199 31529 leader_election.cc:290] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.165619 31365 leader_election.cc:304] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.165755 31472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:45.166543 31541 raft_consensus.cc:2804] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:45.166338 31516 raft_consensus.cc:359] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.166922 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:45.167167 31516 raft_consensus.cc:385] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.167003 31541 raft_consensus.cc:493] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.167621 31516 raft_consensus.cc:740] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.167757 31541 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:45.168521 31288 leader_election.cc:343] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:45.168438 31516 consensus_queue.cc:260] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.166441 31472 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.170614 31516 ts_tablet_manager.cc:1434] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:45.171604 31516 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:45.176086 31541 raft_consensus.cc:515] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.177299 31516 tablet_bootstrap.cc:654] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.180490 31541 leader_election.cc:290] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.180588 31523 raft_consensus.cc:493] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.182878 31517 raft_consensus.cc:493] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.183419 31523 raft_consensus.cc:515] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.183959 31517 raft_consensus.cc:515] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.185618 31523 leader_election.cc:290] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.186031 31517 leader_election.cc:290] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:45.187436 31472 raft_consensus.cc:2468] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:45.188210 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:45.188326 31322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b42ff1b1d46159b7d833a795d6f50" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
I20260709 13:14:45.188931 31290 leader_election.cc:304] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 6e6d613befde4e62b5352c1c14bcaf29
I20260709 13:14:45.189332 31322 raft_consensus.cc:2468] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 0.
I20260709 13:14:45.189805 31324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:45.187426 31323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
I20260709 13:14:45.190420 31324 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.190887 31323 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 0.
I20260709 13:14:45.191774 31529 raft_consensus.cc:2804] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.192020 31520 raft_consensus.cc:493] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.192437 31365 leader_election.cc:304] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.192528 31520 raft_consensus.cc:515] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.193868 31523 raft_consensus.cc:2804] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:45.194391 31523 raft_consensus.cc:493] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.194818 31523 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.196755 31439 leader_election.cc:304] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.197517 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:45.197642 31517 raft_consensus.cc:2804] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:45.198165 31517 raft_consensus.cc:493] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.198210 31399 raft_consensus.cc:2468] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:45.198616 31517 raft_consensus.cc:3060] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.198927 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b42ff1b1d46159b7d833a795d6f50" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:45.199311 31472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:45.199654 31288 leader_election.cc:304] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.200016 31472 raft_consensus.cc:2468] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:45.199680 31398 raft_consensus.cc:2468] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 0.
I20260709 13:14:45.188941 31471 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 0.
I20260709 13:14:45.207935 31523 raft_consensus.cc:515] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.210433 31523 leader_election.cc:290] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.196679 31520 leader_election.cc:290] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.196755 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:45.215022 31520 raft_consensus.cc:2804] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:45.215075 31473 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.215541 31520 raft_consensus.cc:493] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.213687 31323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:45.215916 31520 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.218277 31516 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:45.218329 31324 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:45.217255 31323 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.216675 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:45.220057 31365 leader_election.cc:304] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.220333 31471 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.221926 31523 raft_consensus.cc:2804] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.222505 31523 raft_consensus.cc:697] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:45.223018 31473 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:45.223654 31523 consensus_queue.cc:237] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.226814 31323 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:45.218794 31516 ts_tablet_manager.cc:1403] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.011s
I20260709 13:14:45.213284 31529 raft_consensus.cc:697] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Becoming Leader. State: Replica: fef85a27379d47749867ecb8d725b327, State: Running, Role: LEADER
I20260709 13:14:45.228900 31365 leader_election.cc:304] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.230919 31541 raft_consensus.cc:2804] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.231383 31541 raft_consensus.cc:697] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:45.231443 31516 raft_consensus.cc:359] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.232317 31516 raft_consensus.cc:385] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.232239 31541 consensus_queue.cc:237] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.233311 31529 consensus_queue.cc:237] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.232726 31516 raft_consensus.cc:740] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.239814 31516 consensus_queue.cc:260] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.232892 31517 raft_consensus.cc:515] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.241815 31520 raft_consensus.cc:515] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.250932 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:45.251598 31398 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.252190 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:45.253209 31473 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.252732 31218 catalog_manager.cc:5697] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.259419 31398 raft_consensus.cc:2468] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:45.260908 31288 leader_election.cc:304] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.245518 31516 ts_tablet_manager.cc:1434] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:14:45.261916 31560 raft_consensus.cc:2804] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.263265 31560 raft_consensus.cc:697] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Becoming Leader. State: Replica: fef85a27379d47749867ecb8d725b327, State: Running, Role: LEADER
I20260709 13:14:45.263552 31516 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29: Bootstrap starting.
I20260709 13:14:45.264199 31560 consensus_queue.cc:237] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.239964 31471 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:45.270154 31564 raft_consensus.cc:493] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.268265 31520 leader_election.cc:290] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.270577 31517 leader_election.cc:290] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:45.264845 31473 raft_consensus.cc:2468] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:45.280622 31323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b42ff1b1d46159b7d833a795d6f50" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:45.281724 31323 raft_consensus.cc:3060] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.274246 31541 raft_consensus.cc:493] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.270684 31564 raft_consensus.cc:515] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.284543 31541 raft_consensus.cc:515] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.286414 31564 leader_election.cc:290] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:45.287304 31541 leader_election.cc:290] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.288646 31324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
I20260709 13:14:45.289487 31322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
I20260709 13:14:45.289696 31324 raft_consensus.cc:2468] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 0.
I20260709 13:14:45.291446 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:45.291442 31439 leader_election.cc:304] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.292367 31473 raft_consensus.cc:2393] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6d613befde4e62b5352c1c14bcaf29 in current term 1: Already voted for candidate fef85a27379d47749867ecb8d725b327 in this term.
I20260709 13:14:45.292642 31564 raft_consensus.cc:2804] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:45.275746 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b42ff1b1d46159b7d833a795d6f50" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:45.295742 31365 leader_election.cc:304] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29; no voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327
I20260709 13:14:45.293502 31564 raft_consensus.cc:493] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.297610 31398 raft_consensus.cc:3060] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.298103 31541 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.298928 31564 raft_consensus.cc:3060] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.306561 31516 tablet_bootstrap.cc:654] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.308667 31541 raft_consensus.cc:2749] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:45.308750 31564 raft_consensus.cc:515] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.311439 31564 leader_election.cc:290] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:45.312827 31516 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29: No bootstrap required, opened a new log
I20260709 13:14:45.369791 31516 ts_tablet_manager.cc:1403] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.001s
I20260709 13:14:45.370160 31322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:45.371879 31322 raft_consensus.cc:3060] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.371625 31541 raft_consensus.cc:493] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.372884 31541 raft_consensus.cc:515] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.367417 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:45.378750 31324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
I20260709 13:14:45.379153 31397 raft_consensus.cc:3060] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.365319 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:45.380997 31541 leader_election.cc:290] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.376327 31516 raft_consensus.cc:359] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.382136 31516 raft_consensus.cc:385] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.382684 31516 raft_consensus.cc:740] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.382755 31529 raft_consensus.cc:493] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.359247 31218 catalog_manager.cc:5697] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.383747 31529 raft_consensus.cc:515] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.384534 31516 consensus_queue.cc:260] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.388314 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:45.389093 31399 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:45.389415 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:45.390604 31473 raft_consensus.cc:2393] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6d613befde4e62b5352c1c14bcaf29 in current term 1: Already voted for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in this term.
I20260709 13:14:45.392409 31365 leader_election.cc:304] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29; no voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327
I20260709 13:14:45.392901 31516 ts_tablet_manager.cc:1434] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.008s
I20260709 13:14:45.395646 31288 leader_election.cc:304] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.399408 31560 raft_consensus.cc:2804] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:45.399928 31560 raft_consensus.cc:493] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.401170 31560 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.402408 31398 raft_consensus.cc:2468] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 1.
I20260709 13:14:45.402868 31529 leader_election.cc:290] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.404628 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:45.404554 31437 leader_election.cc:304] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: 
I20260709 13:14:45.405732 31473 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 0.
I20260709 13:14:45.405954 31529 consensus_queue.cc:1048] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:45.406565 31517 raft_consensus.cc:2804] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.407814 31564 raft_consensus.cc:493] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.408555 31564 raft_consensus.cc:515] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.409471 31222 catalog_manager.cc:5697] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 reported cstate change: term changed from 0 to 1, leader changed from <none> to fef85a27379d47749867ecb8d725b327 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "fef85a27379d47749867ecb8d725b327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.416648 31324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef85a27379d47749867ecb8d725b327" is_pre_election: true
I20260709 13:14:45.399334 31397 raft_consensus.cc:2468] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 1.
I20260709 13:14:45.427644 31323 raft_consensus.cc:2468] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 1.
I20260709 13:14:45.415953 31560 raft_consensus.cc:515] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.429956 31541 raft_consensus.cc:2749] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:45.435647 31437 leader_election.cc:304] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: 
I20260709 13:14:45.437280 31568 raft_consensus.cc:2804] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.437635 31560 leader_election.cc:290] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:45.438004 31568 raft_consensus.cc:697] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:45.438827 31324 raft_consensus.cc:2393] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ff30b22b3f64f54b46b20f49ef1c818 in current term 1: Already voted for candidate fef85a27379d47749867ecb8d725b327 in this term.
I20260709 13:14:45.439188 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:45.440084 31473 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.439612 31568 consensus_queue.cc:237] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.431180 31517 raft_consensus.cc:697] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:45.444583 31564 leader_election.cc:290] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:45.445257 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "fef85a27379d47749867ecb8d725b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:45.445981 31397 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.445452 31517 consensus_queue.cc:237] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.453835 31322 raft_consensus.cc:2468] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 1.
I20260709 13:14:45.469612 31560 consensus_queue.cc:1048] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:45.470309 31218 catalog_manager.cc:5697] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 reported cstate change: term changed from 0 to 1, leader changed from <none> to fef85a27379d47749867ecb8d725b327 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "fef85a27379d47749867ecb8d725b327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:45.488966 31437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:42315, user_credentials={real_user=slave}} blocked reactor thread for 55370.1us
I20260709 13:14:45.476830 31397 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:45.493923 31288 leader_election.cc:304] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:45.494944 31560 raft_consensus.cc:2804] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.495162 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:45.495484 31560 raft_consensus.cc:697] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Becoming Leader. State: Replica: fef85a27379d47749867ecb8d725b327, State: Running, Role: LEADER
I20260709 13:14:45.496079 31397 raft_consensus.cc:2393] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ff30b22b3f64f54b46b20f49ef1c818 in current term 1: Already voted for candidate fef85a27379d47749867ecb8d725b327 in this term.
I20260709 13:14:45.496234 31473 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fef85a27379d47749867ecb8d725b327 in term 1.
I20260709 13:14:45.496650 31560 consensus_queue.cc:237] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:45.497355 31437 leader_election.cc:304] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818; no voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327
I20260709 13:14:45.505131 31517 raft_consensus.cc:2749] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:45.508848 31218 catalog_manager.cc:5697] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:45.514607 31222 catalog_manager.cc:5697] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 reported cstate change: term changed from 0 to 1, leader changed from <none> to fef85a27379d47749867ecb8d725b327 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "fef85a27379d47749867ecb8d725b327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.524271 31218 catalog_manager.cc:5697] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:45.560370 31541 consensus_queue.cc:1048] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:45.565235 31560 consensus_queue.cc:1048] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:45.575964 31552 consensus_queue.cc:1048] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:45.594950 31520 consensus_queue.cc:1048] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:45.611404 20199 ts_manager.cc:295] Set tserver state for fef85a27379d47749867ecb8d725b327 to MAINTENANCE_MODE
I20260709 13:14:45.612542 20199 tablet_server.cc:179] TabletServer@127.19.185.193:0 shutting down...
I20260709 13:14:45.647091 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:45.648149 20199 tablet_replica.cc:333] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.649071 20199 raft_consensus.cc:2243] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:45.649842 20199 pending_rounds.cc:70] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Trying to abort 1 pending ops.
I20260709 13:14:45.650028 20199 pending_rounds.cc:77] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637418052620288 op_type: NO_OP noop_request { }
I20260709 13:14:45.650297 20199 raft_consensus.cc:2889] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:45.650539 20199 raft_consensus.cc:2272] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.653512 20199 tablet_replica.cc:333] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.654162 20199 raft_consensus.cc:2243] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:45.654568 20199 raft_consensus.cc:2272] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.657856 20199 tablet_replica.cc:333] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.658732 20199 raft_consensus.cc:2243] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:45.659312 20199 raft_consensus.cc:2272] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:45.660836 31365 consensus_peers.cc:597] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.662261 20199 tablet_replica.cc:333] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.662938 20199 raft_consensus.cc:2243] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:45.663496 20199 pending_rounds.cc:70] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Trying to abort 1 pending ops.
I20260709 13:14:45.663647 20199 pending_rounds.cc:77] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637419019567104 op_type: NO_OP noop_request { }
I20260709 13:14:45.663863 20199 raft_consensus.cc:2889] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:45.664170 20199 raft_consensus.cc:2272] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.666874 20199 tablet_replica.cc:333] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.667433 20199 raft_consensus.cc:2243] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:45.667874 20199 raft_consensus.cc:2272] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.670095 20199 tablet_replica.cc:333] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.670620 20199 raft_consensus.cc:2243] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:45.671023 20199 raft_consensus.cc:2272] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.674168 20199 tablet_replica.cc:333] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.675019 20199 raft_consensus.cc:2243] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:45.676407 20199 pending_rounds.cc:70] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Trying to abort 1 pending ops.
I20260709 13:14:45.676608 20199 pending_rounds.cc:77] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637417928572928 op_type: NO_OP noop_request { }
I20260709 13:14:45.676930 20199 raft_consensus.cc:2889] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:45.677237 20199 raft_consensus.cc:2272] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.680294 20199 tablet_replica.cc:333] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.680935 20199 raft_consensus.cc:2243] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:45.681819 20199 raft_consensus.cc:2272] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.685397 20199 tablet_replica.cc:333] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.685992 20199 raft_consensus.cc:2243] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:45.686872 20199 raft_consensus.cc:2272] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.689806 20199 tablet_replica.cc:333] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: stopping tablet replica
I20260709 13:14:45.690378 20199 raft_consensus.cc:2243] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:45.690901 20199 raft_consensus.cc:2272] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:45.695583 31541 consensus_queue.cc:1048] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:45.714629 31365 consensus_peers.cc:597] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.735481 20199 tablet_server.cc:196] TabletServer@127.19.185.193:0 shutdown complete.
I20260709 13:14:45.785511 31552 consensus_queue.cc:1048] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:45.881624 31439 consensus_peers.cc:597] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.887205 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:45.975659 31517 consensus_queue.cc:1048] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:45.997752 31439 consensus_peers.cc:597] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:46.074918 31570 consensus_queue.cc:1048] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:46.179426 31365 consensus_peers.cc:597] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:46.719985 31517 raft_consensus.cc:493] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.720539 31517 raft_consensus.cc:515] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:46.722354 31517 leader_election.cc:290] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:46.723563 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:46.724452 31397 raft_consensus.cc:2468] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 1.
I20260709 13:14:46.725829 31437 leader_election.cc:304] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: 
W20260709 13:14:46.726444 31439 leader_election.cc:336] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:46.726642 31517 raft_consensus.cc:2804] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:46.727057 31517 raft_consensus.cc:493] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.727324 31517 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.733023 31517 raft_consensus.cc:515] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:46.734653 31517 leader_election.cc:290] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:46.735687 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:46.736343 31397 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:46.738649 31439 leader_election.cc:336] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:46.742033 31397 raft_consensus.cc:2468] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 2.
I20260709 13:14:46.743063 31437 leader_election.cc:304] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: fef85a27379d47749867ecb8d725b327
I20260709 13:14:46.743747 31517 raft_consensus.cc:2804] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.744643 31517 raft_consensus.cc:697] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:46.745558 31517 consensus_queue.cc:237] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:46.752264 31222 catalog_manager.cc:5697] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 1 to 2, leader changed from fef85a27379d47749867ecb8d725b327 (127.19.185.193) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:46.888383 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:46.918131 31552 raft_consensus.cc:493] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.918723 31552 raft_consensus.cc:515] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:46.920580 31552 leader_election.cc:290] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:46.922426 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:46.923252 31471 raft_consensus.cc:2468] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:46.924480 31365 leader_election.cc:304] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: 
W20260709 13:14:46.925210 31365 leader_election.cc:336] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:46.925208 31552 raft_consensus.cc:2804] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:46.925768 31552 raft_consensus.cc:493] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.926120 31552 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.932322 31552 raft_consensus.cc:515] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:46.933955 31552 leader_election.cc:290] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:46.935770 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:46.936851 31471 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:46.938227 31365 leader_election.cc:336] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:46.943178 31471 raft_consensus.cc:2468] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 2.
I20260709 13:14:46.944296 31365 leader_election.cc:304] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: fef85a27379d47749867ecb8d725b327
I20260709 13:14:46.944995 31552 raft_consensus.cc:2804] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.945506 31552 raft_consensus.cc:697] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:46.946484 31552 consensus_queue.cc:237] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:46.953702 31222 catalog_manager.cc:5697] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 1 to 2, leader changed from fef85a27379d47749867ecb8d725b327 (127.19.185.193) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.967583 31541 raft_consensus.cc:493] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fef85a27379d47749867ecb8d725b327)
I20260709 13:14:46.968245 31541 raft_consensus.cc:515] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:46.970470 31541 leader_election.cc:290] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:46.971949 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ef3d5e8254dec95e15895bed25d44" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
W20260709 13:14:46.974385 31365 leader_election.cc:336] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:46.974781 31365 leader_election.cc:304] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29; no voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327
I20260709 13:14:46.975422 31541 raft_consensus.cc:2749] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.980840 31517 raft_consensus.cc:493] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fef85a27379d47749867ecb8d725b327)
I20260709 13:14:46.981542 31517 raft_consensus.cc:515] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:46.984331 31517 leader_election.cc:290] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:46.986256 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ef3d5e8254dec95e15895bed25d44" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
I20260709 13:14:46.987008 31397 raft_consensus.cc:2468] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 1.
I20260709 13:14:46.988248 31437 leader_election.cc:304] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: 
I20260709 13:14:46.988917 31517 raft_consensus.cc:2804] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:46.989104 31439 leader_election.cc:336] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:46.989329 31517 raft_consensus.cc:493] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fef85a27379d47749867ecb8d725b327)
I20260709 13:14:46.989742 31517 raft_consensus.cc:3060] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.995090 31517 raft_consensus.cc:515] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:46.996817 31517 leader_election.cc:290] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:46.998080 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ef3d5e8254dec95e15895bed25d44" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:46.998667 31397 raft_consensus.cc:3060] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:47.000527 31439 leader_election.cc:336] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:47.004175 31397 raft_consensus.cc:2468] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 2.
I20260709 13:14:47.005241 31437 leader_election.cc:304] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: fef85a27379d47749867ecb8d725b327
I20260709 13:14:47.005903 31517 raft_consensus.cc:2804] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.006331 31517 raft_consensus.cc:697] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:47.007174 31517 consensus_queue.cc:237] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:47.014768 31222 catalog_manager.cc:5697] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 1 to 2, leader changed from fef85a27379d47749867ecb8d725b327 (127.19.185.193) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.090240 31517 raft_consensus.cc:493] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fef85a27379d47749867ecb8d725b327)
I20260709 13:14:47.090845 31517 raft_consensus.cc:515] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:47.092785 31517 leader_election.cc:290] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:47.093864 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29" is_pre_election: true
W20260709 13:14:47.096786 31439 leader_election.cc:336] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:47.097205 31439 leader_election.cc:304] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818; no voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327
I20260709 13:14:47.097924 31517 raft_consensus.cc:2749] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.099433 31541 raft_consensus.cc:493] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fef85a27379d47749867ecb8d725b327)
I20260709 13:14:47.100023 31541 raft_consensus.cc:515] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:47.102340 31541 leader_election.cc:290] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:47.103389 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:47.104127 31471 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:47.105427 31365 leader_election.cc:304] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: 
I20260709 13:14:47.106052 31541 raft_consensus.cc:2804] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:47.106153 31365 leader_election.cc:336] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:47.106369 31541 raft_consensus.cc:493] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fef85a27379d47749867ecb8d725b327)
I20260709 13:14:47.106786 31541 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.112594 31541 raft_consensus.cc:515] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:47.114095 31541 leader_election.cc:290] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:47.115731 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:47.116470 31471 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:47.117807 31365 leader_election.cc:336] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:47.121762 31471 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 2.
I20260709 13:14:47.122761 31365 leader_election.cc:304] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: fef85a27379d47749867ecb8d725b327
I20260709 13:14:47.123579 31541 raft_consensus.cc:2804] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.124101 31541 raft_consensus.cc:697] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:47.124884 31541 consensus_queue.cc:237] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
W20260709 13:14:47.127936 31439 consensus_peers.cc:597] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.132998 31222 catalog_manager.cc:5697] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 1 to 2, leader changed from fef85a27379d47749867ecb8d725b327 (127.19.185.193) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:47.136590 31365 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111) [suppressed 121 similar messages]
I20260709 13:14:47.191541 31397 raft_consensus.cc:1275] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:47.192958 31517 consensus_queue.cc:1048] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:47.410765 31365 consensus_peers.cc:597] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.473584 31471 raft_consensus.cc:1275] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:47.474915 31541 consensus_queue.cc:1048] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.494899 31604 raft_consensus.cc:493] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.495360 31604 raft_consensus.cc:515] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:47.497277 31604 leader_election.cc:290] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:47.498871 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" is_pre_election: true
I20260709 13:14:47.499554 31471 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 1.
I20260709 13:14:47.500684 31365 leader_election.cc:304] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: 
I20260709 13:14:47.501459 31604 raft_consensus.cc:2804] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:47.501477 31365 leader_election.cc:336] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:47.501812 31604 raft_consensus.cc:493] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.502250 31604 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.508610 31604 raft_consensus.cc:515] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:47.510214 31604 leader_election.cc:290] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:47.511895 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:47.512601 31471 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:47.514032 31365 leader_election.cc:336] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111)
I20260709 13:14:47.516505 31473 raft_consensus.cc:1275] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:47.517733 31604 consensus_queue.cc:1048] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.519207 31471 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 2.
I20260709 13:14:47.520313 31365 leader_election.cc:304] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: fef85a27379d47749867ecb8d725b327
I20260709 13:14:47.521140 31604 raft_consensus.cc:2804] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.521687 31604 raft_consensus.cc:697] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:47.522502 31604 consensus_queue.cc:237] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:47.526263 31397 raft_consensus.cc:1275] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:47.527843 31517 consensus_queue.cc:1048] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:47.532912 31222 catalog_manager.cc:5697] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 1 to 2, leader changed from fef85a27379d47749867ecb8d725b327 (127.19.185.193) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:47.537492 31365 consensus_peers.cc:597] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:47.546540 31439 consensus_peers.cc:597] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:47.889405 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:14:47.904969 31365 consensus_peers.cc:597] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.924476 31471 raft_consensus.cc:1275] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:47.925817 31541 consensus_queue.cc:1048] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:47.981493 31365 consensus_peers.cc:597] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.106520 31365 consensus_peers.cc:597] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.433352 31439 consensus_peers.cc:597] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.634858 31439 consensus_peers.cc:597] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.693185 31365 consensus_peers.cc:597] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.890560 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:14:49.536238 31439 consensus_peers.cc:597] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:49.855424 31439 consensus_peers.cc:597] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:49.891664 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:14:50.005681 31365 consensus_peers.cc:597] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:50.209043 31365 consensus_peers.cc:597] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:50.339511 31365 consensus_peers.cc:597] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:50.402282 31365 consensus_peers.cc:597] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:50.414363 31365 consensus_peers.cc:597] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:50.764676 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:50.772430 31613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:50.772851 31612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:50.774655 20199 server_base.cc:1061] running on GCE node
W20260709 13:14:50.774724 31615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:50.778203 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:50.778440 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:50.778676 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602890778655 us; error 0 us; skew 500 ppm
I20260709 13:14:50.779273 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:50.782826 20199 webserver.cc:533] Webserver started at http://127.19.185.193:43989/ using document root <none> and password file <none>
I20260709 13:14:50.783392 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:50.783617 20199 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:14:50.787814 20199 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:50.791738 31620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:50.792732 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:50.793174 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "fef85a27379d47749867ecb8d725b327"
format_stamp: "Formatted at 2026-07-09 13:14:43 on dist-test-slave-rrf3"
I20260709 13:14:50.793677 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:50.819073 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:50.820595 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:50.822446 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:50.826561 31627 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:14:50.875710 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:14:50.876076 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:14:50.876386 20199 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:14:50.882150 31627 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
W20260709 13:14:50.892745 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:50.897672 31627 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:50.898607 31627 tablet_bootstrap.cc:492] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:50.899235 31627 ts_tablet_manager.cc:1403] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
W20260709 13:14:50.899938 31439 consensus_peers.cc:597] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:50.901923 31627 raft_consensus.cc:359] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.902550 31627 raft_consensus.cc:740] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:50.903170 31627 consensus_queue.cc:260] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.905794 31627 ts_tablet_manager.cc:1434] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.002s
I20260709 13:14:50.906476 31627 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:50.918776 31627 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:50.919638 31627 tablet_bootstrap.cc:492] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:50.920490 31627 ts_tablet_manager.cc:1403] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:14:50.920642 20199 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:14:50.920996 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.045s	user 0.043s	sys 0.000s
I20260709 13:14:50.922706 31627 raft_consensus.cc:359] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.923331 31627 raft_consensus.cc:740] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:50.923985 31627 consensus_queue.cc:260] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.925770 31627 ts_tablet_manager.cc:1434] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:50.926486 31627 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:50.940883 31627 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:14:50.941748 31627 tablet_bootstrap.cc:492] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:50.942375 31627 ts_tablet_manager.cc:1403] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:14:50.945294 31627 raft_consensus.cc:359] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.946233 31627 raft_consensus.cc:740] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:50.947026 31627 consensus_queue.cc:260] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.948906 31627 ts_tablet_manager.cc:1434] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:50.949612 31627 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:50.959985 31627 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:50.960852 31627 tablet_bootstrap.cc:492] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:50.961404 31627 ts_tablet_manager.cc:1403] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:14:50.963233 31627 raft_consensus.cc:359] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.963766 31627 raft_consensus.cc:740] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:50.964463 31627 consensus_queue.cc:260] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.966344 31627 ts_tablet_manager.cc:1434] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:14:50.967003 31627 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:50.981942 31627 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:50.983155 31627 tablet_bootstrap.cc:492] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:50.984020 31627 ts_tablet_manager.cc:1403] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:14:50.987073 31627 raft_consensus.cc:359] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.987852 31627 raft_consensus.cc:740] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:50.988620 31627 consensus_queue.cc:260] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:50.991237 31627 ts_tablet_manager.cc:1434] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:50.992024 31627 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:50.995528 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:35519
I20260709 13:14:50.995675 31689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:35519 every 8 connection(s)
I20260709 13:14:51.000699 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:51.025676 31627 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:14:51.027114 31627 tablet_bootstrap.cc:492] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:51.028050 31627 ts_tablet_manager.cc:1403] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.016s
I20260709 13:14:51.031877 31627 raft_consensus.cc:359] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.033088 31627 raft_consensus.cc:740] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:51.034231 31627 consensus_queue.cc:260] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.037091 31627 ts_tablet_manager.cc:1434] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:51.037823 31627 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:51.046494 31690 heartbeater.cc:344] Connected to a master server at 127.19.185.254:39787
I20260709 13:14:51.047039 31690 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:51.048002 31690 heartbeater.cc:507] Master 127.19.185.254:39787 requested a full tablet report, sending...
I20260709 13:14:51.050082 31397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
mode: GRACEFUL
new_leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:14:51.050772 31397 raft_consensus.cc:606] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Received request to transfer leadership to TS 3ff30b22b3f64f54b46b20f49ef1c818
I20260709 13:14:51.053303 31627 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:14:51.053714 31397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
mode: GRACEFUL
new_leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:14:51.054373 31627 tablet_bootstrap.cc:492] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:51.054320 31397 raft_consensus.cc:606] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Received request to transfer leadership to TS 3ff30b22b3f64f54b46b20f49ef1c818
I20260709 13:14:51.055166 31627 ts_tablet_manager.cc:1403] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:14:51.055514 31222 ts_manager.cc:194] Re-registered known tserver with Master: fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519)
I20260709 13:14:51.057917 31627 raft_consensus.cc:359] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.058564 31627 raft_consensus.cc:740] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:51.059063 31627 consensus_queue.cc:260] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.060159 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:51.060843 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:51.060966 31627 ts_tablet_manager.cc:1434] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:51.061575 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:51.061777 31627 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:51.067436 31222 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50904
I20260709 13:14:51.071058 31690 heartbeater.cc:499] Master 127.19.185.254:39787 was elected leader, sending a full tablet report...
I20260709 13:14:51.074270 31627 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:51.075114 31627 tablet_bootstrap.cc:492] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:51.075668 31627 ts_tablet_manager.cc:1403] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:14:51.077582 31627 raft_consensus.cc:359] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:51.078274 31627 raft_consensus.cc:740] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:51.078894 31627 consensus_queue.cc:260] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } }
I20260709 13:14:51.080258 31664 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.080534 31627 ts_tablet_manager.cc:1434] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:14:51.081318 31627 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:51.088495 31664 pending_rounds.cc:85] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Aborting all ops after (but not including) 0
I20260709 13:14:51.088966 31664 pending_rounds.cc:107] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:14:51.089267 31664 raft_consensus.cc:2889] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:51.101233 31627 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:51.103323 31627 tablet_bootstrap.cc:492] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:51.104075 31627 ts_tablet_manager.cc:1403] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 13:14:51.106072 31627 raft_consensus.cc:359] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.106611 31627 raft_consensus.cc:740] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:51.107250 31627 consensus_queue.cc:260] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.108774 31627 ts_tablet_manager.cc:1434] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:51.109431 31627 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Bootstrap starting.
I20260709 13:14:51.115935 31664 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.121560 31627 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:51.122244 31627 tablet_bootstrap.cc:492] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Bootstrap complete.
I20260709 13:14:51.122745 31664 pending_rounds.cc:85] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Aborting all ops after (but not including) 0
I20260709 13:14:51.122757 31627 ts_tablet_manager.cc:1403] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:14:51.123319 31664 pending_rounds.cc:107] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:14:51.123659 31664 raft_consensus.cc:2889] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:51.125762 31627 raft_consensus.cc:359] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.126489 31627 raft_consensus.cc:740] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef85a27379d47749867ecb8d725b327, State: Initialized, Role: FOLLOWER
I20260709 13:14:51.127302 31627 consensus_queue.cc:260] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.129937 31627 ts_tablet_manager.cc:1434] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:51.237469 31541 raft_consensus.cc:993] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29: : Instructing follower 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:51.237954 31706 raft_consensus.cc:1081] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Signalling peer 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:51.239414 31471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:43912
I20260709 13:14:51.239873 31471 raft_consensus.cc:493] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:51.240159 31471 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.245172 31471 raft_consensus.cc:515] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.246851 31471 leader_election.cc:290] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 3 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:51.247740 31664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:51.248183 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:51.248337 31664 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.248762 31397 raft_consensus.cc:3055] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:51.249059 31397 raft_consensus.cc:740] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:51.249761 31397 consensus_queue.cc:260] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.250733 31397 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.254022 31664 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 3.
I20260709 13:14:51.255335 31439 leader_election.cc:304] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:51.256165 31517 raft_consensus.cc:2804] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:51.256172 31397 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 3.
I20260709 13:14:51.257652 31517 raft_consensus.cc:697] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:51.258453 31517 consensus_queue.cc:237] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.265312 31222 catalog_manager.cc:5697] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 2 to 3, leader changed from 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 3 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.495517 31664 raft_consensus.cc:3060] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.497125 31663 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.504914 31663 pending_rounds.cc:85] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Aborting all ops after (but not including) 0
I20260709 13:14:51.505288 31663 pending_rounds.cc:107] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:14:51.505610 31663 raft_consensus.cc:2889] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:51.520068 31541 raft_consensus.cc:993] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29: : Instructing follower 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:51.522624 31706 raft_consensus.cc:1081] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Signalling peer 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:51.524632 31471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:43912
I20260709 13:14:51.525281 31471 raft_consensus.cc:493] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:51.525758 31471 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.531157 31471 raft_consensus.cc:515] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.533066 31471 leader_election.cc:290] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:51.534163 31397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:51.534041 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:51.534951 31397 raft_consensus.cc:3055] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:51.535018 31663 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.535406 31397 raft_consensus.cc:740] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:51.536336 31397 consensus_queue.cc:260] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.537621 31397 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.542951 31663 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 2.
I20260709 13:14:51.544588 31439 leader_election.cc:304] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:51.545418 31397 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 2.
I20260709 13:14:51.545576 31717 raft_consensus.cc:2804] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:51.546528 31717 raft_consensus.cc:697] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:51.548137 31717 consensus_queue.cc:237] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:51.563361 31222 catalog_manager.cc:5697] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 1 to 2, leader changed from 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.797626 31663 raft_consensus.cc:1275] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:51.799033 31717 consensus_queue.cc:1048] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:51.810892 31397 raft_consensus.cc:1275] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:51.812654 31517 consensus_queue.cc:1048] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:51.893748 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:52.007864 31397 raft_consensus.cc:1275] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:52.009473 31517 consensus_queue.cc:1048] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.021690 31663 raft_consensus.cc:1275] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:52.023159 31707 consensus_queue.cc:1048] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.071823 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:52.089583 31471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
mode: GRACEFUL
new_leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:48672
I20260709 13:14:52.090250 31471 raft_consensus.cc:606] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Received request to transfer leadership to TS 6e6d613befde4e62b5352c1c14bcaf29
I20260709 13:14:52.093005 31399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
mode: GRACEFUL
new_leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:14:52.093600 31399 raft_consensus.cc:606] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Received request to transfer leadership to TS 3ff30b22b3f64f54b46b20f49ef1c818
I20260709 13:14:52.096215 31471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
mode: GRACEFUL
new_leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:48672
I20260709 13:14:52.096669 31471 raft_consensus.cc:606] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Received request to transfer leadership to TS 6e6d613befde4e62b5352c1c14bcaf29
I20260709 13:14:52.097666 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:52.098225 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:52.098795 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:52.198216 31517 raft_consensus.cc:993] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818: : Instructing follower 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:52.198782 31707 raft_consensus.cc:1081] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Signalling peer 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:52.200718 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:36238
I20260709 13:14:52.201279 31399 raft_consensus.cc:493] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:52.201587 31399 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.207259 31399 raft_consensus.cc:515] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.209086 31399 leader_election.cc:290] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 4 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:52.209849 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:52.210111 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144dffcbe8c14cb28cfcf976a4067b1d" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:52.210665 31663 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.210798 31471 raft_consensus.cc:3055] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:52.211337 31471 raft_consensus.cc:740] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:52.212096 31471 consensus_queue.cc:260] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.213037 31471 raft_consensus.cc:3060] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.216228 31663 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 4.
I20260709 13:14:52.217322 31365 leader_election.cc:304] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:52.217703 31471 raft_consensus.cc:2468] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 4.
I20260709 13:14:52.218111 31719 raft_consensus.cc:2804] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:52.218600 31719 raft_consensus.cc:697] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:52.219331 31719 consensus_queue.cc:237] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.225355 31222 catalog_manager.cc:5697] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 3 to 4, leader changed from 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.291157 31517 raft_consensus.cc:993] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818: : Instructing follower 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:52.291652 31707 raft_consensus.cc:1081] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Signalling peer 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:52.293366 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:36238
I20260709 13:14:52.293905 31399 raft_consensus.cc:493] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:52.294229 31399 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.300899 31399 raft_consensus.cc:515] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.302678 31399 leader_election.cc:290] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 3 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:52.303673 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:52.303534 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7637b7c9b4fc0bac88ebab10a530d" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:52.304304 31471 raft_consensus.cc:3055] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:52.304369 31663 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.304631 31471 raft_consensus.cc:740] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:52.305320 31471 consensus_queue.cc:260] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.306185 31471 raft_consensus.cc:3060] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.310119 31663 raft_consensus.cc:2468] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 3.
I20260709 13:14:52.310786 31471 raft_consensus.cc:2468] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 3.
I20260709 13:14:52.311471 31365 leader_election.cc:304] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:52.312304 31719 raft_consensus.cc:2804] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:52.312721 31719 raft_consensus.cc:697] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:52.313637 31719 consensus_queue.cc:237] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.320611 31222 catalog_manager.cc:5697] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 2 to 3, leader changed from 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.427151 31706 raft_consensus.cc:993] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29: : Instructing follower 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:52.427704 31706 raft_consensus.cc:1081] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Signalling peer 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:52.429217 31471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:43912
I20260709 13:14:52.429718 31471 raft_consensus.cc:493] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:52.430001 31471 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.434563 31471 raft_consensus.cc:515] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.436153 31471 leader_election.cc:290] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 3 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:52.437049 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:52.437325 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:52.437659 31663 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.437995 31399 raft_consensus.cc:3055] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:52.438300 31399 raft_consensus.cc:740] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:52.439043 31399 consensus_queue.cc:260] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.440460 31399 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.443389 31663 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 3.
I20260709 13:14:52.444520 31439 leader_election.cc:304] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:52.445194 31707 raft_consensus.cc:2804] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:52.445675 31707 raft_consensus.cc:697] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:52.446008 31399 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 3.
I20260709 13:14:52.446620 31707 consensus_queue.cc:237] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:52.454737 31222 catalog_manager.cc:5697] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 2 to 3, leader changed from 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 3 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.620803 31471 raft_consensus.cc:1275] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:52.622084 31706 consensus_queue.cc:1048] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:52.634061 31663 raft_consensus.cc:1275] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:52.635784 31706 consensus_queue.cc:1048] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:52.768512 31471 raft_consensus.cc:1275] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:52.769622 31706 consensus_queue.cc:1048] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.783511 31663 raft_consensus.cc:1275] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:52.784916 31734 consensus_queue.cc:1048] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:52.894693 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:52.990355 31663 raft_consensus.cc:1275] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:52.991894 31707 consensus_queue.cc:1048] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:53.000625 31399 raft_consensus.cc:1275] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:53.002586 31717 consensus_queue.cc:1048] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:53.106125 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:53.114951 31399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
mode: GRACEFUL
new_leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:14:53.115558 31399 raft_consensus.cc:606] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Received request to transfer leadership to TS 3ff30b22b3f64f54b46b20f49ef1c818
I20260709 13:14:53.118158 31471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
mode: GRACEFUL
new_leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:48672
I20260709 13:14:53.118604 31471 raft_consensus.cc:606] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Received request to transfer leadership to TS 6e6d613befde4e62b5352c1c14bcaf29
I20260709 13:14:53.121249 31399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
mode: GRACEFUL
new_leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:14:53.121836 31399 raft_consensus.cc:606] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Received request to transfer leadership to TS 3ff30b22b3f64f54b46b20f49ef1c818
I20260709 13:14:53.123032 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:53.123589 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:53.124285 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:53.135810 31706 raft_consensus.cc:993] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29: : Instructing follower 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:53.136507 31706 raft_consensus.cc:1081] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Signalling peer 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:53.138159 31471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:43912
I20260709 13:14:53.138670 31471 raft_consensus.cc:493] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.139025 31471 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.143648 31471 raft_consensus.cc:515] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.145180 31471 leader_election.cc:290] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:53.146108 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:53.146307 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:53.146816 31663 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.146838 31399 raft_consensus.cc:3055] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:53.147429 31399 raft_consensus.cc:740] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:53.148330 31399 consensus_queue.cc:260] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.149581 31399 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.154543 31663 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 2.
I20260709 13:14:53.155884 31439 leader_election.cc:304] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:53.156710 31717 raft_consensus.cc:2804] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:53.156976 31399 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 2.
I20260709 13:14:53.157217 31717 raft_consensus.cc:697] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:53.158300 31717 consensus_queue.cc:237] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.165001 31222 catalog_manager.cc:5697] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 1 to 2, leader changed from 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.476624 31719 raft_consensus.cc:993] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29: : Instructing follower 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:53.477092 31706 raft_consensus.cc:1081] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Signalling peer 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:53.478565 31471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:43912
I20260709 13:14:53.479030 31471 raft_consensus.cc:493] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.479287 31471 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.483683 31471 raft_consensus.cc:515] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.485165 31471 leader_election.cc:290] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 3 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:53.486222 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:53.486843 31399 raft_consensus.cc:3055] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:53.486881 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ae6ae390464869ba10803a2245a6cb" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:53.487268 31399 raft_consensus.cc:740] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:53.487567 31663 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.488168 31399 consensus_queue.cc:260] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.489565 31399 raft_consensus.cc:3060] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.494783 31663 raft_consensus.cc:2468] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 3.
I20260709 13:14:53.496191 31439 leader_election.cc:304] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:53.496814 31399 raft_consensus.cc:2468] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 3.
I20260709 13:14:53.497007 31717 raft_consensus.cc:2804] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.497592 31717 raft_consensus.cc:697] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:53.498284 31717 consensus_queue.cc:237] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.505599 31222 catalog_manager.cc:5697] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 2 to 3, leader changed from 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 3 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.542045 31707 raft_consensus.cc:993] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818: : Instructing follower 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:53.543397 31707 raft_consensus.cc:1081] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Signalling peer 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:53.545202 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:36238
I20260709 13:14:53.545794 31399 raft_consensus.cc:493] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.546175 31399 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.548673 31663 raft_consensus.cc:1275] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:53.549913 31707 consensus_queue.cc:1048] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:53.553632 31399 raft_consensus.cc:515] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.556602 31399 leader_election.cc:290] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 3 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:53.556949 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:53.557637 31663 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.562112 31399 raft_consensus.cc:1275] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:53.566211 31663 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 3.
I20260709 13:14:53.566461 31748 consensus_queue.cc:1048] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:53.567566 31365 leader_election.cc:304] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:53.568440 31706 raft_consensus.cc:2804] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.568982 31706 raft_consensus.cc:697] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:53.570034 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:53.569825 31706 consensus_queue.cc:237] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.570542 31471 raft_consensus.cc:3055] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:53.570766 31471 raft_consensus.cc:740] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:53.571339 31471 consensus_queue.cc:260] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:53.572546 31471 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.579561 31471 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 3.
I20260709 13:14:53.583757 31218 catalog_manager.cc:5697] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 2 to 3, leader changed from 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:53.895848 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:53.933082 31399 raft_consensus.cc:1275] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:53.934437 31717 consensus_queue.cc:1048] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:53.944621 31661 raft_consensus.cc:1275] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:53.945947 31717 consensus_queue.cc:1048] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:53.989640 31661 raft_consensus.cc:1275] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:53.991070 31719 consensus_queue.cc:1048] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:54.001688 31471 raft_consensus.cc:1275] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:54.003582 31759 consensus_queue.cc:1048] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:54.130671 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:54.139602 31471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
mode: GRACEFUL
new_leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:48672
I20260709 13:14:54.140283 31471 raft_consensus.cc:606] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Received request to transfer leadership to TS 6e6d613befde4e62b5352c1c14bcaf29
I20260709 13:14:54.142864 31471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
mode: GRACEFUL
new_leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:48672
I20260709 13:14:54.143350 31471 raft_consensus.cc:606] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 LEADER]: Received request to transfer leadership to TS 6e6d613befde4e62b5352c1c14bcaf29
I20260709 13:14:54.146009 31399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
mode: GRACEFUL
new_leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:14:54.146562 31399 raft_consensus.cc:606] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Received request to transfer leadership to TS 3ff30b22b3f64f54b46b20f49ef1c818
I20260709 13:14:54.147958 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:54.148511 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:54.149098 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:54.306247 31717 raft_consensus.cc:993] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818: : Instructing follower 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:54.306928 31747 raft_consensus.cc:1081] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 LEADER]: Signalling peer 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:54.308502 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:36238
I20260709 13:14:54.309012 31399 raft_consensus.cc:493] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:54.309340 31399 raft_consensus.cc:3060] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.314404 31399 raft_consensus.cc:515] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.316286 31399 leader_election.cc:290] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:54.317324 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:54.317142 31661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75b9ed11f644d5bb5e9595f198ace0e" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:54.318071 31471 raft_consensus.cc:3055] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:54.318173 31661 raft_consensus.cc:3060] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.318351 31471 raft_consensus.cc:740] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:54.319275 31471 consensus_queue.cc:260] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.320637 31471 raft_consensus.cc:3060] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.326433 31661 raft_consensus.cc:2468] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 2.
I20260709 13:14:54.327544 31471 raft_consensus.cc:2468] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 2.
I20260709 13:14:54.327721 31365 leader_election.cc:304] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:54.328485 31706 raft_consensus.cc:2804] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:54.328956 31706 raft_consensus.cc:697] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:54.329641 31706 consensus_queue.cc:237] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.336534 31222 catalog_manager.cc:5697] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 1 to 2, leader changed from 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.398689 31717 raft_consensus.cc:993] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818: : Instructing follower 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:54.399284 31747 raft_consensus.cc:1081] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Signalling peer 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:54.400924 31399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:36238
I20260709 13:14:54.401473 31399 raft_consensus.cc:493] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:54.401790 31399 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.407807 31399 raft_consensus.cc:515] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.409058 31719 raft_consensus.cc:993] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29: : Instructing follower 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:54.409629 31706 raft_consensus.cc:1081] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Signalling peer 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:54.410828 31399 leader_election.cc:290] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 3 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:54.411154 31471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:54.411489 31473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:43912
I20260709 13:14:54.411960 31661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:54.412151 31473 raft_consensus.cc:493] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:54.411818 31471 raft_consensus.cc:3055] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:54.412693 31473 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.412693 31661 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.413102 31471 raft_consensus.cc:740] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:54.413966 31471 consensus_queue.cc:260] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.414852 31471 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.420099 31471 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 3.
I20260709 13:14:54.420439 31661 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 3.
I20260709 13:14:54.421306 31365 leader_election.cc:304] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, 6e6d613befde4e62b5352c1c14bcaf29; no voters: 
I20260709 13:14:54.422153 31706 raft_consensus.cc:2804] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:54.422943 31706 raft_consensus.cc:697] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:54.422547 31473 raft_consensus.cc:515] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.423877 31706 consensus_queue.cc:237] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.425323 31473 leader_election.cc:290] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 4 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:54.425943 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:54.426602 31399 raft_consensus.cc:3055] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:54.426086 31661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d028789819df4b7aa36ef622c6221c4b" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:54.427027 31399 raft_consensus.cc:740] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:54.427256 31661 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.427781 31399 consensus_queue.cc:260] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.428702 31399 raft_consensus.cc:3060] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.432767 31222 catalog_manager.cc:5697] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 2 to 3, leader changed from 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 3 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.434793 31661 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 4.
I20260709 13:14:54.435506 31399 raft_consensus.cc:2468] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 4.
I20260709 13:14:54.436064 31439 leader_election.cc:304] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:54.437170 31747 raft_consensus.cc:2804] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:54.437621 31747 raft_consensus.cc:697] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:54.438421 31747 consensus_queue.cc:237] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:54.446437 31222 catalog_manager.cc:5697] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 3 to 4, leader changed from 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 4 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.722314 31661 raft_consensus.cc:1275] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.723546 31719 consensus_queue.cc:1048] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.734338 31473 raft_consensus.cc:1275] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.739032 31759 consensus_queue.cc:1048] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.851585 31399 raft_consensus.cc:1275] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:54.852934 31748 consensus_queue.cc:1048] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:54.855998 31661 raft_consensus.cc:1275] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:54.857587 31748 consensus_queue.cc:1048] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:14:54.896842 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:54.925921 31663 raft_consensus.cc:1275] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:54.927287 31768 consensus_queue.cc:1048] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:54.937023 31473 raft_consensus.cc:1275] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:54.939320 31759 consensus_queue.cc:1048] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:55.155601 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:55.162752 31473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
mode: GRACEFUL
new_leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:48672
I20260709 13:14:55.163427 31473 raft_consensus.cc:606] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Received request to transfer leadership to TS 6e6d613befde4e62b5352c1c14bcaf29
I20260709 13:14:55.166057 31399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
mode: GRACEFUL
new_leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:14:55.166572 31399 raft_consensus.cc:606] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Received request to transfer leadership to TS 3ff30b22b3f64f54b46b20f49ef1c818
I20260709 13:14:55.169250 31399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a874a108a1b74919bb600d7ae61d8f58"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
mode: GRACEFUL
new_leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:14:55.169731 31399 raft_consensus.cc:606] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Received request to transfer leadership to TS 3ff30b22b3f64f54b46b20f49ef1c818
I20260709 13:14:55.170812 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:55.171307 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:55.171957 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:55.238291 31768 raft_consensus.cc:993] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29: : Instructing follower 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:55.238840 31759 raft_consensus.cc:1081] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Signalling peer 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:55.240295 31473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a874a108a1b74919bb600d7ae61d8f58"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:43912
I20260709 13:14:55.240813 31473 raft_consensus.cc:493] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:55.241097 31473 raft_consensus.cc:3060] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.246374 31473 raft_consensus.cc:515] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.248363 31473 leader_election.cc:290] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:55.249058 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a874a108a1b74919bb600d7ae61d8f58" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:55.249351 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a874a108a1b74919bb600d7ae61d8f58" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:55.249764 31663 raft_consensus.cc:3060] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.249955 31399 raft_consensus.cc:3055] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.250312 31399 raft_consensus.cc:740] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:55.251075 31399 consensus_queue.cc:260] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.252278 31399 raft_consensus.cc:3060] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.257155 31663 raft_consensus.cc:2468] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 2.
I20260709 13:14:55.258420 31439 leader_election.cc:304] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:55.259202 31399 raft_consensus.cc:2468] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 2.
I20260709 13:14:55.259238 31747 raft_consensus.cc:2804] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:55.260063 31747 raft_consensus.cc:697] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:55.260943 31747 consensus_queue.cc:237] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.269552 31219 catalog_manager.cc:5697] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 1 to 2, leader changed from 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 2 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:55.334022 31759 raft_consensus.cc:993] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29: : Instructing follower 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:55.334591 31759 raft_consensus.cc:1081] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Signalling peer 3ff30b22b3f64f54b46b20f49ef1c818 to start an election
I20260709 13:14:55.336179 31473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc"
dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
 from {username='slave'} at 127.0.0.1:43912
I20260709 13:14:55.336669 31473 raft_consensus.cc:493] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:55.336966 31473 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.342087 31473 raft_consensus.cc:515] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.343869 31473 leader_election.cc:290] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 4 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315)
I20260709 13:14:55.344695 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:55.344942 31399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827baed22a1947539e3a5fc6de4b7bbc" candidate_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
I20260709 13:14:55.345355 31663 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.345537 31399 raft_consensus.cc:3055] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:55.345870 31399 raft_consensus.cc:740] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:55.346510 31399 consensus_queue.cc:260] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.347394 31399 raft_consensus.cc:3060] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.351087 31663 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 4.
I20260709 13:14:55.351998 31439 leader_election.cc:304] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ff30b22b3f64f54b46b20f49ef1c818, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:55.352686 31748 raft_consensus.cc:2804] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:55.353149 31748 raft_consensus.cc:697] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 LEADER]: Becoming Leader. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:55.353469 31399 raft_consensus.cc:2468] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ff30b22b3f64f54b46b20f49ef1c818 in term 4.
I20260709 13:14:55.353992 31748 consensus_queue.cc:237] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.360873 31219 catalog_manager.cc:5697] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 reported cstate change: term changed from 3 to 4, leader changed from 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194) to 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195). New cstate: current_term: 4 leader_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:55.501262 31747 raft_consensus.cc:993] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818: : Instructing follower 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:55.502779 31779 raft_consensus.cc:1081] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Signalling peer 6e6d613befde4e62b5352c1c14bcaf29 to start an election
I20260709 13:14:55.505235 31397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946"
dest_uuid: "6e6d613befde4e62b5352c1c14bcaf29"
 from {username='slave'} at 127.0.0.1:36238
I20260709 13:14:55.506162 31397 raft_consensus.cc:493] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:55.506633 31397 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.515257 31397 raft_consensus.cc:515] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.517290 31397 leader_election.cc:290] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 4 election: Requested vote from peers fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519), 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195:45617)
I20260709 13:14:55.519104 31473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3ff30b22b3f64f54b46b20f49ef1c818"
I20260709 13:14:55.518994 31663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41046b8af00d481e96309be0d7fe4946" candidate_uuid: "6e6d613befde4e62b5352c1c14bcaf29" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fef85a27379d47749867ecb8d725b327"
I20260709 13:14:55.520219 31473 raft_consensus.cc:3055] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:55.520392 31663 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.520656 31473 raft_consensus.cc:740] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ff30b22b3f64f54b46b20f49ef1c818, State: Running, Role: LEADER
I20260709 13:14:55.522064 31473 consensus_queue.cc:260] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.524365 31473 raft_consensus.cc:3060] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.531430 31663 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 4.
I20260709 13:14:55.533138 31365 leader_election.cc:304] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6d613befde4e62b5352c1c14bcaf29, fef85a27379d47749867ecb8d725b327; no voters: 
I20260709 13:14:55.534206 31759 raft_consensus.cc:2804] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:55.534669 31759 raft_consensus.cc:697] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6d613befde4e62b5352c1c14bcaf29, State: Running, Role: LEADER
I20260709 13:14:55.535837 31759 consensus_queue.cc:237] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } }
I20260709 13:14:55.536098 31473 raft_consensus.cc:2468] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6d613befde4e62b5352c1c14bcaf29 in term 4.
I20260709 13:14:55.547119 31219 catalog_manager.cc:5697] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 reported cstate change: term changed from 3 to 4, leader changed from 3ff30b22b3f64f54b46b20f49ef1c818 (127.19.185.195) to 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194). New cstate: current_term: 4 leader_uuid: "6e6d613befde4e62b5352c1c14bcaf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:55.794240 31663 raft_consensus.cc:1275] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:55.795701 31779 consensus_queue.cc:1048] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:55.809832 31397 raft_consensus.cc:1275] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:55.812378 31747 consensus_queue.cc:1048] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:55.865296 31397 raft_consensus.cc:1275] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:55.866730 31748 consensus_queue.cc:1048] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6d613befde4e62b5352c1c14bcaf29" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:55.877859 31663 raft_consensus.cc:1275] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Refusing update from remote peer 3ff30b22b3f64f54b46b20f49ef1c818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:55.880645 31779 consensus_queue.cc:1048] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:55.898047 31270 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:55.932503 31663 raft_consensus.cc:1275] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:55.933837 31759 consensus_queue.cc:1048] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef85a27379d47749867ecb8d725b327" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:55.944233 31473 raft_consensus.cc:1275] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Refusing update from remote peer 6e6d613befde4e62b5352c1c14bcaf29: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:55.946254 31759 consensus_queue.cc:1048] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ff30b22b3f64f54b46b20f49ef1c818" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:56.178505 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:56.217196 20199 tablet_server.cc:179] TabletServer@127.19.185.193:35519 shutting down...
I20260709 13:14:56.246583 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:56.247546 20199 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:56.248397 31439 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 75 similar messages]
I20260709 13:14:56.248963 20199 raft_consensus.cc:2243] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.250089 20199 raft_consensus.cc:2272] T d028789819df4b7aa36ef622c6221c4b P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:56.252072 31439 consensus_peers.cc:597] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.253502 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.254138 20199 raft_consensus.cc:2243] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.254623 20199 raft_consensus.cc:2272] T f0ae6ae390464869ba10803a2245a6cb P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.257319 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.257917 20199 raft_consensus.cc:2243] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.258378 20199 raft_consensus.cc:2272] T f86b42ff1b1d46159b7d833a795d6f50 P fef85a27379d47749867ecb8d725b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.261715 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.262473 20199 raft_consensus.cc:2243] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.263098 20199 raft_consensus.cc:2272] T 41046b8af00d481e96309be0d7fe4946 P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:56.263897 31365 consensus_peers.cc:597] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.266471 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.267114 20199 raft_consensus.cc:2243] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.267652 20199 raft_consensus.cc:2272] T 827baed22a1947539e3a5fc6de4b7bbc P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.271370 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.272256 20199 raft_consensus.cc:2243] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.273103 20199 raft_consensus.cc:2272] T c75b9ed11f644d5bb5e9595f198ace0e P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:56.273376 31365 consensus_peers.cc:597] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.275928 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.276670 20199 raft_consensus.cc:2243] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.277143 20199 raft_consensus.cc:2272] T a874a108a1b74919bb600d7ae61d8f58 P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.279953 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.280588 20199 raft_consensus.cc:2243] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.281057 20199 raft_consensus.cc:2272] T 254ef3d5e8254dec95e15895bed25d44 P fef85a27379d47749867ecb8d725b327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.283437 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.284019 20199 raft_consensus.cc:2243] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.284636 20199 raft_consensus.cc:2272] T 8ea7637b7c9b4fc0bac88ebab10a530d P fef85a27379d47749867ecb8d725b327 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.286994 20199 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:56.287498 20199 raft_consensus.cc:2243] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.288132 20199 raft_consensus.cc:2272] T 144dffcbe8c14cb28cfcf976a4067b1d P fef85a27379d47749867ecb8d725b327 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.324570 20199 tablet_server.cc:196] TabletServer@127.19.185.193:35519 shutdown complete.
I20260709 13:14:56.354496 20199 tablet_server.cc:179] TabletServer@127.19.185.194:0 shutting down...
I20260709 13:14:56.382956 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:56.384843 20199 tablet_replica.cc:333] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
I20260709 13:14:56.386516 20199 raft_consensus.cc:2243] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.387898 20199 raft_consensus.cc:2272] T 41046b8af00d481e96309be0d7fe4946 P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.395536 20199 tablet_replica.cc:333] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
W20260709 13:14:56.396234 31439 consensus_peers.cc:597] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.396632 20199 raft_consensus.cc:2243] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.397485 20199 raft_consensus.cc:2272] T f86b42ff1b1d46159b7d833a795d6f50 P 6e6d613befde4e62b5352c1c14bcaf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.400445 20199 tablet_replica.cc:333] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
I20260709 13:14:56.400985 20199 raft_consensus.cc:2243] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.401813 20199 raft_consensus.cc:2272] T c75b9ed11f644d5bb5e9595f198ace0e P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.404228 20199 tablet_replica.cc:333] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
I20260709 13:14:56.404773 20199 raft_consensus.cc:2243] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.405169 20199 raft_consensus.cc:2272] T 827baed22a1947539e3a5fc6de4b7bbc P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.408325 20199 tablet_replica.cc:333] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
I20260709 13:14:56.408908 20199 raft_consensus.cc:2243] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.409411 20199 raft_consensus.cc:2272] T f0ae6ae390464869ba10803a2245a6cb P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.412174 20199 tablet_replica.cc:333] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
I20260709 13:14:56.412952 20199 raft_consensus.cc:2243] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.414206 20199 raft_consensus.cc:2272] T 8ea7637b7c9b4fc0bac88ebab10a530d P 6e6d613befde4e62b5352c1c14bcaf29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.417757 20199 tablet_replica.cc:333] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
W20260709 13:14:56.418509 31437 consensus_peers.cc:597] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315): Couldn't send request to peer 6e6d613befde4e62b5352c1c14bcaf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.418700 20199 raft_consensus.cc:2243] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:56.418896 31365 consensus_peers.cc:597] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.419479 20199 raft_consensus.cc:2272] T 254ef3d5e8254dec95e15895bed25d44 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.423743 20199 tablet_replica.cc:333] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
W20260709 13:14:56.424338 31437 consensus_peers.cc:597] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315): Couldn't send request to peer 6e6d613befde4e62b5352c1c14bcaf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.424870 20199 raft_consensus.cc:2243] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.426484 20199 raft_consensus.cc:2272] T 144dffcbe8c14cb28cfcf976a4067b1d P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:56.427551 31439 consensus_peers.cc:597] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.430155 20199 tablet_replica.cc:333] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
I20260709 13:14:56.430891 20199 raft_consensus.cc:2243] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.431409 20199 raft_consensus.cc:2272] T a874a108a1b74919bb600d7ae61d8f58 P 6e6d613befde4e62b5352c1c14bcaf29 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:56.434267 31437 consensus_peers.cc:597] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315): Couldn't send request to peer 6e6d613befde4e62b5352c1c14bcaf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:56.434754 31439 consensus_peers.cc:597] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer fef85a27379d47749867ecb8d725b327 (127.19.185.193:35519): Couldn't send request to peer fef85a27379d47749867ecb8d725b327. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:35519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.435556 20199 tablet_replica.cc:333] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29: stopping tablet replica
I20260709 13:14:56.436159 20199 raft_consensus.cc:2243] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.436601 20199 raft_consensus.cc:2272] T d028789819df4b7aa36ef622c6221c4b P 6e6d613befde4e62b5352c1c14bcaf29 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.475047 20199 tablet_server.cc:196] TabletServer@127.19.185.194:0 shutdown complete.
I20260709 13:14:56.502075 20199 tablet_server.cc:179] TabletServer@127.19.185.195:0 shutting down...
W20260709 13:14:56.526582 31437 consensus_peers.cc:597] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 -> Peer 6e6d613befde4e62b5352c1c14bcaf29 (127.19.185.194:42315): Couldn't send request to peer 6e6d613befde4e62b5352c1c14bcaf29. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:42315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.537045 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:56.538089 20199 tablet_replica.cc:333] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.539090 20199 raft_consensus.cc:2243] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.539685 20199 raft_consensus.cc:2272] T c75b9ed11f644d5bb5e9595f198ace0e P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.542145 20199 tablet_replica.cc:333] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.542879 20199 raft_consensus.cc:2243] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.543853 20199 raft_consensus.cc:2272] T 827baed22a1947539e3a5fc6de4b7bbc P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.546900 20199 tablet_replica.cc:333] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.547537 20199 raft_consensus.cc:2243] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.548534 20199 raft_consensus.cc:2272] T f0ae6ae390464869ba10803a2245a6cb P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.550767 20199 tablet_replica.cc:333] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.551326 20199 raft_consensus.cc:2243] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.551772 20199 raft_consensus.cc:2272] T 41046b8af00d481e96309be0d7fe4946 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.555449 20199 tablet_replica.cc:333] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.556205 20199 raft_consensus.cc:2243] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.557127 20199 raft_consensus.cc:2272] T f86b42ff1b1d46159b7d833a795d6f50 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.560388 20199 tablet_replica.cc:333] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.561146 20199 raft_consensus.cc:2243] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.561709 20199 raft_consensus.cc:2272] T 8ea7637b7c9b4fc0bac88ebab10a530d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.563820 20199 tablet_replica.cc:333] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.564404 20199 raft_consensus.cc:2243] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.565574 20199 raft_consensus.cc:2272] T 254ef3d5e8254dec95e15895bed25d44 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.568193 20199 tablet_replica.cc:333] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.568759 20199 raft_consensus.cc:2243] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.569451 20199 raft_consensus.cc:2272] T 144dffcbe8c14cb28cfcf976a4067b1d P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.571930 20199 tablet_replica.cc:333] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.572685 20199 raft_consensus.cc:2243] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.573650 20199 raft_consensus.cc:2272] T a874a108a1b74919bb600d7ae61d8f58 P 3ff30b22b3f64f54b46b20f49ef1c818 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.577054 20199 tablet_replica.cc:333] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818: stopping tablet replica
I20260709 13:14:56.577745 20199 raft_consensus.cc:2243] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.578713 20199 raft_consensus.cc:2272] T d028789819df4b7aa36ef622c6221c4b P 3ff30b22b3f64f54b46b20f49ef1c818 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.613411 20199 tablet_server.cc:196] TabletServer@127.19.185.195:0 shutdown complete.
I20260709 13:14:56.643589 20199 master.cc:562] Master@127.19.185.254:39787 shutting down...
I20260709 13:14:56.671469 20199 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.672005 20199 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.672529 20199 tablet_replica.cc:333] T 00000000000000000000000000000000 P 958003602e9045528f5c1310d82f834a: stopping tablet replica
I20260709 13:14:56.693826 20199 master.cc:584] Master@127.19.185.254:39787 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13000 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:14:56.741894 20199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.185.254:38645
I20260709 13:14:56.743168 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:56.749848 31800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.749956 31801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.750962 31803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.752130 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:56.753082 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:56.753264 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:56.753381 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602896753370 us; error 0 us; skew 500 ppm
I20260709 13:14:56.753839 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:56.756898 20199 webserver.cc:533] Webserver started at http://127.19.185.254:40761/ using document root <none> and password file <none>
I20260709 13:14:56.757395 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:56.757550 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:56.757756 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:56.758875 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/master-0-root/instance:
uuid: "352f4b1870f34573897add55264bdaf0"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-rrf3"
I20260709 13:14:56.763609 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:14:56.767781 31808 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.768716 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:14:56.769033 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/master-0-root
uuid: "352f4b1870f34573897add55264bdaf0"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-rrf3"
I20260709 13:14:56.769316 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:56.784953 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:56.786157 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:56.826375 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.254:38645
I20260709 13:14:56.826485 31859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.254:38645 every 8 connection(s)
I20260709 13:14:56.830339 31860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.842290 31860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0: Bootstrap starting.
I20260709 13:14:56.847246 31860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:56.851788 31860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0: No bootstrap required, opened a new log
I20260709 13:14:56.854024 31860 raft_consensus.cc:359] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f4b1870f34573897add55264bdaf0" member_type: VOTER }
I20260709 13:14:56.854406 31860 raft_consensus.cc:385] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:56.854661 31860 raft_consensus.cc:740] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 352f4b1870f34573897add55264bdaf0, State: Initialized, Role: FOLLOWER
I20260709 13:14:56.855269 31860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f4b1870f34573897add55264bdaf0" member_type: VOTER }
I20260709 13:14:56.855746 31860 raft_consensus.cc:399] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:56.855979 31860 raft_consensus.cc:493] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:56.856279 31860 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:56.861231 31860 raft_consensus.cc:515] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f4b1870f34573897add55264bdaf0" member_type: VOTER }
I20260709 13:14:56.861785 31860 leader_election.cc:304] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 352f4b1870f34573897add55264bdaf0; no voters: 
I20260709 13:14:56.862972 31860 leader_election.cc:290] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:56.863415 31863 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:56.864929 31863 raft_consensus.cc:697] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 1 LEADER]: Becoming Leader. State: Replica: 352f4b1870f34573897add55264bdaf0, State: Running, Role: LEADER
I20260709 13:14:56.865612 31863 consensus_queue.cc:237] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f4b1870f34573897add55264bdaf0" member_type: VOTER }
I20260709 13:14:56.865892 31860 sys_catalog.cc:565] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:56.870515 31864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "352f4b1870f34573897add55264bdaf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f4b1870f34573897add55264bdaf0" member_type: VOTER } }
I20260709 13:14:56.871140 31865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 352f4b1870f34573897add55264bdaf0. Latest consensus state: current_term: 1 leader_uuid: "352f4b1870f34573897add55264bdaf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f4b1870f34573897add55264bdaf0" member_type: VOTER } }
I20260709 13:14:56.871387 31864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:56.871760 31865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:56.875015 31871 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:56.882974 31871 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:56.884069 20199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:56.892551 31871 catalog_manager.cc:1383] Generated new cluster ID: 1b31a2a5a2ad4a4594a65061ff52c093
I20260709 13:14:56.892906 31871 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:56.908843 31871 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:56.910167 31871 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:56.931788 31871 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0: Generated new TSK 0
I20260709 13:14:56.932446 31871 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:56.951452 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:56.957571 31881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.958403 31882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.960639 31884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.960924 20199 server_base.cc:1061] running on GCE node
I20260709 13:14:56.961897 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:56.962121 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:56.962333 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602896962317 us; error 0 us; skew 500 ppm
I20260709 13:14:56.962894 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:56.965296 20199 webserver.cc:533] Webserver started at http://127.19.185.193:41233/ using document root <none> and password file <none>
I20260709 13:14:56.965771 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:56.965970 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:56.966246 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:56.967423 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-0-root/instance:
uuid: "248a1ea5b1bf4c7292159d9e2b910621"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-rrf3"
I20260709 13:14:56.972162 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:56.975586 31889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.976532 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:56.976895 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "248a1ea5b1bf4c7292159d9e2b910621"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-rrf3"
I20260709 13:14:56.977196 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:56.996433 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:56.997835 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:56.999286 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:57.001781 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:57.002022 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.002276 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:57.002465 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.044654 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:39507
I20260709 13:14:57.044749 31951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:39507 every 8 connection(s)
I20260709 13:14:57.050581 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:57.059370 31956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:57.059784 31957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:57.064005 20199 server_base.cc:1061] running on GCE node
W20260709 13:14:57.065341 31960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:57.066407 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:57.066706 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:57.066699 31952 heartbeater.cc:344] Connected to a master server at 127.19.185.254:38645
I20260709 13:14:57.067188 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602897067163 us; error 0 us; skew 500 ppm
I20260709 13:14:57.067394 31952 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:57.067934 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:57.068334 31952 heartbeater.cc:507] Master 127.19.185.254:38645 requested a full tablet report, sending...
I20260709 13:14:57.070562 31825 ts_manager.cc:194] Registered new tserver with Master: 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507)
I20260709 13:14:57.071034 20199 webserver.cc:533] Webserver started at http://127.19.185.194:43187/ using document root <none> and password file <none>
I20260709 13:14:57.071631 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:57.071839 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:57.072149 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:57.072769 31825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51254
I20260709 13:14:57.073439 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-1-root/instance:
uuid: "94748be01bae4696a7ffd232855a7710"
format_stamp: "Formatted at 2026-07-09 13:14:57 on dist-test-slave-rrf3"
I20260709 13:14:57.078954 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:57.082571 31964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.083380 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:14:57.083684 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-1-root
uuid: "94748be01bae4696a7ffd232855a7710"
format_stamp: "Formatted at 2026-07-09 13:14:57 on dist-test-slave-rrf3"
I20260709 13:14:57.083998 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:57.095474 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:57.096740 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:57.098234 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:57.101054 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:57.101235 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.101573 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:57.101714 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.143595 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.194:35257
I20260709 13:14:57.143723 32026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.194:35257 every 8 connection(s)
I20260709 13:14:57.148679 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:57.156255 32030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:57.158932 32031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:57.160516 20199 server_base.cc:1061] running on GCE node
W20260709 13:14:57.162492 32033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:57.163218 32027 heartbeater.cc:344] Connected to a master server at 127.19.185.254:38645
I20260709 13:14:57.163630 32027 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:57.163743 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:57.164135 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:57.164350 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602897164330 us; error 0 us; skew 500 ppm
I20260709 13:14:57.164472 32027 heartbeater.cc:507] Master 127.19.185.254:38645 requested a full tablet report, sending...
I20260709 13:14:57.165057 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:57.166958 31825 ts_manager.cc:194] Registered new tserver with Master: 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257)
I20260709 13:14:57.168321 20199 webserver.cc:533] Webserver started at http://127.19.185.195:45535/ using document root <none> and password file <none>
I20260709 13:14:57.169114 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:57.169221 31825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51256
I20260709 13:14:57.169417 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:57.169876 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:57.171622 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-2-root/instance:
uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
format_stamp: "Formatted at 2026-07-09 13:14:57 on dist-test-slave-rrf3"
I20260709 13:14:57.177011 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:14:57.181002 32038 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.181947 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:14:57.182320 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-2-root
uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
format_stamp: "Formatted at 2026-07-09 13:14:57 on dist-test-slave-rrf3"
I20260709 13:14:57.182585 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602552983791-20199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:57.207923 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:57.209272 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:57.210772 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:57.213116 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:57.213323 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.213605 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:57.213778 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.254581 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.195:34679
I20260709 13:14:57.254712 32100 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.195:34679 every 8 connection(s)
I20260709 13:14:57.269877 32101 heartbeater.cc:344] Connected to a master server at 127.19.185.254:38645
I20260709 13:14:57.270349 32101 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:57.271095 32101 heartbeater.cc:507] Master 127.19.185.254:38645 requested a full tablet report, sending...
I20260709 13:14:57.273065 31825 ts_manager.cc:194] Registered new tserver with Master: fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:57.273589 20199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015814006s
I20260709 13:14:57.274863 31825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51262
I20260709 13:14:57.301090 31825 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51268:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:57.303274 31825 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:57.359154 31917 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4dda66c7a4cd38528a6932a755574 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=94010bd3d9b34706bb3a6acefad43df1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:57.360720 31917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4dda66c7a4cd38528a6932a755574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.362397 31992 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4dda66c7a4cd38528a6932a755574 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=94010bd3d9b34706bb3a6acefad43df1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:57.362576 31991 tablet_service.cc:1511] Processing CreateTablet for tablet f0ab877b82184f8293d4f2f6acba6ee4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=94010bd3d9b34706bb3a6acefad43df1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:57.363972 31992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4dda66c7a4cd38528a6932a755574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.364640 31991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ab877b82184f8293d4f2f6acba6ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.367081 31916 tablet_service.cc:1511] Processing CreateTablet for tablet f0ab877b82184f8293d4f2f6acba6ee4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=94010bd3d9b34706bb3a6acefad43df1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:57.368917 31916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ab877b82184f8293d4f2f6acba6ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.387331 32066 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4dda66c7a4cd38528a6932a755574 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=94010bd3d9b34706bb3a6acefad43df1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:57.388818 32066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4dda66c7a4cd38528a6932a755574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.392102 32065 tablet_service.cc:1511] Processing CreateTablet for tablet f0ab877b82184f8293d4f2f6acba6ee4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=94010bd3d9b34706bb3a6acefad43df1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:57.393499 32065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ab877b82184f8293d4f2f6acba6ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.394505 32117 tablet_bootstrap.cc:492] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710: Bootstrap starting.
I20260709 13:14:57.398494 32116 tablet_bootstrap.cc:492] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621: Bootstrap starting.
I20260709 13:14:57.401360 32117 tablet_bootstrap.cc:654] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.406540 32116 tablet_bootstrap.cc:654] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.409997 32119 tablet_bootstrap.cc:492] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5: Bootstrap starting.
I20260709 13:14:57.416023 32116 tablet_bootstrap.cc:492] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621: No bootstrap required, opened a new log
I20260709 13:14:57.416023 32117 tablet_bootstrap.cc:492] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710: No bootstrap required, opened a new log
I20260709 13:14:57.416915 32116 ts_tablet_manager.cc:1403] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:14:57.416963 32117 ts_tablet_manager.cc:1403] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:14:57.417918 32119 tablet_bootstrap.cc:654] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.419327 32116 raft_consensus.cc:359] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.419955 32116 raft_consensus.cc:385] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.420257 32116 raft_consensus.cc:740] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 248a1ea5b1bf4c7292159d9e2b910621, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.420372 32117 raft_consensus.cc:359] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.421319 32117 raft_consensus.cc:385] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.421005 32116 consensus_queue.cc:260] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.421717 32117 raft_consensus.cc:740] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94748be01bae4696a7ffd232855a7710, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.423512 31952 heartbeater.cc:499] Master 127.19.185.254:38645 was elected leader, sending a full tablet report...
I20260709 13:14:57.424145 32116 ts_tablet_manager.cc:1434] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:57.424171 32119 tablet_bootstrap.cc:492] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5: No bootstrap required, opened a new log
I20260709 13:14:57.422688 32117 consensus_queue.cc:260] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.425051 32119 ts_tablet_manager.cc:1403] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:14:57.429934 32116 tablet_bootstrap.cc:492] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621: Bootstrap starting.
I20260709 13:14:57.429311 32119 raft_consensus.cc:359] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.430629 32119 raft_consensus.cc:385] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.431162 32119 raft_consensus.cc:740] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.432560 32119 consensus_queue.cc:260] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.437785 32116 tablet_bootstrap.cc:654] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.440536 32101 heartbeater.cc:499] Master 127.19.185.254:38645 was elected leader, sending a full tablet report...
I20260709 13:14:57.443401 32027 heartbeater.cc:499] Master 127.19.185.254:38645 was elected leader, sending a full tablet report...
I20260709 13:14:57.443955 32117 ts_tablet_manager.cc:1434] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.017s
I20260709 13:14:57.445058 32117 tablet_bootstrap.cc:492] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710: Bootstrap starting.
I20260709 13:14:57.445334 32119 ts_tablet_manager.cc:1434] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:14:57.446468 32119 tablet_bootstrap.cc:492] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5: Bootstrap starting.
I20260709 13:14:57.440502 32125 raft_consensus.cc:493] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.448611 32125 raft_consensus.cc:515] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.456916 32119 tablet_bootstrap.cc:654] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.479743 31927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4dda66c7a4cd38528a6932a755574" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621" is_pre_election: true
I20260709 13:14:57.481005 31927 raft_consensus.cc:2468] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 0.
I20260709 13:14:57.483183 32041 leader_election.cc:304] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 
I20260709 13:14:57.484660 32124 raft_consensus.cc:2804] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.485298 32124 raft_consensus.cc:493] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.484678 32125 leader_election.cc:290] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257)
I20260709 13:14:57.485800 32124 raft_consensus.cc:3060] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.503786 32117 tablet_bootstrap.cc:654] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.504245 32116 tablet_bootstrap.cc:492] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621: No bootstrap required, opened a new log
I20260709 13:14:57.504815 32116 ts_tablet_manager.cc:1403] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621: Time spent bootstrapping tablet: real 0.075s	user 0.034s	sys 0.039s
I20260709 13:14:57.508352 32124 raft_consensus.cc:515] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.509631 32116 raft_consensus.cc:359] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.510993 32116 raft_consensus.cc:385] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.511451 32116 raft_consensus.cc:740] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 248a1ea5b1bf4c7292159d9e2b910621, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.512696 31927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4dda66c7a4cd38528a6932a755574" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
I20260709 13:14:57.513618 31927 raft_consensus.cc:3060] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.512950 32116 consensus_queue.cc:260] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.516009 32116 ts_tablet_manager.cc:1434] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:14:57.526139 31927 raft_consensus.cc:2468] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 1.
I20260709 13:14:57.530932 32041 leader_election.cc:304] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 
I20260709 13:14:57.532238 32125 raft_consensus.cc:2804] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.533535 32002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4dda66c7a4cd38528a6932a755574" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94748be01bae4696a7ffd232855a7710" is_pre_election: true
I20260709 13:14:57.534637 32002 raft_consensus.cc:2468] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 0.
I20260709 13:14:57.540812 32002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4dda66c7a4cd38528a6932a755574" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94748be01bae4696a7ffd232855a7710"
I20260709 13:14:57.541460 32002 raft_consensus.cc:3060] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.552191 32124 leader_election.cc:290] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 1 election: Requested vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257)
I20260709 13:14:57.559355 32125 raft_consensus.cc:697] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Becoming Leader. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Running, Role: LEADER
I20260709 13:14:57.560585 32125 consensus_queue.cc:237] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.562245 32002 raft_consensus.cc:2468] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 1.
I20260709 13:14:57.562885 32119 tablet_bootstrap.cc:492] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5: No bootstrap required, opened a new log
I20260709 13:14:57.563503 32119 ts_tablet_manager.cc:1403] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5: Time spent bootstrapping tablet: real 0.117s	user 0.033s	sys 0.081s
I20260709 13:14:57.563813 32117 tablet_bootstrap.cc:492] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710: No bootstrap required, opened a new log
I20260709 13:14:57.564385 32117 ts_tablet_manager.cc:1403] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.047s
I20260709 13:14:57.567531 32119 raft_consensus.cc:359] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.568091 32117 raft_consensus.cc:359] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.568418 32119 raft_consensus.cc:385] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.568848 32117 raft_consensus.cc:385] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.568898 32119 raft_consensus.cc:740] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.569377 32117 raft_consensus.cc:740] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94748be01bae4696a7ffd232855a7710, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.569895 32119 consensus_queue.cc:260] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.570152 32117 consensus_queue.cc:260] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.570359 31823 catalog_manager.cc:5697] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.572314 32119 ts_tablet_manager.cc:1434] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:57.574352 32117 ts_tablet_manager.cc:1434] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:14:57.716952 32123 raft_consensus.cc:493] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.717438 32123 raft_consensus.cc:515] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.719627 32123 leader_election.cc:290] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:57.730242 31927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ab877b82184f8293d4f2f6acba6ee4" candidate_uuid: "94748be01bae4696a7ffd232855a7710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621" is_pre_election: true
I20260709 13:14:57.731062 31927 raft_consensus.cc:2468] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94748be01bae4696a7ffd232855a7710 in term 0.
I20260709 13:14:57.731691 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ab877b82184f8293d4f2f6acba6ee4" candidate_uuid: "94748be01bae4696a7ffd232855a7710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" is_pre_election: true
I20260709 13:14:57.732106 31967 leader_election.cc:304] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, 94748be01bae4696a7ffd232855a7710; no voters: 
I20260709 13:14:57.732491 32076 raft_consensus.cc:2468] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94748be01bae4696a7ffd232855a7710 in term 0.
I20260709 13:14:57.732933 32123 raft_consensus.cc:2804] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.733311 32123 raft_consensus.cc:493] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.733649 32123 raft_consensus.cc:3060] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.739034 32123 raft_consensus.cc:515] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.740763 32123 leader_election.cc:290] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [CANDIDATE]: Term 1 election: Requested vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:57.741438 31927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ab877b82184f8293d4f2f6acba6ee4" candidate_uuid: "94748be01bae4696a7ffd232855a7710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
I20260709 13:14:57.741847 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ab877b82184f8293d4f2f6acba6ee4" candidate_uuid: "94748be01bae4696a7ffd232855a7710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
I20260709 13:14:57.742112 31927 raft_consensus.cc:3060] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.742445 32076 raft_consensus.cc:3060] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.749568 31927 raft_consensus.cc:2468] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94748be01bae4696a7ffd232855a7710 in term 1.
I20260709 13:14:57.749732 32076 raft_consensus.cc:2468] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94748be01bae4696a7ffd232855a7710 in term 1.
I20260709 13:14:57.750885 31967 leader_election.cc:304] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, 94748be01bae4696a7ffd232855a7710; no voters: 
I20260709 13:14:57.751570 32123 raft_consensus.cc:2804] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.752560 32123 raft_consensus.cc:697] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 1 LEADER]: Becoming Leader. State: Replica: 94748be01bae4696a7ffd232855a7710, State: Running, Role: LEADER
I20260709 13:14:57.753342 32123 consensus_queue.cc:237] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.759778 31825 catalog_manager.cc:5697] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94748be01bae4696a7ffd232855a7710 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "94748be01bae4696a7ffd232855a7710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.799428 31825 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51272:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:57.801810 31825 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:57.825171 31917 tablet_service.cc:1511] Processing CreateTablet for tablet 4a66eae5d94c441391fbf8ea765f7a8e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9352bd79f69d4e71ba7b91298a719657]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:57.826642 31917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66eae5d94c441391fbf8ea765f7a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.826539 31991 tablet_service.cc:1511] Processing CreateTablet for tablet 4a66eae5d94c441391fbf8ea765f7a8e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9352bd79f69d4e71ba7b91298a719657]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:57.828045 31991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66eae5d94c441391fbf8ea765f7a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.829286 32066 tablet_service.cc:1511] Processing CreateTablet for tablet 4a66eae5d94c441391fbf8ea765f7a8e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9352bd79f69d4e71ba7b91298a719657]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:57.830616 32066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66eae5d94c441391fbf8ea765f7a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.831547 31916 tablet_service.cc:1511] Processing CreateTablet for tablet b13006640bf84f81b6e5b864781e00b9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9352bd79f69d4e71ba7b91298a719657]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:57.833027 31916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13006640bf84f81b6e5b864781e00b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.836953 31992 tablet_service.cc:1511] Processing CreateTablet for tablet b13006640bf84f81b6e5b864781e00b9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9352bd79f69d4e71ba7b91298a719657]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:57.838325 31992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13006640bf84f81b6e5b864781e00b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.841861 32065 tablet_service.cc:1511] Processing CreateTablet for tablet b13006640bf84f81b6e5b864781e00b9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9352bd79f69d4e71ba7b91298a719657]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:57.843318 32065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13006640bf84f81b6e5b864781e00b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.848591 32119 tablet_bootstrap.cc:492] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5: Bootstrap starting.
I20260709 13:14:57.855790 32117 tablet_bootstrap.cc:492] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710: Bootstrap starting.
I20260709 13:14:57.855202 32119 tablet_bootstrap.cc:654] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.862985 32117 tablet_bootstrap.cc:654] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.867208 32116 tablet_bootstrap.cc:492] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621: Bootstrap starting.
I20260709 13:14:57.874501 32119 tablet_bootstrap.cc:492] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5: No bootstrap required, opened a new log
I20260709 13:14:57.875223 32119 ts_tablet_manager.cc:1403] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260709 13:14:57.875237 32116 tablet_bootstrap.cc:654] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:57.877697 31873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:57.879004 32119 raft_consensus.cc:359] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.879894 32119 raft_consensus.cc:385] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.880227 32119 raft_consensus.cc:740] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.881551 32117 tablet_bootstrap.cc:492] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710: No bootstrap required, opened a new log
I20260709 13:14:57.882112 32117 ts_tablet_manager.cc:1403] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
I20260709 13:14:57.881119 32119 consensus_queue.cc:260] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.884493 32119 ts_tablet_manager.cc:1434] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:14:57.884536 32116 tablet_bootstrap.cc:492] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621: No bootstrap required, opened a new log
I20260709 13:14:57.885355 32116 ts_tablet_manager.cc:1403] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.002s
I20260709 13:14:57.885404 32117 raft_consensus.cc:359] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.886059 32119 tablet_bootstrap.cc:492] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: Bootstrap starting.
I20260709 13:14:57.886381 32117 raft_consensus.cc:385] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.886758 32117 raft_consensus.cc:740] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94748be01bae4696a7ffd232855a7710, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.887662 32117 consensus_queue.cc:260] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.888500 32116 raft_consensus.cc:359] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.889290 32116 raft_consensus.cc:385] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.889593 32116 raft_consensus.cc:740] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 248a1ea5b1bf4c7292159d9e2b910621, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.890424 32116 consensus_queue.cc:260] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.893533 32116 ts_tablet_manager.cc:1434] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:14:57.894605 32116 tablet_bootstrap.cc:492] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621: Bootstrap starting.
I20260709 13:14:57.894735 32117 ts_tablet_manager.cc:1434] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:14:57.895205 32119 tablet_bootstrap.cc:654] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.895896 32117 tablet_bootstrap.cc:492] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710: Bootstrap starting.
I20260709 13:14:57.902694 32116 tablet_bootstrap.cc:654] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.903096 32117 tablet_bootstrap.cc:654] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.916815 32116 tablet_bootstrap.cc:492] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621: No bootstrap required, opened a new log
I20260709 13:14:57.917542 32116 ts_tablet_manager.cc:1403] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.015s
I20260709 13:14:57.919155 32117 tablet_bootstrap.cc:492] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710: No bootstrap required, opened a new log
I20260709 13:14:57.919822 32117 ts_tablet_manager.cc:1403] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:14:57.920553 32119 tablet_bootstrap.cc:492] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: No bootstrap required, opened a new log
I20260709 13:14:57.921144 32119 ts_tablet_manager.cc:1403] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.022s
I20260709 13:14:57.921092 32116 raft_consensus.cc:359] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.921991 32116 raft_consensus.cc:385] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.922328 32116 raft_consensus.cc:740] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 248a1ea5b1bf4c7292159d9e2b910621, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.923159 32116 consensus_queue.cc:260] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.923429 32117 raft_consensus.cc:359] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.924703 32117 raft_consensus.cc:385] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.925112 32117 raft_consensus.cc:740] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94748be01bae4696a7ffd232855a7710, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.926501 32125 raft_consensus.cc:493] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.926134 32117 consensus_queue.cc:260] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.927037 32125 raft_consensus.cc:515] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.927556 32116 ts_tablet_manager.cc:1434] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:14:57.929638 32125 leader_election.cc:290] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257)
I20260709 13:14:57.925457 32119 raft_consensus.cc:359] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.930259 32119 raft_consensus.cc:385] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.930570 32119 raft_consensus.cc:740] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.931105 32117 ts_tablet_manager.cc:1434] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:14:57.931135 31927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a66eae5d94c441391fbf8ea765f7a8e" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621" is_pre_election: true
I20260709 13:14:57.931401 32119 consensus_queue.cc:260] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.932011 32002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a66eae5d94c441391fbf8ea765f7a8e" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94748be01bae4696a7ffd232855a7710" is_pre_election: true
I20260709 13:14:57.932498 31927 raft_consensus.cc:2468] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 0.
I20260709 13:14:57.932755 32002 raft_consensus.cc:2468] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 0.
I20260709 13:14:57.933862 32041 leader_election.cc:304] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 
I20260709 13:14:57.935962 32119 ts_tablet_manager.cc:1434] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:14:57.936105 32125 raft_consensus.cc:2804] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.937176 32125 raft_consensus.cc:493] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.937579 32125 raft_consensus.cc:3060] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.945358 32125 raft_consensus.cc:515] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.947546 32125 leader_election.cc:290] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 1 election: Requested vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257)
I20260709 13:14:57.948338 31927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a66eae5d94c441391fbf8ea765f7a8e" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
I20260709 13:14:57.948740 32002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a66eae5d94c441391fbf8ea765f7a8e" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94748be01bae4696a7ffd232855a7710"
I20260709 13:14:57.949090 31927 raft_consensus.cc:3060] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.949342 32002 raft_consensus.cc:3060] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.956332 31927 raft_consensus.cc:2468] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 1.
I20260709 13:14:57.956332 32002 raft_consensus.cc:2468] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 1.
I20260709 13:14:57.957836 32039 leader_election.cc:304] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94748be01bae4696a7ffd232855a7710, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 
I20260709 13:14:57.958593 32125 raft_consensus.cc:2804] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.959079 32125 raft_consensus.cc:697] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Becoming Leader. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Running, Role: LEADER
I20260709 13:14:57.959736 32125 consensus_queue.cc:237] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:57.967830 31823 catalog_manager.cc:5697] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195). New cstate: current_term: 1 leader_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.048238 32122 raft_consensus.cc:493] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.048763 32122 raft_consensus.cc:515] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.050987 32122 leader_election.cc:290] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:58.055198 32123 raft_consensus.cc:493] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.055859 32123 raft_consensus.cc:515] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.058084 32123 leader_election.cc:290] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:58.059744 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "94748be01bae4696a7ffd232855a7710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" is_pre_election: true
I20260709 13:14:58.059229 31927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "94748be01bae4696a7ffd232855a7710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621" is_pre_election: true
I20260709 13:14:58.060894 32076 raft_consensus.cc:2468] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94748be01bae4696a7ffd232855a7710 in term 0.
I20260709 13:14:58.060978 31927 raft_consensus.cc:2468] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94748be01bae4696a7ffd232855a7710 in term 0.
I20260709 13:14:58.062109 31967 leader_election.cc:304] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94748be01bae4696a7ffd232855a7710, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 
I20260709 13:14:58.063191 32123 raft_consensus.cc:2804] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.063570 32123 raft_consensus.cc:493] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.063915 32123 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.066007 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" is_pre_election: true
I20260709 13:14:58.066717 32076 raft_consensus.cc:2468] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 248a1ea5b1bf4c7292159d9e2b910621 in term 0.
I20260709 13:14:58.067339 32002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94748be01bae4696a7ffd232855a7710" is_pre_election: true
I20260709 13:14:58.067853 31892 leader_election.cc:304] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 
I20260709 13:14:58.068861 32122 raft_consensus.cc:2804] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.069182 32122 raft_consensus.cc:493] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.069453 32122 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.070892 32123 raft_consensus.cc:515] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.071969 32002 raft_consensus.cc:2393] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 248a1ea5b1bf4c7292159d9e2b910621 in current term 1: Already voted for candidate 94748be01bae4696a7ffd232855a7710 in this term.
I20260709 13:14:58.073741 32123 leader_election.cc:290] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [CANDIDATE]: Term 1 election: Requested vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:58.074703 31927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "94748be01bae4696a7ffd232855a7710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
I20260709 13:14:58.075181 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "94748be01bae4696a7ffd232855a7710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
I20260709 13:14:58.075922 32076 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.076825 32125 consensus_queue.cc:1048] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.079819 32122 raft_consensus.cc:515] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.081043 31927 raft_consensus.cc:2393] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 94748be01bae4696a7ffd232855a7710 in current term 1: Already voted for candidate 248a1ea5b1bf4c7292159d9e2b910621 in this term.
I20260709 13:14:58.082790 32002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94748be01bae4696a7ffd232855a7710"
I20260709 13:14:58.083526 32002 raft_consensus.cc:2393] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 248a1ea5b1bf4c7292159d9e2b910621 in current term 1: Already voted for candidate 94748be01bae4696a7ffd232855a7710 in this term.
I20260709 13:14:58.084685 32076 raft_consensus.cc:2468] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94748be01bae4696a7ffd232855a7710 in term 1.
I20260709 13:14:58.085574 32122 leader_election.cc:290] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 1 election: Requested vote from peers 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:58.086433 31967 leader_election.cc:304] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94748be01bae4696a7ffd232855a7710, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 248a1ea5b1bf4c7292159d9e2b910621
I20260709 13:14:58.086225 32076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
I20260709 13:14:58.087255 32123 raft_consensus.cc:2804] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.087555 32076 raft_consensus.cc:2393] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 248a1ea5b1bf4c7292159d9e2b910621 in current term 1: Already voted for candidate 94748be01bae4696a7ffd232855a7710 in this term.
I20260709 13:14:58.087903 32123 raft_consensus.cc:697] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 LEADER]: Becoming Leader. State: Replica: 94748be01bae4696a7ffd232855a7710, State: Running, Role: LEADER
I20260709 13:14:58.089093 31892 leader_election.cc:304] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621; no voters: 94748be01bae4696a7ffd232855a7710, fc082ff11e3f4db4bab7d2b61bd9fea5
I20260709 13:14:58.090278 32122 raft_consensus.cc:2749] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:58.090268 32123 consensus_queue.cc:237] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.099112 32125 consensus_queue.cc:1048] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.104933 31824 catalog_manager.cc:5697] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94748be01bae4696a7ffd232855a7710 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "94748be01bae4696a7ffd232855a7710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.132094 32076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44d4dda66c7a4cd38528a6932a755574"
dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
mode: GRACEFUL
new_leader_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
 from {username='slave'} at 127.0.0.1:40130
I20260709 13:14:58.132685 32076 raft_consensus.cc:606] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Received request to transfer leadership to TS 248a1ea5b1bf4c7292159d9e2b910621
I20260709 13:14:58.141776 32076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a66eae5d94c441391fbf8ea765f7a8e"
dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
mode: GRACEFUL
new_leader_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
 from {username='slave'} at 127.0.0.1:40130
I20260709 13:14:58.142304 32076 raft_consensus.cc:606] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Received request to transfer leadership to TS 248a1ea5b1bf4c7292159d9e2b910621
I20260709 13:14:58.156416 32001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9"
dest_uuid: "94748be01bae4696a7ffd232855a7710"
mode: GRACEFUL
new_leader_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
 from {username='slave'} at 127.0.0.1:40260
I20260709 13:14:58.156978 32001 raft_consensus.cc:606] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 LEADER]: Received request to transfer leadership to TS 248a1ea5b1bf4c7292159d9e2b910621
I20260709 13:14:58.209908 32123 consensus_queue.cc:1048] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.221575 32134 consensus_queue.cc:1048] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [LEADER]: Connected to new peer: Peer: permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.886595 32161 consensus_queue.cc:1048] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.894400 32134 consensus_queue.cc:1048] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [LEADER]: Connected to new peer: Peer: permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.903162 32159 raft_consensus.cc:993] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710: : Instructing follower 248a1ea5b1bf4c7292159d9e2b910621 to start an election
I20260709 13:14:58.903646 32159 raft_consensus.cc:1081] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 LEADER]: Signalling peer 248a1ea5b1bf4c7292159d9e2b910621 to start an election
I20260709 13:14:58.906488 31927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9"
dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
 from {username='slave'} at 127.0.0.1:43928
I20260709 13:14:58.908656 31927 raft_consensus.cc:493] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.909119 31927 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.917721 32166 raft_consensus.cc:993] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5: : Instructing follower 248a1ea5b1bf4c7292159d9e2b910621 to start an election
I20260709 13:14:58.918455 32166 raft_consensus.cc:1081] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Signalling peer 248a1ea5b1bf4c7292159d9e2b910621 to start an election
I20260709 13:14:58.920725 31925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a66eae5d94c441391fbf8ea765f7a8e"
dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
 from {username='slave'} at 127.0.0.1:43914
I20260709 13:14:58.921412 31925 raft_consensus.cc:493] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.921837 31925 raft_consensus.cc:3060] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.923008 32166 consensus_queue.cc:1048] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.928653 32159 consensus_queue.cc:1048] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.931110 31927 raft_consensus.cc:515] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.932484 31926 raft_consensus.cc:1240] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Rejecting Update request from peer 94748be01bae4696a7ffd232855a7710 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:58.934218 31927 leader_election.cc:290] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 2 election: Requested vote from peers 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:58.936676 32002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94748be01bae4696a7ffd232855a7710"
I20260709 13:14:58.937180 32159 consensus_queue.cc:1059] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.940864 32002 raft_consensus.cc:3055] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.953698 32002 raft_consensus.cc:740] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94748be01bae4696a7ffd232855a7710, State: Running, Role: LEADER
I20260709 13:14:58.951783 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
I20260709 13:14:58.955729 32002 consensus_queue.cc:260] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.957170 32002 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.966748 32170 raft_consensus.cc:993] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5: : Instructing follower 248a1ea5b1bf4c7292159d9e2b910621 to start an election
I20260709 13:14:58.967445 32170 raft_consensus.cc:1081] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Signalling peer 248a1ea5b1bf4c7292159d9e2b910621 to start an election
I20260709 13:14:58.963238 31925 raft_consensus.cc:515] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.969669 31924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44d4dda66c7a4cd38528a6932a755574"
dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
 from {username='slave'} at 127.0.0.1:43914
I20260709 13:14:58.970455 31924 raft_consensus.cc:493] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.970660 31923 raft_consensus.cc:1240] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Rejecting Update request from peer fc082ff11e3f4db4bab7d2b61bd9fea5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:58.970901 31924 raft_consensus.cc:3060] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.971742 32002 raft_consensus.cc:2468] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 248a1ea5b1bf4c7292159d9e2b910621 in term 2.
W20260709 13:14:58.972543 32123 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:14:58.973767 32000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a66eae5d94c441391fbf8ea765f7a8e" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94748be01bae4696a7ffd232855a7710"
I20260709 13:14:58.971964 31925 leader_election.cc:290] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 2 election: Requested vote from peers 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:58.976473 31890 leader_election.cc:304] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, 94748be01bae4696a7ffd232855a7710; no voters: fc082ff11e3f4db4bab7d2b61bd9fea5
I20260709 13:14:58.977391 32162 raft_consensus.cc:2804] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.980098 32170 consensus_queue.cc:1059] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.981206 32170 raft_consensus.cc:3055] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.981556 32170 raft_consensus.cc:740] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Running, Role: LEADER
I20260709 13:14:58.982524 32170 consensus_queue.cc:260] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:58.984900 32170 raft_consensus.cc:3060] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.991551 32075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a66eae5d94c441391fbf8ea765f7a8e" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
I20260709 13:14:59.036787 31924 raft_consensus.cc:515] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:59.041920 32074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4dda66c7a4cd38528a6932a755574" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
I20260709 13:14:59.042797 32074 raft_consensus.cc:3055] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.043226 32074 raft_consensus.cc:740] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Running, Role: LEADER
I20260709 13:14:59.044250 32162 raft_consensus.cc:697] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Becoming Leader. State: Replica: 248a1ea5b1bf4c7292159d9e2b910621, State: Running, Role: LEADER
I20260709 13:14:59.044708 31924 leader_election.cc:290] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 2 election: Requested vote from peers 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257), fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195:34679)
I20260709 13:14:59.044793 32075 raft_consensus.cc:2468] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 248a1ea5b1bf4c7292159d9e2b910621 in term 2.
I20260709 13:14:59.045668 32074 consensus_queue.cc:260] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:59.045375 32162 consensus_queue.cc:237] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:59.046303 32001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4dda66c7a4cd38528a6932a755574" candidate_uuid: "248a1ea5b1bf4c7292159d9e2b910621" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94748be01bae4696a7ffd232855a7710"
I20260709 13:14:59.046984 32001 raft_consensus.cc:3060] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.047087 32074 raft_consensus.cc:3060] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.055096 32001 raft_consensus.cc:2468] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 248a1ea5b1bf4c7292159d9e2b910621 in term 2.
I20260709 13:14:59.056362 31890 leader_election.cc:304] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, 94748be01bae4696a7ffd232855a7710; no voters: 
I20260709 13:14:59.057591 32162 raft_consensus.cc:2804] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.058202 32162 raft_consensus.cc:697] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Becoming Leader. State: Replica: 248a1ea5b1bf4c7292159d9e2b910621, State: Running, Role: LEADER
I20260709 13:14:59.059126 32162 consensus_queue.cc:237] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:59.061096 31892 leader_election.cc:304] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 94748be01bae4696a7ffd232855a7710
I20260709 13:14:59.060751 31824 catalog_manager.cc:5697] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 reported cstate change: term changed from 1 to 2, leader changed from 94748be01bae4696a7ffd232855a7710 (127.19.185.194) to 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "248a1ea5b1bf4c7292159d9e2b910621" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.062561 32176 raft_consensus.cc:2804] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.064215 32176 raft_consensus.cc:697] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Becoming Leader. State: Replica: 248a1ea5b1bf4c7292159d9e2b910621, State: Running, Role: LEADER
I20260709 13:14:59.065191 32176 consensus_queue.cc:237] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:59.065832 32074 raft_consensus.cc:2468] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 248a1ea5b1bf4c7292159d9e2b910621 in term 2.
I20260709 13:14:59.086194 31825 catalog_manager.cc:5697] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 reported cstate change: term changed from 1 to 2, leader changed from fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195) to 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "248a1ea5b1bf4c7292159d9e2b910621" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.087761 31825 catalog_manager.cc:5697] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 reported cstate change: term changed from 1 to 2, leader changed from fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195) to 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "248a1ea5b1bf4c7292159d9e2b910621" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.122840 20199 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:14:59.124616 20199 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:14:59.125020 20199 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:14:59.139034 31924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9"
dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
mode: GRACEFUL
new_leader_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
 from {username='slave'} at 127.0.0.1:39390
I20260709 13:14:59.139561 31924 raft_consensus.cc:606] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Received request to transfer leadership to TS fc082ff11e3f4db4bab7d2b61bd9fea5
I20260709 13:14:59.140792 20199 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
W20260709 13:14:59.331102 31856 debug-util.cc:398] Leaking SignalData structure 0x7b08000f8ec0 after lost signal to thread 20202
W20260709 13:14:59.332330 31856 debug-util.cc:398] Leaking SignalData structure 0x7b080003b3c0 after lost signal to thread 31859
W20260709 13:14:59.334232 31856 debug-util.cc:398] Leaking SignalData structure 0x7b0800161f60 after lost signal to thread 32026
W20260709 13:14:59.335206 31856 debug-util.cc:398] Leaking SignalData structure 0x7b08002996a0 after lost signal to thread 32100
I20260709 13:14:59.449071 32074 raft_consensus.cc:1275] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Refusing update from remote peer 248a1ea5b1bf4c7292159d9e2b910621: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.450572 32176 consensus_queue.cc:1048] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.455307 32075 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.463367 32075 raft_consensus.cc:1275] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Refusing update from remote peer 248a1ea5b1bf4c7292159d9e2b910621: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.464864 32162 consensus_queue.cc:1048] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.466642 32001 raft_consensus.cc:3060] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.477110 32177 raft_consensus.cc:993] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621: : Instructing follower fc082ff11e3f4db4bab7d2b61bd9fea5 to start an election
I20260709 13:14:59.477380 32001 raft_consensus.cc:1275] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Refusing update from remote peer 248a1ea5b1bf4c7292159d9e2b910621: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.477931 32162 raft_consensus.cc:1081] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Signalling peer fc082ff11e3f4db4bab7d2b61bd9fea5 to start an election
I20260709 13:14:59.479195 32162 consensus_queue.cc:1048] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.486519 32000 raft_consensus.cc:1275] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Refusing update from remote peer 248a1ea5b1bf4c7292159d9e2b910621: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.487963 32075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9"
dest_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:14:59.488770 32075 raft_consensus.cc:493] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.489140 32075 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.492956 32177 consensus_queue.cc:1048] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:59.499838 32075 raft_consensus.cc:515] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:59.502971 32075 leader_election.cc:290] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 3 election: Requested vote from peers 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193:39507), 94748be01bae4696a7ffd232855a7710 (127.19.185.194:35257)
I20260709 13:14:59.503902 31924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "248a1ea5b1bf4c7292159d9e2b910621"
I20260709 13:14:59.504639 31924 raft_consensus.cc:3055] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:59.504703 32074 raft_consensus.cc:1240] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 3 FOLLOWER]: Rejecting Update request from peer 248a1ea5b1bf4c7292159d9e2b910621 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:59.506201 31924 raft_consensus.cc:740] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 248a1ea5b1bf4c7292159d9e2b910621, State: Running, Role: LEADER
I20260709 13:14:59.506417 32000 raft_consensus.cc:1275] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Refusing update from remote peer 248a1ea5b1bf4c7292159d9e2b910621: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.506029 32002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13006640bf84f81b6e5b864781e00b9" candidate_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94748be01bae4696a7ffd232855a7710"
I20260709 13:14:59.508834 32002 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.508572 31924 consensus_queue.cc:260] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:59.509501 32162 consensus_queue.cc:1048] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.509918 31924 raft_consensus.cc:3060] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.519745 31924 raft_consensus.cc:2468] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 3.
I20260709 13:14:59.521425 32041 leader_election.cc:304] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248a1ea5b1bf4c7292159d9e2b910621, fc082ff11e3f4db4bab7d2b61bd9fea5; no voters: 
I20260709 13:14:59.522379 32170 raft_consensus.cc:2804] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:59.527908 32002 raft_consensus.cc:2468] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc082ff11e3f4db4bab7d2b61bd9fea5 in term 3.
I20260709 13:14:59.533061 32074 raft_consensus.cc:1275] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Refusing update from remote peer 248a1ea5b1bf4c7292159d9e2b910621: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.534703 32162 consensus_queue.cc:1048] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.546598 32170 raft_consensus.cc:697] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 3 LEADER]: Becoming Leader. State: Replica: fc082ff11e3f4db4bab7d2b61bd9fea5, State: Running, Role: LEADER
I20260709 13:14:59.547748 32170 consensus_queue.cc:237] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } }
I20260709 13:14:59.562940 31822 catalog_manager.cc:5697] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 reported cstate change: term changed from 2 to 3, leader changed from 248a1ea5b1bf4c7292159d9e2b910621 (127.19.185.193) to fc082ff11e3f4db4bab7d2b61bd9fea5 (127.19.185.195). New cstate: current_term: 3 leader_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "248a1ea5b1bf4c7292159d9e2b910621" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 39507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94748be01bae4696a7ffd232855a7710" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc082ff11e3f4db4bab7d2b61bd9fea5" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34679 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.789454 20199 tablet_server.cc:179] TabletServer@127.19.185.193:0 shutting down...
I20260709 13:14:59.814131 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:59.814819 20199 tablet_replica.cc:333] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621: stopping tablet replica
I20260709 13:14:59.815498 20199 raft_consensus.cc:2243] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.816442 20199 raft_consensus.cc:2272] T 4a66eae5d94c441391fbf8ea765f7a8e P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.819005 20199 tablet_replica.cc:333] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621: stopping tablet replica
I20260709 13:14:59.819617 20199 raft_consensus.cc:2243] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.820143 20199 raft_consensus.cc:2272] T b13006640bf84f81b6e5b864781e00b9 P 248a1ea5b1bf4c7292159d9e2b910621 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.822988 20199 tablet_replica.cc:333] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621: stopping tablet replica
I20260709 13:14:59.823544 20199 raft_consensus.cc:2243] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.823982 20199 raft_consensus.cc:2272] T f0ab877b82184f8293d4f2f6acba6ee4 P 248a1ea5b1bf4c7292159d9e2b910621 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.825913 20199 tablet_replica.cc:333] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621: stopping tablet replica
I20260709 13:14:59.826399 20199 raft_consensus.cc:2243] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.827191 20199 raft_consensus.cc:2272] T 44d4dda66c7a4cd38528a6932a755574 P 248a1ea5b1bf4c7292159d9e2b910621 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.842736 20199 tablet_server.cc:196] TabletServer@127.19.185.193:0 shutdown complete.
I20260709 13:14:59.855706 20199 tablet_server.cc:179] TabletServer@127.19.185.194:0 shutting down...
I20260709 13:14:59.883852 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:59.884548 20199 tablet_replica.cc:333] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710: stopping tablet replica
I20260709 13:14:59.885140 20199 raft_consensus.cc:2243] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.885613 20199 raft_consensus.cc:2272] T 4a66eae5d94c441391fbf8ea765f7a8e P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.887979 20199 tablet_replica.cc:333] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710: stopping tablet replica
I20260709 13:14:59.888562 20199 raft_consensus.cc:2243] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.889011 20199 raft_consensus.cc:2272] T b13006640bf84f81b6e5b864781e00b9 P 94748be01bae4696a7ffd232855a7710 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.891094 20199 tablet_replica.cc:333] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710: stopping tablet replica
I20260709 13:14:59.891623 20199 raft_consensus.cc:2243] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.892484 20199 raft_consensus.cc:2272] T f0ab877b82184f8293d4f2f6acba6ee4 P 94748be01bae4696a7ffd232855a7710 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.894454 20199 tablet_replica.cc:333] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710: stopping tablet replica
I20260709 13:14:59.894955 20199 raft_consensus.cc:2243] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.895382 20199 raft_consensus.cc:2272] T 44d4dda66c7a4cd38528a6932a755574 P 94748be01bae4696a7ffd232855a7710 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.919272 20199 tablet_server.cc:196] TabletServer@127.19.185.194:0 shutdown complete.
I20260709 13:14:59.932488 20199 tablet_server.cc:179] TabletServer@127.19.185.195:0 shutting down...
I20260709 13:14:59.961546 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:59.962333 20199 tablet_replica.cc:333] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5: stopping tablet replica
I20260709 13:14:59.963140 20199 raft_consensus.cc:2243] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.963764 20199 raft_consensus.cc:2272] T 4a66eae5d94c441391fbf8ea765f7a8e P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.966877 20199 tablet_replica.cc:333] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: stopping tablet replica
I20260709 13:14:59.967682 20199 raft_consensus.cc:2243] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.968624 20199 pending_rounds.cc:70] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: Trying to abort 2 pending ops.
I20260709 13:14:59.968880 20199 pending_rounds.cc:77] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637476562333696 op_type: NO_OP noop_request { }
I20260709 13:14:59.969300 20199 raft_consensus.cc:2889] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:59.969604 20199 pending_rounds.cc:77] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637474508091392 op_type: NO_OP noop_request { }
I20260709 13:14:59.969918 20199 raft_consensus.cc:2889] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:59.970279 20199 raft_consensus.cc:2272] T b13006640bf84f81b6e5b864781e00b9 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.973173 20199 tablet_replica.cc:333] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5: stopping tablet replica
I20260709 13:14:59.973743 20199 raft_consensus.cc:2243] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.974208 20199 raft_consensus.cc:2272] T f0ab877b82184f8293d4f2f6acba6ee4 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.976260 20199 tablet_replica.cc:333] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5: stopping tablet replica
I20260709 13:14:59.976750 20199 raft_consensus.cc:2243] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.977182 20199 raft_consensus.cc:2272] T 44d4dda66c7a4cd38528a6932a755574 P fc082ff11e3f4db4bab7d2b61bd9fea5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.001650 20199 tablet_server.cc:196] TabletServer@127.19.185.195:0 shutdown complete.
I20260709 13:15:00.014726 20199 master.cc:562] Master@127.19.185.254:38645 shutting down...
I20260709 13:15:00.040542 20199 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.041128 20199 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.041471 20199 tablet_replica.cc:333] T 00000000000000000000000000000000 P 352f4b1870f34573897add55264bdaf0: stopping tablet replica
W20260709 13:15:01.059345 20199 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 31856)
W20260709 13:15:02.059821 20199 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 31856)
I20260709 13:15:02.740367 20199 master.cc:584] Master@127.19.185.254:38645 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (6031 ms)
[----------] 6 tests from LeaderRebalancerTest (349621 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:15:02.773330 20199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.185.254:41371
I20260709 13:15:02.774444 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:02.779989 32190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.780262 32191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.781338 32193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.781903 20199 server_base.cc:1061] running on GCE node
I20260709 13:15:02.782825 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:02.782998 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:02.783191 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602902783177 us; error 0 us; skew 500 ppm
I20260709 13:15:02.783851 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:02.786860 20199 webserver.cc:533] Webserver started at http://127.19.185.254:33695/ using document root <none> and password file <none>
I20260709 13:15:02.787441 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:02.787629 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:02.788002 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:02.789268 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/master-0-root/instance:
uuid: "6522952009304476864e1c0895f9f623"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-rrf3"
I20260709 13:15:02.794322 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:15:02.798049 32198 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.799005 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:02.799376 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/master-0-root
uuid: "6522952009304476864e1c0895f9f623"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-rrf3"
I20260709 13:15:02.799718 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:02.834303 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:02.835482 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.875403 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.254:41371
I20260709 13:15:02.875520 32249 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.254:41371 every 8 connection(s)
I20260709 13:15:02.879365 32250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.891073 32250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623: Bootstrap starting.
I20260709 13:15:02.895650 32250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:02.899946 32250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623: No bootstrap required, opened a new log
I20260709 13:15:02.902402 32250 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6522952009304476864e1c0895f9f623" member_type: VOTER }
I20260709 13:15:02.902824 32250 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:02.903090 32250 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6522952009304476864e1c0895f9f623, State: Initialized, Role: FOLLOWER
I20260709 13:15:02.903795 32250 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6522952009304476864e1c0895f9f623" member_type: VOTER }
I20260709 13:15:02.904273 32250 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:02.904513 32250 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:02.904798 32250 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:02.909605 32250 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6522952009304476864e1c0895f9f623" member_type: VOTER }
I20260709 13:15:02.910178 32250 leader_election.cc:304] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6522952009304476864e1c0895f9f623; no voters: 
I20260709 13:15:02.911422 32250 leader_election.cc:290] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:02.911957 32253 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:02.913448 32253 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 1 LEADER]: Becoming Leader. State: Replica: 6522952009304476864e1c0895f9f623, State: Running, Role: LEADER
I20260709 13:15:02.914134 32253 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6522952009304476864e1c0895f9f623" member_type: VOTER }
I20260709 13:15:02.914650 32250 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:02.918658 32255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6522952009304476864e1c0895f9f623. Latest consensus state: current_term: 1 leader_uuid: "6522952009304476864e1c0895f9f623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6522952009304476864e1c0895f9f623" member_type: VOTER } }
I20260709 13:15:02.918506 32254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6522952009304476864e1c0895f9f623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6522952009304476864e1c0895f9f623" member_type: VOTER } }
I20260709 13:15:02.919581 32255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:02.919813 32254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:02.925627 32260 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:02.931418 32260 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:02.932657 20199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:02.940624 32260 catalog_manager.cc:1383] Generated new cluster ID: 581c104c818544588c9a6b5264b72faa
I20260709 13:15:02.940940 32260 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:02.964197 32260 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:02.965548 32260 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:02.979610 32260 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623: Generated new TSK 0
I20260709 13:15:02.980443 32260 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:02.999672 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:03.005862 32271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:03.007055 32272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:03.008405 32274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:03.010380 20199 server_base.cc:1061] running on GCE node
I20260709 13:15:03.011281 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:03.011463 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:03.011585 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602903011574 us; error 0 us; skew 500 ppm
I20260709 13:15:03.012401 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:03.014906 20199 webserver.cc:533] Webserver started at http://127.19.185.193:46459/ using document root <none> and password file <none>
I20260709 13:15:03.015447 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:03.015606 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:03.015831 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:03.017176 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-0-root/instance:
uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
format_stamp: "Formatted at 2026-07-09 13:15:03 on dist-test-slave-rrf3"
I20260709 13:15:03.021876 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:03.025610 32279 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.026475 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:15:03.026840 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
format_stamp: "Formatted at 2026-07-09 13:15:03 on dist-test-slave-rrf3"
I20260709 13:15:03.027109 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:03.054982 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:03.056324 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:03.057868 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:03.060429 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:03.060662 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.060949 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:03.061133 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.103884 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:46113
I20260709 13:15:03.103946 32341 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:46113 every 8 connection(s)
I20260709 13:15:03.109297 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:03.116952 32346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:03.118160 32347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:03.121826 32349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:03.121896 20199 server_base.cc:1061] running on GCE node
I20260709 13:15:03.123667 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:03.123948 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:03.124184 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602903124157 us; error 0 us; skew 500 ppm
I20260709 13:15:03.124953 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:03.127969 20199 webserver.cc:533] Webserver started at http://127.19.185.194:41347/ using document root <none> and password file <none>
I20260709 13:15:03.128669 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:03.128904 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:03.128913 32342 heartbeater.cc:344] Connected to a master server at 127.19.185.254:41371
I20260709 13:15:03.129240 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:03.129488 32342 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:03.130306 32342 heartbeater.cc:507] Master 127.19.185.254:41371 requested a full tablet report, sending...
I20260709 13:15:03.130543 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-1-root/instance:
uuid: "cebf07abd77640909fd5c77f65091906"
format_stamp: "Formatted at 2026-07-09 13:15:03 on dist-test-slave-rrf3"
I20260709 13:15:03.132701 32215 ts_manager.cc:194] Registered new tserver with Master: 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113)
I20260709 13:15:03.135250 32215 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58886
I20260709 13:15:03.136814 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:15:03.140595 32354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.141460 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:03.141876 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-1-root
uuid: "cebf07abd77640909fd5c77f65091906"
format_stamp: "Formatted at 2026-07-09 13:15:03 on dist-test-slave-rrf3"
I20260709 13:15:03.142161 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:03.156952 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:03.158095 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:03.159577 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:03.161870 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:03.162081 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.162364 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:03.162521 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.205641 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.194:39253
I20260709 13:15:03.205761 32416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.194:39253 every 8 connection(s)
I20260709 13:15:03.211227 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:03.219658 32420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:03.221030 32421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:03.224356 32417 heartbeater.cc:344] Connected to a master server at 127.19.185.254:41371
W20260709 13:15:03.224558 32423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:03.224592 20199 server_base.cc:1061] running on GCE node
I20260709 13:15:03.224963 32417 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:03.225953 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:03.225971 32417 heartbeater.cc:507] Master 127.19.185.254:41371 requested a full tablet report, sending...
W20260709 13:15:03.226303 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:03.226591 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602903226571 us; error 0 us; skew 500 ppm
I20260709 13:15:03.227458 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:03.228750 32215 ts_manager.cc:194] Registered new tserver with Master: cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:03.230722 20199 webserver.cc:533] Webserver started at http://127.19.185.195:42363/ using document root <none> and password file <none>
I20260709 13:15:03.231045 32215 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58900
I20260709 13:15:03.231525 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:03.231873 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:03.232270 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:03.233946 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-2-root/instance:
uuid: "b77b8fd4718148d2abca289a48b3484d"
format_stamp: "Formatted at 2026-07-09 13:15:03 on dist-test-slave-rrf3"
I20260709 13:15:03.239171 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:15:03.242810 32428 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.243881 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:03.244257 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-2-root
uuid: "b77b8fd4718148d2abca289a48b3484d"
format_stamp: "Formatted at 2026-07-09 13:15:03 on dist-test-slave-rrf3"
I20260709 13:15:03.244594 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602552983791-20199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:03.276968 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:03.278381 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:03.279950 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:03.282404 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:03.282647 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.282958 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:03.283140 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:03.328755 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.195:34189
I20260709 13:15:03.328904 32490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.195:34189 every 8 connection(s)
I20260709 13:15:03.345461 32491 heartbeater.cc:344] Connected to a master server at 127.19.185.254:41371
I20260709 13:15:03.346073 32491 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:03.346859 32491 heartbeater.cc:507] Master 127.19.185.254:41371 requested a full tablet report, sending...
I20260709 13:15:03.349130 32215 ts_manager.cc:194] Registered new tserver with Master: b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:03.349826 20199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01743258s
I20260709 13:15:03.350646 32215 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58904
I20260709 13:15:03.377851 32215 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58920:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:03.380534 32215 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:03.444409 32307 tablet_service.cc:1511] Processing CreateTablet for tablet 331e5384a15c41e4a512e0988f37eb86 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:03.445921 32307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331e5384a15c41e4a512e0988f37eb86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.449016 32306 tablet_service.cc:1511] Processing CreateTablet for tablet 8910bf304736431cb2d07267b964ff5b (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:03.450764 32306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8910bf304736431cb2d07267b964ff5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.453292 32456 tablet_service.cc:1511] Processing CreateTablet for tablet 331e5384a15c41e4a512e0988f37eb86 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:03.454941 32456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331e5384a15c41e4a512e0988f37eb86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.461926 32455 tablet_service.cc:1511] Processing CreateTablet for tablet 8910bf304736431cb2d07267b964ff5b (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:03.463575 32455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8910bf304736431cb2d07267b964ff5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.468680 32454 tablet_service.cc:1511] Processing CreateTablet for tablet b765149d2ea945cdb16f877b01e84af1 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:03.465601 32305 tablet_service.cc:1511] Processing CreateTablet for tablet b765149d2ea945cdb16f877b01e84af1 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:03.470247 32454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b765149d2ea945cdb16f877b01e84af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.470940 32305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b765149d2ea945cdb16f877b01e84af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.473229 32304 tablet_service.cc:1511] Processing CreateTablet for tablet 8a343013437d4f43b64baeb8d987c739 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:03.474706 32304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a343013437d4f43b64baeb8d987c739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.474756 32453 tablet_service.cc:1511] Processing CreateTablet for tablet 8a343013437d4f43b64baeb8d987c739 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:03.476363 32453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a343013437d4f43b64baeb8d987c739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.480427 32452 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6e51ed41a54d26a9c3ad782695a1e6 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:03.482043 32452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6e51ed41a54d26a9c3ad782695a1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.484205 32303 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6e51ed41a54d26a9c3ad782695a1e6 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:03.485756 32303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6e51ed41a54d26a9c3ad782695a1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.486217 32378 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6e51ed41a54d26a9c3ad782695a1e6 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:03.487063 32377 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5c61e32aa44d4b98de3c7d9989ad1e (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:03.487147 32302 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5c61e32aa44d4b98de3c7d9989ad1e (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:03.489159 32381 tablet_service.cc:1511] Processing CreateTablet for tablet 8910bf304736431cb2d07267b964ff5b (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:03.490101 32379 tablet_service.cc:1511] Processing CreateTablet for tablet 8a343013437d4f43b64baeb8d987c739 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:03.493212 32451 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5c61e32aa44d4b98de3c7d9989ad1e (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:03.494764 32451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5c61e32aa44d4b98de3c7d9989ad1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.496209 32376 tablet_service.cc:1511] Processing CreateTablet for tablet 8821a78b96a34e91885742aa8950c01e (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:03.497133 32382 tablet_service.cc:1511] Processing CreateTablet for tablet 331e5384a15c41e4a512e0988f37eb86 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:03.491549 32301 tablet_service.cc:1511] Processing CreateTablet for tablet 8821a78b96a34e91885742aa8950c01e (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:03.493361 32450 tablet_service.cc:1511] Processing CreateTablet for tablet 8821a78b96a34e91885742aa8950c01e (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:03.499289 32300 tablet_service.cc:1511] Processing CreateTablet for tablet e6ca6305ffaf4563bfb34beab3943103 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:03.499485 32375 tablet_service.cc:1511] Processing CreateTablet for tablet e6ca6305ffaf4563bfb34beab3943103 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:03.491489 32380 tablet_service.cc:1511] Processing CreateTablet for tablet b765149d2ea945cdb16f877b01e84af1 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:03.501495 32301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821a78b96a34e91885742aa8950c01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.502257 32300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ca6305ffaf4563bfb34beab3943103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.501502 32449 tablet_service.cc:1511] Processing CreateTablet for tablet e6ca6305ffaf4563bfb34beab3943103 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:03.504179 32302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5c61e32aa44d4b98de3c7d9989ad1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.487690 32378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6e51ed41a54d26a9c3ad782695a1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.506469 32375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ca6305ffaf4563bfb34beab3943103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.509236 32448 tablet_service.cc:1511] Processing CreateTablet for tablet b49422ced0124424a55fc048aa49ce54 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:03.511478 32374 tablet_service.cc:1511] Processing CreateTablet for tablet b49422ced0124424a55fc048aa49ce54 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:03.512440 32379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a343013437d4f43b64baeb8d987c739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.513242 32374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49422ced0124424a55fc048aa49ce54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.513881 32376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821a78b96a34e91885742aa8950c01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.516454 32377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5c61e32aa44d4b98de3c7d9989ad1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.520411 32450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8821a78b96a34e91885742aa8950c01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.522097 32449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ca6305ffaf4563bfb34beab3943103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.521857 32299 tablet_service.cc:1511] Processing CreateTablet for tablet b49422ced0124424a55fc048aa49ce54 (DEFAULT_TABLE table=test-workload [id=bdb947f65bcd401e9ac91e87b6f67a8b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:03.523303 32299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49422ced0124424a55fc048aa49ce54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.523703 32448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49422ced0124424a55fc048aa49ce54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.524529 32380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b765149d2ea945cdb16f877b01e84af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.526151 32382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331e5384a15c41e4a512e0988f37eb86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.544515 32381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8910bf304736431cb2d07267b964ff5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.626037 32507 tablet_bootstrap.cc:492] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:03.643728 32507 tablet_bootstrap.cc:654] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.648291 32506 tablet_bootstrap.cc:492] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:03.652096 32508 tablet_bootstrap.cc:492] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:03.654708 32506 tablet_bootstrap.cc:654] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.655925 32507 tablet_bootstrap.cc:492] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:03.656515 32507 ts_tablet_manager.cc:1403] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.009s
I20260709 13:15:03.659175 32507 raft_consensus.cc:359] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.659786 32507 raft_consensus.cc:385] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.660043 32507 raft_consensus.cc:740] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.660236 32508 tablet_bootstrap.cc:654] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.660825 32507 consensus_queue.cc:260] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.663574 32417 heartbeater.cc:499] Master 127.19.185.254:41371 was elected leader, sending a full tablet report...
I20260709 13:15:03.664173 32507 ts_tablet_manager.cc:1434] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:03.664981 32506 tablet_bootstrap.cc:492] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:03.665443 32507 tablet_bootstrap.cc:492] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:03.665519 32506 ts_tablet_manager.cc:1403] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.006s
I20260709 13:15:03.668705 32506 raft_consensus.cc:359] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:03.669513 32506 raft_consensus.cc:385] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.669848 32506 raft_consensus.cc:740] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.670799 32506 consensus_queue.cc:260] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:03.672102 32507 tablet_bootstrap.cc:654] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.674569 32508 tablet_bootstrap.cc:492] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:03.675356 32508 ts_tablet_manager.cc:1403] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:15:03.678812 32508 raft_consensus.cc:359] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:03.679695 32508 raft_consensus.cc:385] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.680092 32508 raft_consensus.cc:740] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.681139 32508 consensus_queue.cc:260] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:03.688369 32342 heartbeater.cc:499] Master 127.19.185.254:41371 was elected leader, sending a full tablet report...
I20260709 13:15:03.695598 32506 ts_tablet_manager.cc:1434] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 13:15:03.696203 32508 ts_tablet_manager.cc:1434] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:15:03.697079 32491 heartbeater.cc:499] Master 127.19.185.254:41371 was elected leader, sending a full tablet report...
I20260709 13:15:03.697242 32506 tablet_bootstrap.cc:492] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:03.702749 32508 tablet_bootstrap.cc:492] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:03.707227 32507 tablet_bootstrap.cc:492] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:03.707894 32507 ts_tablet_manager.cc:1403] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.043s	user 0.027s	sys 0.011s
I20260709 13:15:03.709003 32508 tablet_bootstrap.cc:654] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.710883 32507 raft_consensus.cc:359] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.711756 32507 raft_consensus.cc:385] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.712085 32507 raft_consensus.cc:740] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.713064 32507 consensus_queue.cc:260] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.717782 32507 ts_tablet_manager.cc:1434] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:03.718843 32507 tablet_bootstrap.cc:492] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:03.721521 32506 tablet_bootstrap.cc:654] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.726363 32507 tablet_bootstrap.cc:654] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.727584 32508 tablet_bootstrap.cc:492] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:03.728194 32508 ts_tablet_manager.cc:1403] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.005s
I20260709 13:15:03.731210 32508 raft_consensus.cc:359] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.731962 32508 raft_consensus.cc:385] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.732350 32508 raft_consensus.cc:740] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.733223 32508 consensus_queue.cc:260] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.737807 32508 ts_tablet_manager.cc:1434] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:03.739203 32508 tablet_bootstrap.cc:492] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:03.741475 32515 raft_consensus.cc:493] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.742797 32515 raft_consensus.cc:515] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:03.748248 32515 leader_election.cc:290] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:03.755509 32506 tablet_bootstrap.cc:492] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:03.756197 32506 ts_tablet_manager.cc:1403] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.059s	user 0.033s	sys 0.002s
I20260709 13:15:03.756801 32508 tablet_bootstrap.cc:654] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.758332 32511 raft_consensus.cc:493] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.758970 32511 raft_consensus.cc:515] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.763116 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:03.764780 32317 raft_consensus.cc:2468] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:03.759147 32506 raft_consensus.cc:359] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.765921 32506 raft_consensus.cc:385] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.766233 32432 leader_election.cc:304] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:03.769345 32515 raft_consensus.cc:2804] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.769825 32515 raft_consensus.cc:493] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.770013 32511 leader_election.cc:290] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:03.775996 32515 raft_consensus.cc:3060] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.766278 32506 raft_consensus.cc:740] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.778064 32506 consensus_queue.cc:260] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.778806 32507 tablet_bootstrap.cc:492] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:03.779378 32507 ts_tablet_manager.cc:1403] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.010s
I20260709 13:15:03.780684 32506 ts_tablet_manager.cc:1434] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:15:03.781792 32506 tablet_bootstrap.cc:492] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:03.782501 32507 raft_consensus.cc:359] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.783300 32507 raft_consensus.cc:385] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.783577 32507 raft_consensus.cc:740] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.784618 32507 consensus_queue.cc:260] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.785360 32513 raft_consensus.cc:493] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.785883 32513 raft_consensus.cc:515] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.787894 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:03.789135 32508 tablet_bootstrap.cc:492] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:03.787101 32507 ts_tablet_manager.cc:1434] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
W20260709 13:15:03.790719 32429 leader_election.cc:343] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.791077 32515 raft_consensus.cc:515] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:03.791997 32513 leader_election.cc:290] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:03.791603 32507 tablet_bootstrap.cc:492] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:03.795047 32508 ts_tablet_manager.cc:1403] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.011s
I20260709 13:15:03.795862 32515 leader_election.cc:290] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:03.799014 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:03.799706 32317 raft_consensus.cc:3060] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.801546 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
W20260709 13:15:03.803259 32429 leader_election.cc:343] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.806535 32507 tablet_bootstrap.cc:654] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.811544 32317 raft_consensus.cc:2468] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 1.
I20260709 13:15:03.812829 32432 leader_election.cc:304] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: cebf07abd77640909fd5c77f65091906
I20260709 13:15:03.813271 32508 raft_consensus.cc:359] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.814129 32508 raft_consensus.cc:385] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.815966 32508 raft_consensus.cc:740] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.818044 32508 consensus_queue.cc:260] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.815841 32515 raft_consensus.cc:2804] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.830219 32506 tablet_bootstrap.cc:654] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.836969 32511 raft_consensus.cc:493] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.842345 32511 raft_consensus.cc:515] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.845989 32511 leader_election.cc:290] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:03.847416 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
W20260709 13:15:03.850229 32280 leader_election.cc:343] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.851214 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
W20260709 13:15:03.853399 32358 leader_election.cc:343] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.853319 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:03.854483 32507 tablet_bootstrap.cc:492] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:03.855136 32507 ts_tablet_manager.cc:1403] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.005s
W20260709 13:15:03.855012 32358 leader_election.cc:343] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.857527 32508 ts_tablet_manager.cc:1434] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.016s
I20260709 13:15:03.858706 32508 tablet_bootstrap.cc:492] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:03.858706 32507 raft_consensus.cc:359] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.859633 32507 raft_consensus.cc:385] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.859952 32507 raft_consensus.cc:740] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.860971 32507 consensus_queue.cc:260] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.866262 32507 ts_tablet_manager.cc:1434] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:15:03.866775 32508 tablet_bootstrap.cc:654] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.867442 32507 tablet_bootstrap.cc:492] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:03.873900 32527 raft_consensus.cc:493] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.881711 32507 tablet_bootstrap.cc:654] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.885807 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:03.886309 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:03.874512 32527 raft_consensus.cc:515] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
W20260709 13:15:03.888780 32357 leader_election.cc:343] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.889503 32357 leader_election.cc:304] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:03.891150 32511 raft_consensus.cc:2749] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.894938 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:03.896270 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
W20260709 13:15:03.897173 32432 leader_election.cc:343] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.898180 32465 raft_consensus.cc:2468] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
W20260709 13:15:03.898619 32282 leader_election.cc:343] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.899421 32282 leader_election.cc:304] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5; no voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906
I20260709 13:15:03.901117 32513 raft_consensus.cc:2749] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.902093 32511 raft_consensus.cc:493] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.902300 32357 leader_election.cc:304] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:03.902699 32511 raft_consensus.cc:515] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.875396 32515 raft_consensus.cc:697] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:03.909529 32515 consensus_queue.cc:237] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:03.910184 32511 leader_election.cc:290] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:03.910815 32511 raft_consensus.cc:2804] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.911170 32511 raft_consensus.cc:493] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.911499 32511 raft_consensus.cc:3060] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.910810 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:03.913304 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:03.912533 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
W20260709 13:15:03.914902 32358 leader_election.cc:343] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:03.915779 32357 leader_election.cc:343] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.903556 32527 leader_election.cc:290] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:03.918287 32357 leader_election.cc:304] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:03.920390 32532 raft_consensus.cc:2749] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.918629 32506 tablet_bootstrap.cc:492] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:03.922013 32508 tablet_bootstrap.cc:492] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:03.922014 32506 ts_tablet_manager.cc:1403] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.140s	user 0.017s	sys 0.007s
I20260709 13:15:03.923005 32508 ts_tablet_manager.cc:1403] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.030s
W20260709 13:15:03.925850 32263 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:03.926031 32506 raft_consensus.cc:359] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.926993 32506 raft_consensus.cc:385] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.927325 32506 raft_consensus.cc:740] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.927325 32511 raft_consensus.cc:515] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.928725 32392 raft_consensus.cc:2393] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b77b8fd4718148d2abca289a48b3484d in current term 1: Already voted for candidate cebf07abd77640909fd5c77f65091906 in this term.
I20260709 13:15:03.928807 32507 tablet_bootstrap.cc:492] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:03.928499 32506 consensus_queue.cc:260] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.929783 32507 ts_tablet_manager.cc:1403] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.036s
I20260709 13:15:03.929244 32508 raft_consensus.cc:359] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.930243 32508 raft_consensus.cc:385] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.930581 32508 raft_consensus.cc:740] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.931412 32508 consensus_queue.cc:260] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.932684 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:03.932972 32429 leader_election.cc:304] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906
I20260709 13:15:03.934085 32508 ts_tablet_manager.cc:1434] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
W20260709 13:15:03.934247 32358 leader_election.cc:343] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.934093 32515 raft_consensus.cc:3060] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.935331 32508 tablet_bootstrap.cc:492] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:03.936219 32511 leader_election.cc:290] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:03.934715 32507 raft_consensus.cc:359] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.936859 32507 raft_consensus.cc:385] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.940191 32507 raft_consensus.cc:740] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.940907 32212 catalog_manager.cc:5697] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 0 to 1, leader changed from <none> to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 1 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.941344 32507 consensus_queue.cc:260] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.942070 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:03.944554 32508 tablet_bootstrap.cc:654] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.944638 32506 ts_tablet_manager.cc:1434] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:15:03.948155 32507 ts_tablet_manager.cc:1434] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:15:03.952217 32507 tablet_bootstrap.cc:492] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:03.957191 32508 tablet_bootstrap.cc:492] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:03.949692 32515 raft_consensus.cc:2749] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.957872 32508 ts_tablet_manager.cc:1403] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.010s
I20260709 13:15:03.960570 32507 tablet_bootstrap.cc:654] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.962215 32508 raft_consensus.cc:359] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.963083 32508 raft_consensus.cc:385] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.963380 32508 raft_consensus.cc:740] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.964453 32508 consensus_queue.cc:260] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.967520 32508 ts_tablet_manager.cc:1434] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:03.968955 32508 tablet_bootstrap.cc:492] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:03.971326 32465 raft_consensus.cc:2468] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:03.973269 32506 tablet_bootstrap.cc:492] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:03.978200 32507 tablet_bootstrap.cc:492] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:03.978842 32507 ts_tablet_manager.cc:1403] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:15:03.979553 32508 tablet_bootstrap.cc:654] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.982297 32507 raft_consensus.cc:359] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.983247 32507 raft_consensus.cc:385] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.983632 32507 raft_consensus.cc:740] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.984876 32507 consensus_queue.cc:260] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:03.986085 32357 leader_election.cc:304] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:03.987844 32511 raft_consensus.cc:2804] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.988494 32507 ts_tablet_manager.cc:1434] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:15:03.988642 32511 raft_consensus.cc:697] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:03.990149 32507 tablet_bootstrap.cc:492] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:03.990197 32511 consensus_queue.cc:237] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.000109 32508 tablet_bootstrap.cc:492] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:04.000641 32506 tablet_bootstrap.cc:654] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.001024 32507 tablet_bootstrap.cc:654] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.000869 32508 ts_tablet_manager.cc:1403] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.007s
I20260709 13:15:04.005030 32508 raft_consensus.cc:359] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.006775 32508 raft_consensus.cc:385] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.007264 32508 raft_consensus.cc:740] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.008559 32508 consensus_queue.cc:260] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.011869 32508 ts_tablet_manager.cc:1434] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:15:04.013038 32508 tablet_bootstrap.cc:492] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:04.013229 32507 tablet_bootstrap.cc:492] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:04.013806 32507 ts_tablet_manager.cc:1403] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.016s
I20260709 13:15:04.017496 32507 raft_consensus.cc:359] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.018316 32507 raft_consensus.cc:385] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.018642 32507 raft_consensus.cc:740] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.018685 32506 tablet_bootstrap.cc:492] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:04.019382 32506 ts_tablet_manager.cc:1403] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.016s
I20260709 13:15:04.019645 32507 consensus_queue.cc:260] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.020917 32508 tablet_bootstrap.cc:654] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.022677 32507 ts_tablet_manager.cc:1434] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:15:04.022572 32506 raft_consensus.cc:359] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.023451 32506 raft_consensus.cc:385] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.023782 32506 raft_consensus.cc:740] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.023938 32507 tablet_bootstrap.cc:492] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:04.024713 32506 consensus_queue.cc:260] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.033181 32507 tablet_bootstrap.cc:654] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.033629 32508 tablet_bootstrap.cc:492] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:04.034274 32506 ts_tablet_manager.cc:1434] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:04.035490 32506 tablet_bootstrap.cc:492] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:04.038348 32507 tablet_bootstrap.cc:492] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:04.038890 32507 ts_tablet_manager.cc:1403] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:15:04.034291 32508 ts_tablet_manager.cc:1403] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:15:04.041064 32506 tablet_bootstrap.cc:654] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.041622 32507 raft_consensus.cc:359] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.042346 32507 raft_consensus.cc:385] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.042601 32507 raft_consensus.cc:740] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.043426 32508 raft_consensus.cc:359] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.043426 32507 consensus_queue.cc:260] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.044420 32508 raft_consensus.cc:385] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.044891 32508 raft_consensus.cc:740] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.046279 32507 ts_tablet_manager.cc:1434] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:04.046036 32508 consensus_queue.cc:260] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.047412 32507 tablet_bootstrap.cc:492] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:04.049297 32508 ts_tablet_manager.cc:1434] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:15:04.050662 32508 tablet_bootstrap.cc:492] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:04.053287 32506 tablet_bootstrap.cc:492] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:04.053925 32506 ts_tablet_manager.cc:1403] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 13:15:04.054075 32507 tablet_bootstrap.cc:654] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.057663 32508 tablet_bootstrap.cc:654] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.057507 32506 raft_consensus.cc:359] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.058331 32506 raft_consensus.cc:385] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.058686 32506 raft_consensus.cc:740] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.053325 32214 catalog_manager.cc:5697] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 0 to 1, leader changed from <none> to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.067289 32507 tablet_bootstrap.cc:492] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:04.067862 32507 ts_tablet_manager.cc:1403] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:15:04.070773 32507 raft_consensus.cc:359] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:04.071514 32507 raft_consensus.cc:385] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.071785 32507 raft_consensus.cc:740] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.072705 32507 consensus_queue.cc:260] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:04.075395 32507 ts_tablet_manager.cc:1434] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:15:04.076104 32506 consensus_queue.cc:260] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.079257 32506 ts_tablet_manager.cc:1434] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:15:04.080720 32506 tablet_bootstrap.cc:492] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:04.082262 32515 raft_consensus.cc:493] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.082892 32515 raft_consensus.cc:515] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.086793 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:04.089273 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:04.087507 32392 raft_consensus.cc:2468] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:04.092490 32429 leader_election.cc:304] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.099910 32528 raft_consensus.cc:2804] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.100359 32508 tablet_bootstrap.cc:492] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:04.100498 32528 raft_consensus.cc:493] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.100286 32506 tablet_bootstrap.cc:654] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.101099 32528 raft_consensus.cc:3060] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.101217 32508 ts_tablet_manager.cc:1403] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.031s
W20260709 13:15:04.102572 32432 leader_election.cc:343] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.103788 32515 leader_election.cc:290] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:04.104741 32508 raft_consensus.cc:359] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.105798 32508 raft_consensus.cc:385] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.106182 32508 raft_consensus.cc:740] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.106994 32508 consensus_queue.cc:260] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.115185 32528 raft_consensus.cc:515] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.115875 32506 tablet_bootstrap.cc:492] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:04.116597 32506 ts_tablet_manager.cc:1403] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.011s
I20260709 13:15:04.117619 32508 ts_tablet_manager.cc:1434] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:15:04.118744 32508 tablet_bootstrap.cc:492] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:04.118836 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.119073 32528 leader_election.cc:290] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:04.119817 32506 raft_consensus.cc:359] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
W20260709 13:15:04.120605 32432 leader_election.cc:343] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.120627 32506 raft_consensus.cc:385] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.121014 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:04.121289 32506 raft_consensus.cc:740] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.121737 32392 raft_consensus.cc:3060] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.122191 32506 consensus_queue.cc:260] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.124677 32506 ts_tablet_manager.cc:1434] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:04.125566 32508 tablet_bootstrap.cc:654] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.125854 32506 tablet_bootstrap.cc:492] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:04.128497 32511 raft_consensus.cc:493] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.129050 32511 raft_consensus.cc:515] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.129792 32392 raft_consensus.cc:2468] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 1.
I20260709 13:15:04.131081 32429 leader_election.cc:304] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:04.131474 32511 leader_election.cc:290] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.134428 32506 tablet_bootstrap.cc:654] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.133810 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:04.137883 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:04.138964 32465 raft_consensus.cc:2468] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
W20260709 13:15:04.139699 32358 leader_election.cc:343] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.140975 32357 leader_election.cc:304] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:04.142602 32511 raft_consensus.cc:2804] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.143105 32511 raft_consensus.cc:493] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.138027 32528 raft_consensus.cc:2804] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.143592 32511 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.144534 32528 raft_consensus.cc:697] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:04.145498 32528 consensus_queue.cc:237] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.157752 32511 raft_consensus.cc:515] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.165306 32506 tablet_bootstrap.cc:492] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:04.166256 32506 ts_tablet_manager.cc:1403] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.005s
I20260709 13:15:04.165925 32212 catalog_manager.cc:5697] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 0 to 1, leader changed from <none> to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 1 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.170723 32506 raft_consensus.cc:359] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.171628 32506 raft_consensus.cc:385] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.171850 32506 raft_consensus.cc:740] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.172758 32506 consensus_queue.cc:260] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.174875 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.175685 32511 leader_election.cc:290] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
W20260709 13:15:04.177088 32358 leader_election.cc:343] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.175082 32508 tablet_bootstrap.cc:492] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:04.178122 32508 ts_tablet_manager.cc:1403] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.060s	user 0.032s	sys 0.020s
I20260709 13:15:04.178157 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.178881 32465 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.181296 32508 raft_consensus.cc:359] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.181901 32508 raft_consensus.cc:385] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.182123 32508 raft_consensus.cc:740] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.182967 32508 consensus_queue.cc:260] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.185750 32508 ts_tablet_manager.cc:1434] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:04.187083 32465 raft_consensus.cc:2468] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:04.188395 32357 leader_election.cc:304] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:04.189286 32511 raft_consensus.cc:2804] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.189847 32511 raft_consensus.cc:697] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:04.190749 32511 consensus_queue.cc:237] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.191735 32506 ts_tablet_manager.cc:1434] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.004s
I20260709 13:15:04.192884 32506 tablet_bootstrap.cc:492] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:04.198191 32511 raft_consensus.cc:493] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.198801 32511 raft_consensus.cc:515] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.201838 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821a78b96a34e91885742aa8950c01e" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:04.202626 32317 raft_consensus.cc:2468] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:04.201947 32212 catalog_manager.cc:5697] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 0 to 1, leader changed from <none> to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.202694 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821a78b96a34e91885742aa8950c01e" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:04.203194 32511 leader_election.cc:290] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.203480 32465 raft_consensus.cc:2468] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:04.204128 32358 leader_election.cc:304] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.205116 32511 raft_consensus.cc:2804] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.205516 32511 raft_consensus.cc:493] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.205894 32511 raft_consensus.cc:3060] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.206408 32506 tablet_bootstrap.cc:654] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.211179 32528 raft_consensus.cc:493] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.211382 32506 tablet_bootstrap.cc:492] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:04.211958 32506 ts_tablet_manager.cc:1403] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.001s
I20260709 13:15:04.211795 32528 raft_consensus.cc:515] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.212607 32511 raft_consensus.cc:515] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.214038 32528 leader_election.cc:290] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:04.214826 32506 raft_consensus.cc:359] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.215288 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:04.215529 32506 raft_consensus.cc:385] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.215690 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:04.215934 32506 raft_consensus.cc:740] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.216003 32392 raft_consensus.cc:2468] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:04.216418 32317 raft_consensus.cc:2468] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:04.216959 32506 consensus_queue.cc:260] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.217577 32429 leader_election.cc:304] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.218457 32528 raft_consensus.cc:2804] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.218804 32528 raft_consensus.cc:493] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.219125 32528 raft_consensus.cc:3060] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.219252 32506 ts_tablet_manager.cc:1434] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:15:04.220340 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821a78b96a34e91885742aa8950c01e" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.220964 32317 raft_consensus.cc:3060] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.221773 32511 leader_election.cc:290] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.224597 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821a78b96a34e91885742aa8950c01e" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.225265 32465 raft_consensus.cc:3060] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.227579 32528 raft_consensus.cc:515] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.228464 32317 raft_consensus.cc:2468] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:04.229878 32358 leader_election.cc:304] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.230649 32532 raft_consensus.cc:493] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.220323 32506 tablet_bootstrap.cc:492] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:04.230866 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.231133 32465 raft_consensus.cc:2468] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:04.231670 32316 raft_consensus.cc:3060] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.231321 32532 raft_consensus.cc:515] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.233736 32532 leader_election.cc:290] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.234220 32532 raft_consensus.cc:493] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.234661 32532 raft_consensus.cc:515] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:04.230993 32511 raft_consensus.cc:2804] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.238094 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5c61e32aa44d4b98de3c7d9989ad1e" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:04.238948 32511 raft_consensus.cc:697] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:04.239369 32315 raft_consensus.cc:2468] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:04.239883 32511 consensus_queue.cc:237] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.240587 32528 leader_election.cc:290] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:04.239755 32316 raft_consensus.cc:2468] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 1.
I20260709 13:15:04.241230 32358 leader_election.cc:304] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.241742 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:04.242242 32432 leader_election.cc:304] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:04.242365 32392 raft_consensus.cc:3060] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.243264 32513 raft_consensus.cc:493] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.243866 32513 raft_consensus.cc:515] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.245985 32532 leader_election.cc:290] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.247617 32532 raft_consensus.cc:2804] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.248775 32532 raft_consensus.cc:493] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.249414 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:04.249583 32532 raft_consensus.cc:3060] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.250720 32466 raft_consensus.cc:2393] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in current term 1: Already voted for candidate cebf07abd77640909fd5c77f65091906 in this term.
I20260709 13:15:04.252394 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:04.253230 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:04.254436 32280 leader_election.cc:304] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5; no voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906
I20260709 13:15:04.246719 32513 leader_election.cc:290] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.255268 32528 raft_consensus.cc:2804] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.255832 32528 raft_consensus.cc:697] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:04.257110 32513 raft_consensus.cc:3060] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.258327 32392 raft_consensus.cc:2468] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 1.
I20260709 13:15:04.240401 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5c61e32aa44d4b98de3c7d9989ad1e" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:04.262733 32465 raft_consensus.cc:2468] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:04.256698 32528 consensus_queue.cc:237] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.263772 32513 raft_consensus.cc:2749] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:04.265306 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:04.266243 32316 raft_consensus.cc:2393] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebf07abd77640909fd5c77f65091906 in current term 1: Already voted for candidate b77b8fd4718148d2abca289a48b3484d in this term.
I20260709 13:15:04.268707 32358 leader_election.cc:304] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:04.269790 32555 raft_consensus.cc:3060] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.238116 32506 tablet_bootstrap.cc:654] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.273723 32532 raft_consensus.cc:515] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.277093 32215 catalog_manager.cc:5697] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 0 to 1, leader changed from <none> to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 1 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.277782 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5c61e32aa44d4b98de3c7d9989ad1e" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.278239 32555 raft_consensus.cc:2749] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:04.278620 32316 raft_consensus.cc:3060] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.279142 32532 leader_election.cc:290] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.280349 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5c61e32aa44d4b98de3c7d9989ad1e" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.281020 32465 raft_consensus.cc:3060] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.273070 32212 catalog_manager.cc:5697] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 0 to 1, leader changed from <none> to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.286597 32316 raft_consensus.cc:2468] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:04.288059 32358 leader_election.cc:304] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.289151 32532 raft_consensus.cc:2804] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.289274 32465 raft_consensus.cc:2468] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:04.289708 32532 raft_consensus.cc:697] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:04.290596 32532 consensus_queue.cc:237] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.294204 32506 tablet_bootstrap.cc:492] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:04.294961 32506 ts_tablet_manager.cc:1403] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.015s
I20260709 13:15:04.298825 32506 raft_consensus.cc:359] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.299535 32506 raft_consensus.cc:385] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.299823 32506 raft_consensus.cc:740] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.300588 32506 consensus_queue.cc:260] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.302273 32506 ts_tablet_manager.cc:1434] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:04.305151 32212 catalog_manager.cc:5697] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 0 to 1, leader changed from <none> to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.331909 32528 consensus_queue.cc:1048] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.350502 32527 consensus_queue.cc:1048] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.367868 32513 raft_consensus.cc:493] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.368513 32513 raft_consensus.cc:515] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.370471 32513 leader_election.cc:290] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.371371 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:04.371506 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:04.372107 32392 raft_consensus.cc:2468] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:04.372378 32465 raft_consensus.cc:2468] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:04.373472 32280 leader_election.cc:304] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.374172 32513 raft_consensus.cc:2804] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.374554 32513 raft_consensus.cc:493] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.374840 32513 raft_consensus.cc:3060] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.381022 32513 raft_consensus.cc:515] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.382929 32513 leader_election.cc:290] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.383708 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:04.384125 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.384527 32392 raft_consensus.cc:3060] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.384783 32465 raft_consensus.cc:3060] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.391903 32392 raft_consensus.cc:2468] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:04.391903 32465 raft_consensus.cc:2468] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:04.393327 32280 leader_election.cc:304] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.394100 32513 raft_consensus.cc:2804] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.395324 32513 raft_consensus.cc:697] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:04.396384 32513 consensus_queue.cc:237] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.403038 32532 consensus_queue.cc:1048] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.404954 32215 catalog_manager.cc:5697] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.413935 32555 consensus_queue.cc:1048] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.453245 32555 raft_consensus.cc:493] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.453795 32555 raft_consensus.cc:515] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.455653 32555 leader_election.cc:290] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.456511 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:04.456719 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:04.457126 32316 raft_consensus.cc:2468] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:04.457382 32465 raft_consensus.cc:2468] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:04.458180 32358 leader_election.cc:304] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.458858 32555 raft_consensus.cc:2804] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.459249 32555 raft_consensus.cc:493] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.459491 32555 raft_consensus.cc:3060] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.464558 32555 raft_consensus.cc:515] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.466100 32555 leader_election.cc:290] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.467093 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.466987 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.467854 32465 raft_consensus.cc:3060] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.468001 32316 raft_consensus.cc:3060] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.472929 32465 raft_consensus.cc:2468] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:04.473125 32316 raft_consensus.cc:2468] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:04.474059 32357 leader_election.cc:304] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.474852 32555 raft_consensus.cc:2804] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.475359 32555 raft_consensus.cc:697] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:04.476353 32555 consensus_queue.cc:237] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.483342 32215 catalog_manager.cc:5697] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 0 to 1, leader changed from <none> to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.527940 32513 raft_consensus.cc:493] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.528666 32513 raft_consensus.cc:515] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.530489 32513 leader_election.cc:290] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.531418 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:04.531700 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:04.532371 32392 raft_consensus.cc:2393] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in current term 1: Already voted for candidate b77b8fd4718148d2abca289a48b3484d in this term.
I20260709 13:15:04.533569 32280 leader_election.cc:304] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5; no voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906
I20260709 13:15:04.534369 32513 raft_consensus.cc:3060] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.539752 32513 raft_consensus.cc:2749] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:04.586830 32465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
mode: GRACEFUL
new_leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:15:04.587486 32465 raft_consensus.cc:606] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Received request to transfer leadership to TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:04.596005 32555 consensus_queue.cc:1048] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.604779 32392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
mode: GRACEFUL
new_leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:47986
I20260709 13:15:04.605425 32392 raft_consensus.cc:606] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Received request to transfer leadership to TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:04.607144 32316 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.616433 32511 consensus_queue.cc:1048] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.616789 32465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
mode: GRACEFUL
new_leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:15:04.617551 32465 raft_consensus.cc:606] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Received request to transfer leadership to TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:04.626493 32392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
mode: GRACEFUL
new_leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:47986
I20260709 13:15:04.627166 32392 raft_consensus.cc:606] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Received request to transfer leadership to TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:04.633812 32465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
mode: GRACEFUL
new_leader_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:15:04.634528 32465 raft_consensus.cc:606] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Received request to transfer leadership to TS cebf07abd77640909fd5c77f65091906
I20260709 13:15:04.639967 32511 consensus_queue.cc:1048] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.657868 32511 consensus_queue.cc:1048] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.661484 32315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
mode: GRACEFUL
new_leader_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:34538
I20260709 13:15:04.662144 32315 raft_consensus.cc:606] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Received request to transfer leadership to TS cebf07abd77640909fd5c77f65091906
I20260709 13:15:04.668628 32392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
mode: GRACEFUL
new_leader_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:47986
I20260709 13:15:04.669214 32392 raft_consensus.cc:606] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Received request to transfer leadership to TS b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:04.718465 32527 consensus_queue.cc:1048] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.727933 32515 consensus_queue.cc:1048] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.730121 32515 consensus_queue.cc:1048] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.741511 32515 consensus_queue.cc:1048] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.746356 32511 consensus_queue.cc:1048] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.756263 32563 raft_consensus.cc:993] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d: : Instructing follower 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:04.756870 32563 raft_consensus.cc:1081] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Signalling peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:04.759114 32315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:34518
I20260709 13:15:04.759939 32315 raft_consensus.cc:493] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:04.760411 32315 raft_consensus.cc:3060] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.764720 32527 raft_consensus.cc:993] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d: : Instructing follower cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:04.765271 32527 raft_consensus.cc:1081] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Signalling peer cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:04.767094 32391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:15:04.767688 32391 raft_consensus.cc:493] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:04.768090 32391 raft_consensus.cc:3060] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.773411 32315 raft_consensus.cc:515] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:04.775547 32554 consensus_queue.cc:1048] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.777127 32315 leader_election.cc:290] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Requested vote from peers b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:04.777168 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.777985 32465 raft_consensus.cc:3055] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.778338 32465 raft_consensus.cc:740] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:04.778465 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331e5384a15c41e4a512e0988f37eb86" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:04.779096 32392 raft_consensus.cc:3060] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.779224 32465 consensus_queue.cc:260] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:04.780562 32465 raft_consensus.cc:3060] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.785454 32391 raft_consensus.cc:515] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.787663 32563 raft_consensus.cc:993] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d: : Instructing follower 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:04.789029 32563 raft_consensus.cc:1081] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Signalling peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:04.791596 32315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:34518
I20260709 13:15:04.791909 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.793254 32391 leader_election.cc:290] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.793341 32316 raft_consensus.cc:3060] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.793921 32464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6e51ed41a54d26a9c3ad782695a1e6" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.794559 32464 raft_consensus.cc:3055] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.794863 32464 raft_consensus.cc:740] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:04.792306 32315 raft_consensus.cc:493] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:04.795462 32315 raft_consensus.cc:3060] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.795656 32464 consensus_queue.cc:260] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.796989 32464 raft_consensus.cc:3060] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.801306 32316 raft_consensus.cc:2468] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:04.802771 32358 leader_election.cc:304] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.804991 32464 raft_consensus.cc:2468] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:04.805694 32465 raft_consensus.cc:2468] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:04.806035 32554 raft_consensus.cc:2804] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:04.806644 32554 raft_consensus.cc:697] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:04.807495 32554 consensus_queue.cc:237] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.809329 32392 raft_consensus.cc:2468] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:04.809363 32315 raft_consensus.cc:515] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.810526 32282 leader_election.cc:304] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:04.811532 32513 raft_consensus.cc:2804] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:04.811909 32315 leader_election.cc:290] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.812070 32513 raft_consensus.cc:697] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:04.813102 32513 consensus_queue.cc:237] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } }
I20260709 13:15:04.815245 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.815989 32465 raft_consensus.cc:3055] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.816366 32465 raft_consensus.cc:740] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:04.817273 32465 consensus_queue.cc:260] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.817492 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b765149d2ea945cdb16f877b01e84af1" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:04.818284 32392 raft_consensus.cc:3060] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.818677 32465 raft_consensus.cc:3060] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.820308 32215 catalog_manager.cc:5697] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 1 to 2, leader changed from b77b8fd4718148d2abca289a48b3484d (127.19.185.195) to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.822973 32212 catalog_manager.cc:5697] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 1 to 2, leader changed from b77b8fd4718148d2abca289a48b3484d (127.19.185.195) to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.825769 32465 raft_consensus.cc:2468] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:04.827430 32282 leader_election.cc:304] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:04.828298 32513 raft_consensus.cc:2804] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:04.828972 32513 raft_consensus.cc:697] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:04.829828 32513 consensus_queue.cc:237] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.832567 32392 raft_consensus.cc:2468] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:04.839986 32212 catalog_manager.cc:5697] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 1 to 2, leader changed from b77b8fd4718148d2abca289a48b3484d (127.19.185.195) to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.863888 32511 raft_consensus.cc:993] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906: : Instructing follower b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:04.864455 32554 raft_consensus.cc:1081] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Signalling peer b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:04.866286 32465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:44766
I20260709 13:15:04.866876 32465 raft_consensus.cc:493] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:04.867277 32465 raft_consensus.cc:3060] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.872496 32465 raft_consensus.cc:515] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.874353 32465 leader_election.cc:290] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:04.875166 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.875550 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49422ced0124424a55fc048aa49ce54" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:04.875928 32315 raft_consensus.cc:3060] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.876227 32392 raft_consensus.cc:3055] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.876573 32392 raft_consensus.cc:740] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:04.877277 32392 consensus_queue.cc:260] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.878268 32392 raft_consensus.cc:3060] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.881501 32315 raft_consensus.cc:2468] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 2.
I20260709 13:15:04.882858 32432 leader_election.cc:304] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:04.883733 32563 raft_consensus.cc:2804] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:04.883787 32392 raft_consensus.cc:2468] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 2.
I20260709 13:15:04.884482 32563 raft_consensus.cc:697] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 2 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:04.885401 32563 consensus_queue.cc:237] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.887773 32554 consensus_queue.cc:1048] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.893067 32212 catalog_manager.cc:5697] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 1 to 2, leader changed from cebf07abd77640909fd5c77f65091906 (127.19.185.194) to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 2 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.895895 32511 raft_consensus.cc:993] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906: : Instructing follower 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:04.896459 32555 raft_consensus.cc:1081] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Signalling peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:04.900126 32315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:34528
I20260709 13:15:04.903049 32315 raft_consensus.cc:493] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:04.902910 32554 consensus_queue.cc:1048] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.903678 32315 raft_consensus.cc:3060] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.912220 32315 raft_consensus.cc:515] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.916468 32315 leader_election.cc:290] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.916675 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:04.917407 32392 raft_consensus.cc:3055] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.917101 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8910bf304736431cb2d07267b964ff5b" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.917783 32392 raft_consensus.cc:740] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:04.918123 32465 raft_consensus.cc:3060] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.918665 32392 consensus_queue.cc:260] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.920112 32392 raft_consensus.cc:3060] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.925649 32465 raft_consensus.cc:2468] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:04.927639 32392 raft_consensus.cc:2468] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:04.929471 32513 consensus_queue.cc:1048] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.929627 32280 leader_election.cc:304] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.931310 32566 raft_consensus.cc:2804] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:04.931813 32566 raft_consensus.cc:697] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:04.932723 32566 consensus_queue.cc:237] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.941773 32212 catalog_manager.cc:5697] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 1 to 2, leader changed from cebf07abd77640909fd5c77f65091906 (127.19.185.194) to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.943780 32566 consensus_queue.cc:1048] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.946383 32566 raft_consensus.cc:993] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: : Instructing follower cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:04.946884 32513 raft_consensus.cc:1081] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Signalling peer cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:04.948704 32391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:47974
I20260709 13:15:04.950373 32391 raft_consensus.cc:493] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:04.950788 32391 raft_consensus.cc:3060] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.958946 32391 raft_consensus.cc:515] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.965358 32391 leader_election.cc:290] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:04.965953 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:04.965754 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ca6305ffaf4563bfb34beab3943103" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:04.966815 32315 raft_consensus.cc:3055] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.967180 32315 raft_consensus.cc:740] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:04.968055 32315 consensus_queue.cc:260] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.969417 32315 raft_consensus.cc:3060] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.969606 32465 raft_consensus.cc:3060] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:04.977416 32465 raft_consensus.cc:2468] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:04.977416 32315 raft_consensus.cc:2468] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:04.978767 32357 leader_election.cc:304] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:04.979513 32555 raft_consensus.cc:2804] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:04.980091 32555 raft_consensus.cc:697] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:04.981019 32555 consensus_queue.cc:237] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:04.989636 32214 catalog_manager.cc:5697] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 1 to 2, leader changed from 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193) to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.184597 32554 raft_consensus.cc:993] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906: : Instructing follower 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:05.185201 32511 raft_consensus.cc:1081] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Signalling peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:05.186862 32315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:34528
I20260709 13:15:05.187422 32315 raft_consensus.cc:493] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.187758 32315 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.193151 32315 raft_consensus.cc:515] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:05.194990 32315 leader_election.cc:290] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:05.196004 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:05.196048 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:05.196949 32391 raft_consensus.cc:3055] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:05.197082 32465 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.197274 32391 raft_consensus.cc:740] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:05.198175 32391 consensus_queue.cc:260] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:05.199164 32391 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.202771 32465 raft_consensus.cc:2468] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:05.204171 32282 leader_election.cc:304] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:05.204588 32391 raft_consensus.cc:2468] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:05.204916 32513 raft_consensus.cc:2804] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:05.205535 32513 raft_consensus.cc:697] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:05.206771 32513 consensus_queue.cc:237] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:05.213383 32214 catalog_manager.cc:5697] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 1 to 2, leader changed from cebf07abd77640909fd5c77f65091906 (127.19.185.194) to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.225230 32391 raft_consensus.cc:1275] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.226789 32513 consensus_queue.cc:1048] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.236145 32465 raft_consensus.cc:1275] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.237741 32566 consensus_queue.cc:1048] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.303222 32315 raft_consensus.cc:1275] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.304726 32554 consensus_queue.cc:1048] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.313993 32465 raft_consensus.cc:1275] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.316185 32511 consensus_queue.cc:1048] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:05.353722 32391 raft_consensus.cc:1275] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.355309 32566 consensus_queue.cc:1048] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.363265 32465 raft_consensus.cc:1275] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.365330 32513 consensus_queue.cc:1048] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.409271 32391 raft_consensus.cc:1275] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.410682 32563 consensus_queue.cc:1048] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.423218 32315 raft_consensus.cc:1275] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.425171 32595 consensus_queue.cc:1048] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:05.429343 32391 raft_consensus.cc:1275] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.431180 32513 consensus_queue.cc:1048] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:05.436335 32465 raft_consensus.cc:1275] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.438115 32513 consensus_queue.cc:1048] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.438632 32315 raft_consensus.cc:1275] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.440853 32511 consensus_queue.cc:1048] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.473896 32465 raft_consensus.cc:1275] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.475482 32555 consensus_queue.cc:1048] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.595695 32464 raft_consensus.cc:1275] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.597502 32598 consensus_queue.cc:1048] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:05.611987 32391 raft_consensus.cc:1275] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.614323 32566 consensus_queue.cc:1048] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:07.126258 32487 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe780 after lost signal to thread 20202
W20260709 13:15:07.127529 32487 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8ce0 after lost signal to thread 32249
W20260709 13:15:07.128924 32487 debug-util.cc:398] Leaking SignalData structure 0x7b08001125e0 after lost signal to thread 32341
W20260709 13:15:07.130118 32487 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4840 after lost signal to thread 32416
W20260709 13:15:07.131352 32487 debug-util.cc:398] Leaking SignalData structure 0x7b0800306d00 after lost signal to thread 32490
I20260709 13:15:07.826227 32215 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58926:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:07.829501 32215 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:07.897193 32304 tablet_service.cc:1511] Processing CreateTablet for tablet 7ede2f161c844f118932f84d4d57fcb2 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:07.899137 32304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ede2f161c844f118932f84d4d57fcb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.899268 32382 tablet_service.cc:1511] Processing CreateTablet for tablet 7ede2f161c844f118932f84d4d57fcb2 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:07.926448 32382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ede2f161c844f118932f84d4d57fcb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.902407 32302 tablet_service.cc:1511] Processing CreateTablet for tablet 8c503a3a95004a5b9edf4a9b99b9f755 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:07.927598 32452 tablet_service.cc:1511] Processing CreateTablet for tablet 4b09128b9528411582bd716b7082f956 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:07.929081 32302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c503a3a95004a5b9edf4a9b99b9f755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.929338 32452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b09128b9528411582bd716b7082f956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.905603 32381 tablet_service.cc:1511] Processing CreateTablet for tablet 8c503a3a95004a5b9edf4a9b99b9f755 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:07.933153 32381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c503a3a95004a5b9edf4a9b99b9f755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.908016 32451 tablet_service.cc:1511] Processing CreateTablet for tablet 7ede2f161c844f118932f84d4d57fcb2 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:07.934875 32453 tablet_service.cc:1511] Processing CreateTablet for tablet 189bec1bd7a84e93b975a3e282f2c953 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:07.936410 32451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ede2f161c844f118932f84d4d57fcb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.937795 32454 tablet_service.cc:1511] Processing CreateTablet for tablet 2826e3682a07455183c875f7ff9282a4 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:07.909123 32376 tablet_service.cc:1511] Processing CreateTablet for tablet eeafebdc6c304a18866b51e28f09ab39 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:07.941215 32376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeafebdc6c304a18866b51e28f09ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.910691 32455 tablet_service.cc:1511] Processing CreateTablet for tablet 8c503a3a95004a5b9edf4a9b99b9f755 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:07.911900 32305 tablet_service.cc:1511] Processing CreateTablet for tablet eeafebdc6c304a18866b51e28f09ab39 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:07.914829 32456 tablet_service.cc:1511] Processing CreateTablet for tablet eeafebdc6c304a18866b51e28f09ab39 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:07.915738 32377 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc810fbc31049919cd93856d2a4f62f (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:07.947147 32305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeafebdc6c304a18866b51e28f09ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.919191 32450 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc810fbc31049919cd93856d2a4f62f (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:07.920614 32449 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd0be7f20124d36b75307e6b9f3a35f (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:07.924633 32299 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc810fbc31049919cd93856d2a4f62f (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:07.947983 32377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc810fbc31049919cd93856d2a4f62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.961413 32307 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd0be7f20124d36b75307e6b9f3a35f (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:07.966511 32301 tablet_service.cc:1511] Processing CreateTablet for tablet 189bec1bd7a84e93b975a3e282f2c953 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:07.966008 32303 tablet_service.cc:1511] Processing CreateTablet for tablet 4b09128b9528411582bd716b7082f956 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:07.950860 32454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2826e3682a07455183c875f7ff9282a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.953685 32299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc810fbc31049919cd93856d2a4f62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.971407 32455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c503a3a95004a5b9edf4a9b99b9f755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.954980 32374 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd0be7f20124d36b75307e6b9f3a35f (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:07.978029 32453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189bec1bd7a84e93b975a3e282f2c953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.980078 32456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeafebdc6c304a18866b51e28f09ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.975764 32374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd0be7f20124d36b75307e6b9f3a35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.982818 32307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd0be7f20124d36b75307e6b9f3a35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.983722 32450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc810fbc31049919cd93856d2a4f62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.987227 32380 tablet_service.cc:1511] Processing CreateTablet for tablet 4b09128b9528411582bd716b7082f956 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:07.988554 32303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b09128b9528411582bd716b7082f956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.989307 32380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b09128b9528411582bd716b7082f956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.993005 32301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189bec1bd7a84e93b975a3e282f2c953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.994072 32379 tablet_service.cc:1511] Processing CreateTablet for tablet 189bec1bd7a84e93b975a3e282f2c953 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:07.996445 32379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189bec1bd7a84e93b975a3e282f2c953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.987484 32449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd0be7f20124d36b75307e6b9f3a35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.017935 32448 tablet_service.cc:1511] Processing CreateTablet for tablet b3efce368da5484ab52396041505ba81 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:08.019596 32448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3efce368da5484ab52396041505ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.060333 32375 tablet_service.cc:1511] Processing CreateTablet for tablet 2826e3682a07455183c875f7ff9282a4 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:08.062405 32375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2826e3682a07455183c875f7ff9282a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.067844 32378 tablet_service.cc:1511] Processing CreateTablet for tablet b3efce368da5484ab52396041505ba81 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:08.069413 32378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3efce368da5484ab52396041505ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.081858 32300 tablet_service.cc:1511] Processing CreateTablet for tablet 2826e3682a07455183c875f7ff9282a4 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:08.083616 32300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2826e3682a07455183c875f7ff9282a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.098694 32306 tablet_service.cc:1511] Processing CreateTablet for tablet b3efce368da5484ab52396041505ba81 (DEFAULT_TABLE table=soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:08.100328 32306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3efce368da5484ab52396041505ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.137421 32613 tablet_bootstrap.cc:492] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.168056 32616 tablet_bootstrap.cc:492] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.173436 32615 tablet_bootstrap.cc:492] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.177112 32613 tablet_bootstrap.cc:654] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.197352 32616 tablet_bootstrap.cc:654] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.201941 32615 tablet_bootstrap.cc:654] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:08.224422 32263 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:08.278359 32616 tablet_bootstrap.cc:492] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.279613 32616 ts_tablet_manager.cc:1403] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.112s	user 0.022s	sys 0.014s
I20260709 13:15:08.286404 32613 tablet_bootstrap.cc:492] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.287107 32613 ts_tablet_manager.cc:1403] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.010s
I20260709 13:15:08.283854 32616 raft_consensus.cc:359] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.290467 32616 raft_consensus.cc:385] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.290843 32616 raft_consensus.cc:740] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.292186 32616 consensus_queue.cc:260] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.293083 32615 tablet_bootstrap.cc:492] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.293685 32615 ts_tablet_manager.cc:1403] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.020s
I20260709 13:15:08.322098 32600 raft_consensus.cc:493] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.327004 32600 raft_consensus.cc:515] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.330458 32615 raft_consensus.cc:359] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.335490 32615 raft_consensus.cc:385] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.333791 32616 ts_tablet_manager.cc:1434] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.004s
I20260709 13:15:08.338858 32613 raft_consensus.cc:359] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.341125 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:08.346686 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
W20260709 13:15:08.347991 32432 leader_election.cc:343] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.339092 32615 raft_consensus.cc:740] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
W20260709 13:15:08.348922 32429 leader_election.cc:343] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.344336 32616 tablet_bootstrap.cc:492] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.349417 32615 consensus_queue.cc:260] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.349546 32613 raft_consensus.cc:385] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.351441 32613 raft_consensus.cc:740] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.352586 32613 consensus_queue.cc:260] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.353068 32615 ts_tablet_manager.cc:1434] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.006s
I20260709 13:15:08.354835 32615 tablet_bootstrap.cc:492] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.349409 32429 leader_election.cc:304] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906
I20260709 13:15:08.366760 32613 ts_tablet_manager.cc:1434] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.079s	user 0.014s	sys 0.004s
I20260709 13:15:08.367470 32615 tablet_bootstrap.cc:654] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.368175 32613 tablet_bootstrap.cc:492] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.375320 32616 tablet_bootstrap.cc:654] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.384943 32600 leader_election.cc:290] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:08.387256 32613 tablet_bootstrap.cc:654] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:08.393853 32429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:39253, user_credentials={real_user=slave}} blocked reactor thread for 45075.1us
I20260709 13:15:08.402463 32615 tablet_bootstrap.cc:492] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.403080 32600 raft_consensus.cc:2749] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.403272 32615 ts_tablet_manager.cc:1403] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.049s	user 0.025s	sys 0.004s
I20260709 13:15:08.409046 32613 tablet_bootstrap.cc:492] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.407648 32615 raft_consensus.cc:359] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.409776 32615 raft_consensus.cc:385] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.409981 32613 ts_tablet_manager.cc:1403] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.000s
I20260709 13:15:08.410149 32615 raft_consensus.cc:740] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.411496 32615 consensus_queue.cc:260] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.415545 32616 tablet_bootstrap.cc:492] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.416184 32616 ts_tablet_manager.cc:1403] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.003s
I20260709 13:15:08.418972 32615 ts_tablet_manager.cc:1434] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.010s
I20260709 13:15:08.420251 32615 tablet_bootstrap.cc:492] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.423010 32616 raft_consensus.cc:359] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.423799 32616 raft_consensus.cc:385] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.424119 32616 raft_consensus.cc:740] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.424954 32616 consensus_queue.cc:260] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.427966 32613 raft_consensus.cc:359] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.428923 32613 raft_consensus.cc:385] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.429239 32613 raft_consensus.cc:740] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.430630 32615 tablet_bootstrap.cc:654] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.432374 32616 ts_tablet_manager.cc:1434] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:15:08.433655 32616 tablet_bootstrap.cc:492] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.437552 32613 consensus_queue.cc:260] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.441392 32613 ts_tablet_manager.cc:1434] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:15:08.442587 32613 tablet_bootstrap.cc:492] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.444693 32598 raft_consensus.cc:493] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.445363 32598 raft_consensus.cc:515] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.449373 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:08.456527 32616 tablet_bootstrap.cc:654] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:08.451301 32280 leader_election.cc:343] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.459633 32598 leader_election.cc:290] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.450980 32613 tablet_bootstrap.cc:654] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.461233 32615 tablet_bootstrap.cc:492] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.461058 32464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:08.461894 32615 ts_tablet_manager.cc:1403] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.010s
I20260709 13:15:08.461971 32464 raft_consensus.cc:2468] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:08.463877 32282 leader_election.cc:304] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: cebf07abd77640909fd5c77f65091906
I20260709 13:15:08.465266 32598 raft_consensus.cc:2804] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.465692 32598 raft_consensus.cc:493] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.466054 32598 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.466040 32615 raft_consensus.cc:359] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.467126 32615 raft_consensus.cc:385] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.467499 32615 raft_consensus.cc:740] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.469471 32555 raft_consensus.cc:493] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.470232 32613 tablet_bootstrap.cc:492] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.470016 32555 raft_consensus.cc:515] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.470762 32613 ts_tablet_manager.cc:1403] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.000s
I20260709 13:15:08.473606 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd0be7f20124d36b75307e6b9f3a35f" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:08.475638 32598 raft_consensus.cc:515] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.476338 32464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd0be7f20124d36b75307e6b9f3a35f" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:08.477018 32464 raft_consensus.cc:2468] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:08.477965 32598 leader_election.cc:290] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.478688 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:08.479332 32555 leader_election.cc:290] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.478705 32357 leader_election.cc:304] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:08.480074 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:08.480829 32466 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:08.481797 32280 leader_election.cc:343] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.482617 32616 tablet_bootstrap.cc:492] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.483337 32616 ts_tablet_manager.cc:1403] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.003s
I20260709 13:15:08.474316 32613 raft_consensus.cc:359] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.480144 32555 raft_consensus.cc:493] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.488399 32613 raft_consensus.cc:385] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.487946 32616 raft_consensus.cc:359] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.489219 32616 raft_consensus.cc:385] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.488960 32613 raft_consensus.cc:740] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.488830 32555 raft_consensus.cc:515] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.489696 32616 raft_consensus.cc:740] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.487885 32628 raft_consensus.cc:2804] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.490623 32613 consensus_queue.cc:260] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.491204 32628 raft_consensus.cc:493] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.492192 32315 raft_consensus.cc:2468] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:08.492936 32628 raft_consensus.cc:3060] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.493158 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ede2f161c844f118932f84d4d57fcb2" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:08.493902 32317 raft_consensus.cc:2468] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:08.495497 32358 leader_election.cc:304] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:08.496662 32555 leader_election.cc:290] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.491681 32616 consensus_queue.cc:260] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.503928 32616 ts_tablet_manager.cc:1434] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.005s
I20260709 13:15:08.504585 32613 ts_tablet_manager.cc:1434] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.033s	user 0.015s	sys 0.000s
I20260709 13:15:08.499836 32629 raft_consensus.cc:2804] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.505788 32613 tablet_bootstrap.cc:492] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.506145 32466 raft_consensus.cc:2468] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:08.512398 32628 raft_consensus.cc:515] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.514717 32628 leader_election.cc:290] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.505729 32629 raft_consensus.cc:493] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.507181 32616 tablet_bootstrap.cc:492] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.516396 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd0be7f20124d36b75307e6b9f3a35f" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:08.517285 32466 raft_consensus.cc:3060] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.506429 32615 consensus_queue.cc:260] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.515326 32613 tablet_bootstrap.cc:654] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.509603 32464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ede2f161c844f118932f84d4d57fcb2" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:08.519649 32282 leader_election.cc:304] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: cebf07abd77640909fd5c77f65091906
I20260709 13:15:08.521101 32615 ts_tablet_manager.cc:1434] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.007s
I20260709 13:15:08.521622 32598 raft_consensus.cc:2804] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.522229 32598 raft_consensus.cc:697] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:08.523170 32598 consensus_queue.cc:237] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
W20260709 13:15:08.525224 32357 leader_election.cc:343] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.526158 32616 tablet_bootstrap.cc:654] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.529476 32466 raft_consensus.cc:2468] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:08.530367 32628 raft_consensus.cc:493] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.535386 32628 raft_consensus.cc:515] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.536991 32357 leader_election.cc:304] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:08.530788 32629 raft_consensus.cc:3060] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:08.539237 32358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.193:46113, user_credentials={real_user=slave}} blocked reactor thread for 43979.7us
I20260709 13:15:08.539279 32464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
W20260709 13:15:08.541299 32357 leader_election.cc:343] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.547474 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:08.532564 32615 tablet_bootstrap.cc:492] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.538309 32555 raft_consensus.cc:2804] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.548393 32555 raft_consensus.cc:697] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:08.549693 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd0be7f20124d36b75307e6b9f3a35f" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:08.551136 32315 raft_consensus.cc:3060] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.549422 32555 consensus_queue.cc:237] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.537894 32628 leader_election.cc:290] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
W20260709 13:15:08.553197 32358 leader_election.cc:343] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.553665 32358 leader_election.cc:304] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:08.554425 32628 raft_consensus.cc:2749] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.566229 32629 raft_consensus.cc:515] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.568652 32629 leader_election.cc:290] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.569617 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ede2f161c844f118932f84d4d57fcb2" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:08.570405 32317 raft_consensus.cc:3060] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.570495 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ede2f161c844f118932f84d4d57fcb2" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
W20260709 13:15:08.573459 32357 leader_election.cc:343] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.574916 32615 tablet_bootstrap.cc:654] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.577423 32315 raft_consensus.cc:2468] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:08.587500 32615 tablet_bootstrap.cc:492] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.589370 32615 ts_tablet_manager.cc:1403] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.001s
I20260709 13:15:08.588606 32214 catalog_manager.cc:5697] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.593437 32615 raft_consensus.cc:359] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.596982 32615 raft_consensus.cc:385] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.595041 32213 catalog_manager.cc:5697] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 0 to 1, leader changed from <none> to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.599053 32616 tablet_bootstrap.cc:492] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.597863 32615 raft_consensus.cc:740] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.600124 32615 consensus_queue.cc:260] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.600908 32317 raft_consensus.cc:2468] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:08.602329 32615 ts_tablet_manager.cc:1434] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:15:08.602420 32358 leader_election.cc:304] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:08.603475 32555 raft_consensus.cc:2804] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.603816 32616 ts_tablet_manager.cc:1403] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.007s
I20260709 13:15:08.604070 32555 raft_consensus.cc:697] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:08.605368 32555 consensus_queue.cc:237] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.607640 32616 raft_consensus.cc:359] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.608438 32613 tablet_bootstrap.cc:492] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.608637 32616 raft_consensus.cc:385] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.609174 32613 ts_tablet_manager.cc:1403] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.046s
I20260709 13:15:08.609134 32616 raft_consensus.cc:740] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.603502 32615 tablet_bootstrap.cc:492] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.610378 32616 consensus_queue.cc:260] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.613193 32616 ts_tablet_manager.cc:1434] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:15:08.614290 32616 tablet_bootstrap.cc:492] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.617926 32613 raft_consensus.cc:359] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.618700 32613 raft_consensus.cc:385] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.619015 32613 raft_consensus.cc:740] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.619762 32613 consensus_queue.cc:260] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.621773 32616 tablet_bootstrap.cc:654] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.622907 32613 ts_tablet_manager.cc:1434] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:08.624449 32613 tablet_bootstrap.cc:492] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.633760 32613 tablet_bootstrap.cc:654] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.655141 32613 tablet_bootstrap.cc:492] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.655754 32613 ts_tablet_manager.cc:1403] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.007s
I20260709 13:15:08.659253 32613 raft_consensus.cc:359] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.660107 32613 raft_consensus.cc:385] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.660416 32613 raft_consensus.cc:740] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.661298 32613 consensus_queue.cc:260] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.664088 32613 ts_tablet_manager.cc:1434] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:15:08.664484 32615 tablet_bootstrap.cc:654] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.665150 32613 tablet_bootstrap.cc:492] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.666983 32555 raft_consensus.cc:493] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.667542 32555 raft_consensus.cc:515] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.672555 32616 tablet_bootstrap.cc:492] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.673362 32616 ts_tablet_manager.cc:1403] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.059s	user 0.030s	sys 0.020s
I20260709 13:15:08.673650 32613 tablet_bootstrap.cc:654] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.674103 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc810fbc31049919cd93856d2a4f62f" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:08.674875 32317 raft_consensus.cc:2468] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:08.673719 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc810fbc31049919cd93856d2a4f62f" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:08.679508 32465 raft_consensus.cc:2468] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 0.
I20260709 13:15:08.680830 32357 leader_election.cc:304] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:08.682253 32555 leader_election.cc:290] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.682832 32555 raft_consensus.cc:2804] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.683180 32555 raft_consensus.cc:493] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.683542 32555 raft_consensus.cc:3060] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.685513 32598 raft_consensus.cc:493] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.686106 32598 raft_consensus.cc:515] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.687227 32613 tablet_bootstrap.cc:492] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.687878 32613 ts_tablet_manager.cc:1403] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:15:08.689306 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
W20260709 13:15:08.690968 32280 leader_election.cc:343] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.691406 32613 raft_consensus.cc:359] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.691993 32598 leader_election.cc:290] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.692437 32613 raft_consensus.cc:385] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.692807 32613 raft_consensus.cc:740] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.693894 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:08.693676 32613 consensus_queue.cc:260] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.694432 32213 catalog_manager.cc:5697] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 0 to 1, leader changed from <none> to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:08.695520 32282 leader_election.cc:343] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:08.696092 32282 leader_election.cc:304] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5; no voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906
I20260709 13:15:08.696916 32598 raft_consensus.cc:2749] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:08.697032 32613 ts_tablet_manager.cc:1434] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:08.699000 32613 tablet_bootstrap.cc:492] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.706269 32616 raft_consensus.cc:359] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.706871 32613 tablet_bootstrap.cc:654] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.707087 32616 raft_consensus.cc:385] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.707526 32616 raft_consensus.cc:740] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.708406 32616 consensus_queue.cc:260] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.710911 32616 ts_tablet_manager.cc:1434] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.002s
I20260709 13:15:08.712850 32555 raft_consensus.cc:515] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.718676 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc810fbc31049919cd93856d2a4f62f" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:08.718739 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc810fbc31049919cd93856d2a4f62f" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:08.719297 32465 raft_consensus.cc:3060] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.719455 32315 raft_consensus.cc:3060] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.725378 32613 tablet_bootstrap.cc:492] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.726006 32613 ts_tablet_manager.cc:1403] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.007s
I20260709 13:15:08.726207 32465 raft_consensus.cc:2468] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:08.727581 32357 leader_election.cc:304] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:08.728451 32616 tablet_bootstrap.cc:492] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.729285 32613 raft_consensus.cc:359] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.730113 32613 raft_consensus.cc:385] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.730450 32613 raft_consensus.cc:740] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.729017 32555 leader_election.cc:290] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.731751 32555 raft_consensus.cc:2804] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:08.731448 32613 consensus_queue.cc:260] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.732852 32555 raft_consensus.cc:697] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:08.733820 32555 consensus_queue.cc:237] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.734328 32613 ts_tablet_manager.cc:1434] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:08.735726 32613 tablet_bootstrap.cc:492] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.740823 32616 tablet_bootstrap.cc:654] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.742661 32613 tablet_bootstrap.cc:654] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.750798 32615 tablet_bootstrap.cc:492] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.751365 32615 ts_tablet_manager.cc:1403] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.003s
I20260709 13:15:08.752622 32315 raft_consensus.cc:2468] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:08.754956 32613 tablet_bootstrap.cc:492] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.755805 32613 ts_tablet_manager.cc:1403] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:15:08.759640 32613 raft_consensus.cc:359] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.755021 32615 raft_consensus.cc:359] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.761039 32613 raft_consensus.cc:385] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.761564 32613 raft_consensus.cc:740] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.761539 32615 raft_consensus.cc:385] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.762217 32615 raft_consensus.cc:740] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.762501 32613 consensus_queue.cc:260] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.763375 32213 catalog_manager.cc:5697] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 0 to 1, leader changed from <none> to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.764531 32616 tablet_bootstrap.cc:492] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.763423 32615 consensus_queue.cc:260] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.765100 32616 ts_tablet_manager.cc:1403] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.007s
I20260709 13:15:08.766378 32613 ts_tablet_manager.cc:1434] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:15:08.768581 32616 raft_consensus.cc:359] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.768683 32615 ts_tablet_manager.cc:1434] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.005s
I20260709 13:15:08.772435 32615 tablet_bootstrap.cc:492] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.769557 32616 raft_consensus.cc:385] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.770212 32613 tablet_bootstrap.cc:492] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Bootstrap starting.
I20260709 13:15:08.775064 32616 raft_consensus.cc:740] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.776508 32616 consensus_queue.cc:260] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.781445 32616 ts_tablet_manager.cc:1434] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 13:15:08.782577 32616 tablet_bootstrap.cc:492] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.788028 32615 tablet_bootstrap.cc:654] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.790493 32616 tablet_bootstrap.cc:654] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.793383 32613 tablet_bootstrap.cc:654] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.810715 32613 tablet_bootstrap.cc:492] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: No bootstrap required, opened a new log
I20260709 13:15:08.811267 32613 ts_tablet_manager.cc:1403] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.003s
I20260709 13:15:08.812192 32616 tablet_bootstrap.cc:492] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.812908 32616 ts_tablet_manager.cc:1403] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.007s
I20260709 13:15:08.813977 32615 tablet_bootstrap.cc:492] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.814699 32615 ts_tablet_manager.cc:1403] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.006s
I20260709 13:15:08.815244 32613 raft_consensus.cc:359] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.816851 32613 raft_consensus.cc:385] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.817354 32613 raft_consensus.cc:740] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.818813 32615 raft_consensus.cc:359] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.818665 32613 consensus_queue.cc:260] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.819183 32616 raft_consensus.cc:359] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.820911 32615 raft_consensus.cc:385] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.821775 32615 raft_consensus.cc:740] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.822942 32613 ts_tablet_manager.cc:1434] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 13:15:08.822878 32615 consensus_queue.cc:260] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.821131 32616 raft_consensus.cc:385] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.824554 32616 raft_consensus.cc:740] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.826187 32615 ts_tablet_manager.cc:1434] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:08.825525 32616 consensus_queue.cc:260] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.828080 32615 tablet_bootstrap.cc:492] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.835847 32616 ts_tablet_manager.cc:1434] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 13:15:08.841270 32615 tablet_bootstrap.cc:654] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.853394 32616 tablet_bootstrap.cc:492] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.861294 32615 tablet_bootstrap.cc:492] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.861395 32616 tablet_bootstrap.cc:654] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.862177 32615 ts_tablet_manager.cc:1403] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.017s
I20260709 13:15:08.867336 32615 raft_consensus.cc:359] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.869635 32615 raft_consensus.cc:385] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.869828 32616 tablet_bootstrap.cc:492] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.870010 32615 raft_consensus.cc:740] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.870850 32616 ts_tablet_manager.cc:1403] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:15:08.871357 32615 consensus_queue.cc:260] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.874094 32616 raft_consensus.cc:359] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.875322 32616 raft_consensus.cc:385] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.875746 32616 raft_consensus.cc:740] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.876653 32616 consensus_queue.cc:260] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.879500 32616 ts_tablet_manager.cc:1434] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:08.883514 32616 tablet_bootstrap.cc:492] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d: Bootstrap starting.
I20260709 13:15:08.884654 32615 ts_tablet_manager.cc:1434] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 13:15:08.886040 32615 tablet_bootstrap.cc:492] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.891041 32616 tablet_bootstrap.cc:654] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.894794 32615 tablet_bootstrap.cc:654] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.906059 32616 tablet_bootstrap.cc:492] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d: No bootstrap required, opened a new log
I20260709 13:15:08.906733 32616 ts_tablet_manager.cc:1403] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 13:15:08.910741 32616 raft_consensus.cc:359] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.911396 32616 raft_consensus.cc:385] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.911633 32616 raft_consensus.cc:740] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.912345 32616 consensus_queue.cc:260] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.914521 32616 ts_tablet_manager.cc:1434] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:08.917845 32615 tablet_bootstrap.cc:492] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.918607 32615 ts_tablet_manager.cc:1403] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.009s
I20260709 13:15:08.921629 32615 raft_consensus.cc:359] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.922461 32615 raft_consensus.cc:385] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.922864 32615 raft_consensus.cc:740] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.923607 32615 consensus_queue.cc:260] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.926532 32615 ts_tablet_manager.cc:1434] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:08.927510 32615 tablet_bootstrap.cc:492] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906: Bootstrap starting.
I20260709 13:15:08.933964 32615 tablet_bootstrap.cc:654] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.947937 32615 tablet_bootstrap.cc:492] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906: No bootstrap required, opened a new log
I20260709 13:15:08.948542 32615 ts_tablet_manager.cc:1403] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.003s
I20260709 13:15:08.951351 32615 raft_consensus.cc:359] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.951978 32615 raft_consensus.cc:385] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.952283 32615 raft_consensus.cc:740] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.952946 32615 consensus_queue.cc:260] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.955045 32615 ts_tablet_manager.cc:1434] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:08.968729 32620 raft_consensus.cc:493] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.969452 32620 raft_consensus.cc:515] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.973368 32620 leader_election.cc:290] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:08.973407 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:08.973762 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:08.974475 32315 raft_consensus.cc:2468] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:08.974541 32391 raft_consensus.cc:2468] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:08.975811 32432 leader_election.cc:304] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:08.976765 32620 raft_consensus.cc:2804] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:08.977167 32620 raft_consensus.cc:493] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.977069 32598 raft_consensus.cc:493] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.977725 32620 raft_consensus.cc:3060] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:08.977960 32598 raft_consensus.cc:515] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.981921 32598 leader_election.cc:290] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:08.995232 32657 raft_consensus.cc:493] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.996767 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3efce368da5484ab52396041505ba81" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:08.997676 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3efce368da5484ab52396041505ba81" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:08.998603 32620 raft_consensus.cc:515] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:08.998639 32391 raft_consensus.cc:2468] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:08.998965 32465 raft_consensus.cc:2468] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:09.000937 32620 leader_election.cc:290] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:09.001295 32555 consensus_queue.cc:1048] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.002616 32280 leader_election.cc:304] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.004993 32614 raft_consensus.cc:2804] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:09.005452 32614 raft_consensus.cc:493] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.005792 32614 raft_consensus.cc:3060] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.001536 32620 raft_consensus.cc:493] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.009071 32620 raft_consensus.cc:515] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.010545 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:09.011755 32391 raft_consensus.cc:3060] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.012614 32620 leader_election.cc:290] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:09.014532 32389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:09.015400 32389 raft_consensus.cc:2468] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:09.016673 32598 raft_consensus.cc:493] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.016963 32429 leader_election.cc:304] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.018234 32620 raft_consensus.cc:2804] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:09.018641 32620 raft_consensus.cc:493] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.019003 32620 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.023072 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:09.024407 32317 raft_consensus.cc:3060] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.017262 32598 raft_consensus.cc:515] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.035112 32598 leader_election.cc:290] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.036849 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:09.037768 32316 raft_consensus.cc:2468] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:09.035782 32598 raft_consensus.cc:493] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.041077 32389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:09.044740 32598 raft_consensus.cc:515] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.045465 32389 raft_consensus.cc:2468] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:09.047307 32598 leader_election.cc:290] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.049486 32627 consensus_queue.cc:1048] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.056046 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:09.038941 32620 raft_consensus.cc:515] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.048434 32657 raft_consensus.cc:515] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.060348 32464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b09128b9528411582bd716b7082f956" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:09.062305 32464 raft_consensus.cc:2468] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:09.060684 32389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b09128b9528411582bd716b7082f956" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:09.063320 32620 leader_election.cc:290] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:09.063755 32389 raft_consensus.cc:2468] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:09.061486 32280 leader_election.cc:304] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.065351 32282 leader_election.cc:304] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:09.066092 32598 raft_consensus.cc:2804] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:09.066674 32598 raft_consensus.cc:493] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.068264 32661 raft_consensus.cc:2804] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:09.067351 32466 raft_consensus.cc:2468] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 0.
I20260709 13:15:09.070856 32391 raft_consensus.cc:2468] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 1.
I20260709 13:15:09.071597 32661 raft_consensus.cc:493] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.072175 32661 raft_consensus.cc:3060] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.077736 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:09.078791 32315 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.080379 32391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:09.081458 32391 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.085944 32389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906" is_pre_election: true
I20260709 13:15:09.086822 32389 raft_consensus.cc:2468] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 0.
I20260709 13:15:09.087054 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:09.066838 32614 raft_consensus.cc:515] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.068876 32598 raft_consensus.cc:3060] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.068533 32657 leader_election.cc:290] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:09.066753 32317 raft_consensus.cc:2468] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 1.
I20260709 13:15:09.089308 32429 leader_election.cc:304] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.094677 32389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3efce368da5484ab52396041505ba81" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:09.095472 32389 raft_consensus.cc:3060] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.099418 32598 raft_consensus.cc:515] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.090291 32315 raft_consensus.cc:2468] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 1.
I20260709 13:15:09.102669 32432 leader_election.cc:304] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:09.104089 32620 raft_consensus.cc:2804] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:09.102694 32316 raft_consensus.cc:2393] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b77b8fd4718148d2abca289a48b3484d in current term 1: Already voted for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in this term.
I20260709 13:15:09.104701 32620 raft_consensus.cc:697] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:09.105654 32620 consensus_queue.cc:237] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.107944 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:09.108639 32392 raft_consensus.cc:3060] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.109686 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:09.108718 32598 leader_election.cc:290] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.110318 32465 raft_consensus.cc:3060] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.114480 32389 raft_consensus.cc:2468] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:09.114856 32661 raft_consensus.cc:515] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.117328 32657 raft_consensus.cc:2804] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:09.124944 32657 raft_consensus.cc:697] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:09.125620 32280 leader_election.cc:304] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.125869 32657 consensus_queue.cc:237] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.117504 32392 raft_consensus.cc:2468] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:09.118559 32465 raft_consensus.cc:2468] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:09.120461 32429 leader_election.cc:304] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:09.132911 32661 leader_election.cc:290] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.133348 32658 raft_consensus.cc:2764] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:15:09.133522 32661 raft_consensus.cc:2804] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:09.134114 32661 raft_consensus.cc:697] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:09.120694 32614 leader_election.cc:290] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.122035 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3efce368da5484ab52396041505ba81" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:09.136091 32466 raft_consensus.cc:3060] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.135041 32661 consensus_queue.cc:237] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.152267 32466 raft_consensus.cc:2468] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:09.154289 32213 catalog_manager.cc:5697] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 0 to 1, leader changed from <none> to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 1 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.177850 32212 catalog_manager.cc:5697] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 0 to 1, leader changed from <none> to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 1 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.195569 32466 raft_consensus.cc:3060] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:09.202502 32280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:39253, user_credentials={real_user=slave}} blocked reactor thread for 76966.4us
I20260709 13:15:09.202904 32630 consensus_queue.cc:1048] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.205044 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b09128b9528411582bd716b7082f956" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:09.205952 32392 raft_consensus.cc:3060] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.217864 32630 consensus_queue.cc:1048] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.218542 32392 raft_consensus.cc:2468] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:09.221060 32280 leader_election.cc:304] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.222417 32280 leader_election.cc:304] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.224678 32389 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.228332 32614 raft_consensus.cc:2804] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:09.229151 32614 raft_consensus.cc:697] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
W20260709 13:15:09.229715 32263 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:09.234699 32391 raft_consensus.cc:2468] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 1.
I20260709 13:15:09.236270 32667 raft_consensus.cc:2804] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:09.238003 32614 consensus_queue.cc:237] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
W20260709 13:15:09.247481 32282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:34189, user_credentials={real_user=slave}} blocked reactor thread for 121852us
I20260709 13:15:09.258131 32667 raft_consensus.cc:697] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:09.259225 32667 consensus_queue.cc:237] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.258252 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b09128b9528411582bd716b7082f956" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:09.263832 32213 catalog_manager.cc:5697] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.267375 32630 raft_consensus.cc:493] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.268668 32630 raft_consensus.cc:515] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.261149 32466 raft_consensus.cc:3060] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.277273 32661 consensus_queue.cc:1048] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.281080 32630 leader_election.cc:290] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.295210 32672 consensus_queue.cc:1048] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.299288 32464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d" is_pre_election: true
I20260709 13:15:09.300271 32464 raft_consensus.cc:2468] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 1.
I20260709 13:15:09.309037 32627 consensus_queue.cc:1048] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.309970 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" is_pre_election: true
I20260709 13:15:09.319664 32357 leader_election.cc:304] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.339561 32214 catalog_manager.cc:5697] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.342466 32214 catalog_manager.cc:5697] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 1 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.355096 32630 consensus_queue.cc:1048] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.369297 32466 raft_consensus.cc:2468] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 1.
I20260709 13:15:09.394071 32629 raft_consensus.cc:2804] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.396257 32629 raft_consensus.cc:493] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59f4fcb430cb4cd6ad5fe1291b0a9fa5)
I20260709 13:15:09.396768 32629 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.417968 32629 raft_consensus.cc:515] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.419725 32389 raft_consensus.cc:1240] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Rejecting Update request from peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:09.425546 32667 consensus_queue.cc:1059] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.426808 32614 raft_consensus.cc:3055] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.427305 32614 raft_consensus.cc:740] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:09.428670 32629 leader_election.cc:290] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.429008 32466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:09.428555 32614 consensus_queue.cc:260] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.442207 32614 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.450733 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:09.465638 32316 raft_consensus.cc:2468] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:09.468746 32358 leader_election.cc:304] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:09.469595 32678 raft_consensus.cc:2804] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.470162 32678 raft_consensus.cc:697] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:09.471014 32678 consensus_queue.cc:237] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.479566 32212 catalog_manager.cc:5697] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 1 to 2, leader changed from 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193) to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.554395 32657 consensus_queue.cc:1048] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.557238 32657 consensus_queue.cc:1048] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.576185 32658 consensus_queue.cc:1048] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.595259 32620 consensus_queue.cc:1048] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.623337 32392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ede2f161c844f118932f84d4d57fcb2"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
mode: GRACEFUL
new_leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:47986
I20260709 13:15:09.624307 32392 raft_consensus.cc:606] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Received request to transfer leadership to TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:09.632300 32392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
mode: GRACEFUL
new_leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:47986
I20260709 13:15:09.633131 32392 raft_consensus.cc:606] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Received request to transfer leadership to TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:09.639940 32661 consensus_queue.cc:1048] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.644629 32389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bc810fbc31049919cd93856d2a4f62f"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
mode: GRACEFUL
new_leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:47986
I20260709 13:15:09.645290 32389 raft_consensus.cc:606] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Received request to transfer leadership to TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5
I20260709 13:15:09.645869 32614 consensus_queue.cc:1048] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.659768 32661 consensus_queue.cc:1048] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.665611 32316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b09128b9528411582bd716b7082f956"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
mode: GRACEFUL
new_leader_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:34538
I20260709 13:15:09.667826 32316 raft_consensus.cc:606] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Received request to transfer leadership to TS cebf07abd77640909fd5c77f65091906
I20260709 13:15:09.678359 32466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
mode: GRACEFUL
new_leader_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:15:09.679009 32466 raft_consensus.cc:606] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Received request to transfer leadership to TS cebf07abd77640909fd5c77f65091906
I20260709 13:15:09.693668 32465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
mode: GRACEFUL
new_leader_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:15:09.694317 32465 raft_consensus.cc:606] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Received request to transfer leadership to TS cebf07abd77640909fd5c77f65091906
I20260709 13:15:09.701817 32316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3efce368da5484ab52396041505ba81"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
mode: GRACEFUL
new_leader_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:34538
I20260709 13:15:09.702528 32316 raft_consensus.cc:606] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Received request to transfer leadership to TS b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:09.715056 32672 consensus_queue.cc:1048] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.721540 32672 consensus_queue.cc:1048] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.736519 32667 raft_consensus.cc:993] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: : Instructing follower cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:09.737056 32614 raft_consensus.cc:1081] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Signalling peer cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:09.741042 32392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b09128b9528411582bd716b7082f956"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:47974
I20260709 13:15:09.741900 32392 raft_consensus.cc:493] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.742297 32392 raft_consensus.cc:3060] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.744242 32614 consensus_queue.cc:1048] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:09.750272 32392 raft_consensus.cc:515] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.756465 32391 raft_consensus.cc:1240] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Rejecting Update request from peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:09.758477 32614 consensus_queue.cc:1059] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:09.759593 32598 raft_consensus.cc:3055] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.759946 32598 raft_consensus.cc:740] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:09.760913 32598 consensus_queue.cc:260] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.761951 32598 raft_consensus.cc:3060] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.763722 32392 leader_election.cc:290] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.766712 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b09128b9528411582bd716b7082f956" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:09.769052 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b09128b9528411582bd716b7082f956" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:09.769814 32465 raft_consensus.cc:3060] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.777453 32465 raft_consensus.cc:2468] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:09.781077 32357 leader_election.cc:304] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.782249 32630 raft_consensus.cc:2804] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.782896 32630 raft_consensus.cc:697] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:09.784782 32630 consensus_queue.cc:237] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.794045 32316 raft_consensus.cc:2468] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:09.798739 32213 catalog_manager.cc:5697] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 1 to 2, leader changed from 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193) to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.846035 32555 raft_consensus.cc:993] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906: : Instructing follower 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:09.846618 32630 raft_consensus.cc:1081] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Signalling peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:09.849123 32316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ede2f161c844f118932f84d4d57fcb2"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:34528
I20260709 13:15:09.849794 32316 raft_consensus.cc:493] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.850189 32316 raft_consensus.cc:3060] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.858791 32316 raft_consensus.cc:515] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.861650 32316 leader_election.cc:290] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.862099 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ede2f161c844f118932f84d4d57fcb2" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:09.862408 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ede2f161c844f118932f84d4d57fcb2" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:09.862885 32392 raft_consensus.cc:3055] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.862954 32465 raft_consensus.cc:3060] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.863541 32392 raft_consensus.cc:740] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:09.864499 32392 consensus_queue.cc:260] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.865938 32392 raft_consensus.cc:3060] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.868597 32555 raft_consensus.cc:993] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: : Instructing follower 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:09.869292 32555 raft_consensus.cc:1081] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Signalling peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:09.871309 32316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bc810fbc31049919cd93856d2a4f62f"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:34528
I20260709 13:15:09.871946 32316 raft_consensus.cc:493] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.872376 32316 raft_consensus.cc:3060] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.873063 32465 raft_consensus.cc:2468] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:09.874362 32392 raft_consensus.cc:2468] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:09.874511 32282 leader_election.cc:304] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:09.875701 32598 raft_consensus.cc:2804] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.876276 32598 raft_consensus.cc:697] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:09.877215 32598 consensus_queue.cc:237] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.880481 32316 raft_consensus.cc:515] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.882306 32465 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.883579 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc810fbc31049919cd93856d2a4f62f" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:09.884305 32392 raft_consensus.cc:3055] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.884620 32392 raft_consensus.cc:740] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:09.886473 32464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc810fbc31049919cd93856d2a4f62f" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:09.887208 32464 raft_consensus.cc:3060] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.882787 32316 leader_election.cc:290] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.887411 32213 catalog_manager.cc:5697] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 1 to 2, leader changed from cebf07abd77640909fd5c77f65091906 (127.19.185.194) to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.889137 32392 consensus_queue.cc:260] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.892323 32465 raft_consensus.cc:1275] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.894003 32555 consensus_queue.cc:1048] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.896190 32464 raft_consensus.cc:2468] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:09.897337 32392 raft_consensus.cc:3060] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.897593 32282 leader_election.cc:304] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:09.901652 32598 raft_consensus.cc:2804] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.902271 32598 raft_consensus.cc:697] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:09.903184 32598 consensus_queue.cc:237] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.904452 32392 raft_consensus.cc:2468] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 2.
I20260709 13:15:09.916731 32215 catalog_manager.cc:5697] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 1 to 2, leader changed from cebf07abd77640909fd5c77f65091906 (127.19.185.194) to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 2 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.919831 32316 raft_consensus.cc:1275] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.926314 32555 consensus_queue.cc:1048] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.932312 32629 raft_consensus.cc:993] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906: : Instructing follower 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:09.932808 32555 raft_consensus.cc:1081] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Signalling peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 to start an election
I20260709 13:15:09.934612 32316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
 from {username='slave'} at 127.0.0.1:34528
I20260709 13:15:09.935243 32316 raft_consensus.cc:493] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.935693 32316 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.944468 32316 raft_consensus.cc:515] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.948137 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:09.948845 32392 raft_consensus.cc:3055] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:09.949160 32392 raft_consensus.cc:740] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:09.949918 32392 consensus_queue.cc:260] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.951035 32392 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.947008 32316 leader_election.cc:290] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 3 election: Requested vote from peers cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:09.955013 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c503a3a95004a5b9edf4a9b99b9f755" candidate_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:09.955906 32465 raft_consensus.cc:3060] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.958597 32392 raft_consensus.cc:2468] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 3.
I20260709 13:15:09.959843 32280 leader_election.cc:304] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:09.960739 32598 raft_consensus.cc:2804] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:09.961908 32598 raft_consensus.cc:697] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 LEADER]: Becoming Leader. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:09.962736 32465 raft_consensus.cc:2468] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59f4fcb430cb4cd6ad5fe1291b0a9fa5 in term 3.
I20260709 13:15:09.962785 32598 consensus_queue.cc:237] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:09.971508 32215 catalog_manager.cc:5697] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 reported cstate change: term changed from 2 to 3, leader changed from cebf07abd77640909fd5c77f65091906 (127.19.185.194) to 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193). New cstate: current_term: 3 leader_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.142023 32598 raft_consensus.cc:993] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: : Instructing follower b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:10.142588 32667 raft_consensus.cc:1081] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Signalling peer b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:10.144435 32465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3efce368da5484ab52396041505ba81"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:44768
I20260709 13:15:10.145047 32465 raft_consensus.cc:493] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.145388 32465 raft_consensus.cc:3060] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.150573 32465 raft_consensus.cc:515] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.152987 32465 leader_election.cc:290] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:10.153342 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3efce368da5484ab52396041505ba81" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:10.153671 32392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3efce368da5484ab52396041505ba81" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:10.154047 32316 raft_consensus.cc:3055] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.154309 32392 raft_consensus.cc:3060] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.154436 32316 raft_consensus.cc:740] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:10.155330 32316 consensus_queue.cc:260] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.156800 32316 raft_consensus.cc:3060] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.161639 32392 raft_consensus.cc:2468] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 2.
I20260709 13:15:10.163198 32429 leader_election.cc:304] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:10.164126 32693 raft_consensus.cc:2804] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.164572 32693 raft_consensus.cc:697] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 2 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:10.165310 32316 raft_consensus.cc:2468] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 2.
I20260709 13:15:10.165412 32693 consensus_queue.cc:237] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.173447 32693 raft_consensus.cc:993] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d: : Instructing follower cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:10.173979 32620 raft_consensus.cc:1081] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Signalling peer cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:10.174250 32215 catalog_manager.cc:5697] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 1 to 2, leader changed from 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193) to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 2 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.175626 32392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:15:10.176249 32392 raft_consensus.cc:493] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.176548 32392 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.182432 32392 raft_consensus.cc:515] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.185545 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:10.185985 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:10.184908 32392 leader_election.cc:290] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:10.186498 32316 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.186894 32465 raft_consensus.cc:3055] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.187269 32465 raft_consensus.cc:740] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:10.188251 32465 consensus_queue.cc:260] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.189586 32465 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.194610 32316 raft_consensus.cc:2468] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:10.196147 32358 leader_election.cc:304] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:10.197057 32465 raft_consensus.cc:2468] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:10.197708 32629 raft_consensus.cc:2804] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.198305 32629 raft_consensus.cc:697] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:10.199223 32629 consensus_queue.cc:237] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.205710 32692 raft_consensus.cc:993] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d: : Instructing follower cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:10.206261 32692 raft_consensus.cc:1081] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Signalling peer cebf07abd77640909fd5c77f65091906 to start an election
I20260709 13:15:10.210543 32392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:15:10.211184 32392 raft_consensus.cc:493] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.211548 32392 raft_consensus.cc:3060] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.218111 32212 catalog_manager.cc:5697] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 1 to 2, leader changed from b77b8fd4718148d2abca289a48b3484d (127.19.185.195) to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.219449 32392 raft_consensus.cc:515] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.222371 32317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:10.222976 32317 raft_consensus.cc:3060] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.224069 32392 leader_election.cc:290] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), b77b8fd4718148d2abca289a48b3484d (127.19.185.195:34189)
I20260709 13:15:10.228048 32465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2826e3682a07455183c875f7ff9282a4" candidate_uuid: "cebf07abd77640909fd5c77f65091906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
I20260709 13:15:10.228645 32465 raft_consensus.cc:3055] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.228945 32465 raft_consensus.cc:740] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:10.229871 32465 consensus_queue.cc:260] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.231104 32465 raft_consensus.cc:3060] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.238483 32465 raft_consensus.cc:2468] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:10.239584 32317 raft_consensus.cc:2468] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebf07abd77640909fd5c77f65091906 in term 2.
I20260709 13:15:10.239838 32357 leader_election.cc:304] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:10.240922 32629 raft_consensus.cc:2804] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.241458 32316 raft_consensus.cc:1275] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.241641 32629 raft_consensus.cc:697] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Becoming Leader. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:10.242611 32629 consensus_queue.cc:237] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:10.244632 32555 consensus_queue.cc:1048] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.249526 32465 raft_consensus.cc:1275] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.252275 32678 consensus_queue.cc:1048] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.256910 32212 catalog_manager.cc:5697] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 reported cstate change: term changed from 1 to 2, leader changed from b77b8fd4718148d2abca289a48b3484d (127.19.185.195) to cebf07abd77640909fd5c77f65091906 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "cebf07abd77640909fd5c77f65091906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.264823 32464 raft_consensus.cc:1275] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.266803 32667 consensus_queue.cc:1048] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.291646 32392 raft_consensus.cc:1275] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.293637 32598 consensus_queue.cc:1048] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.351863 32464 raft_consensus.cc:1275] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.353259 32614 consensus_queue.cc:1048] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.363263 32392 raft_consensus.cc:1275] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.368253 32667 consensus_queue.cc:1048] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.369707 32466 raft_consensus.cc:1275] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:10.371543 32598 consensus_queue.cc:1048] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:10.382110 32389 raft_consensus.cc:1275] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Refusing update from remote peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:10.386042 32672 consensus_queue.cc:1048] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:10.604084 32392 raft_consensus.cc:1275] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.605476 32620 consensus_queue.cc:1048] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.614476 32316 raft_consensus.cc:1275] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.615998 32620 consensus_queue.cc:1048] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.717485 32464 raft_consensus.cc:1275] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.719023 32629 consensus_queue.cc:1048] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.731576 32316 raft_consensus.cc:1275] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.733223 32630 consensus_queue.cc:1048] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.757591 32464 raft_consensus.cc:1275] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.759991 32678 consensus_queue.cc:1048] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.761281 32316 raft_consensus.cc:1275] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer cebf07abd77640909fd5c77f65091906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.763105 32678 consensus_queue.cc:1048] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.706745 32213 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58926:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:15:12.729102 32213 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58926:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:15:12.775034 20199 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:15:12.958597 32280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.194:39253, user_credentials={real_user=slave}} blocked reactor thread for 49664.7us
W20260709 13:15:13.007068 32744 log.cc:927] Time spent T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:15:13.008607 32282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:34189, user_credentials={real_user=slave}} blocked reactor thread for 48397us
I20260709 13:15:12.983839 32745 tablet.cc:1724] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:13.042788 32733 log.cc:927] Time spent T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:15:13.051201 32418 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:4b09128b9528411582bd716b7082f956)
W20260709 13:15:13.060012 32418 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:4b09128b9528411582bd716b7082f956)
W20260709 13:15:13.061069 32418 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:4b09128b9528411582bd716b7082f956)
W20260709 13:15:13.078118 32740 log.cc:927] Time spent T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:15:13.144635   302 tablet.cc:1724] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:13.147620 32748 log.cc:927] Time spent T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
W20260709 13:15:13.148380 32759 log.cc:927] Time spent T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:15:13.144716 32765 tablet.cc:1724] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.105329 32761 tablet.cc:1724] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.110581 32758 tablet.cc:1724] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.164937 32763 tablet.cc:1724] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.135306 32756 tablet.cc:1724] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.086478 32755 tablet.cc:1724] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.183772 32764 tablet.cc:1724] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.201150 32388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
mode: GRACEFUL
new_leader_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:54102
I20260709 13:15:13.202073 32388 raft_consensus.cc:606] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Received request to transfer leadership to TS b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:13.203292 32761 tablet.cc:1724] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:13.215085 32282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:34189, user_credentials={real_user=slave}} blocked reactor thread for 78234.6us
I20260709 13:15:13.207383 32745 tablet.cc:1724] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.187614   301 tablet.cc:1724] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.219249   305 tablet.cc:1724] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.235209 32758 tablet.cc:1724] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.265962   303 tablet.cc:1724] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.226473 32755 tablet.cc:1724] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.269006 32763 tablet.cc:1724] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.279603 32765 tablet.cc:1724] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.279928 32756 tablet.cc:1724] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.295141 32212 catalog_manager.cc:5789] TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113) does not have the latest schema for tablet eeafebdc6c304a18866b51e28f09ab39 (table soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]). Expected version 1 got 0
I20260709 13:15:13.296301 32212 catalog_manager.cc:5789] TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113) does not have the latest schema for tablet 8c503a3a95004a5b9edf4a9b99b9f755 (table soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]). Expected version 1 got 0
I20260709 13:15:13.297298 32212 catalog_manager.cc:5789] TS 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113) does not have the latest schema for tablet 0bc810fbc31049919cd93856d2a4f62f (table soft_deleted_table [id=9e6de302e2d04894b3934f469575515f]). Expected version 1 got 0
I20260709 13:15:13.299445 32745 tablet.cc:1724] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.304821   301 tablet.cc:1724] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.343323 32312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
mode: GRACEFUL
new_leader_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:43290
I20260709 13:15:13.310168 32764 tablet.cc:1724] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.315078   303 tablet.cc:1724] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.317243 32761 tablet.cc:1724] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.348241 32312 raft_consensus.cc:606] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Received request to transfer leadership to TS b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:13.343148 32755 tablet.cc:1724] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.355469 20199 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:15:13.356534 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:13.368202 32763 tablet.cc:1724] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.378958   305 tablet.cc:1724] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:13.387656 32389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8821a78b96a34e91885742aa8950c01e"
dest_uuid: "cebf07abd77640909fd5c77f65091906"
mode: GRACEFUL
new_leader_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:54102
I20260709 13:15:13.388428 32389 raft_consensus.cc:606] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Received request to transfer leadership to TS b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:13.394522 32312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739"
dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
mode: GRACEFUL
new_leader_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:43290
I20260709 13:15:13.395234 32312 raft_consensus.cc:606] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Received request to transfer leadership to TS b77b8fd4718148d2abca289a48b3484d
I20260709 13:15:13.403620 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:13.404650 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:13.413316 32212 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623: soft_deleted_table [id=9e6de302e2d04894b3934f469575515f] alter complete (version 1)
I20260709 13:15:13.536446 32732 raft_consensus.cc:993] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906: : Instructing follower b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:13.536983 32720 raft_consensus.cc:1081] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Signalling peer b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:13.538753 32461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:44766
I20260709 13:15:13.539367 32461 raft_consensus.cc:493] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.539664 32461 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.545491 32461 raft_consensus.cc:515] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.547291 32461 leader_election.cc:290] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 3 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:13.548295 32312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:13.548565 32389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189bec1bd7a84e93b975a3e282f2c953" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:13.549055 32312 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.549221 32389 raft_consensus.cc:3055] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.549623 32389 raft_consensus.cc:740] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:13.550354 32389 consensus_queue.cc:260] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.551462 32389 raft_consensus.cc:3060] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.555049 32312 raft_consensus.cc:2468] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 3.
I20260709 13:15:13.556540 32432 leader_election.cc:304] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:13.557212 32389 raft_consensus.cc:2468] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 3.
I20260709 13:15:13.557531 32701 raft_consensus.cc:2804] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.558899 32701 raft_consensus.cc:697] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 3 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:13.559832 32701 consensus_queue.cc:237] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.567823 32215 catalog_manager.cc:5697] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 2 to 3, leader changed from cebf07abd77640909fd5c77f65091906 (127.19.185.194) to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 3 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.677073 32703 raft_consensus.cc:993] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: : Instructing follower b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:13.677814   306 raft_consensus.cc:1081] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Signalling peer b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:13.679504 32461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:44768
I20260709 13:15:13.680120 32461 raft_consensus.cc:493] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.680490 32461 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.687356 32461 raft_consensus.cc:515] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.689556 32461 leader_election.cc:290] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 3 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:13.690049 32314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:13.690531 32389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a343013437d4f43b64baeb8d987c739" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:13.690800 32314 raft_consensus.cc:3055] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.691233 32314 raft_consensus.cc:740] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:13.691310 32389 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.692233 32314 consensus_queue.cc:260] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.693701 32314 raft_consensus.cc:3060] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.699891 32389 raft_consensus.cc:2468] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 3.
I20260709 13:15:13.701263 32429 leader_election.cc:304] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:13.701705 32314 raft_consensus.cc:2468] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 3.
I20260709 13:15:13.702104 32701 raft_consensus.cc:2804] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.702646 32701 raft_consensus.cc:697] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 3 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:13.703527 32701 consensus_queue.cc:237] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.711586 32215 catalog_manager.cc:5697] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 2 to 3, leader changed from 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193) to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 3 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.713586 32732 raft_consensus.cc:993] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906: : Instructing follower b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:13.714244 32720 raft_consensus.cc:1081] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Signalling peer b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:13.715982 32461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8821a78b96a34e91885742aa8950c01e"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:44766
I20260709 13:15:13.716590 32461 raft_consensus.cc:493] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.717012 32461 raft_consensus.cc:3060] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.723215 32461 raft_consensus.cc:515] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.724952 32461 leader_election.cc:290] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:13.725960 32314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821a78b96a34e91885742aa8950c01e" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:13.726164 32389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8821a78b96a34e91885742aa8950c01e" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:13.726699 32389 raft_consensus.cc:3055] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.726711 32314 raft_consensus.cc:3060] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.727136 32389 raft_consensus.cc:740] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cebf07abd77640909fd5c77f65091906, State: Running, Role: LEADER
I20260709 13:15:13.728119 32389 consensus_queue.cc:260] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.729468 32389 raft_consensus.cc:3060] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.734589 32314 raft_consensus.cc:2468] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 2.
I20260709 13:15:13.736416 32432 leader_election.cc:304] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, b77b8fd4718148d2abca289a48b3484d; no voters: 
I20260709 13:15:13.737008 32389 raft_consensus.cc:2468] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 2.
I20260709 13:15:13.737404 32701 raft_consensus.cc:2804] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.738062 32701 raft_consensus.cc:697] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 2 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:13.738972 32701 consensus_queue.cc:237] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.739889 32703 raft_consensus.cc:993] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: : Instructing follower b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:13.740432 32672 raft_consensus.cc:1081] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Signalling peer b77b8fd4718148d2abca289a48b3484d to start an election
I20260709 13:15:13.742288 32461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39"
dest_uuid: "b77b8fd4718148d2abca289a48b3484d"
 from {username='slave'} at 127.0.0.1:44768
I20260709 13:15:13.742802 32461 raft_consensus.cc:493] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.743160 32461 raft_consensus.cc:3060] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.748142 32215 catalog_manager.cc:5697] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 1 to 2, leader changed from cebf07abd77640909fd5c77f65091906 (127.19.185.194) to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 2 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.750156 32461 raft_consensus.cc:515] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.752990 32314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5"
I20260709 13:15:13.753377 32461 leader_election.cc:290] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 2 election: Requested vote from peers 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113), cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253)
I20260709 13:15:13.753634 32314 raft_consensus.cc:3055] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.753618 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeafebdc6c304a18866b51e28f09ab39" candidate_uuid: "b77b8fd4718148d2abca289a48b3484d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "cebf07abd77640909fd5c77f65091906"
I20260709 13:15:13.754359 32314 raft_consensus.cc:740] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59f4fcb430cb4cd6ad5fe1291b0a9fa5, State: Running, Role: LEADER
I20260709 13:15:13.754540 32388 raft_consensus.cc:3060] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.755262 32314 consensus_queue.cc:260] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.756675 32314 raft_consensus.cc:3060] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.762588 32388 raft_consensus.cc:2468] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 2.
I20260709 13:15:13.763883 32429 leader_election.cc:304] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77b8fd4718148d2abca289a48b3484d, cebf07abd77640909fd5c77f65091906; no voters: 
I20260709 13:15:13.764422 32314 raft_consensus.cc:2468] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77b8fd4718148d2abca289a48b3484d in term 2.
I20260709 13:15:13.764696 32701 raft_consensus.cc:2804] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.765241 32701 raft_consensus.cc:697] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 2 LEADER]: Becoming Leader. State: Replica: b77b8fd4718148d2abca289a48b3484d, State: Running, Role: LEADER
I20260709 13:15:13.766098 32701 consensus_queue.cc:237] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } }
I20260709 13:15:13.773556 32215 catalog_manager.cc:5697] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d reported cstate change: term changed from 1 to 2, leader changed from 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193) to b77b8fd4718148d2abca289a48b3484d (127.19.185.195). New cstate: current_term: 2 leader_uuid: "b77b8fd4718148d2abca289a48b3484d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77b8fd4718148d2abca289a48b3484d" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 34189 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.945103 32388 raft_consensus.cc:1275] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:13.946506 32701 consensus_queue.cc:1048] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:13.956322 32314 raft_consensus.cc:1275] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:13.960427   315 consensus_queue.cc:1048] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:14.173574 32388 raft_consensus.cc:1275] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:14.175177   315 consensus_queue.cc:1048] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:14.186189 32314 raft_consensus.cc:1275] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:14.187505   315 consensus_queue.cc:1048] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.316499 32388 raft_consensus.cc:1275] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:14.317765   315 consensus_queue.cc:1048] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.321288 32314 raft_consensus.cc:1275] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.322594   315 consensus_queue.cc:1048] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.330313 32312 raft_consensus.cc:1275] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:14.332613   320 consensus_queue.cc:1048] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59f4fcb430cb4cd6ad5fe1291b0a9fa5" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.349795 32388 raft_consensus.cc:1275] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Refusing update from remote peer b77b8fd4718148d2abca289a48b3484d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.351536   320 consensus_queue.cc:1048] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebf07abd77640909fd5c77f65091906" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.470317 20199 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:15:14.475867 20199 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:15:14.476439 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:14.482038 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:15:14.482517 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:15.514818 20199 tablet_server.cc:179] TabletServer@127.19.185.193:0 shutting down...
I20260709 13:15:15.543445 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:15.582474 20199 tablet_replica.cc:333] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.586750 20199 raft_consensus.cc:2243] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:15.588490 32432 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 13:15:15.591861 20199 raft_consensus.cc:2272] T 4b09128b9528411582bd716b7082f956 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:15.598479 32432 consensus_peers.cc:597] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.598790 20199 tablet_replica.cc:333] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
W20260709 13:15:15.600335 32432 consensus_peers.cc:597] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.601464 20199 raft_consensus.cc:2243] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.602700 20199 raft_consensus.cc:2272] T 189bec1bd7a84e93b975a3e282f2c953 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:15.607918 32358 consensus_peers.cc:597] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.608098 20199 tablet_replica.cc:333] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.609208 20199 raft_consensus.cc:2243] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.609902 20199 raft_consensus.cc:2272] T eeafebdc6c304a18866b51e28f09ab39 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.613090 20199 tablet_replica.cc:333] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.614079 20199 raft_consensus.cc:2243] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.615356 20199 raft_consensus.cc:2272] T 2826e3682a07455183c875f7ff9282a4 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.620220 20199 tablet_replica.cc:333] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.621295 20199 raft_consensus.cc:2243] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.623780 20199 raft_consensus.cc:2272] T 0bc810fbc31049919cd93856d2a4f62f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.629911 20199 tablet_replica.cc:333] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.630878 20199 raft_consensus.cc:2243] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.631618 20199 raft_consensus.cc:2272] T 2c5c61e32aa44d4b98de3c7d9989ad1e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.634402 20199 tablet_replica.cc:333] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.635468 20199 raft_consensus.cc:2243] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.637087 20199 raft_consensus.cc:2272] T b765149d2ea945cdb16f877b01e84af1 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.639782 20199 tablet_replica.cc:333] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.640532 20199 raft_consensus.cc:2243] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.641218 20199 raft_consensus.cc:2272] T 2e6e51ed41a54d26a9c3ad782695a1e6 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.644317 20199 tablet_replica.cc:333] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.645586 20199 raft_consensus.cc:2243] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.647429 20199 raft_consensus.cc:2272] T 8c503a3a95004a5b9edf4a9b99b9f755 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.650467 20199 tablet_replica.cc:333] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.651211 20199 raft_consensus.cc:2243] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.652817 20199 raft_consensus.cc:2272] T 331e5384a15c41e4a512e0988f37eb86 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.655813 20199 tablet_replica.cc:333] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.656570 20199 raft_consensus.cc:2243] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.657176 20199 raft_consensus.cc:2272] T e6ca6305ffaf4563bfb34beab3943103 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.659570 20199 tablet_replica.cc:333] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.660873 20199 raft_consensus.cc:2243] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.662171 20199 raft_consensus.cc:2272] T 5fd0be7f20124d36b75307e6b9f3a35f P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.667824 20199 tablet_replica.cc:333] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.669030 20199 raft_consensus.cc:2243] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.672147 20199 raft_consensus.cc:2272] T 7ede2f161c844f118932f84d4d57fcb2 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.677009 20199 tablet_replica.cc:333] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.677662 20199 raft_consensus.cc:2243] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.678395 20199 raft_consensus.cc:2272] T b3efce368da5484ab52396041505ba81 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.681217 20199 tablet_replica.cc:333] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.681805 20199 raft_consensus.cc:2243] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.682426 20199 raft_consensus.cc:2272] T 8821a78b96a34e91885742aa8950c01e P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.685277 20199 tablet_replica.cc:333] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.685853 20199 raft_consensus.cc:2243] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.686910 20199 raft_consensus.cc:2272] T 8910bf304736431cb2d07267b964ff5b P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.689543 20199 tablet_replica.cc:333] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.690486 20199 raft_consensus.cc:2243] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.691701 20199 raft_consensus.cc:2272] T 8a343013437d4f43b64baeb8d987c739 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:15.694526 32432 consensus_peers.cc:597] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.694692 20199 tablet_replica.cc:333] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5: stopping tablet replica
I20260709 13:15:15.695502 20199 raft_consensus.cc:2243] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.696112 20199 raft_consensus.cc:2272] T b49422ced0124424a55fc048aa49ce54 P 59f4fcb430cb4cd6ad5fe1291b0a9fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:15.733246 32358 consensus_peers.cc:597] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.750730 20199 tablet_server.cc:196] TabletServer@127.19.185.193:0 shutdown complete.
W20260709 13:15:15.804991 32358 consensus_peers.cc:597] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:46113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.811241 20199 tablet_server.cc:179] TabletServer@127.19.185.194:0 shutting down...
W20260709 13:15:15.835214 32358 consensus_peers.cc:597] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:46113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.847961 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:15.849226 20199 tablet_replica.cc:333] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.850281 20199 raft_consensus.cc:2243] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.851505 20199 raft_consensus.cc:2272] T 4b09128b9528411582bd716b7082f956 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.854187 20199 tablet_replica.cc:333] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.854820 20199 raft_consensus.cc:2243] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.856242 20199 raft_consensus.cc:2272] T 2826e3682a07455183c875f7ff9282a4 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.858989 20199 tablet_replica.cc:333] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.859697 20199 raft_consensus.cc:2243] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.860428 20199 raft_consensus.cc:2272] T eeafebdc6c304a18866b51e28f09ab39 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.862797 20199 tablet_replica.cc:333] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.863319 20199 raft_consensus.cc:2243] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.863932 20199 raft_consensus.cc:2272] T 0bc810fbc31049919cd93856d2a4f62f P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.866305 20199 tablet_replica.cc:333] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.866837 20199 raft_consensus.cc:2243] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.867327 20199 raft_consensus.cc:2272] T 189bec1bd7a84e93b975a3e282f2c953 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.869990 20199 tablet_replica.cc:333] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.870697 20199 raft_consensus.cc:2243] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.871275 20199 raft_consensus.cc:2272] T 7ede2f161c844f118932f84d4d57fcb2 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.873785 20199 tablet_replica.cc:333] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.874336 20199 raft_consensus.cc:2243] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.875263 20199 raft_consensus.cc:2272] T 5fd0be7f20124d36b75307e6b9f3a35f P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.877867 20199 tablet_replica.cc:333] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.878424 20199 raft_consensus.cc:2243] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.878923 20199 raft_consensus.cc:2272] T 8910bf304736431cb2d07267b964ff5b P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.881382 20199 tablet_replica.cc:333] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.882377 20199 raft_consensus.cc:2243] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.883365 20199 raft_consensus.cc:2272] T b3efce368da5484ab52396041505ba81 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.887094 20199 tablet_replica.cc:333] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.887969 20199 raft_consensus.cc:2243] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.888723 20199 raft_consensus.cc:2272] T 8821a78b96a34e91885742aa8950c01e P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.891681 20199 tablet_replica.cc:333] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.892365 20199 raft_consensus.cc:2243] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.892954 20199 raft_consensus.cc:2272] T b765149d2ea945cdb16f877b01e84af1 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.895512 20199 tablet_replica.cc:333] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.896111 20199 raft_consensus.cc:2243] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.897186 20199 raft_consensus.cc:2272] T 2c5c61e32aa44d4b98de3c7d9989ad1e P cebf07abd77640909fd5c77f65091906 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.899540 20199 tablet_replica.cc:333] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.900141 20199 raft_consensus.cc:2243] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.900702 20199 raft_consensus.cc:2272] T 331e5384a15c41e4a512e0988f37eb86 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.903177 20199 tablet_replica.cc:333] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.903751 20199 raft_consensus.cc:2243] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.904783 20199 raft_consensus.cc:2272] T e6ca6305ffaf4563bfb34beab3943103 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.907053 20199 tablet_replica.cc:333] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.907615 20199 raft_consensus.cc:2243] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.908298 20199 raft_consensus.cc:2272] T 8c503a3a95004a5b9edf4a9b99b9f755 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.910701 20199 tablet_replica.cc:333] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.911435 20199 raft_consensus.cc:2243] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:15.912647 20199 raft_consensus.cc:2272] T 2e6e51ed41a54d26a9c3ad782695a1e6 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:15.916446 32429 consensus_peers.cc:597] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d -> Peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Couldn't send request to peer cebf07abd77640909fd5c77f65091906. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.916608 20199 tablet_replica.cc:333] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.917378 20199 raft_consensus.cc:2243] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.917897 20199 raft_consensus.cc:2272] T 8a343013437d4f43b64baeb8d987c739 P cebf07abd77640909fd5c77f65091906 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.920403 20199 tablet_replica.cc:333] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906: stopping tablet replica
I20260709 13:15:15.920971 20199 raft_consensus.cc:2243] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.921501 20199 raft_consensus.cc:2272] T b49422ced0124424a55fc048aa49ce54 P cebf07abd77640909fd5c77f65091906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.968878 20199 tablet_server.cc:196] TabletServer@127.19.185.194:0 shutdown complete.
W20260709 13:15:15.988452 32432 consensus_peers.cc:597] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:46113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.012825 20199 tablet_server.cc:179] TabletServer@127.19.185.195:0 shutting down...
W20260709 13:15:16.017022 32429 consensus_peers.cc:597] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d -> Peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Couldn't send request to peer cebf07abd77640909fd5c77f65091906. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:39253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.027853 32429 consensus_peers.cc:597] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d -> Peer cebf07abd77640909fd5c77f65091906 (127.19.185.194:39253): Couldn't send request to peer cebf07abd77640909fd5c77f65091906. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:39253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.035982 32432 consensus_peers.cc:597] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d -> Peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5 (127.19.185.193:46113): Couldn't send request to peer 59f4fcb430cb4cd6ad5fe1291b0a9fa5. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:46113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.058842 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:16.059657 20199 tablet_replica.cc:333] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.060595 20199 raft_consensus.cc:2243] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.061475 20199 raft_consensus.cc:2272] T 4b09128b9528411582bd716b7082f956 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.064790 20199 tablet_replica.cc:333] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.065553 20199 raft_consensus.cc:2243] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.066577 20199 raft_consensus.cc:2272] T 189bec1bd7a84e93b975a3e282f2c953 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.069000 20199 tablet_replica.cc:333] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.069622 20199 raft_consensus.cc:2243] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.070233 20199 raft_consensus.cc:2272] T 2826e3682a07455183c875f7ff9282a4 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.072841 20199 tablet_replica.cc:333] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.073485 20199 raft_consensus.cc:2243] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.074494 20199 raft_consensus.cc:2272] T eeafebdc6c304a18866b51e28f09ab39 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.077093 20199 tablet_replica.cc:333] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.077734 20199 raft_consensus.cc:2243] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.078352 20199 raft_consensus.cc:2272] T 0bc810fbc31049919cd93856d2a4f62f P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.080833 20199 tablet_replica.cc:333] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.081480 20199 raft_consensus.cc:2243] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.082152 20199 raft_consensus.cc:2272] T 7ede2f161c844f118932f84d4d57fcb2 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.084547 20199 tablet_replica.cc:333] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.085186 20199 raft_consensus.cc:2243] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.085745 20199 raft_consensus.cc:2272] T 5fd0be7f20124d36b75307e6b9f3a35f P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.088240 20199 tablet_replica.cc:333] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.088860 20199 raft_consensus.cc:2243] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.089371 20199 raft_consensus.cc:2272] T 8910bf304736431cb2d07267b964ff5b P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.091879 20199 tablet_replica.cc:333] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.092633 20199 raft_consensus.cc:2243] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.093215 20199 raft_consensus.cc:2272] T b765149d2ea945cdb16f877b01e84af1 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.095628 20199 tablet_replica.cc:333] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.096302 20199 raft_consensus.cc:2243] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.096776 20199 raft_consensus.cc:2272] T 2c5c61e32aa44d4b98de3c7d9989ad1e P b77b8fd4718148d2abca289a48b3484d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.099164 20199 tablet_replica.cc:333] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.099797 20199 raft_consensus.cc:2243] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.100833 20199 raft_consensus.cc:2272] T b3efce368da5484ab52396041505ba81 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.103124 20199 tablet_replica.cc:333] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.103715 20199 raft_consensus.cc:2243] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.104698 20199 raft_consensus.cc:2272] T 8821a78b96a34e91885742aa8950c01e P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.107025 20199 tablet_replica.cc:333] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.107604 20199 raft_consensus.cc:2243] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.108554 20199 raft_consensus.cc:2272] T b49422ced0124424a55fc048aa49ce54 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.110682 20199 tablet_replica.cc:333] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.111250 20199 raft_consensus.cc:2243] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.111873 20199 raft_consensus.cc:2272] T 8c503a3a95004a5b9edf4a9b99b9f755 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.114025 20199 tablet_replica.cc:333] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.114502 20199 raft_consensus.cc:2243] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.114982 20199 raft_consensus.cc:2272] T 2e6e51ed41a54d26a9c3ad782695a1e6 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.117136 20199 tablet_replica.cc:333] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.117578 20199 raft_consensus.cc:2243] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.118451 20199 raft_consensus.cc:2272] T 8a343013437d4f43b64baeb8d987c739 P b77b8fd4718148d2abca289a48b3484d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.120550 20199 tablet_replica.cc:333] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.120997 20199 raft_consensus.cc:2243] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.121474 20199 raft_consensus.cc:2272] T e6ca6305ffaf4563bfb34beab3943103 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.123617 20199 tablet_replica.cc:333] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d: stopping tablet replica
I20260709 13:15:16.124073 20199 raft_consensus.cc:2243] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.124629 20199 raft_consensus.cc:2272] T 331e5384a15c41e4a512e0988f37eb86 P b77b8fd4718148d2abca289a48b3484d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.190129 20199 tablet_server.cc:196] TabletServer@127.19.185.195:0 shutdown complete.
I20260709 13:15:16.231178 20199 master.cc:562] Master@127.19.185.254:41371 shutting down...
I20260709 13:15:16.255926 20199 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.256719 20199 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.257095 20199 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6522952009304476864e1c0895f9f623: stopping tablet replica
I20260709 13:15:16.278611 20199 master.cc:584] Master@127.19.185.254:41371 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13562 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:15:16.336346 20199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.185.254:33015
I20260709 13:15:16.337566 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:16.343452   333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.345494   334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:16.345817 20199 server_base.cc:1061] running on GCE node
W20260709 13:15:16.346020   336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:16.347095 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:16.347293 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:16.347501 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602916347469 us; error 0 us; skew 500 ppm
I20260709 13:15:16.348114 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:16.350600 20199 webserver.cc:533] Webserver started at http://127.19.185.254:45517/ using document root <none> and password file <none>
I20260709 13:15:16.351179 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:16.351421 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:16.351730 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:16.353013 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/master-0-root/instance:
uuid: "3dffefd4e9ac4723a59703d3f8129f73"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-rrf3"
I20260709 13:15:16.358124 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:16.361804   341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.362756 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:15:16.363025 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/master-0-root
uuid: "3dffefd4e9ac4723a59703d3f8129f73"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-rrf3"
I20260709 13:15:16.363277 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:16.374431 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:16.375615 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:16.414731 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.254:33015
I20260709 13:15:16.414846   392 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.254:33015 every 8 connection(s)
I20260709 13:15:16.419209   393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:16.434260   393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73: Bootstrap starting.
I20260709 13:15:16.439427   393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.443964   393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73: No bootstrap required, opened a new log
I20260709 13:15:16.446420   393 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dffefd4e9ac4723a59703d3f8129f73" member_type: VOTER }
I20260709 13:15:16.446872   393 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.447132   393 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dffefd4e9ac4723a59703d3f8129f73, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.447781   393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dffefd4e9ac4723a59703d3f8129f73" member_type: VOTER }
I20260709 13:15:16.448336   393 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:16.448565   393 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:16.448859   393 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.453768   393 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dffefd4e9ac4723a59703d3f8129f73" member_type: VOTER }
I20260709 13:15:16.454325   393 leader_election.cc:304] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3dffefd4e9ac4723a59703d3f8129f73; no voters: 
I20260709 13:15:16.455472   393 leader_election.cc:290] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:16.455953   396 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.457388   396 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 1 LEADER]: Becoming Leader. State: Replica: 3dffefd4e9ac4723a59703d3f8129f73, State: Running, Role: LEADER
I20260709 13:15:16.458127   396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dffefd4e9ac4723a59703d3f8129f73" member_type: VOTER }
I20260709 13:15:16.458559   393 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:16.464426   397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3dffefd4e9ac4723a59703d3f8129f73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dffefd4e9ac4723a59703d3f8129f73" member_type: VOTER } }
I20260709 13:15:16.464541   398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dffefd4e9ac4723a59703d3f8129f73. Latest consensus state: current_term: 1 leader_uuid: "3dffefd4e9ac4723a59703d3f8129f73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dffefd4e9ac4723a59703d3f8129f73" member_type: VOTER } }
I20260709 13:15:16.465337   397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:16.465358   398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:16.467586   404 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:16.472993   404 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:16.476020 20199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:16.483695   404 catalog_manager.cc:1383] Generated new cluster ID: 9b5a535cf8bb443294d0e6ebcc37c9cb
I20260709 13:15:16.484102   404 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:16.511528   404 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:16.512920   404 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:16.537369   404 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73: Generated new TSK 0
I20260709 13:15:16.538234   404 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:16.547355 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:16.553915   414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.554982   415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:16.556655 20199 server_base.cc:1061] running on GCE node
W20260709 13:15:16.556785   417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:16.557884 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:16.558113 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:16.558280 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602916558259 us; error 0 us; skew 500 ppm
I20260709 13:15:16.558780 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:16.561244 20199 webserver.cc:533] Webserver started at http://127.19.185.193:39047/ using document root <none> and password file <none>
I20260709 13:15:16.561731 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:16.561955 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:16.562222 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:16.563429 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-0-root/instance:
uuid: "8401cbff669c4f0aadd7a578c869071d"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-rrf3"
I20260709 13:15:16.567894 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:15:16.571420   422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.572283 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:15:16.572580 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-0-root
uuid: "8401cbff669c4f0aadd7a578c869071d"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-rrf3"
I20260709 13:15:16.572940 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:16.582828 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:16.584103 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:16.585615 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:16.588373 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:16.588591 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.588877 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:16.589069 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.631771 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.193:45751
I20260709 13:15:16.631924   485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.193:45751 every 8 connection(s)
I20260709 13:15:16.637070 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:16.647104   491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.647459   490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.648290   493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:16.649660 20199 server_base.cc:1061] running on GCE node
I20260709 13:15:16.651391   486 heartbeater.cc:344] Connected to a master server at 127.19.185.254:33015
I20260709 13:15:16.651780 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:16.651849   486 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:16.652174 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:16.652412 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602916652399 us; error 0 us; skew 500 ppm
I20260709 13:15:16.653021 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:16.653049   486 heartbeater.cc:507] Master 127.19.185.254:33015 requested a full tablet report, sending...
I20260709 13:15:16.655655   358 ts_manager.cc:194] Registered new tserver with Master: 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751)
I20260709 13:15:16.655848 20199 webserver.cc:533] Webserver started at http://127.19.185.194:33707/ using document root <none> and password file <none>
I20260709 13:15:16.656623 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:16.656867 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:16.657200 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:16.658316   358 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41016
I20260709 13:15:16.658814 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-1-root/instance:
uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-rrf3"
I20260709 13:15:16.663923 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.005s
I20260709 13:15:16.668020   498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.668926 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:16.669207 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-1-root
uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-rrf3"
I20260709 13:15:16.669523 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:16.701217 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:16.702435 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:16.703873 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:16.706207 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:16.706385 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.706688 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:16.706826 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.747475 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.194:35341
I20260709 13:15:16.747628   560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.194:35341 every 8 connection(s)
I20260709 13:15:16.753069 20199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:16.760757   564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.762769   565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.763999   567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:16.765090 20199 server_base.cc:1061] running on GCE node
I20260709 13:15:16.766065   561 heartbeater.cc:344] Connected to a master server at 127.19.185.254:33015
I20260709 13:15:16.766273 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:16.766490   561 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:16.766597 20199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:16.766999 20199 hybrid_clock.cc:648] HybridClock initialized: now 1783602916766978 us; error 0 us; skew 500 ppm
I20260709 13:15:16.767510   561 heartbeater.cc:507] Master 127.19.185.254:33015 requested a full tablet report, sending...
I20260709 13:15:16.767612 20199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:16.770136   358 ts_manager.cc:194] Registered new tserver with Master: ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:16.770663 20199 webserver.cc:533] Webserver started at http://127.19.185.195:46813/ using document root <none> and password file <none>
I20260709 13:15:16.771294 20199 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:16.771504 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:16.771788 20199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:16.771955   358 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41024
I20260709 13:15:16.773151 20199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-2-root/instance:
uuid: "c647018786ba4aaab442af0ecb85bf8b"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-rrf3"
I20260709 13:15:16.778398 20199 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:16.782196   572 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.783186 20199 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:16.783460 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-2-root
uuid: "c647018786ba4aaab442af0ecb85bf8b"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-rrf3"
I20260709 13:15:16.783704 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskM59xEa/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602552983791-20199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:16.801345 20199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:16.802553 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:16.804008 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:16.806407 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:16.806589 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.806900 20199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:16.807040 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.851229 20199 rpc_server.cc:307] RPC server started. Bound to: 127.19.185.195:37023
I20260709 13:15:16.851356   634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.185.195:37023 every 8 connection(s)
I20260709 13:15:16.866801   635 heartbeater.cc:344] Connected to a master server at 127.19.185.254:33015
I20260709 13:15:16.867300   635 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:16.868127   635 heartbeater.cc:507] Master 127.19.185.254:33015 requested a full tablet report, sending...
I20260709 13:15:16.870335   358 ts_manager.cc:194] Registered new tserver with Master: c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:16.870611 20199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01621066s
I20260709 13:15:16.871832   358 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41036
I20260709 13:15:16.898037   358 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41044:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:16.901101   358 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:16.989995   450 tablet_service.cc:1511] Processing CreateTablet for tablet 23de4d8703a5498b83b5da1bf5d43947 (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:16.991639   450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23de4d8703a5498b83b5da1bf5d43947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:16.991907   451 tablet_service.cc:1511] Processing CreateTablet for tablet 46f8f02a74ab4efeaec20d91e7df966f (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:16.993515   451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f8f02a74ab4efeaec20d91e7df966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:16.993192   449 tablet_service.cc:1511] Processing CreateTablet for tablet a9e0d7485dbc42fa9b7c0b079cdcafa6 (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:16.996088   448 tablet_service.cc:1511] Processing CreateTablet for tablet 2206ebf713e44aaaa069f47f2dbcc16a (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:16.996676   447 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa8767ccb014f8da9cf39124d6baa3b (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:16.997571   449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e0d7485dbc42fa9b7c0b079cdcafa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:16.998467   447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa8767ccb014f8da9cf39124d6baa3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:16.999073   448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2206ebf713e44aaaa069f47f2dbcc16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.003722   446 tablet_service.cc:1511] Processing CreateTablet for tablet 19bba5a817824115ac39420b80ce3d2c (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:17.005321   446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bba5a817824115ac39420b80ce3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.009570   445 tablet_service.cc:1511] Processing CreateTablet for tablet 253f3b376f5f4372a4d9f75435f774ee (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:17.011143   445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f3b376f5f4372a4d9f75435f774ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.019210   444 tablet_service.cc:1511] Processing CreateTablet for tablet e48ac6a679ec4494a534631f5a777cef (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:17.021394   444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48ac6a679ec4494a534631f5a777cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.041885   599 tablet_service.cc:1511] Processing CreateTablet for tablet 23de4d8703a5498b83b5da1bf5d43947 (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:17.042698   525 tablet_service.cc:1511] Processing CreateTablet for tablet 23de4d8703a5498b83b5da1bf5d43947 (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:17.043481   599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23de4d8703a5498b83b5da1bf5d43947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.043766   600 tablet_service.cc:1511] Processing CreateTablet for tablet 46f8f02a74ab4efeaec20d91e7df966f (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:17.044250   525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23de4d8703a5498b83b5da1bf5d43947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.045261   600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f8f02a74ab4efeaec20d91e7df966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.045303   598 tablet_service.cc:1511] Processing CreateTablet for tablet a9e0d7485dbc42fa9b7c0b079cdcafa6 (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:17.046847   598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e0d7485dbc42fa9b7c0b079cdcafa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.047382   526 tablet_service.cc:1511] Processing CreateTablet for tablet 46f8f02a74ab4efeaec20d91e7df966f (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:17.048758   526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f8f02a74ab4efeaec20d91e7df966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.049260   597 tablet_service.cc:1511] Processing CreateTablet for tablet 2206ebf713e44aaaa069f47f2dbcc16a (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:17.050043   524 tablet_service.cc:1511] Processing CreateTablet for tablet a9e0d7485dbc42fa9b7c0b079cdcafa6 (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:17.050711   597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2206ebf713e44aaaa069f47f2dbcc16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.051456   524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e0d7485dbc42fa9b7c0b079cdcafa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.053534   594 tablet_service.cc:1511] Processing CreateTablet for tablet 253f3b376f5f4372a4d9f75435f774ee (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:17.054132   593 tablet_service.cc:1511] Processing CreateTablet for tablet e48ac6a679ec4494a534631f5a777cef (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:17.054471   596 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa8767ccb014f8da9cf39124d6baa3b (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:17.054958   594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f3b376f5f4372a4d9f75435f774ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.055878   596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa8767ccb014f8da9cf39124d6baa3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.056854   592 tablet_service.cc:1511] Processing CreateTablet for tablet ea28a0a6193647dd925a91ca3d876dbf (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:17.057019   595 tablet_service.cc:1511] Processing CreateTablet for tablet 19bba5a817824115ac39420b80ce3d2c (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:17.057796   444 tablet_service.cc:1511] Processing CreateTablet for tablet ea28a0a6193647dd925a91ca3d876dbf (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:17.058558   592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea28a0a6193647dd925a91ca3d876dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.059019   444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea28a0a6193647dd925a91ca3d876dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.059368   595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bba5a817824115ac39420b80ce3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.060164   593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48ac6a679ec4494a534631f5a777cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.063476   523 tablet_service.cc:1511] Processing CreateTablet for tablet 2206ebf713e44aaaa069f47f2dbcc16a (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:17.064949   523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2206ebf713e44aaaa069f47f2dbcc16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.067314   522 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa8767ccb014f8da9cf39124d6baa3b (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:17.068840   522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa8767ccb014f8da9cf39124d6baa3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.072723   521 tablet_service.cc:1511] Processing CreateTablet for tablet 19bba5a817824115ac39420b80ce3d2c (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:17.077206   518 tablet_service.cc:1511] Processing CreateTablet for tablet ea28a0a6193647dd925a91ca3d876dbf (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:17.077514   519 tablet_service.cc:1511] Processing CreateTablet for tablet e48ac6a679ec4494a534631f5a777cef (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:17.079685   520 tablet_service.cc:1511] Processing CreateTablet for tablet 253f3b376f5f4372a4d9f75435f774ee (DEFAULT_TABLE table=test-workload [id=4868f661d2324dc98f23aafe31afad6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:17.074437   521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bba5a817824115ac39420b80ce3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.083233   520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f3b376f5f4372a4d9f75435f774ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.084568   518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea28a0a6193647dd925a91ca3d876dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.096397   519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48ac6a679ec4494a534631f5a777cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.125188   651 tablet_bootstrap.cc:492] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.130036   650 tablet_bootstrap.cc:492] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.141225   650 tablet_bootstrap.cc:654] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.153510   651 tablet_bootstrap.cc:654] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.195254   650 tablet_bootstrap.cc:492] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.195796   650 ts_tablet_manager.cc:1403] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.031s
I20260709 13:15:17.198899   650 raft_consensus.cc:359] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.199666   650 raft_consensus.cc:385] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.199991   650 raft_consensus.cc:740] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.200806   650 consensus_queue.cc:260] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.212927   653 tablet_bootstrap.cc:492] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.227701   651 tablet_bootstrap.cc:492] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.228387   651 ts_tablet_manager.cc:1403] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.013s
I20260709 13:15:17.231287   653 tablet_bootstrap.cc:654] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.231725   651 raft_consensus.cc:359] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.232584   651 raft_consensus.cc:385] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.232887   651 raft_consensus.cc:740] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.233680   651 consensus_queue.cc:260] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.236224   486 heartbeater.cc:499] Master 127.19.185.254:33015 was elected leader, sending a full tablet report...
I20260709 13:15:17.236687   650 ts_tablet_manager.cc:1434] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.041s	user 0.023s	sys 0.007s
I20260709 13:15:17.237774   650 tablet_bootstrap.cc:492] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.238696   653 tablet_bootstrap.cc:492] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.239485   653 ts_tablet_manager.cc:1403] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.002s
I20260709 13:15:17.241585   635 heartbeater.cc:499] Master 127.19.185.254:33015 was elected leader, sending a full tablet report...
I20260709 13:15:17.242007   651 ts_tablet_manager.cc:1434] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.007s
I20260709 13:15:17.243108   651 tablet_bootstrap.cc:492] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.244549   650 tablet_bootstrap.cc:654] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.251150   651 tablet_bootstrap.cc:654] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.255818   653 raft_consensus.cc:359] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.256700   653 raft_consensus.cc:385] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.257041   653 raft_consensus.cc:740] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.257305   651 tablet_bootstrap.cc:492] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.257498   650 tablet_bootstrap.cc:492] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.257902   651 ts_tablet_manager.cc:1403] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:15:17.258059   650 ts_tablet_manager.cc:1403] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:15:17.257946   653 consensus_queue.cc:260] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.261488   651 raft_consensus.cc:359] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.262295   651 raft_consensus.cc:385] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.262136   650 raft_consensus.cc:359] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.262919   651 raft_consensus.cc:740] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.263507   650 raft_consensus.cc:385] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.263950   650 raft_consensus.cc:740] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.264235   651 consensus_queue.cc:260] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.265272   650 consensus_queue.cc:260] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.266922   651 ts_tablet_manager.cc:1434] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:17.267021   657 raft_consensus.cc:493] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.267675   657 raft_consensus.cc:515] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.268147   651 tablet_bootstrap.cc:492] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.268736   650 ts_tablet_manager.cc:1434] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:15:17.269795   650 tablet_bootstrap.cc:492] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.276640   650 tablet_bootstrap.cc:654] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.277397   651 tablet_bootstrap.cc:654] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.287566   657 leader_election.cc:290] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:17.289184   650 tablet_bootstrap.cc:492] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.289531   651 tablet_bootstrap.cc:492] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.289996   650 ts_tablet_manager.cc:1403] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 13:15:17.290100   651 ts_tablet_manager.cc:1403] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.001s
I20260709 13:15:17.293175   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.293962   651 raft_consensus.cc:359] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.295027   651 raft_consensus.cc:385] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:17.295387   576 leader_election.cc:343] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.295396   651 raft_consensus.cc:740] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.295810   653 ts_tablet_manager.cc:1434] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.008s
I20260709 13:15:17.297117   561 heartbeater.cc:499] Master 127.19.185.254:33015 was elected leader, sending a full tablet report...
I20260709 13:15:17.296676   651 consensus_queue.cc:260] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.299326   651 ts_tablet_manager.cc:1434] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:15:17.300485   651 tablet_bootstrap.cc:492] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.297189   653 tablet_bootstrap.cc:492] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.309950   653 tablet_bootstrap.cc:654] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.311991   651 tablet_bootstrap.cc:654] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.312223   650 raft_consensus.cc:359] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.313093   650 raft_consensus.cc:385] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.313433   650 raft_consensus.cc:740] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.313683   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:17.314410   650 consensus_queue.cc:260] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
W20260709 13:15:17.315447   573 leader_election.cc:343] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.315999   573 leader_election.cc:304] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c647018786ba4aaab442af0ecb85bf8b; no voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:17.317252   650 ts_tablet_manager.cc:1434] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:15:17.317642   657 raft_consensus.cc:2749] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.318617   657 raft_consensus.cc:493] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.318800   650 tablet_bootstrap.cc:492] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.319124   657 raft_consensus.cc:515] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.323813   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
W20260709 13:15:17.325486   576 leader_election.cc:343] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.328342   650 tablet_bootstrap.cc:654] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.328253   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
W20260709 13:15:17.330255   573 leader_election.cc:343] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.326648   657 leader_election.cc:290] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:17.330734   653 tablet_bootstrap.cc:492] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.330772   573 leader_election.cc:304] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c647018786ba4aaab442af0ecb85bf8b; no voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:17.331503   653 ts_tablet_manager.cc:1403] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.011s
I20260709 13:15:17.332463   657 raft_consensus.cc:2749] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.334822   653 raft_consensus.cc:359] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.335757   653 raft_consensus.cc:385] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.336095   653 raft_consensus.cc:740] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.337121   653 consensus_queue.cc:260] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.339354   653 ts_tablet_manager.cc:1434] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:17.340476   653 tablet_bootstrap.cc:492] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.347301   653 tablet_bootstrap.cc:654] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.353547   651 tablet_bootstrap.cc:492] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.354140   651 ts_tablet_manager.cc:1403] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.054s	user 0.034s	sys 0.005s
W20260709 13:15:17.355599   636 tablet.cc:2406] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:17.356056   650 tablet_bootstrap.cc:492] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.356359   653 tablet_bootstrap.cc:492] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.356593   650 ts_tablet_manager.cc:1403] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.015s
I20260709 13:15:17.357028   653 ts_tablet_manager.cc:1403] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.007s
I20260709 13:15:17.357379   651 raft_consensus.cc:359] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.358235   651 raft_consensus.cc:385] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.358539   651 raft_consensus.cc:740] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.359454   650 raft_consensus.cc:359] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.359508   651 consensus_queue.cc:260] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.360327   650 raft_consensus.cc:385] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.360308   653 raft_consensus.cc:359] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.361230   653 raft_consensus.cc:385] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.360956   650 raft_consensus.cc:740] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.361565   653 raft_consensus.cc:740] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.362212   651 ts_tablet_manager.cc:1434] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:17.362737   653 consensus_queue.cc:260] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.362484   650 consensus_queue.cc:260] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.363374   655 raft_consensus.cc:493] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.364048   655 raft_consensus.cc:515] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.367580   655 leader_election.cc:290] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.377732   653 ts_tablet_manager.cc:1434] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:15:17.363401   651 tablet_bootstrap.cc:492] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.392745   653 tablet_bootstrap.cc:492] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.394034   651 tablet_bootstrap.cc:654] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.402002   650 ts_tablet_manager.cc:1434] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.045s	user 0.022s	sys 0.020s
I20260709 13:15:17.403631   650 tablet_bootstrap.cc:492] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.405361   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48ac6a679ec4494a534631f5a777cef" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:17.405625   653 tablet_bootstrap.cc:654] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.408357   668 raft_consensus.cc:493] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:17.408407   423 leader_election.cc:343] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.409082   668 raft_consensus.cc:515] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.411285   650 tablet_bootstrap.cc:654] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.412599   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
W20260709 13:15:17.414225   423 leader_election.cc:343] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.417006   668 leader_election.cc:290] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.417145   651 tablet_bootstrap.cc:492] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.418109   651 ts_tablet_manager.cc:1403] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.004s
I20260709 13:15:17.422341   653 tablet_bootstrap.cc:492] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.422104   651 raft_consensus.cc:359] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.422956   653 ts_tablet_manager.cc:1403] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.005s
I20260709 13:15:17.422946   651 raft_consensus.cc:385] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.423566   651 raft_consensus.cc:740] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.423978   650 tablet_bootstrap.cc:492] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.424608   650 ts_tablet_manager.cc:1403] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:15:17.424849   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.424641   651 consensus_queue.cc:260] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.426389   653 raft_consensus.cc:359] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.427173   653 raft_consensus.cc:385] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.427479   653 raft_consensus.cc:740] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
W20260709 13:15:17.427565   424 leader_election.cc:343] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.428108   424 leader_election.cc:304] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d; no voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:17.428282   651 ts_tablet_manager.cc:1434] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:15:17.423827   610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48ac6a679ec4494a534631f5a777cef" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.428414   650 raft_consensus.cc:359] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.428543   653 consensus_queue.cc:260] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.429774   650 raft_consensus.cc:385] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.430186   650 raft_consensus.cc:740] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.430269   668 raft_consensus.cc:2749] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.431281   650 consensus_queue.cc:260] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.431676   653 ts_tablet_manager.cc:1434] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:15:17.432077   651 tablet_bootstrap.cc:492] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.433063   653 tablet_bootstrap.cc:492] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.433791   650 ts_tablet_manager.cc:1434] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:17.434916   650 tablet_bootstrap.cc:492] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.439991   651 tablet_bootstrap.cc:654] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.441834   650 tablet_bootstrap.cc:654] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.443697   653 tablet_bootstrap.cc:654] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:17.430181   424 leader_election.cc:343] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.448803   424 leader_election.cc:304] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d; no voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:17.449586   668 raft_consensus.cc:2749] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.455576   653 tablet_bootstrap.cc:492] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.456219   653 ts_tablet_manager.cc:1403] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.002s
I20260709 13:15:17.459190   653 raft_consensus.cc:359] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.459955   653 raft_consensus.cc:385] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.461587   653 raft_consensus.cc:740] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.462483   653 consensus_queue.cc:260] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.463891   650 tablet_bootstrap.cc:492] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.464815   650 ts_tablet_manager.cc:1403] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260709 13:15:17.465314   653 ts_tablet_manager.cc:1434] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:17.466464   653 tablet_bootstrap.cc:492] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.469390   650 raft_consensus.cc:359] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.470546   650 raft_consensus.cc:385] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:17.470768   406 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:17.471040   650 raft_consensus.cc:740] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.472587   650 consensus_queue.cc:260] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.475962   650 ts_tablet_manager.cc:1434] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:17.477571   650 tablet_bootstrap.cc:492] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.477739   653 tablet_bootstrap.cc:654] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.487717   650 tablet_bootstrap.cc:654] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.500975   650 tablet_bootstrap.cc:492] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.501803   650 ts_tablet_manager.cc:1403] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.012s
I20260709 13:15:17.505041   650 raft_consensus.cc:359] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.505642   650 raft_consensus.cc:385] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.505913   650 raft_consensus.cc:740] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.506855   653 tablet_bootstrap.cc:492] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.506688   650 consensus_queue.cc:260] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.507391   653 ts_tablet_manager.cc:1403] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.041s	user 0.027s	sys 0.007s
I20260709 13:15:17.507542   651 tablet_bootstrap.cc:492] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.508380   651 ts_tablet_manager.cc:1403] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.077s	user 0.044s	sys 0.027s
I20260709 13:15:17.509182   650 ts_tablet_manager.cc:1434] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:15:17.510309   650 tablet_bootstrap.cc:492] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.510915   653 raft_consensus.cc:359] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.511687   653 raft_consensus.cc:385] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.511656   651 raft_consensus.cc:359] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.512279   653 raft_consensus.cc:740] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.512749   651 raft_consensus.cc:385] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.513146   651 raft_consensus.cc:740] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.513383   653 consensus_queue.cc:260] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.514129   651 consensus_queue.cc:260] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.516113   653 ts_tablet_manager.cc:1434] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:17.517012   651 ts_tablet_manager.cc:1434] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:17.517222   653 tablet_bootstrap.cc:492] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.517601   650 tablet_bootstrap.cc:654] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.518282   651 tablet_bootstrap.cc:492] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.524168   653 tablet_bootstrap.cc:654] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.524657   660 raft_consensus.cc:493] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.525206   660 raft_consensus.cc:515] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.541126   660 leader_election.cc:290] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.542047   660 raft_consensus.cc:493] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.542557   660 raft_consensus.cc:515] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.544821   660 leader_election.cc:290] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.553530   651 tablet_bootstrap.cc:654] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.561648   650 tablet_bootstrap.cc:492] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.562358   650 ts_tablet_manager.cc:1403] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.025s
I20260709 13:15:17.564407   653 tablet_bootstrap.cc:492] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.564682   651 tablet_bootstrap.cc:492] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.565244   651 ts_tablet_manager.cc:1403] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.009s
I20260709 13:15:17.565032   650 raft_consensus.cc:359] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.565861   650 raft_consensus.cc:385] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.566175   650 raft_consensus.cc:740] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.565042   653 ts_tablet_manager.cc:1403] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.020s
I20260709 13:15:17.568761   651 raft_consensus.cc:359] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.569530   651 raft_consensus.cc:385] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.569944   651 raft_consensus.cc:740] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.569852   650 consensus_queue.cc:260] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.569983   653 raft_consensus.cc:359] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.570911   651 consensus_queue.cc:260] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.574435   653 raft_consensus.cc:385] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.575146   650 ts_tablet_manager.cc:1434] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:15:17.576478   650 tablet_bootstrap.cc:492] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:17.577816   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de4d8703a5498b83b5da1bf5d43947" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.578315   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea28a0a6193647dd925a91ca3d876dbf" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.578645   461 raft_consensus.cc:2468] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.579607   657 raft_consensus.cc:493] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.580348   657 raft_consensus.cc:515] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
W20260709 13:15:17.581072   502 leader_election.cc:343] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.581823   502 leader_election.cc:304] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.582504   650 tablet_bootstrap.cc:654] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.582765   660 raft_consensus.cc:2804] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.579737   680 raft_consensus.cc:493] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.583266   660 raft_consensus.cc:493] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.583673   660 raft_consensus.cc:3060] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.583472   680 raft_consensus.cc:515] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.586184   680 leader_election.cc:290] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.587338   657 leader_election.cc:290] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:17.588016   651 ts_tablet_manager.cc:1434] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:15:17.589215   651 tablet_bootstrap.cc:492] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.589394   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f3b376f5f4372a4d9f75435f774ee" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:17.590163   536 raft_consensus.cc:2468] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:17.591717   573 leader_election.cc:304] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:17.592708   657 raft_consensus.cc:2804] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.592772   680 raft_consensus.cc:493] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.593103   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f3b376f5f4372a4d9f75435f774ee" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.593441   680 raft_consensus.cc:515] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.593878   461 raft_consensus.cc:2468] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:17.595758   651 tablet_bootstrap.cc:654] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.596350   680 leader_election.cc:290] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.574816   653 raft_consensus.cc:740] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.597690   660 raft_consensus.cc:515] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.598750   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea28a0a6193647dd925a91ca3d876dbf" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.599450   609 raft_consensus.cc:2468] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.593228   657 raft_consensus.cc:493] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.600509   657 raft_consensus.cc:3060] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.600553   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.601354   607 raft_consensus.cc:2468] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.600841   653 consensus_queue.cc:260] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.602576   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48ac6a679ec4494a534631f5a777cef" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.597993   610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de4d8703a5498b83b5da1bf5d43947" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.604336   680 raft_consensus.cc:493] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.604410   610 raft_consensus.cc:2468] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.605389   500 leader_election.cc:304] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 8401cbff669c4f0aadd7a578c869071d
I20260709 13:15:17.606175   680 raft_consensus.cc:515] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.605675   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de4d8703a5498b83b5da1bf5d43947" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:17.608511   609 raft_consensus.cc:3060] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.613426   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de4d8703a5498b83b5da1bf5d43947" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:17.614214   459 raft_consensus.cc:3060] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.614737   680 leader_election.cc:290] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.615681   660 leader_election.cc:290] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.617218   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.617549   660 raft_consensus.cc:2804] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.618000   458 raft_consensus.cc:2468] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.618101   660 raft_consensus.cc:493] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.618685   660 raft_consensus.cc:3060] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.619159   502 leader_election.cc:304] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.619432   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48ac6a679ec4494a534631f5a777cef" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.620116   460 raft_consensus.cc:2468] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.621407   680 raft_consensus.cc:2804] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.621706   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.621915   680 raft_consensus.cc:493] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.622421   461 raft_consensus.cc:2468] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.622403   680 raft_consensus.cc:3060] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.627951   502 leader_election.cc:304] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.629010   502 leader_election.cc:304] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.639703   680 raft_consensus.cc:515] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.643469   650 tablet_bootstrap.cc:492] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:17.643765   680 leader_election.cc:290] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.644187   650 ts_tablet_manager.cc:1403] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.016s
I20260709 13:15:17.643990   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:17.644757   461 raft_consensus.cc:3060] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.645403   459 raft_consensus.cc:2468] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.646428   660 raft_consensus.cc:515] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.647339   650 raft_consensus.cc:359] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.647840   609 raft_consensus.cc:2468] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.648137   650 raft_consensus.cc:385] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.648598   650 raft_consensus.cc:740] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.650777   650 consensus_queue.cc:260] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.659904   660 leader_election.cc:290] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.661172   660 raft_consensus.cc:2804] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.662246   502 leader_election.cc:304] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.644757   680 raft_consensus.cc:2804] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.669344   650 ts_tablet_manager.cc:1434] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:15:17.613413   657 raft_consensus.cc:515] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
W20260709 13:15:17.670451   500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.195:37023, user_credentials={real_user=slave}} blocked reactor thread for 65339.8us
I20260709 13:15:17.671773   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea28a0a6193647dd925a91ca3d876dbf" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:17.672473   459 raft_consensus.cc:3060] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.672782   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.673486   609 raft_consensus.cc:2468] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.675119   657 leader_election.cc:290] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:17.675278   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f3b376f5f4372a4d9f75435f774ee" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:17.661754   660 raft_consensus.cc:493] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.675616   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f3b376f5f4372a4d9f75435f774ee" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:17.675918   536 raft_consensus.cc:3060] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.676220   660 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.676340   460 raft_consensus.cc:3060] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.680229   668 raft_consensus.cc:493] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.680871   668 raft_consensus.cc:515] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.684170   536 raft_consensus.cc:2468] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:17.684497   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2206ebf713e44aaaa069f47f2dbcc16a" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.685269   609 raft_consensus.cc:2468] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 0.
I20260709 13:15:17.685787   573 leader_election.cc:304] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:17.684170   660 raft_consensus.cc:515] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.686523   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2206ebf713e44aaaa069f47f2dbcc16a" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:17.686972   657 raft_consensus.cc:2804] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.684641   668 leader_election.cc:290] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.689308   660 leader_election.cc:290] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
W20260709 13:15:17.689675   423 leader_election.cc:343] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.690231   460 raft_consensus.cc:2468] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:17.690367   424 leader_election.cc:304] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: ad42ff365b014966b5eb1bf65a86c7f5
W20260709 13:15:17.696370   500 leader_election.cc:343] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.696436   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea28a0a6193647dd925a91ca3d876dbf" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:17.696945   688 raft_consensus.cc:2804] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.697494   607 raft_consensus.cc:3060] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.697620   688 raft_consensus.cc:697] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:17.698679   688 consensus_queue.cc:237] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.699510   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:17.687556   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:17.700188   608 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.700354   609 raft_consensus.cc:3060] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.704289   668 raft_consensus.cc:2804] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.704945   668 raft_consensus.cc:493] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.705338   668 raft_consensus.cc:3060] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.670039   680 raft_consensus.cc:493] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.709553   461 raft_consensus.cc:2468] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.712620   608 raft_consensus.cc:2468] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.712991   502 leader_election.cc:304] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.714949   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:17.715919   460 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.711557   680 raft_consensus.cc:3060] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.717638   687 raft_consensus.cc:2804] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.718518   687 raft_consensus.cc:697] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:17.720395   687 consensus_queue.cc:237] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.720662   459 raft_consensus.cc:2468] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.721230   653 ts_tablet_manager.cc:1434] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.154s	user 0.027s	sys 0.024s
I20260709 13:15:17.722524   653 tablet_bootstrap.cc:492] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.729524   500 leader_election.cc:304] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:17.734292   657 raft_consensus.cc:697] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:17.734354   655 raft_consensus.cc:493] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.733810   660 raft_consensus.cc:2804] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.725584   502 leader_election.cc:304] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.744239   680 raft_consensus.cc:515] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.745564   688 raft_consensus.cc:2804] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.746140   688 raft_consensus.cc:697] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:17.746850   609 raft_consensus.cc:2468] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.747372   688 consensus_queue.cc:237] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.741868   653 tablet_bootstrap.cc:654] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.736222   655 raft_consensus.cc:515] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.751966   651 tablet_bootstrap.cc:492] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.752568   651 ts_tablet_manager.cc:1403] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.164s	user 0.031s	sys 0.054s
I20260709 13:15:17.753983   680 leader_election.cc:290] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.755048   655 leader_election.cc:290] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.749686   668 raft_consensus.cc:515] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.755453   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48ac6a679ec4494a534631f5a777cef" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:17.752610   660 raft_consensus.cc:697] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:17.759265   460 raft_consensus.cc:2468] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.759214   660 consensus_queue.cc:237] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.760799   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.761534   608 raft_consensus.cc:2468] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 0.
I20260709 13:15:17.763336   424 leader_election.cc:304] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:17.756727   607 raft_consensus.cc:2468] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.764690   655 raft_consensus.cc:2804] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.753562   657 consensus_queue.cc:237] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.767069   655 raft_consensus.cc:493] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.767563   655 raft_consensus.cc:3060] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.767455   356 catalog_manager.cc:5697] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.774873   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48ac6a679ec4494a534631f5a777cef" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:17.775949   460 raft_consensus.cc:3060] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:17.777164   500 leader_election.cc:343] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.780174   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:17.780452   668 leader_election.cc:290] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.780542   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2206ebf713e44aaaa069f47f2dbcc16a" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:17.781417   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2206ebf713e44aaaa069f47f2dbcc16a" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
W20260709 13:15:17.781566   423 leader_election.cc:343] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:17.782647   423 leader_election.cc:343] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.783300   609 raft_consensus.cc:3060] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.777994   651 raft_consensus.cc:359] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.784603   651 raft_consensus.cc:385] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.782994   655 raft_consensus.cc:515] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.785462   651 raft_consensus.cc:740] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.787161   651 consensus_queue.cc:260] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.796056   651 ts_tablet_manager.cc:1434] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:15:17.797523   651 tablet_bootstrap.cc:492] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:17.801290   655 leader_election.cc:290] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.801604   609 raft_consensus.cc:2468] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 1.
I20260709 13:15:17.802644   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:17.802983   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:17.805509   424 leader_election.cc:304] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: ad42ff365b014966b5eb1bf65a86c7f5
W20260709 13:15:17.805763   423 leader_election.cc:343] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.806747   655 raft_consensus.cc:2804] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.807348   655 raft_consensus.cc:697] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:17.808247   655 consensus_queue.cc:237] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.809429   460 raft_consensus.cc:2468] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.810352   651 tablet_bootstrap.cc:654] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.813566   607 raft_consensus.cc:3060] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.815742   502 leader_election.cc:304] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:17.817440   687 raft_consensus.cc:2804] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.817930   687 raft_consensus.cc:697] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:17.818750   687 consensus_queue.cc:237] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.820874   653 tablet_bootstrap.cc:492] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.821658   653 ts_tablet_manager.cc:1403] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.005s
I20260709 13:15:17.812567   357 catalog_manager.cc:5697] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 0 to 1, leader changed from <none> to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.823645   607 raft_consensus.cc:2468] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 1.
I20260709 13:15:17.825302   424 leader_election.cc:304] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:17.825735   653 raft_consensus.cc:359] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.826558   668 raft_consensus.cc:2804] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.826807   653 raft_consensus.cc:385] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.827309   653 raft_consensus.cc:740] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.829754   653 consensus_queue.cc:260] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.833514   668 raft_consensus.cc:697] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:17.834913   653 ts_tablet_manager.cc:1434] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:15:17.835850   653 tablet_bootstrap.cc:492] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:17.836761   668 consensus_queue.cc:237] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.840744   651 tablet_bootstrap.cc:492] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:17.841333   651 ts_tablet_manager.cc:1403] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:15:17.842468   358 catalog_manager.cc:5697] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 1 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.844281   651 raft_consensus.cc:359] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.845072   651 raft_consensus.cc:385] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.845330   651 raft_consensus.cc:740] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.846462   651 consensus_queue.cc:260] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.847204   653 tablet_bootstrap.cc:654] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.848649   651 ts_tablet_manager.cc:1434] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:17.869189   653 tablet_bootstrap.cc:492] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:17.869779   653 ts_tablet_manager.cc:1403] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:15:17.870301   358 catalog_manager.cc:5697] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 1 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.872679   653 raft_consensus.cc:359] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.873423   653 raft_consensus.cc:385] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.873692   653 raft_consensus.cc:740] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.874518   653 consensus_queue.cc:260] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.875209   357 catalog_manager.cc:5697] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.876718   653 ts_tablet_manager.cc:1434] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:17.877266   357 catalog_manager.cc:5697] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.878815   357 catalog_manager.cc:5697] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.880342   357 catalog_manager.cc:5697] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.914158   692 raft_consensus.cc:493] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.914727   692 raft_consensus.cc:515] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.916690   692 leader_election.cc:290] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.917508   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.917939   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.918180   460 raft_consensus.cc:2468] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.918655   607 raft_consensus.cc:2468] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 0.
I20260709 13:15:17.919292   502 leader_election.cc:304] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.920137   692 raft_consensus.cc:2804] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.920473   692 raft_consensus.cc:493] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.920687   692 raft_consensus.cc:3060] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.926052   692 raft_consensus.cc:515] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.928251   657 raft_consensus.cc:493] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.929142   657 raft_consensus.cc:515] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.930233   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:17.930609   692 leader_election.cc:290] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.930984   460 raft_consensus.cc:3060] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.930840   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:17.931939   607 raft_consensus.cc:3060] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.932631   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48ac6a679ec4494a534631f5a777cef" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.932804   657 leader_election.cc:290] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:17.932971   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48ac6a679ec4494a534631f5a777cef" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:17.933459   459 raft_consensus.cc:2393] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c647018786ba4aaab442af0ecb85bf8b in current term 1: Already voted for candidate ad42ff365b014966b5eb1bf65a86c7f5 in this term.
I20260709 13:15:17.934800   576 leader_election.cc:304] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c647018786ba4aaab442af0ecb85bf8b; no voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:17.935667   657 raft_consensus.cc:3060] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.938145   460 raft_consensus.cc:2468] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.939363   502 leader_election.cc:304] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:17.940090   692 raft_consensus.cc:2804] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.940522   692 raft_consensus.cc:697] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:17.940825   607 raft_consensus.cc:2468] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 1.
I20260709 13:15:17.941284   692 consensus_queue.cc:237] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.943557   657 raft_consensus.cc:2749] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.944566   687 raft_consensus.cc:493] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.945147   687 raft_consensus.cc:515] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:17.947356   687 leader_election.cc:290] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:17.948071   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2206ebf713e44aaaa069f47f2dbcc16a" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:17.948460   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2206ebf713e44aaaa069f47f2dbcc16a" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:17.949291   607 raft_consensus.cc:2393] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad42ff365b014966b5eb1bf65a86c7f5 in current term 1: Already voted for candidate 8401cbff669c4f0aadd7a578c869071d in this term.
I20260709 13:15:17.949303   357 catalog_manager.cc:5697] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 1 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.950280   500 leader_election.cc:304] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5; no voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:17.951167   687 raft_consensus.cc:3060] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.957607   687 raft_consensus.cc:2749] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.999686   687 raft_consensus.cc:493] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.000205   687 raft_consensus.cc:515] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.002310   687 leader_election.cc:290] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:18.003144   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:18.004657   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:18.005344   607 raft_consensus.cc:2393] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad42ff365b014966b5eb1bf65a86c7f5 in current term 1: Already voted for candidate 8401cbff669c4f0aadd7a578c869071d in this term.
I20260709 13:15:18.006332   500 leader_election.cc:304] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5; no voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:18.007030   687 raft_consensus.cc:3060] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.012856   687 raft_consensus.cc:2749] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:18.135087   687 consensus_queue.cc:1048] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.155241   687 consensus_queue.cc:1048] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.155764   535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
mode: GRACEFUL
new_leader_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:57478
I20260709 13:15:18.156584   535 raft_consensus.cc:606] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Received request to transfer leadership to TS 8401cbff669c4f0aadd7a578c869071d
I20260709 13:15:18.164166   535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23de4d8703a5498b83b5da1bf5d43947"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
mode: GRACEFUL
new_leader_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:57478
I20260709 13:15:18.164693   535 raft_consensus.cc:606] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Received request to transfer leadership to TS 8401cbff669c4f0aadd7a578c869071d
I20260709 13:15:18.169974   535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
mode: GRACEFUL
new_leader_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:57478
I20260709 13:15:18.170557   535 raft_consensus.cc:606] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Received request to transfer leadership to TS 8401cbff669c4f0aadd7a578c869071d
I20260709 13:15:18.188961   657 consensus_queue.cc:1048] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.190482   460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
mode: GRACEFUL
new_leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:48806
I20260709 13:15:18.191201   460 raft_consensus.cc:606] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Received request to transfer leadership to TS ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:18.201467   689 consensus_queue.cc:1048] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.202378   687 consensus_queue.cc:1048] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.215066   687 consensus_queue.cc:1048] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.231551   607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "253f3b376f5f4372a4d9f75435f774ee"
dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
mode: GRACEFUL
new_leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:52340
I20260709 13:15:18.232410   607 raft_consensus.cc:606] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Received request to transfer leadership to TS ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:18.235570   687 raft_consensus.cc:993] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5: : Instructing follower 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:18.236172   687 raft_consensus.cc:1081] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Signalling peer 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:18.237973   459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:48792
I20260709 13:15:18.238549   459 raft_consensus.cc:493] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.238902   459 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.243321   535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea28a0a6193647dd925a91ca3d876dbf"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
mode: GRACEFUL
new_leader_uuid: "c647018786ba4aaab442af0ecb85bf8b"
 from {username='slave'} at 127.0.0.1:57478
I20260709 13:15:18.244016   535 raft_consensus.cc:606] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Received request to transfer leadership to TS c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:18.245325   459 raft_consensus.cc:515] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.246622   668 consensus_queue.cc:1048] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.249799   459 leader_election.cc:290] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:18.253438   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:18.253626   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:18.256289   535 raft_consensus.cc:3055] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.256631   535 raft_consensus.cc:740] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:18.256423   609 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.257578   535 consensus_queue.cc:260] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.258690   535 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.254235   668 consensus_queue.cc:1048] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.267887   609 raft_consensus.cc:2468] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:18.270102   535 raft_consensus.cc:2468] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:18.283514   423 leader_election.cc:304] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:18.269085   692 consensus_queue.cc:1048] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:15:18.272150   668 consensus_queue.cc:1048] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:15:18.286777   724 raft_consensus.cc:2804] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.299279   660 consensus_queue.cc:1048] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.322150   688 raft_consensus.cc:993] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5: : Instructing follower 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:18.322762   687 raft_consensus.cc:1081] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Signalling peer 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:18.323755   668 consensus_queue.cc:1048] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.316733   724 raft_consensus.cc:697] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:18.324519   459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23de4d8703a5498b83b5da1bf5d43947"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:48792
I20260709 13:15:18.325166   459 raft_consensus.cc:493] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.325660   655 raft_consensus.cc:993] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d: : Instructing follower ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:18.325567   459 raft_consensus.cc:3060] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.326754   703 raft_consensus.cc:1081] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Signalling peer ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:18.325418   724 consensus_queue.cc:237] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.333711   459 raft_consensus.cc:515] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.335461   459 leader_election.cc:290] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:18.336620   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de4d8703a5498b83b5da1bf5d43947" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:18.337388   607 raft_consensus.cc:3060] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.337893   356 catalog_manager.cc:5697] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 1 to 2, leader changed from ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194) to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 2 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.341285   535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:57468
I20260709 13:15:18.341976   535 raft_consensus.cc:493] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.342376   535 raft_consensus.cc:3060] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.345234   607 raft_consensus.cc:2468] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:18.346632   424 leader_election.cc:304] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:18.347533   655 raft_consensus.cc:2804] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.348004   655 raft_consensus.cc:697] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:18.348958   655 consensus_queue.cc:237] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.341375   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de4d8703a5498b83b5da1bf5d43947" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:18.352066   536 raft_consensus.cc:3055] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.351336   535 raft_consensus.cc:515] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.352422   536 raft_consensus.cc:740] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:18.355536   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:18.356176   459 raft_consensus.cc:3055] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.356490   459 raft_consensus.cc:740] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:18.356395   536 consensus_queue.cc:260] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.357702   535 leader_election.cc:290] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:18.358031   536 raft_consensus.cc:3060] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.358856   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bba5a817824115ac39420b80ce3d2c" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:18.359503   609 raft_consensus.cc:3060] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.357529   459 consensus_queue.cc:260] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.361250   459 raft_consensus.cc:3060] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.365978   536 raft_consensus.cc:2468] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:18.368822   459 raft_consensus.cc:2468] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:18.371145   502 leader_election.cc:304] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:18.372068   660 raft_consensus.cc:2804] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.372577   660 raft_consensus.cc:697] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:18.373535   660 consensus_queue.cc:237] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.375289   609 raft_consensus.cc:2468] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:18.376799   688 consensus_queue.cc:1048] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.382695   660 consensus_queue.cc:1048] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.383196   356 catalog_manager.cc:5697] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 1 to 2, leader changed from ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194) to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 2 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.387401   688 consensus_queue.cc:1048] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.395115   688 raft_consensus.cc:993] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5: : Instructing follower c647018786ba4aaab442af0ecb85bf8b to start an election
I20260709 13:15:18.396091   688 raft_consensus.cc:1081] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Signalling peer c647018786ba4aaab442af0ecb85bf8b to start an election
I20260709 13:15:18.398296   609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea28a0a6193647dd925a91ca3d876dbf"
dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
 from {username='slave'} at 127.0.0.1:52324
I20260709 13:15:18.398908   609 raft_consensus.cc:493] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.400888   609 raft_consensus.cc:3060] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.400092   358 catalog_manager.cc:5697] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 1 to 2, leader changed from 8401cbff669c4f0aadd7a578c869071d (127.19.185.193) to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.410163   688 consensus_queue.cc:1048] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.411207   609 raft_consensus.cc:515] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.412314   607 raft_consensus.cc:1240] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Rejecting Update request from peer ad42ff365b014966b5eb1bf65a86c7f5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:18.414403   609 leader_election.cc:290] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 2 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:18.415956   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea28a0a6193647dd925a91ca3d876dbf" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:18.416455   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea28a0a6193647dd925a91ca3d876dbf" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:18.416690   536 raft_consensus.cc:3055] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.417052   536 raft_consensus.cc:740] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:18.417085   460 raft_consensus.cc:3060] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.418707   536 consensus_queue.cc:260] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.419998   536 raft_consensus.cc:3060] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.427867   536 raft_consensus.cc:2468] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 2.
I20260709 13:15:18.427867   460 raft_consensus.cc:2468] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 2.
I20260709 13:15:18.429394   576 leader_election.cc:304] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:18.430385   689 raft_consensus.cc:2804] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.430910   689 raft_consensus.cc:697] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 2 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:18.431820   689 consensus_queue.cc:237] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.440620   357 catalog_manager.cc:5697] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 1 to 2, leader changed from ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194) to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 2 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.534029   688 consensus_queue.cc:1048] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.545832   687 consensus_queue.cc:1048] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.554925   688 raft_consensus.cc:993] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5: : Instructing follower 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:18.555534   688 raft_consensus.cc:1081] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Signalling peer 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:18.557538   459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:48792
I20260709 13:15:18.558148   459 raft_consensus.cc:493] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.558454   459 raft_consensus.cc:3060] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.564009   459 raft_consensus.cc:515] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.566800   459 leader_election.cc:290] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:18.567240   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:18.567512   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f8f02a74ab4efeaec20d91e7df966f" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:18.567960   536 raft_consensus.cc:3055] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.568392   536 raft_consensus.cc:740] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:18.568297   607 raft_consensus.cc:3060] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.569330   536 consensus_queue.cc:260] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.570806   536 raft_consensus.cc:3060] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.575762   607 raft_consensus.cc:2468] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:18.577280   424 leader_election.cc:304] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:18.577761   536 raft_consensus.cc:2468] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:18.578363   726 raft_consensus.cc:2804] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.578889   726 raft_consensus.cc:697] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:18.579607   726 consensus_queue.cc:237] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.587157   356 catalog_manager.cc:5697] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 1 to 2, leader changed from ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194) to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 2 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.807890   607 raft_consensus.cc:1275] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.809440   726 consensus_queue.cc:1048] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.821791   536 raft_consensus.cc:1275] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.823550   724 consensus_queue.cc:1048] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:18.825713   738 raft_consensus.cc:993] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b: : Instructing follower ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:18.826333   738 raft_consensus.cc:1081] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Signalling peer ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:18.828397   534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "253f3b376f5f4372a4d9f75435f774ee"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:57456
I20260709 13:15:18.829056   534 raft_consensus.cc:493] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.829447   534 raft_consensus.cc:3060] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.837375   534 raft_consensus.cc:515] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.839287   534 leader_election.cc:290] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:18.840431   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f3b376f5f4372a4d9f75435f774ee" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:18.840437   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f3b376f5f4372a4d9f75435f774ee" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:18.841351   607 raft_consensus.cc:3055] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.841348   459 raft_consensus.cc:3060] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.841852   607 raft_consensus.cc:740] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:18.842767   607 consensus_queue.cc:260] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.844123   607 raft_consensus.cc:3060] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.849773   459 raft_consensus.cc:2468] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:18.850874   534 raft_consensus.cc:1275] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Refusing update from remote peer c647018786ba4aaab442af0ecb85bf8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.851643   502 leader_election.cc:304] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:18.852607   688 raft_consensus.cc:2804] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.852666   607 raft_consensus.cc:2468] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:18.852874   738 consensus_queue.cc:1048] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:18.853451   688 raft_consensus.cc:697] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:18.854409   688 consensus_queue.cc:237] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:18.862814   356 catalog_manager.cc:5697] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 1 to 2, leader changed from c647018786ba4aaab442af0ecb85bf8b (127.19.185.195) to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.864477   459 raft_consensus.cc:1275] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Refusing update from remote peer c647018786ba4aaab442af0ecb85bf8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.867491   738 consensus_queue.cc:1048] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.919395   459 raft_consensus.cc:1275] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.920967   688 consensus_queue.cc:1048] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.929342   607 raft_consensus.cc:1275] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.931565   687 consensus_queue.cc:1048] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.970335   534 raft_consensus.cc:1275] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.971804   724 consensus_queue.cc:1048] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.980455   607 raft_consensus.cc:1275] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.982273   724 consensus_queue.cc:1048] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.002331   609 raft_consensus.cc:1275] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.003736   655 consensus_queue.cc:1048] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.012009   534 raft_consensus.cc:1275] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.013825   668 consensus_queue.cc:1048] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.356256   609 raft_consensus.cc:1275] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.357800   688 consensus_queue.cc:1048] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.370239   459 raft_consensus.cc:1275] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.372308   692 consensus_queue.cc:1048] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.274245   357 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49428:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:21.276522   357 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:21.333307   444 tablet_service.cc:1511] Processing CreateTablet for tablet b0a0016d38af4eafa84d180985818c41 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:21.334679   444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a0016d38af4eafa84d180985818c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.334240   521 tablet_service.cc:1511] Processing CreateTablet for tablet b0a0016d38af4eafa84d180985818c41 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:21.335922   521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a0016d38af4eafa84d180985818c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.335783   600 tablet_service.cc:1511] Processing CreateTablet for tablet b0a0016d38af4eafa84d180985818c41 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:21.337172   600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a0016d38af4eafa84d180985818c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.339323   448 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3ecc3f11fe46bdaef8d6e6465d4c34 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:21.340705   448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3ecc3f11fe46bdaef8d6e6465d4c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.344736   594 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3ecc3f11fe46bdaef8d6e6465d4c34 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:21.345770   447 tablet_service.cc:1511] Processing CreateTablet for tablet 03e1b31c8afd493f96023d2dc91bee96 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:21.346310   594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3ecc3f11fe46bdaef8d6e6465d4c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.346726   523 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3ecc3f11fe46bdaef8d6e6465d4c34 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:21.348296   523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3ecc3f11fe46bdaef8d6e6465d4c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.347144   447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e1b31c8afd493f96023d2dc91bee96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.355038   593 tablet_service.cc:1511] Processing CreateTablet for tablet 03e1b31c8afd493f96023d2dc91bee96 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:21.355500   526 tablet_service.cc:1511] Processing CreateTablet for tablet 03e1b31c8afd493f96023d2dc91bee96 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:21.356523   593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e1b31c8afd493f96023d2dc91bee96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.356889   526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e1b31c8afd493f96023d2dc91bee96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.370190   445 tablet_service.cc:1511] Processing CreateTablet for tablet 2282d471738d4bfe8a8f5fee05467621 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:21.371826   445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2282d471738d4bfe8a8f5fee05467621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.377889   520 tablet_service.cc:1511] Processing CreateTablet for tablet 2282d471738d4bfe8a8f5fee05467621 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:21.379485   520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2282d471738d4bfe8a8f5fee05467621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.379606   597 tablet_service.cc:1511] Processing CreateTablet for tablet 2282d471738d4bfe8a8f5fee05467621 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:21.381028   597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2282d471738d4bfe8a8f5fee05467621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.381557   449 tablet_service.cc:1511] Processing CreateTablet for tablet 88348acc4d3e4ac2b9a525d4ff1222d0 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:21.382921   449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88348acc4d3e4ac2b9a525d4ff1222d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.394327   522 tablet_service.cc:1511] Processing CreateTablet for tablet 88348acc4d3e4ac2b9a525d4ff1222d0 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:21.394788   599 tablet_service.cc:1511] Processing CreateTablet for tablet 88348acc4d3e4ac2b9a525d4ff1222d0 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:21.395892   522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88348acc4d3e4ac2b9a525d4ff1222d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.396176   599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88348acc4d3e4ac2b9a525d4ff1222d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.411763   450 tablet_service.cc:1511] Processing CreateTablet for tablet b0bc03cc02a0461d821629a8b863f595 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:21.413300   450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bc03cc02a0461d821629a8b863f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.430227   519 tablet_service.cc:1511] Processing CreateTablet for tablet b0bc03cc02a0461d821629a8b863f595 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:21.437198   519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bc03cc02a0461d821629a8b863f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.439983   599 tablet_service.cc:1511] Processing CreateTablet for tablet 732e04cdf57a4576859585a1a9cf8db8 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:21.441529   599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732e04cdf57a4576859585a1a9cf8db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.443866   597 tablet_service.cc:1511] Processing CreateTablet for tablet b0bc03cc02a0461d821629a8b863f595 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:21.444170   593 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2af50ff276460b8b03caac5d781516 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:21.445425   593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2af50ff276460b8b03caac5d781516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.448258   524 tablet_service.cc:1511] Processing CreateTablet for tablet 732e04cdf57a4576859585a1a9cf8db8 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:21.449658   524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732e04cdf57a4576859585a1a9cf8db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.450551   444 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2af50ff276460b8b03caac5d781516 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:21.451915   444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2af50ff276460b8b03caac5d781516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.452929   754 tablet_bootstrap.cc:492] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:21.453116   598 tablet_service.cc:1511] Processing CreateTablet for tablet e21b77d31d3e4684ba78f485fbc75743 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:21.454408   598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21b77d31d3e4684ba78f485fbc75743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.464538   448 tablet_service.cc:1511] Processing CreateTablet for tablet 732e04cdf57a4576859585a1a9cf8db8 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:21.466066   448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732e04cdf57a4576859585a1a9cf8db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.469460   525 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2af50ff276460b8b03caac5d781516 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:21.470386   597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bc03cc02a0461d821629a8b863f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.470847   525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2af50ff276460b8b03caac5d781516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.478047   518 tablet_service.cc:1511] Processing CreateTablet for tablet e21b77d31d3e4684ba78f485fbc75743 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:21.437227   753 tablet_bootstrap.cc:492] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.479490   518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21b77d31d3e4684ba78f485fbc75743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.491700   754 tablet_bootstrap.cc:654] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:21.508492   406 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:21.503808   753 tablet_bootstrap.cc:654] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.517190   755 tablet_bootstrap.cc:492] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:21.533113   447 tablet_service.cc:1511] Processing CreateTablet for tablet e21b77d31d3e4684ba78f485fbc75743 (DEFAULT_TABLE table=soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:21.534662   447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21b77d31d3e4684ba78f485fbc75743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.537672   755 tablet_bootstrap.cc:654] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.544153   753 tablet_bootstrap.cc:492] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:21.544693   753 ts_tablet_manager.cc:1403] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.004s
I20260709 13:15:21.547703   753 raft_consensus.cc:359] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.548542   753 raft_consensus.cc:385] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.548858   753 raft_consensus.cc:740] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.549710   753 consensus_queue.cc:260] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.551076   755 tablet_bootstrap.cc:492] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:21.551694   755 ts_tablet_manager.cc:1403] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.000s
I20260709 13:15:21.553261   754 tablet_bootstrap.cc:492] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:21.553879   754 ts_tablet_manager.cc:1403] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.101s	user 0.029s	sys 0.039s
I20260709 13:15:21.554803   755 raft_consensus.cc:359] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.555666   755 raft_consensus.cc:385] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.555960   755 raft_consensus.cc:740] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.556880   755 consensus_queue.cc:260] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.557235   754 raft_consensus.cc:359] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.558151   754 raft_consensus.cc:385] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.558532   754 raft_consensus.cc:740] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.558681   755 ts_tablet_manager.cc:1434] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:21.559849   755 tablet_bootstrap.cc:492] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:21.559475   754 consensus_queue.cc:260] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.562403   754 ts_tablet_manager.cc:1434] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:21.563462   754 tablet_bootstrap.cc:492] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:21.566680   755 tablet_bootstrap.cc:654] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.570097   754 tablet_bootstrap.cc:654] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.582233   753 ts_tablet_manager.cc:1434] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.004s
I20260709 13:15:21.587261   753 tablet_bootstrap.cc:492] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.600154   754 tablet_bootstrap.cc:492] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:21.601325   754 ts_tablet_manager.cc:1403] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.014s
I20260709 13:15:21.601356   753 tablet_bootstrap.cc:654] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.600570   755 tablet_bootstrap.cc:492] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:21.603161   755 ts_tablet_manager.cc:1403] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.033s
I20260709 13:15:21.605132   754 raft_consensus.cc:359] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.605835   754 raft_consensus.cc:385] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.606149   754 raft_consensus.cc:740] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.606374   755 raft_consensus.cc:359] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.607147   755 raft_consensus.cc:385] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.607331   753 tablet_bootstrap.cc:492] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:21.606906   754 consensus_queue.cc:260] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.607419   755 raft_consensus.cc:740] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.607992   753 ts_tablet_manager.cc:1403] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.011s
I20260709 13:15:21.608301   755 consensus_queue.cc:260] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.609421   754 ts_tablet_manager.cc:1434] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:21.610675   754 tablet_bootstrap.cc:492] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:21.611478   753 raft_consensus.cc:359] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.612303   753 raft_consensus.cc:385] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.612576   753 raft_consensus.cc:740] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.613466   753 consensus_queue.cc:260] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.618038   754 tablet_bootstrap.cc:654] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.619535   755 ts_tablet_manager.cc:1434] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:21.625294   753 ts_tablet_manager.cc:1434] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:21.629154   753 tablet_bootstrap.cc:492] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.636000   755 tablet_bootstrap.cc:492] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:21.636209   753 tablet_bootstrap.cc:654] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.642081   753 tablet_bootstrap.cc:492] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:21.642307   754 tablet_bootstrap.cc:492] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:21.642539   753 ts_tablet_manager.cc:1403] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.006s
I20260709 13:15:21.642931   754 ts_tablet_manager.cc:1403] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.010s
I20260709 13:15:21.644507   755 tablet_bootstrap.cc:654] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.645411   753 raft_consensus.cc:359] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.646200   753 raft_consensus.cc:385] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.646492   753 raft_consensus.cc:740] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.646332   754 raft_consensus.cc:359] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.647457   754 raft_consensus.cc:385] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.647384   753 consensus_queue.cc:260] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.647938   754 raft_consensus.cc:740] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.648998   754 consensus_queue.cc:260] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.650283   753 ts_tablet_manager.cc:1434] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:21.651347   753 tablet_bootstrap.cc:492] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.653156   668 raft_consensus.cc:493] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.653676   668 raft_consensus.cc:515] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.655520   754 ts_tablet_manager.cc:1434] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:15:21.656019   668 leader_election.cc:290] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:21.661480   755 tablet_bootstrap.cc:492] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:21.661671   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a0016d38af4eafa84d180985818c41" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:21.662107   755 ts_tablet_manager.cc:1403] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.002s
I20260709 13:15:21.662444   534 raft_consensus.cc:2468] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 0.
I20260709 13:15:21.663691   423 leader_election.cc:304] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:21.665839   755 raft_consensus.cc:359] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.666675   755 raft_consensus.cc:385] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.666967   755 raft_consensus.cc:740] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.667737   755 consensus_queue.cc:260] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.668262   668 raft_consensus.cc:2804] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.658568   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a0016d38af4eafa84d180985818c41" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:21.669253   668 raft_consensus.cc:493] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.669755   668 raft_consensus.cc:3060] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.657119   754 tablet_bootstrap.cc:492] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:21.670302   755 ts_tablet_manager.cc:1434] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 13:15:21.670715   424 leader_election.cc:343] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.677412   755 tablet_bootstrap.cc:492] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:21.682379   754 tablet_bootstrap.cc:654] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.681989   668 raft_consensus.cc:515] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.658001   753 tablet_bootstrap.cc:654] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.684334   755 tablet_bootstrap.cc:654] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.686570   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a0016d38af4eafa84d180985818c41" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:21.685286   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a0016d38af4eafa84d180985818c41" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
W20260709 13:15:21.693558   424 leader_election.cc:343] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.694065   534 raft_consensus.cc:3060] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.690440   668 leader_election.cc:290] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:21.701776   534 raft_consensus.cc:2468] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 1.
I20260709 13:15:21.703085   754 tablet_bootstrap.cc:492] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:21.703330   423 leader_election.cc:304] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:21.703706   754 ts_tablet_manager.cc:1403] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.008s
I20260709 13:15:21.704591   668 raft_consensus.cc:2804] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.705559   753 tablet_bootstrap.cc:492] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:21.706270   753 ts_tablet_manager.cc:1403] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.008s
I20260709 13:15:21.707118   755 tablet_bootstrap.cc:492] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:21.708223   755 ts_tablet_manager.cc:1403] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:15:21.709496   753 raft_consensus.cc:359] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.710371   753 raft_consensus.cc:385] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.710713   753 raft_consensus.cc:740] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.711618   753 consensus_queue.cc:260] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.707271   754 raft_consensus.cc:359] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.712564   754 raft_consensus.cc:385] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.712407   755 raft_consensus.cc:359] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.713152   754 raft_consensus.cc:740] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.713675   755 raft_consensus.cc:385] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.714143   755 raft_consensus.cc:740] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.714561   754 consensus_queue.cc:260] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.715487   668 raft_consensus.cc:697] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:21.716536   668 consensus_queue.cc:237] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.718997   754 ts_tablet_manager.cc:1434] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:15:21.720341   754 tablet_bootstrap.cc:492] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:21.721951   753 ts_tablet_manager.cc:1434] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:15:21.723188   753 tablet_bootstrap.cc:492] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.727236   754 tablet_bootstrap.cc:654] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.730173   753 tablet_bootstrap.cc:654] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.716317   755 consensus_queue.cc:260] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.738495   755 ts_tablet_manager.cc:1434] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:15:21.739336   356 catalog_manager.cc:5697] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 1 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.741340   755 tablet_bootstrap.cc:492] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:21.748924   755 tablet_bootstrap.cc:654] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.774925   753 tablet_bootstrap.cc:492] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:21.775368   755 tablet_bootstrap.cc:492] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:21.775498   753 ts_tablet_manager.cc:1403] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.015s
I20260709 13:15:21.776213   755 ts_tablet_manager.cc:1403] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.014s
I20260709 13:15:21.776472   754 tablet_bootstrap.cc:492] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:21.777043   754 ts_tablet_manager.cc:1403] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.057s	user 0.031s	sys 0.019s
I20260709 13:15:21.778853   753 raft_consensus.cc:359] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.779698   753 raft_consensus.cc:385] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.779425   755 raft_consensus.cc:359] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.780105   753 raft_consensus.cc:740] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.779982   754 raft_consensus.cc:359] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.780490   755 raft_consensus.cc:385] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.781001   754 raft_consensus.cc:385] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.781016   755 raft_consensus.cc:740] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.781616   754 raft_consensus.cc:740] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.781085   753 consensus_queue.cc:260] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.782459   755 consensus_queue.cc:260] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.782562   754 consensus_queue.cc:260] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.784003   753 ts_tablet_manager.cc:1434] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:21.785004   755 ts_tablet_manager.cc:1434] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:21.786280   755 tablet_bootstrap.cc:492] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:21.786669   754 ts_tablet_manager.cc:1434] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:21.787772   754 tablet_bootstrap.cc:492] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:21.785099   753 tablet_bootstrap.cc:492] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.792979   755 tablet_bootstrap.cc:654] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.799911   753 tablet_bootstrap.cc:654] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.801194   754 tablet_bootstrap.cc:654] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.816787   753 tablet_bootstrap.cc:492] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:21.817551   753 ts_tablet_manager.cc:1403] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.010s
I20260709 13:15:21.822216   753 raft_consensus.cc:359] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.823134   753 raft_consensus.cc:385] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.823688   753 raft_consensus.cc:740] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.823289   754 tablet_bootstrap.cc:492] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:21.824736   754 ts_tablet_manager.cc:1403] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.007s
I20260709 13:15:21.824628   753 consensus_queue.cc:260] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.827173   753 ts_tablet_manager.cc:1434] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:15:21.828570   753 tablet_bootstrap.cc:492] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.828202   754 raft_consensus.cc:359] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.829150   754 raft_consensus.cc:385] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.829463   754 raft_consensus.cc:740] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.830375   754 consensus_queue.cc:260] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.832762   754 ts_tablet_manager.cc:1434] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:15:21.837357   668 raft_consensus.cc:493] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.838289   754 tablet_bootstrap.cc:492] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:21.837982   668 raft_consensus.cc:515] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.841351   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:21.842124   534 raft_consensus.cc:2468] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 0.
I20260709 13:15:21.844198   753 tablet_bootstrap.cc:654] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.845698   754 tablet_bootstrap.cc:654] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.845997   755 tablet_bootstrap.cc:492] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:21.846599   755 ts_tablet_manager.cc:1403] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.034s
I20260709 13:15:21.848371   423 leader_election.cc:304] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:21.849589   768 raft_consensus.cc:2804] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.850090   768 raft_consensus.cc:493] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.850574   768 raft_consensus.cc:3060] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.850761   755 raft_consensus.cc:359] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.851838   755 raft_consensus.cc:385] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.852290   755 raft_consensus.cc:740] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.853454   755 consensus_queue.cc:260] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.853973   742 raft_consensus.cc:493] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.854734   742 raft_consensus.cc:515] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.856333   755 ts_tablet_manager.cc:1434] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.001s
I20260709 13:15:21.856865   753 tablet_bootstrap.cc:492] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:21.857379   755 tablet_bootstrap.cc:492] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:21.857417   753 ts_tablet_manager.cc:1403] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.009s
I20260709 13:15:21.860790   753 raft_consensus.cc:359] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.861773   753 raft_consensus.cc:385] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.862143   753 raft_consensus.cc:740] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.862826   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:21.863093   753 consensus_queue.cc:260] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.865262   755 tablet_bootstrap.cc:654] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.865006   668 leader_election.cc:290] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:21.866104   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:21.866844   609 raft_consensus.cc:2468] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 0.
I20260709 13:15:21.870857   742 leader_election.cc:290] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:21.872958   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:21.873750   753 ts_tablet_manager.cc:1434] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:21.874091   534 raft_consensus.cc:2468] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:21.875391   753 tablet_bootstrap.cc:492] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.876197   573 leader_election.cc:304] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:21.878100   742 raft_consensus.cc:2804] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.883313   742 raft_consensus.cc:493] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.889554   742 raft_consensus.cc:3060] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.894793   768 raft_consensus.cc:515] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.896998   460 raft_consensus.cc:2393] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c647018786ba4aaab442af0ecb85bf8b in current term 1: Already voted for candidate 8401cbff669c4f0aadd7a578c869071d in this term.
I20260709 13:15:21.897262   768 leader_election.cc:290] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:21.898236   753 tablet_bootstrap.cc:654] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.898533   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:21.899600   754 tablet_bootstrap.cc:492] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:21.900171   754 ts_tablet_manager.cc:1403] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.062s	user 0.033s	sys 0.023s
I20260709 13:15:21.903294   754 raft_consensus.cc:359] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.904083   754 raft_consensus.cc:385] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.904353   754 raft_consensus.cc:740] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.904418   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:21.905025   534 raft_consensus.cc:3060] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.905139   754 consensus_queue.cc:260] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.909371   755 tablet_bootstrap.cc:492] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:21.910167   755 ts_tablet_manager.cc:1403] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.008s
I20260709 13:15:21.913528   755 raft_consensus.cc:359] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.914249   755 raft_consensus.cc:385] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.914522   755 raft_consensus.cc:740] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.915349   755 consensus_queue.cc:260] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.918324   755 ts_tablet_manager.cc:1434] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:21.919565   755 tablet_bootstrap.cc:492] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:21.937919   755 tablet_bootstrap.cc:654] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.939684   785 raft_consensus.cc:493] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.939972   786 raft_consensus.cc:493] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.940361   785 raft_consensus.cc:515] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.940630   786 raft_consensus.cc:515] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.942763   785 leader_election.cc:290] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:21.942728   786 leader_election.cc:290] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:21.943305   785 raft_consensus.cc:493] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.943802   785 raft_consensus.cc:515] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.944573   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2282d471738d4bfe8a8f5fee05467621" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:21.945627   460 raft_consensus.cc:2468] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:21.946228   753 tablet_bootstrap.cc:492] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:21.946744   753 ts_tablet_manager.cc:1403] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.033s
I20260709 13:15:21.948136   576 leader_election.cc:304] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:21.949381   786 raft_consensus.cc:2804] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.949867   786 raft_consensus.cc:493] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.950265   786 raft_consensus.cc:3060] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.950090   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a0016d38af4eafa84d180985818c41" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:21.951434   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e1b31c8afd493f96023d2dc91bee96" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:21.952178   459 raft_consensus.cc:2468] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:21.953910   576 leader_election.cc:304] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:21.949086   753 raft_consensus.cc:359] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.954944   753 raft_consensus.cc:385] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.955252   753 raft_consensus.cc:740] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.956076   753 consensus_queue.cc:260] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.957383   769 raft_consensus.cc:493] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.957664   753 ts_tablet_manager.cc:1434] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:21.957844   769 raft_consensus.cc:515] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.958539   785 leader_election.cc:290] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:21.959165   785 raft_consensus.cc:2804] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.959477   785 raft_consensus.cc:493] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.959826   785 raft_consensus.cc:3060] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.961818   786 raft_consensus.cc:515] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.962461   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3ecc3f11fe46bdaef8d6e6465d4c34" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:21.963400   535 raft_consensus.cc:2468] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 0.
I20260709 13:15:21.964368   786 leader_election.cc:290] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:21.965240   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2282d471738d4bfe8a8f5fee05467621" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:21.965452   769 leader_election.cc:290] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:21.965900   459 raft_consensus.cc:3060] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.968876   423 leader_election.cc:304] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:21.970357   668 raft_consensus.cc:2804] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.971019   668 raft_consensus.cc:493] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.971517   668 raft_consensus.cc:3060] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.973263   459 raft_consensus.cc:2468] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:21.974748   753 tablet_bootstrap.cc:492] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d: Bootstrap starting.
I20260709 13:15:21.977032   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3ecc3f11fe46bdaef8d6e6465d4c34" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:21.977923   607 raft_consensus.cc:2468] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 0.
I20260709 13:15:21.978228   576 leader_election.cc:304] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:21.980623   753 tablet_bootstrap.cc:654] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.983812   786 raft_consensus.cc:493] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.984437   786 raft_consensus.cc:515] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:21.987375   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3ecc3f11fe46bdaef8d6e6465d4c34" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:21.987550   786 leader_election.cc:290] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.008503   533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2282d471738d4bfe8a8f5fee05467621" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.008823   786 raft_consensus.cc:493] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.009560   533 raft_consensus.cc:3060] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.987818   785 raft_consensus.cc:515] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.013237   789 raft_consensus.cc:493] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.014003   789 raft_consensus.cc:515] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.018390   754 ts_tablet_manager.cc:1434] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.118s	user 0.024s	sys 0.043s
I20260709 13:15:22.018172   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e1b31c8afd493f96023d2dc91bee96" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.019253   460 raft_consensus.cc:3060] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.019688   754 tablet_bootstrap.cc:492] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:22.020951   668 raft_consensus.cc:515] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.022260   459 raft_consensus.cc:2393] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c647018786ba4aaab442af0ecb85bf8b in current term 1: Already voted for candidate 8401cbff669c4f0aadd7a578c869071d in this term.
I20260709 13:15:22.027340   754 tablet_bootstrap.cc:654] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.027583   530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3ecc3f11fe46bdaef8d6e6465d4c34" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.028621   530 raft_consensus.cc:3060] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.029798   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2af50ff276460b8b03caac5d781516" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:22.030264   529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e1b31c8afd493f96023d2dc91bee96" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.030579   459 raft_consensus.cc:2468] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:22.031071   529 raft_consensus.cc:3060] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.032274   789 leader_election.cc:290] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.033447   528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2af50ff276460b8b03caac5d781516" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:22.033840   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3ecc3f11fe46bdaef8d6e6465d4c34" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:22.034339   528 raft_consensus.cc:2468] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:22.034584   607 raft_consensus.cc:3060] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.034821   755 tablet_bootstrap.cc:492] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:22.035351   755 ts_tablet_manager.cc:1403] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.116s	user 0.025s	sys 0.045s
I20260709 13:15:22.036734   531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3ecc3f11fe46bdaef8d6e6465d4c34" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:22.036144   576 leader_election.cc:304] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.038278   755 raft_consensus.cc:359] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.039016   755 raft_consensus.cc:385] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.039278   755 raft_consensus.cc:740] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.039949   755 consensus_queue.cc:260] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.040814   530 raft_consensus.cc:2468] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 1.
I20260709 13:15:22.042018   755 ts_tablet_manager.cc:1434] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:15:22.042109   607 raft_consensus.cc:2468] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 1.
I20260709 13:15:22.042152   423 leader_election.cc:304] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:22.042546   668 leader_election.cc:290] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.043373   768 raft_consensus.cc:2804] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.043773   755 tablet_bootstrap.cc:492] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5: Bootstrap starting.
I20260709 13:15:22.043946   768 raft_consensus.cc:697] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:22.045186   768 consensus_queue.cc:237] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.047874   769 raft_consensus.cc:493] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.048368   769 raft_consensus.cc:515] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.049209   573 leader_election.cc:304] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c647018786ba4aaab442af0ecb85bf8b; no voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:22.015735   785 leader_election.cc:290] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.050354   784 raft_consensus.cc:2804] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.050838   785 raft_consensus.cc:2749] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.050963   784 raft_consensus.cc:493] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.051448   784 raft_consensus.cc:3060] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.052162   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b" is_pre_election: true
I20260709 13:15:22.052726   531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:22.053408   531 raft_consensus.cc:2468] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 0.
W20260709 13:15:22.053555   424 leader_election.cc:343] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.054905   423 leader_election.cc:304] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:22.050472   769 leader_election.cc:290] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.060916   769 raft_consensus.cc:2804] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.000833   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a0016d38af4eafa84d180985818c41" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:22.002298   536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2282d471738d4bfe8a8f5fee05467621" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:22.061828   535 raft_consensus.cc:2393] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c647018786ba4aaab442af0ecb85bf8b in current term 1: Already voted for candidate 8401cbff669c4f0aadd7a578c869071d in this term.
I20260709 13:15:22.062510   769 raft_consensus.cc:493] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.009577   786 raft_consensus.cc:515] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.063064   769 raft_consensus.cc:3060] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.063791   755 tablet_bootstrap.cc:654] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.064875   786 leader_election.cc:290] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.005831   532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e1b31c8afd493f96023d2dc91bee96" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:21.986137   742 raft_consensus.cc:515] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.067687   742 leader_election.cc:290] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.068962   609 raft_consensus.cc:2393] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8401cbff669c4f0aadd7a578c869071d in current term 1: Already voted for candidate c647018786ba4aaab442af0ecb85bf8b in this term.
I20260709 13:15:22.067564   784 raft_consensus.cc:515] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.071787   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732e04cdf57a4576859585a1a9cf8db8" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:22.072523   459 raft_consensus.cc:2468] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:22.073602   784 leader_election.cc:290] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:21.997902   534 raft_consensus.cc:2468] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 1.
I20260709 13:15:21.998996   783 raft_consensus.cc:2804] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.076659   783 raft_consensus.cc:697] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.077560   783 consensus_queue.cc:237] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.079499   529 raft_consensus.cc:2468] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.081035   753 tablet_bootstrap.cc:492] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d: No bootstrap required, opened a new log
I20260709 13:15:22.082036   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.082785   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2af50ff276460b8b03caac5d781516" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.082050   532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.086897   535 raft_consensus.cc:3060] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.087549   532 raft_consensus.cc:2393] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c647018786ba4aaab442af0ecb85bf8b in current term 1: Already voted for candidate 8401cbff669c4f0aadd7a578c869071d in this term.
I20260709 13:15:22.088977   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2af50ff276460b8b03caac5d781516" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.089843   459 raft_consensus.cc:3060] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.092231   461 raft_consensus.cc:2393] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c647018786ba4aaab442af0ecb85bf8b in current term 1: Already voted for candidate 8401cbff669c4f0aadd7a578c869071d in this term.
I20260709 13:15:22.095793   576 leader_election.cc:304] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.096958   753 ts_tablet_manager.cc:1403] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.014s
I20260709 13:15:22.097136   784 raft_consensus.cc:2804] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.097644   784 raft_consensus.cc:493] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.098057   784 raft_consensus.cc:3060] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.098039   460 raft_consensus.cc:2468] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.099920   573 leader_election.cc:304] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c647018786ba4aaab442af0ecb85bf8b; no voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:22.101146   576 leader_election.cc:304] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.101982   754 tablet_bootstrap.cc:492] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:22.102509   754 ts_tablet_manager.cc:1403] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.019s
I20260709 13:15:22.102703   535 raft_consensus.cc:2468] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.084151   533 raft_consensus.cc:2468] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.106402   784 raft_consensus.cc:515] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.107846   742 raft_consensus.cc:3060] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.108160   786 raft_consensus.cc:2804] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.108704   786 raft_consensus.cc:697] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.108899   784 leader_election.cc:290] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.109616   786 consensus_queue.cc:237] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.109787   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732e04cdf57a4576859585a1a9cf8db8" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.111065   460 raft_consensus.cc:3060] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.108120   753 raft_consensus.cc:359] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.116861   753 raft_consensus.cc:385] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.117177   753 raft_consensus.cc:740] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.117789   742 raft_consensus.cc:2749] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.117972   753 consensus_queue.cc:260] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.118573   754 raft_consensus.cc:359] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.119578   754 raft_consensus.cc:385] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.119946   754 raft_consensus.cc:740] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.120921   754 consensus_queue.cc:260] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.122452   573 leader_election.cc:304] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c647018786ba4aaab442af0ecb85bf8b; no voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:22.124907   459 raft_consensus.cc:2468] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.123956   754 ts_tablet_manager.cc:1434] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:15:22.126703   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732e04cdf57a4576859585a1a9cf8db8" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:22.134347   534 raft_consensus.cc:2468] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:22.134984   754 tablet_bootstrap.cc:492] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b: Bootstrap starting.
I20260709 13:15:22.138449   769 raft_consensus.cc:515] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.142433   460 raft_consensus.cc:2468] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.155517   753 ts_tablet_manager.cc:1434] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.006s
W20260709 13:15:22.149001   423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:35341, user_credentials={real_user=slave}} blocked reactor thread for 94190.9us
I20260709 13:15:22.149955   754 tablet_bootstrap.cc:654] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.161207   769 leader_election.cc:290] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.162412   609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:22.162302   356 catalog_manager.cc:5697] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 0 to 1, leader changed from <none> to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.164956   423 leader_election.cc:304] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:22.129328   573 leader_election.cc:304] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.129520   742 raft_consensus.cc:2749] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.168006   755 tablet_bootstrap.cc:492] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5: No bootstrap required, opened a new log
I20260709 13:15:22.169260   576 leader_election.cc:304] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.169872   755 ts_tablet_manager.cc:1403] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent bootstrapping tablet: real 0.126s	user 0.027s	sys 0.061s
I20260709 13:15:22.152263   789 raft_consensus.cc:493] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.170989   789 raft_consensus.cc:515] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.172631   742 raft_consensus.cc:2804] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.173205   742 raft_consensus.cc:697] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.173835   783 raft_consensus.cc:2804] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.152817   357 catalog_manager.cc:5697] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 1 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.174500   783 raft_consensus.cc:697] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.175575   768 raft_consensus.cc:2804] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.175359   783 consensus_queue.cc:237] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.175992   791 consensus_queue.cc:1048] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.176476   609 raft_consensus.cc:3060] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.176942   768 raft_consensus.cc:697] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:22.174046   742 consensus_queue.cc:237] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.177918   768 consensus_queue.cc:237] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.175372   755 raft_consensus.cc:359] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.183425   755 raft_consensus.cc:385] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.183698   755 raft_consensus.cc:740] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.184387   755 consensus_queue.cc:260] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.186509   755 ts_tablet_manager.cc:1434] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:15:22.173962   789 leader_election.cc:290] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.193337   754 tablet_bootstrap.cc:492] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b: No bootstrap required, opened a new log
I20260709 13:15:22.193195   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:22.193900   754 ts_tablet_manager.cc:1403] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.008s
I20260709 13:15:22.194396   460 raft_consensus.cc:2393] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c647018786ba4aaab442af0ecb85bf8b in current term 1: Already voted for candidate 8401cbff669c4f0aadd7a578c869071d in this term.
I20260709 13:15:22.200168   754 raft_consensus.cc:359] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.200959   754 raft_consensus.cc:385] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.201306   754 raft_consensus.cc:740] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.202145   754 consensus_queue.cc:260] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.203796   754 ts_tablet_manager.cc:1434] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:15:22.208191   609 raft_consensus.cc:2468] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 1.
I20260709 13:15:22.221203   534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.242568   534 raft_consensus.cc:3060] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:22.173985   573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.185.194:35341, user_credentials={real_user=slave}} blocked reactor thread for 44789.9us
I20260709 13:15:22.255458   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732e04cdf57a4576859585a1a9cf8db8" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.256258   535 raft_consensus.cc:3060] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.257200   768 consensus_queue.cc:1048] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.258351   358 catalog_manager.cc:5697] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 1 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.263005   424 leader_election.cc:304] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.264662   533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:22.264739   791 raft_consensus.cc:2804] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.266563   791 raft_consensus.cc:697] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:22.267422   791 consensus_queue.cc:237] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.268895   534 raft_consensus.cc:2468] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 1.
I20260709 13:15:22.271588   742 raft_consensus.cc:493] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.271800   573 leader_election.cc:304] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c647018786ba4aaab442af0ecb85bf8b; no voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:22.272545   535 raft_consensus.cc:2468] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.272562   742 raft_consensus.cc:515] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.273222   786 raft_consensus.cc:2749] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.275401   742 leader_election.cc:290] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.284301   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21b77d31d3e4684ba78f485fbc75743" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d" is_pre_election: true
I20260709 13:15:22.285432   460 raft_consensus.cc:2468] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:22.287400   576 leader_election.cc:304] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.288648   783 raft_consensus.cc:2804] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.289294   783 raft_consensus.cc:493] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.289814   783 raft_consensus.cc:3060] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.291584   357 catalog_manager.cc:5697] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 0 to 1, leader changed from <none> to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.294767   357 catalog_manager.cc:5697] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 0 to 1, leader changed from <none> to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.297564   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21b77d31d3e4684ba78f485fbc75743" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" is_pre_election: true
I20260709 13:15:22.297130   357 catalog_manager.cc:5697] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 0 to 1, leader changed from <none> to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.300647   535 raft_consensus.cc:2468] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 0.
I20260709 13:15:22.305392   783 raft_consensus.cc:515] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.308772   460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21b77d31d3e4684ba78f485fbc75743" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.309396   460 raft_consensus.cc:3060] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.310786   783 leader_election.cc:290] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:22.312474   530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21b77d31d3e4684ba78f485fbc75743" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.313169   530 raft_consensus.cc:3060] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.317170   460 raft_consensus.cc:2468] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.318583   576 leader_election.cc:304] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.319453   783 raft_consensus.cc:2804] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.319944   783 raft_consensus.cc:697] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.320729   530 raft_consensus.cc:2468] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 1.
I20260709 13:15:22.321043   783 consensus_queue.cc:237] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.318020   358 catalog_manager.cc:5697] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 1 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.339308   357 catalog_manager.cc:5697] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 0 to 1, leader changed from <none> to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 1 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.469998   791 consensus_queue.cc:1048] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.477923   609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03e1b31c8afd493f96023d2dc91bee96"
dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
mode: GRACEFUL
new_leader_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:52340
I20260709 13:15:22.478626   609 raft_consensus.cc:606] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Received request to transfer leadership to TS 8401cbff669c4f0aadd7a578c869071d
I20260709 13:15:22.487231   796 consensus_queue.cc:1048] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.494022   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2282d471738d4bfe8a8f5fee05467621"
dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
mode: GRACEFUL
new_leader_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:52340
I20260709 13:15:22.494736   608 raft_consensus.cc:606] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Received request to transfer leadership to TS 8401cbff669c4f0aadd7a578c869071d
I20260709 13:15:22.501942   460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
mode: GRACEFUL
new_leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:48806
I20260709 13:15:22.502516   460 raft_consensus.cc:606] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Received request to transfer leadership to TS ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:22.507934   460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
mode: GRACEFUL
new_leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:48806
I20260709 13:15:22.508517   460 raft_consensus.cc:606] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Received request to transfer leadership to TS ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:22.514356   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "732e04cdf57a4576859585a1a9cf8db8"
dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
mode: GRACEFUL
new_leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:52340
I20260709 13:15:22.515024   608 raft_consensus.cc:606] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Received request to transfer leadership to TS ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:22.520668   608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e2af50ff276460b8b03caac5d781516"
dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
mode: GRACEFUL
new_leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:52340
I20260709 13:15:22.521337   608 raft_consensus.cc:606] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Received request to transfer leadership to TS ad42ff365b014966b5eb1bf65a86c7f5
I20260709 13:15:22.581691   783 consensus_queue.cc:1048] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.593506   742 consensus_queue.cc:1048] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.601519   742 consensus_queue.cc:1048] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.602392   786 raft_consensus.cc:993] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b: : Instructing follower 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:22.602967   783 raft_consensus.cc:1081] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Signalling peer 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:22.604614   459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2282d471738d4bfe8a8f5fee05467621"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:48776
I20260709 13:15:22.605204   459 raft_consensus.cc:493] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.605587   459 raft_consensus.cc:3060] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.612918   459 raft_consensus.cc:515] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.614547   789 consensus_queue.cc:1048] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.619040   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2282d471738d4bfe8a8f5fee05467621" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.619668   535 raft_consensus.cc:3060] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.623426   459 leader_election.cc:290] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.630764   784 raft_consensus.cc:993] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b: : Instructing follower ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:22.631268   784 raft_consensus.cc:1081] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Signalling peer ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:22.632849   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2282d471738d4bfe8a8f5fee05467621" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:22.633127   534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e2af50ff276460b8b03caac5d781516"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:57456
I20260709 13:15:22.633599   608 raft_consensus.cc:3055] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.633715   534 raft_consensus.cc:493] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.633992   608 raft_consensus.cc:740] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.634222   534 raft_consensus.cc:3060] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.635411   535 raft_consensus.cc:2468] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:22.634979   608 consensus_queue.cc:260] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.637588   423 leader_election.cc:304] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:22.638444   796 raft_consensus.cc:2804] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.638900   796 raft_consensus.cc:697] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:22.639101   608 raft_consensus.cc:3060] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.639389   784 consensus_queue.cc:1048] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.639706   796 consensus_queue.cc:237] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.641983   784 consensus_queue.cc:1048] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.647130   784 consensus_queue.cc:1048] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.648201   608 raft_consensus.cc:2468] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:22.656116   357 catalog_manager.cc:5697] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 1 to 2, leader changed from c647018786ba4aaab442af0ecb85bf8b (127.19.185.195) to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 2 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.657567   789 consensus_queue.cc:1048] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.657577   534 raft_consensus.cc:515] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.660977   534 leader_election.cc:290] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.661994   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2af50ff276460b8b03caac5d781516" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.662664   461 raft_consensus.cc:3060] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.668413   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2af50ff276460b8b03caac5d781516" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:22.669111   608 raft_consensus.cc:3055] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.669406   608 raft_consensus.cc:740] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.670821   461 raft_consensus.cc:2468] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:22.672391   502 leader_election.cc:304] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:22.673471   692 raft_consensus.cc:2804] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.673950   692 raft_consensus.cc:697] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:22.674877   692 consensus_queue.cc:237] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.676731   608 consensus_queue.cc:260] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.681057   608 raft_consensus.cc:3060] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.692948   784 raft_consensus.cc:993] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b: : Instructing follower ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:22.693538   789 raft_consensus.cc:1081] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Signalling peer ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:22.696650   608 raft_consensus.cc:2468] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:22.698791   357 catalog_manager.cc:5697] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 1 to 2, leader changed from c647018786ba4aaab442af0ecb85bf8b (127.19.185.195) to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.699733   786 raft_consensus.cc:993] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b: : Instructing follower 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:22.700309   784 raft_consensus.cc:1081] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Signalling peer 8401cbff669c4f0aadd7a578c869071d to start an election
I20260709 13:15:22.701133   530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "732e04cdf57a4576859585a1a9cf8db8"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:57456
I20260709 13:15:22.701996   530 raft_consensus.cc:493] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.702504   530 raft_consensus.cc:3060] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.705370   461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03e1b31c8afd493f96023d2dc91bee96"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
 from {username='slave'} at 127.0.0.1:48776
I20260709 13:15:22.710796   530 raft_consensus.cc:515] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.711797   461 raft_consensus.cc:493] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.712307   461 raft_consensus.cc:3060] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.713289   530 leader_election.cc:290] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.714830   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732e04cdf57a4576859585a1a9cf8db8" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:22.715495   608 raft_consensus.cc:3055] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.715884   608 raft_consensus.cc:740] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.716311   459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732e04cdf57a4576859585a1a9cf8db8" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.717146   459 raft_consensus.cc:3060] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.716790   608 consensus_queue.cc:260] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.718240   608 raft_consensus.cc:3060] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.723783   459 raft_consensus.cc:2468] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:22.725028   502 leader_election.cc:304] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:22.725482   608 raft_consensus.cc:2468] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:22.725986   692 raft_consensus.cc:2804] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.726569   692 raft_consensus.cc:697] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:22.727288   692 consensus_queue.cc:237] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.725941   461 raft_consensus.cc:515] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.734896   530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e1b31c8afd493f96023d2dc91bee96" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:22.735582   530 raft_consensus.cc:3060] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.735337   356 catalog_manager.cc:5697] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 1 to 2, leader changed from c647018786ba4aaab442af0ecb85bf8b (127.19.185.195) to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.737475   461 leader_election.cc:290] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Requested vote from peers ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.743429   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e1b31c8afd493f96023d2dc91bee96" candidate_uuid: "8401cbff669c4f0aadd7a578c869071d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:22.744118   530 raft_consensus.cc:2468] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:22.744122   608 raft_consensus.cc:3055] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.744859   608 raft_consensus.cc:740] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:22.745044   796 consensus_queue.cc:1048] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.745743   423 leader_election.cc:304] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, ad42ff365b014966b5eb1bf65a86c7f5; no voters: 
I20260709 13:15:22.746740   668 raft_consensus.cc:2804] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.747236   668 raft_consensus.cc:697] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Becoming Leader. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:22.748106   668 consensus_queue.cc:237] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.745858   608 consensus_queue.cc:260] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.749661   608 raft_consensus.cc:3060] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.758023   356 catalog_manager.cc:5697] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d reported cstate change: term changed from 1 to 2, leader changed from c647018786ba4aaab442af0ecb85bf8b (127.19.185.195) to 8401cbff669c4f0aadd7a578c869071d (127.19.185.193). New cstate: current_term: 2 leader_uuid: "8401cbff669c4f0aadd7a578c869071d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.762044   608 raft_consensus.cc:2468] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8401cbff669c4f0aadd7a578c869071d in term 2.
I20260709 13:15:22.762538   768 consensus_queue.cc:1048] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.771447   768 raft_consensus.cc:993] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d: : Instructing follower ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:22.771935   768 raft_consensus.cc:1081] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Signalling peer ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:22.773581   530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:57468
I20260709 13:15:22.774171   530 raft_consensus.cc:493] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.774612   530 raft_consensus.cc:3060] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.781761   530 raft_consensus.cc:515] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.783396   530 leader_election.cc:290] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.784763   607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:22.785429   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88348acc4d3e4ac2b9a525d4ff1222d0" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.785456   607 raft_consensus.cc:3060] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.786113   461 raft_consensus.cc:3055] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.786477   461 raft_consensus.cc:740] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:22.787408   461 consensus_queue.cc:260] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.787721   768 consensus_queue.cc:1048] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.788741   461 raft_consensus.cc:3060] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.792871   607 raft_consensus.cc:2468] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:22.794252   500 leader_election.cc:304] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.794994   692 raft_consensus.cc:2804] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.795502   692 raft_consensus.cc:697] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:22.796504   692 consensus_queue.cc:237] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.797562   461 raft_consensus.cc:2468] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:22.804431   668 consensus_queue.cc:1048] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.808607   358 catalog_manager.cc:5697] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 1 to 2, leader changed from 8401cbff669c4f0aadd7a578c869071d (127.19.185.193) to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.814529   796 raft_consensus.cc:993] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d: : Instructing follower ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:22.815135   668 raft_consensus.cc:1081] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Signalling peer ad42ff365b014966b5eb1bf65a86c7f5 to start an election
I20260709 13:15:22.816959   530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
 from {username='slave'} at 127.0.0.1:57468
I20260709 13:15:22.817689   530 raft_consensus.cc:493] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.818074   530 raft_consensus.cc:3060] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.824471   530 raft_consensus.cc:515] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.826464   530 leader_election.cc:290] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), c647018786ba4aaab442af0ecb85bf8b (127.19.185.195:37023)
I20260709 13:15:22.827745   608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
I20260709 13:15:22.827452   461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bc03cc02a0461d821629a8b863f595" candidate_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:22.828464   608 raft_consensus.cc:3060] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.828852   461 raft_consensus.cc:3055] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.829258   461 raft_consensus.cc:740] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:22.830209   461 consensus_queue.cc:260] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.831698   461 raft_consensus.cc:3060] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.834375   608 raft_consensus.cc:2468] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:22.835508   500 leader_election.cc:304] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:22.836360   692 raft_consensus.cc:2804] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.836858   692 raft_consensus.cc:697] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Becoming Leader. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:22.837673   692 consensus_queue.cc:237] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:22.838625   461 raft_consensus.cc:2468] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad42ff365b014966b5eb1bf65a86c7f5 in term 2.
I20260709 13:15:22.845168   358 catalog_manager.cc:5697] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 reported cstate change: term changed from 1 to 2, leader changed from 8401cbff669c4f0aadd7a578c869071d (127.19.185.193) to ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194). New cstate: current_term: 2 leader_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.949559   789 consensus_queue.cc:1048] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.951551   789 consensus_queue.cc:1048] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.038079   608 raft_consensus.cc:1275] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.039584   668 consensus_queue.cc:1048] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.047930   533 raft_consensus.cc:1275] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.050258   796 consensus_queue.cc:1048] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.143066   608 raft_consensus.cc:1275] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.144513   692 consensus_queue.cc:1048] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.153963   461 raft_consensus.cc:1275] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.157878   692 consensus_queue.cc:1048] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:23.218345   608 raft_consensus.cc:1275] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.219750   796 consensus_queue.cc:1048] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.220525   608 raft_consensus.cc:1275] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.222115   824 consensus_queue.cc:1048] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.232568   533 raft_consensus.cc:1275] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Refusing update from remote peer 8401cbff669c4f0aadd7a578c869071d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.234552   796 consensus_queue.cc:1048] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.243340   461 raft_consensus.cc:1275] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.244872   607 raft_consensus.cc:1275] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.246824   824 consensus_queue.cc:1048] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.247270   825 consensus_queue.cc:1048] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:23.266469   461 raft_consensus.cc:1275] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.267872   824 consensus_queue.cc:1048] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.340479   461 raft_consensus.cc:1275] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.341883   824 consensus_queue.cc:1048] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.350530   607 raft_consensus.cc:1275] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Refusing update from remote peer ad42ff365b014966b5eb1bf65a86c7f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.353190   778 consensus_queue.cc:1048] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:25.528051   357 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49428:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:15:25.547186   357 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49428:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:15:25.622403 20199 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:25.688979   860 tablet.cc:1724] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:25.703969   861 tablet.cc:1724] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:25.708652   865 tablet.cc:1724] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:25.805902   871 tablet.cc:1724] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:25.955602   530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b"
dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
mode: GRACEFUL
new_leader_uuid: "c647018786ba4aaab442af0ecb85bf8b"
 from {username='slave'} at 127.0.0.1:48866
I20260709 13:15:25.961356   530 raft_consensus.cc:606] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Received request to transfer leadership to TS c647018786ba4aaab442af0ecb85bf8b
W20260709 13:15:25.913170   424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:37023, user_credentials={real_user=slave}} blocked reactor thread for 58572.7us
I20260709 13:15:25.967304   881 tablet.cc:1724] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.008926   877 tablet.cc:1724] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.011016   884 tablet.cc:1724] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:25.967425   883 tablet.cc:1724] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.108875   882 tablet.cc:1724] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.109596   887 tablet.cc:1724] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.108867   888 tablet.cc:1724] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.099056   865 tablet.cc:1724] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.145371   778 raft_consensus.cc:993] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5: : Instructing follower c647018786ba4aaab442af0ecb85bf8b to start an election
I20260709 13:15:26.152268   778 raft_consensus.cc:1081] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Signalling peer c647018786ba4aaab442af0ecb85bf8b to start an election
I20260709 13:15:26.182560   891 tablet.cc:1724] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.184259   609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b"
dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
 from {username='slave'} at 127.0.0.1:52324
I20260709 13:15:26.188616   609 raft_consensus.cc:493] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.189141   609 raft_consensus.cc:3060] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.195863   871 tablet.cc:1724] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.179177   884 tablet.cc:1724] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.203928   861 tablet.cc:1724] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.208611   609 raft_consensus.cc:515] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:26.214953   457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6"
dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
mode: GRACEFUL
new_leader_uuid: "c647018786ba4aaab442af0ecb85bf8b"
 from {username='slave'} at 127.0.0.1:57082
I20260709 13:15:26.218748   860 tablet.cc:1724] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.220510   457 raft_consensus.cc:606] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Received request to transfer leadership to TS c647018786ba4aaab442af0ecb85bf8b
I20260709 13:15:26.232944 20199 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:26.234678 20199 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:26.236284   883 tablet.cc:1724] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.223166   888 tablet.cc:1724] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.223266   877 tablet.cc:1724] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.246631   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:26.247521   535 raft_consensus.cc:3055] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.247870   535 raft_consensus.cc:740] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad42ff365b014966b5eb1bf65a86c7f5, State: Running, Role: LEADER
I20260709 13:15:26.244177   882 tablet.cc:1724] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.251055   535 consensus_queue.cc:260] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:26.253088   535 raft_consensus.cc:3060] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.254843   457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa8767ccb014f8da9cf39124d6baa3b" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:26.255717   457 raft_consensus.cc:3060] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.258163   860 tablet.cc:1724] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.245175   609 leader_election.cc:290] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 2 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
W20260709 13:15:26.261076   424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.185.195:37023, user_credentials={real_user=slave}} blocked reactor thread for 225188us
I20260709 13:15:26.262071   865 tablet.cc:1724] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.271199   887 tablet.cc:1724] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.279713   881 tablet.cc:1724] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.293179   535 raft_consensus.cc:2468] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 2.
I20260709 13:15:26.298278   573 leader_election.cc:304] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad42ff365b014966b5eb1bf65a86c7f5, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:26.299364   789 raft_consensus.cc:2804] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.299837   789 raft_consensus.cc:697] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 2 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:26.302263   789 consensus_queue.cc:237] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:26.305142   861 tablet.cc:1724] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.308275   897 raft_consensus.cc:993] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d: : Instructing follower c647018786ba4aaab442af0ecb85bf8b to start an election
I20260709 13:15:26.308813   457 raft_consensus.cc:2468] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 2.
I20260709 13:15:26.309123   867 raft_consensus.cc:1081] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Signalling peer c647018786ba4aaab442af0ecb85bf8b to start an election
I20260709 13:15:26.323853   891 tablet.cc:1724] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:26.333871   607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6"
dest_uuid: "c647018786ba4aaab442af0ecb85bf8b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 13:15:26.334523   607 raft_consensus.cc:493] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.334857   607 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:26.350504   607 raft_consensus.cc:515] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:26.357973   607 leader_election.cc:290] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 3 election: Requested vote from peers 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751), ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341)
I20260709 13:15:26.358721   457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8401cbff669c4f0aadd7a578c869071d"
I20260709 13:15:26.359474   457 raft_consensus.cc:3055] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:26.359876   457 raft_consensus.cc:740] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8401cbff669c4f0aadd7a578c869071d, State: Running, Role: LEADER
I20260709 13:15:26.360898   457 consensus_queue.cc:260] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:26.361384   535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e0d7485dbc42fa9b7c0b079cdcafa6" candidate_uuid: "c647018786ba4aaab442af0ecb85bf8b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad42ff365b014966b5eb1bf65a86c7f5"
I20260709 13:15:26.362165   535 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:26.362536   457 raft_consensus.cc:3060] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:26.359993   356 catalog_manager.cc:5697] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 1 to 2, leader changed from ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194) to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 2 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.370759   457 raft_consensus.cc:2468] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 3.
I20260709 13:15:26.372524   576 leader_election.cc:304] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8401cbff669c4f0aadd7a578c869071d, c647018786ba4aaab442af0ecb85bf8b; no voters: 
I20260709 13:15:26.374440   789 raft_consensus.cc:2804] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:26.375016   789 raft_consensus.cc:697] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 3 LEADER]: Becoming Leader. State: Replica: c647018786ba4aaab442af0ecb85bf8b, State: Running, Role: LEADER
I20260709 13:15:26.375972   789 consensus_queue.cc:237] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } }
I20260709 13:15:26.373883   535 raft_consensus.cc:2468] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c647018786ba4aaab442af0ecb85bf8b in term 3.
I20260709 13:15:26.405069   358 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73: soft_deleted_table [id=b298d081850d4af4b5115c7bd84f0423] alter complete (version 1)
I20260709 13:15:26.417203   357 catalog_manager.cc:5697] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b reported cstate change: term changed from 2 to 3, leader changed from 8401cbff669c4f0aadd7a578c869071d (127.19.185.193) to c647018786ba4aaab442af0ecb85bf8b (127.19.185.195). New cstate: current_term: 3 leader_uuid: "c647018786ba4aaab442af0ecb85bf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c647018786ba4aaab442af0ecb85bf8b" member_type: VOTER last_known_addr { host: "127.19.185.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.749769   457 raft_consensus.cc:1275] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Refusing update from remote peer c647018786ba4aaab442af0ecb85bf8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.751155   880 consensus_queue.cc:1048] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.761544   533 raft_consensus.cc:1275] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Refusing update from remote peer c647018786ba4aaab442af0ecb85bf8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.763518   880 consensus_queue.cc:1048] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.850417   533 raft_consensus.cc:1275] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 3 FOLLOWER]: Refusing update from remote peer c647018786ba4aaab442af0ecb85bf8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:26.851722   880 consensus_queue.cc:1048] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad42ff365b014966b5eb1bf65a86c7f5" member_type: VOTER last_known_addr { host: "127.19.185.194" port: 35341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:26.862118   457 raft_consensus.cc:1275] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 3 FOLLOWER]: Refusing update from remote peer c647018786ba4aaab442af0ecb85bf8b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:26.863511   907 consensus_queue.cc:1048] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8401cbff669c4f0aadd7a578c869071d" member_type: VOTER last_known_addr { host: "127.19.185.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.299559 20199 tablet_server.cc:179] TabletServer@127.19.185.193:0 shutting down...
W20260709 13:15:27.301872   502 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 13:15:27.308348   502 consensus_peers.cc:597] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 -> Peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Couldn't send request to peer 8401cbff669c4f0aadd7a578c869071d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:27.310091   502 consensus_peers.cc:597] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 -> Peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Couldn't send request to peer 8401cbff669c4f0aadd7a578c869071d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.340667 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:27.341571 20199 tablet_replica.cc:333] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.342759 20199 raft_consensus.cc:2243] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.343222 20199 raft_consensus.cc:2272] T e21b77d31d3e4684ba78f485fbc75743 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.346293 20199 tablet_replica.cc:333] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.347237 20199 raft_consensus.cc:2243] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.348410 20199 raft_consensus.cc:2272] T 2282d471738d4bfe8a8f5fee05467621 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.351320 20199 tablet_replica.cc:333] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.352267 20199 raft_consensus.cc:2243] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.352949 20199 raft_consensus.cc:2272] T 1e2af50ff276460b8b03caac5d781516 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.356058 20199 tablet_replica.cc:333] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.357018 20199 raft_consensus.cc:2243] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.358095 20199 raft_consensus.cc:2272] T 03e1b31c8afd493f96023d2dc91bee96 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.361218 20199 tablet_replica.cc:333] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.362088 20199 raft_consensus.cc:2243] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.363206 20199 raft_consensus.cc:2272] T 2206ebf713e44aaaa069f47f2dbcc16a P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.366987 20199 tablet_replica.cc:333] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.367962 20199 raft_consensus.cc:2243] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:27.368726   576 consensus_peers.cc:597] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b -> Peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Couldn't send request to peer 8401cbff669c4f0aadd7a578c869071d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.369288 20199 raft_consensus.cc:2272] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.372097 20199 tablet_replica.cc:333] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.372701 20199 raft_consensus.cc:2243] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.373145 20199 raft_consensus.cc:2272] T 4aa8767ccb014f8da9cf39124d6baa3b P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.375952 20199 tablet_replica.cc:333] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.376672 20199 raft_consensus.cc:2243] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.377120 20199 raft_consensus.cc:2272] T ea28a0a6193647dd925a91ca3d876dbf P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.379317 20199 tablet_replica.cc:333] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.379881 20199 raft_consensus.cc:2243] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.380412 20199 raft_consensus.cc:2272] T 19bba5a817824115ac39420b80ce3d2c P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.382560 20199 tablet_replica.cc:333] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.383071 20199 raft_consensus.cc:2243] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.383507 20199 raft_consensus.cc:2272] T 253f3b376f5f4372a4d9f75435f774ee P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.385986 20199 tablet_replica.cc:333] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.386519 20199 raft_consensus.cc:2243] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.386951 20199 raft_consensus.cc:2272] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P 8401cbff669c4f0aadd7a578c869071d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.389850 20199 tablet_replica.cc:333] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.390425 20199 raft_consensus.cc:2243] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.390988 20199 raft_consensus.cc:2272] T 88348acc4d3e4ac2b9a525d4ff1222d0 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.394090 20199 tablet_replica.cc:333] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.394878 20199 raft_consensus.cc:2243] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:15:27.394915   576 consensus_peers.cc:597] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b -> Peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Couldn't send request to peer 8401cbff669c4f0aadd7a578c869071d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.396060 20199 raft_consensus.cc:2272] T 23de4d8703a5498b83b5da1bf5d43947 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.398908 20199 tablet_replica.cc:333] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.399520 20199 raft_consensus.cc:2243] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.399969 20199 raft_consensus.cc:2272] T e48ac6a679ec4494a534631f5a777cef P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.402388 20199 tablet_replica.cc:333] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.402956 20199 raft_consensus.cc:2243] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.403434 20199 raft_consensus.cc:2272] T 732e04cdf57a4576859585a1a9cf8db8 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.405661 20199 tablet_replica.cc:333] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.406291 20199 raft_consensus.cc:2243] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.406772 20199 raft_consensus.cc:2272] T b0bc03cc02a0461d821629a8b863f595 P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.409438 20199 tablet_replica.cc:333] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.410076 20199 raft_consensus.cc:2243] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.410889 20199 raft_consensus.cc:2272] T b0a0016d38af4eafa84d180985818c41 P 8401cbff669c4f0aadd7a578c869071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.413493 20199 tablet_replica.cc:333] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d: stopping tablet replica
I20260709 13:15:27.414062 20199 raft_consensus.cc:2243] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.414944 20199 raft_consensus.cc:2272] T 46f8f02a74ab4efeaec20d91e7df966f P 8401cbff669c4f0aadd7a578c869071d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:27.455260   502 consensus_peers.cc:597] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 -> Peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Couldn't send request to peer 8401cbff669c4f0aadd7a578c869071d. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.461251 20199 tablet_server.cc:196] TabletServer@127.19.185.193:0 shutdown complete.
W20260709 13:15:27.471701   502 consensus_peers.cc:597] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 -> Peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Couldn't send request to peer 8401cbff669c4f0aadd7a578c869071d. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.501343 20199 tablet_server.cc:179] TabletServer@127.19.185.194:0 shutting down...
I20260709 13:15:27.533515 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:27.534601 20199 tablet_replica.cc:333] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.535519 20199 raft_consensus.cc:2243] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.536187 20199 raft_consensus.cc:2272] T e21b77d31d3e4684ba78f485fbc75743 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.538658 20199 tablet_replica.cc:333] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.539333 20199 raft_consensus.cc:2243] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.540230 20199 raft_consensus.cc:2272] T 1e2af50ff276460b8b03caac5d781516 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.542512 20199 tablet_replica.cc:333] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.543146 20199 raft_consensus.cc:2243] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.543637 20199 raft_consensus.cc:2272] T 2282d471738d4bfe8a8f5fee05467621 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.545838 20199 tablet_replica.cc:333] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.546413 20199 raft_consensus.cc:2243] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.546886 20199 raft_consensus.cc:2272] T 03e1b31c8afd493f96023d2dc91bee96 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.549386 20199 tablet_replica.cc:333] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.550210 20199 raft_consensus.cc:2243] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.550782 20199 raft_consensus.cc:2272] T ea28a0a6193647dd925a91ca3d876dbf P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.553817 20199 tablet_replica.cc:333] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.554630 20199 raft_consensus.cc:2243] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.555182 20199 raft_consensus.cc:2272] T 4aa8767ccb014f8da9cf39124d6baa3b P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:27.555615   576 consensus_peers.cc:597] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b -> Peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Couldn't send request to peer 8401cbff669c4f0aadd7a578c869071d. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.558306 20199 tablet_replica.cc:333] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.559032 20199 raft_consensus.cc:2243] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.559552 20199 raft_consensus.cc:2272] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.561993 20199 tablet_replica.cc:333] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.562595 20199 raft_consensus.cc:2243] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.563651 20199 raft_consensus.cc:2272] T 253f3b376f5f4372a4d9f75435f774ee P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.566045 20199 tablet_replica.cc:333] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.566605 20199 raft_consensus.cc:2243] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.567433 20199 raft_consensus.cc:2272] T 19bba5a817824115ac39420b80ce3d2c P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.569983 20199 tablet_replica.cc:333] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.570538 20199 raft_consensus.cc:2243] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.571115 20199 raft_consensus.cc:2272] T 2206ebf713e44aaaa069f47f2dbcc16a P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.574045 20199 tablet_replica.cc:333] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
W20260709 13:15:27.574119   576 consensus_peers.cc:597] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b -> Peer 8401cbff669c4f0aadd7a578c869071d (127.19.185.193:45751): Couldn't send request to peer 8401cbff669c4f0aadd7a578c869071d. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.574891 20199 raft_consensus.cc:2243] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.575796 20199 raft_consensus.cc:2272] T 732e04cdf57a4576859585a1a9cf8db8 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.577951 20199 tablet_replica.cc:333] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.578521 20199 raft_consensus.cc:2243] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.579298 20199 raft_consensus.cc:2272] T b0bc03cc02a0461d821629a8b863f595 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.581480 20199 tablet_replica.cc:333] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.582008 20199 raft_consensus.cc:2243] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.582427 20199 raft_consensus.cc:2272] T b0a0016d38af4eafa84d180985818c41 P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.584583 20199 tablet_replica.cc:333] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.585139 20199 raft_consensus.cc:2243] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.585639 20199 raft_consensus.cc:2272] T 46f8f02a74ab4efeaec20d91e7df966f P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.587867 20199 tablet_replica.cc:333] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.588390 20199 raft_consensus.cc:2243] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.589270 20199 raft_consensus.cc:2272] T e48ac6a679ec4494a534631f5a777cef P ad42ff365b014966b5eb1bf65a86c7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.592595 20199 tablet_replica.cc:333] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.594056 20199 raft_consensus.cc:2243] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.595611 20199 raft_consensus.cc:2272] T 88348acc4d3e4ac2b9a525d4ff1222d0 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.598397 20199 tablet_replica.cc:333] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.598955 20199 raft_consensus.cc:2243] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.599479 20199 raft_consensus.cc:2272] T 23de4d8703a5498b83b5da1bf5d43947 P ad42ff365b014966b5eb1bf65a86c7f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.601639 20199 tablet_replica.cc:333] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5: stopping tablet replica
I20260709 13:15:27.602135 20199 raft_consensus.cc:2243] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.602586 20199 raft_consensus.cc:2272] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P ad42ff365b014966b5eb1bf65a86c7f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.647028 20199 tablet_server.cc:196] TabletServer@127.19.185.194:0 shutdown complete.
I20260709 13:15:27.686655 20199 tablet_server.cc:179] TabletServer@127.19.185.195:0 shutting down...
I20260709 13:15:27.717393 20199 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:27.718580 20199 tablet_replica.cc:333] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.719703 20199 raft_consensus.cc:2243] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.720892 20199 raft_consensus.cc:2272] T e21b77d31d3e4684ba78f485fbc75743 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.723224 20199 tablet_replica.cc:333] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.723840 20199 raft_consensus.cc:2243] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.724572 20199 raft_consensus.cc:2272] T 1e2af50ff276460b8b03caac5d781516 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.726814 20199 tablet_replica.cc:333] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.727456 20199 raft_consensus.cc:2243] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.727952 20199 raft_consensus.cc:2272] T b0bc03cc02a0461d821629a8b863f595 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.730240 20199 tablet_replica.cc:333] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.730852 20199 raft_consensus.cc:2243] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.731333 20199 raft_consensus.cc:2272] T 732e04cdf57a4576859585a1a9cf8db8 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.733685 20199 tablet_replica.cc:333] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.734267 20199 raft_consensus.cc:2243] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.735044 20199 raft_consensus.cc:2272] T b0a0016d38af4eafa84d180985818c41 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.738240 20199 tablet_replica.cc:333] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.739055 20199 raft_consensus.cc:2243] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.739647 20199 raft_consensus.cc:2272] T 2282d471738d4bfe8a8f5fee05467621 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:27.740870   573 consensus_peers.cc:597] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b -> Peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Couldn't send request to peer ad42ff365b014966b5eb1bf65a86c7f5. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:35341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.742149 20199 tablet_replica.cc:333] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.742853 20199 raft_consensus.cc:2243] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.743623 20199 raft_consensus.cc:2272] T 03e1b31c8afd493f96023d2dc91bee96 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.746138 20199 tablet_replica.cc:333] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.746783 20199 raft_consensus.cc:2243] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.747305 20199 raft_consensus.cc:2272] T 46f8f02a74ab4efeaec20d91e7df966f P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.750661 20199 tablet_replica.cc:333] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.751286 20199 raft_consensus.cc:2243] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.751754 20199 raft_consensus.cc:2272] T e48ac6a679ec4494a534631f5a777cef P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.754550 20199 tablet_replica.cc:333] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.755288 20199 raft_consensus.cc:2243] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.755761 20199 raft_consensus.cc:2272] T 2206ebf713e44aaaa069f47f2dbcc16a P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.758175 20199 tablet_replica.cc:333] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.758785 20199 raft_consensus.cc:2243] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.759294 20199 raft_consensus.cc:2272] T 88348acc4d3e4ac2b9a525d4ff1222d0 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.761770 20199 tablet_replica.cc:333] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.762328 20199 raft_consensus.cc:2243] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.762902 20199 raft_consensus.cc:2272] T 23de4d8703a5498b83b5da1bf5d43947 P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.765291 20199 tablet_replica.cc:333] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.765894 20199 raft_consensus.cc:2243] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.766445 20199 raft_consensus.cc:2272] T 7d3ecc3f11fe46bdaef8d6e6465d4c34 P c647018786ba4aaab442af0ecb85bf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.768946 20199 tablet_replica.cc:333] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.769536 20199 raft_consensus.cc:2243] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.770341 20199 raft_consensus.cc:2272] T 4aa8767ccb014f8da9cf39124d6baa3b P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.772622 20199 tablet_replica.cc:333] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.773192 20199 raft_consensus.cc:2243] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.774072 20199 raft_consensus.cc:2272] T ea28a0a6193647dd925a91ca3d876dbf P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.776983 20199 tablet_replica.cc:333] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.777644 20199 raft_consensus.cc:2243] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.778211 20199 raft_consensus.cc:2272] T 19bba5a817824115ac39420b80ce3d2c P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.780952 20199 tablet_replica.cc:333] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.781782 20199 raft_consensus.cc:2243] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:27.782580 20199 raft_consensus.cc:2272] T 253f3b376f5f4372a4d9f75435f774ee P c647018786ba4aaab442af0ecb85bf8b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:27.785135   573 consensus_peers.cc:597] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b -> Peer ad42ff365b014966b5eb1bf65a86c7f5 (127.19.185.194:35341): Couldn't send request to peer ad42ff365b014966b5eb1bf65a86c7f5. Status: Network error: Client connection negotiation failed: client connection to 127.19.185.194:35341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.785887 20199 tablet_replica.cc:333] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b: stopping tablet replica
I20260709 13:15:27.786538 20199 raft_consensus.cc:2243] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.787446 20199 raft_consensus.cc:2272] T a9e0d7485dbc42fa9b7c0b079cdcafa6 P c647018786ba4aaab442af0ecb85bf8b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.835160 20199 tablet_server.cc:196] TabletServer@127.19.185.195:0 shutdown complete.
I20260709 13:15:27.872471 20199 master.cc:562] Master@127.19.185.254:33015 shutting down...
I20260709 13:15:27.898077 20199 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:27.898850 20199 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:27.899166 20199 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3dffefd4e9ac4723a59703d3f8129f73: stopping tablet replica
I20260709 13:15:27.919862 20199 master.cc:584] Master@127.19.185.254:33015 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11640 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25203 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (374825 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:15:27.980568 20199 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:15:27.980919 20199 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:15:27.981199 20199 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 406 messages since previous log ~14 seconds ago
I20260709 13:15:27.981545 20199 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:15:27.981863 20199 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:15:27.982157 20199 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~144 seconds ago
I20260709 13:15:27.982507 20199 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:15:27.982939 20199 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
